-- Logs begin at Mon 2022-10-31 14:29:56 UTC, end at Mon 2022-10-31 17:09:54 UTC. -- Oct 31 15:03:56.762111 n-d-858383-17 systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 15:03:56.770820 n-d-858383-17 devstack@n-api.service[104777]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 15:03:56 2022] *** Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: nodename: n-d-858383-17 Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: machine: x86_64 Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: clock source: unix Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: pcre jit disabled Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: detected number of CPU cores: 4 Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: current working directory: / Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: detected binary path: /usr/bin/uwsgi-core Oct 31 15:03:56.772899 n-d-858383-17 devstack@n-api.service[104777]: your processes number limit is 47680 Oct 31 15:03:56.773616 n-d-858383-17 devstack@n-api.service[104777]: your memory page size is 4096 bytes Oct 31 15:03:56.773616 n-d-858383-17 devstack@n-api.service[104777]: detected max file descriptor number: 2048 Oct 31 15:03:56.773616 n-d-858383-17 devstack@n-api.service[104777]: lock engine: pthread robust mutexes Oct 31 15:03:56.773616 n-d-858383-17 devstack@n-api.service[104777]: thunder lock: enabled Oct 31 15:03:56.773616 n-d-858383-17 devstack@n-api.service[104777]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 15:03:56.773616 n-d-858383-17 devstack@n-api.service[104777]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 15:03:56.811918 n-d-858383-17 devstack@n-api.service[104777]: Python main interpreter initialized at 0x55c73b70f9c0 Oct 31 15:03:56.811918 n-d-858383-17 devstack@n-api.service[104777]: python threads support enabled Oct 31 15:03:56.811918 n-d-858383-17 devstack@n-api.service[104777]: your server socket listen backlog is limited to 100 connections Oct 31 15:03:56.811918 n-d-858383-17 devstack@n-api.service[104777]: your mercy for graceful operations on workers is 90 seconds Oct 31 15:03:56.812258 n-d-858383-17 devstack@n-api.service[104777]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 15:03:56.812343 n-d-858383-17 devstack@n-api.service[104777]: *** Operational MODE: preforking *** Oct 31 15:03:56.812573 n-d-858383-17 devstack@n-api.service[104777]: *** uWSGI is running in multiple interpreter mode *** Oct 31 15:03:56.812573 n-d-858383-17 devstack@n-api.service[104777]: spawned uWSGI master process (pid: 104777) Oct 31 15:03:56.812774 n-d-858383-17 systemd[1]: Started Devstack devstack@n-api.service. Oct 31 15:03:56.813313 n-d-858383-17 devstack@n-api.service[104777]: spawned uWSGI worker 1 (pid: 104778, cores: 1) Oct 31 15:03:56.813647 n-d-858383-17 devstack@n-api.service[104777]: spawned uWSGI worker 2 (pid: 104779, cores: 1) Oct 31 15:03:56.814943 n-d-858383-17 devstack@n-api.service[104777]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 15:03:57.470464 n-d-858383-17 devstack@n-api.service[104779]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:03:57.472887 n-d-858383-17 devstack@n-api.service[104778]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:03:58.550688 n-d-858383-17 devstack@n-api.service[104779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:03:58.550688 n-d-858383-17 devstack@n-api.service[104779]: from cryptography.utils import int_from_bytes Oct 31 15:03:58.551252 n-d-858383-17 devstack@n-api.service[104779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:03:58.551252 n-d-858383-17 devstack@n-api.service[104779]: from cryptography.utils import int_from_bytes Oct 31 15:03:58.551370 n-d-858383-17 devstack@n-api.service[104778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:03:58.551370 n-d-858383-17 devstack@n-api.service[104778]: from cryptography.utils import int_from_bytes Oct 31 15:03:58.551761 n-d-858383-17 devstack@n-api.service[104778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:03:58.551761 n-d-858383-17 devstack@n-api.service[104778]: from cryptography.utils import int_from_bytes Oct 31 15:04:01.062703 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:04:01.063273 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:04:01.063477 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:04:01.063610 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:04:01.063962 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:04:01.064054 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:04:01.064136 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:04:01.064382 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:04:01.064472 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.064755 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:04:01.064849 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.065009 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:04:01.065101 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.065378 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.065578 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.065700 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.065901 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066008 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066222 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066322 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066540 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066641 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066866 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.066959 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.067169 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.067264 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.067481 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.067569 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.067794 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.067887 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-17 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.068144 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.068233 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.068403 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.068540 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.068731 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.068867 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069054 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-17 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069196 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069373 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069503 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069675 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069811 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.069980 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.070109 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.070292 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.070524 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.070674 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.071844 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.071999 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.072136 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.072273 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.072273 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.072566 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.072731 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.072872 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073001 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073130 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073256 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073405 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073538 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073663 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073795 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.073920 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074043 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074181 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074307 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074432 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074545 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-17 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074677 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074802 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.074926 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075049 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075178 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075312 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075445 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-17 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075570 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075694 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075844 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.075970 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.076112 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.076244 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.076378 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.076576 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.076749 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.076878 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077002 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077138 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077275 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077411 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077538 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077673 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077798 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.077923 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078056 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078182 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078306 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078429 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078562 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078739 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.078870 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079054 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079183 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079352 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079501 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079638 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079772 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.079947 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.080076 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.080249 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.080383 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.080547 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.080676 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.080875 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081005 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081141 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081269 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081416 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081542 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081668 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081802 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.081961 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082101 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082275 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082412 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082548 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082701 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082837 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.082964 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.083101 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.083241 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.083396 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.084053 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.084305 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.084469 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.084755 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.084887 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085013 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085149 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085363 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085493 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085618 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085750 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.085886 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086026 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086153 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086278 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086410 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086535 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086743 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.086886 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087015 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087147 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087280 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087406 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087538 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087677 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087803 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.087928 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.088195 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.088325 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.088449 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.088583 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.088778 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.088918 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089083 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089221 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089397 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089528 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089696 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089831 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.089999 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.090136 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.090312 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.090448 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.090617 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.090755 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091171 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091308 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091443 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091578 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091704 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091836 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.091989 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.092119 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.092303 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.092440 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.092605 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.092766 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.092933 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093062 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093229 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093353 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093533 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093662 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093837 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.093978 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.094139 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.094267 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.094441 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.094569 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.094734 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.094871 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095033 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095161 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095333 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095461 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095632 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095768 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.095934 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.096062 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.096232 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.096366 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.096532 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.096669 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.096907 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097032 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097157 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097281 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097430 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097575 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097730 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.097860 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098038 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098179 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098341 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098486 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098643 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098778 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.098944 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.099083 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.099907 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100052 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100187 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100314 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100438 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100562 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100755 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.100907 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101048 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101182 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101367 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101496 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101670 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101860 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.101995 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.102122 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.102247 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.102369 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.102555 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.102692 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.102867 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103004 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103169 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103309 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103470 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103601 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103775 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.103905 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104075 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104203 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104374 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104505 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104673 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104833 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.104994 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.105137 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.105294 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.105423 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.105589 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.105726 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.105897 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.106035 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.106196 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.106326 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.106496 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.106632 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.106792 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107009 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107139 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107263 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107387 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107512 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107699 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.107836 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.108003 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.108132 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.108303 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.108432 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.108617 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:04:01.108779 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.108972 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.109103 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.109296 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.109423 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.109610 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.109748 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.109919 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110050 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110229 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110358 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110549 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110680 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110857 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.110993 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.111162 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.111302 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.111467 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.111594 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.111781 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.111911 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112085 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112290 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112418 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112564 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112745 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112867 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.112992 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.113117 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.113308 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.113440 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.113628 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.113756 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.113938 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.114075 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.114252 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.114382 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.114565 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.114705 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.114893 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.115030 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.115212 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.115344 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.115534 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.115670 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.115859 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116002 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116156 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116286 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116469 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116597 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116798 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.116942 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.117155 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.117286 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.117419 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.117558 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.117723 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.117861 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118033 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118162 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118340 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118471 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118648 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118779 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.118954 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.119083 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.119271 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.119403 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.119581 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.119718 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.119887 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120016 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120195 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120335 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120502 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120631 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120831 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.120972 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.121139 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.121279 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.121447 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.121578 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.121753 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.121885 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122058 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122197 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122363 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122492 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122677 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122806 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.122987 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.123125 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.123295 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.123424 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.123604 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.123738 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.123905 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124043 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124207 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124342 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124507 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124636 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124833 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.124975 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.125132 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.125267 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.125430 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.125565 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.125731 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.125862 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126035 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126165 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126335 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126471 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126650 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126780 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.126953 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127082 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127284 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127424 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127561 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127686 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127846 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.127976 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.128154 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.128283 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.128459 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.128587 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.128779 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.128921 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.129083 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.129220 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.129393 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.129528 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.129693 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.129823 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130016 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130156 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130289 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130414 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130630 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130758 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.130965 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.131103 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.131315 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.131442 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.131620 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.131745 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.131926 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132064 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132229 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132356 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132534 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132660 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132865 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.132996 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.133175 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.133303 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.133483 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.133612 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.133802 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.133933 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.134107 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.134237 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.134415 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.134543 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.134752 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.134887 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135021 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135154 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135315 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135445 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135621 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135752 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.135922 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136050 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136222 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136362 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136522 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136652 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136839 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.136966 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.137140 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.137297 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.137498 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.137628 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.137754 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.137878 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138011 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138146 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138295 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138425 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138597 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138725 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.138900 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139039 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139198 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139325 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139497 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139625 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139794 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.139930 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.140106 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.140235 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.140408 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.140538 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.140727 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.140861 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141026 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141165 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141362 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141494 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141663 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141794 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.141988 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.142119 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.142299 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.142428 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.142605 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.142736 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.142912 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143041 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143219 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143356 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143523 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143652 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143828 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.143996 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.144123 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.144255 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.144429 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.144557 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.144752 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.144881 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.145072 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.145211 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.145378 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.145539 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.145677 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.145803 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.146509 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.146716 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.146851 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.146978 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.147150 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.147379 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.147520 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.147724 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.147853 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.147977 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.148100 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.148292 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.148429 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.148631 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.148828 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.148981 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.149107 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.149289 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.149435 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.149595 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.149722 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.149900 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150028 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150210 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150345 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150514 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150641 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150821 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.150948 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.151122 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.151257 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.151426 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.151552 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.151728 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.151865 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152033 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152160 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152332 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152465 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152639 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152808 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.152984 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.153114 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.153292 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.153420 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.153599 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.153738 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.153899 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154025 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154209 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154337 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154512 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154638 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154817 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.154946 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.155123 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.155252 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.155423 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.155560 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.155722 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.155858 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156025 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156153 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156329 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156464 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156633 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156797 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.156957 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.157082 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.157254 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.157399 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.157559 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.157710 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.157901 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158028 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158154 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158288 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158422 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158548 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158717 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.158846 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.159030 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.159160 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.159334 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.159463 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.159633 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.159747 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.160734 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.160873 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.160967 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.161054 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.161138 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.161220 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.161220 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.161395 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.161565 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.162263 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.162575 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.162689 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.162882 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.162978 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.163216 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.163311 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.163489 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.163623 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.163833 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.164090 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.164189 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.164401 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.164495 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.164728 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.164836 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.165072 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.165168 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.165380 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.165476 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.165681 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.165771 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166070 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166166 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166300 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166396 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166607 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166704 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.166915 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167003 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167221 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167310 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167527 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167616 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167832 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.167920 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.168138 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.168236 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.168443 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.168538 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.168772 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.168865 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169077 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169185 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169384 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169474 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169690 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169778 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.169986 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.170098 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.170288 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.170381 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.170595 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.170693 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.170901 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.171488 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.171560 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.171628 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.171693 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.171774 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.171843 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.172064 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.172335 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.172424 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.172669 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.172794 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173005 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173102 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173321 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173417 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173650 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173744 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.173953 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174051 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174266 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174367 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174564 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174652 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174864 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.174962 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.175170 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.175259 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.175470 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.175562 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.175770 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.175885 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176067 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176175 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176373 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176486 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176667 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176794 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.176992 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.177079 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.177319 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.177424 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.177623 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.177722 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178023 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178111 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178327 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178416 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178630 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178718 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.178928 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179016 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179241 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179336 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179541 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179638 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179839 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.179934 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.180138 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.180225 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.180440 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.180545 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.180773 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.180864 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.181076 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.181213 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.181378 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.181470 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.181681 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.181776 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182020 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182118 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182324 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182413 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182624 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182711 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.182947 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183045 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183251 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183358 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183554 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183642 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183855 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.183952 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.184161 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.184250 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.184472 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.184606 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.184798 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.184887 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.185104 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.185243 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.185413 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.185558 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.185718 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.185866 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186024 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186168 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186324 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186481 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186637 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186789 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.186936 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.187096 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.187245 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.187402 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.187549 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.187703 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.187847 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188013 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188146 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188315 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188483 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188628 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188751 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.188961 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189050 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189267 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189359 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189567 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189655 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189873 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.189961 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.190181 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.190271 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.190485 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.190589 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.190783 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.190874 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191081 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191187 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191386 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191532 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191681 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191818 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.191963 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.192102 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.192244 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.192381 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.192548 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.192716 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.192914 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193057 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193216 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193315 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193534 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193636 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193841 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.193931 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.194141 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.194228 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.194441 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.194538 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.194745 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.194835 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195044 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195131 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195343 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195441 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195647 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195735 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.195964 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196054 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196277 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196365 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196579 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196707 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196908 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.196999 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.197204 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.197294 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.197502 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.197592 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.197798 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.197896 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198097 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198188 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198391 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198480 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198690 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198828 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.198985 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.199117 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.199280 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.199408 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.199576 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.199714 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.199894 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200023 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200192 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200320 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200489 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200619 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200811 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.200942 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.201113 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.201242 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.201452 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.201614 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.201757 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.201893 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202037 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202172 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202349 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202500 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202648 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202786 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.202944 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203083 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203250 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203392 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203558 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203693 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203858 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.203999 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.204144 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.204279 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.204454 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.204594 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.204786 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.204925 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.205091 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.205221 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.205389 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.205518 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.205688 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.205817 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206005 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206143 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206303 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206430 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206606 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206728 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.206912 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207042 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207217 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207354 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207519 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207658 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207823 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.207950 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.208125 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.208251 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.208430 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.209123 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.209487 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.209716 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.209844 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.209969 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210094 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210232 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210360 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210485 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210621 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210739 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.210933 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211072 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211230 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211359 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211590 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211729 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211866 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.211992 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.212117 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.212240 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.212415 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.212545 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.212729 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.212877 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213041 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213171 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213342 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213478 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213691 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213821 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.213996 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.214124 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.214298 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.214437 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.214606 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.214736 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.214934 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.215065 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.215231 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.215369 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.215543 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.215673 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.216105 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.216236 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.216408 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.216583 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.216844 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.216975 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.217153 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.217282 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.217461 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.217678 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.217808 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.217934 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218067 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218193 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218340 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218512 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218642 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218823 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.218953 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.219133 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.219279 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.219443 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.219573 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.219750 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.219880 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220051 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220195 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220419 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220547 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220672 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220833 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.220969 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.221106 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.221271 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.221401 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.221572 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.221777 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.221915 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.222082 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.222214 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.222387 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.222662 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.222792 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.222995 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.223131 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.223309 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.223439 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.223627 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.223771 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.223929 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.224060 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.224892 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225160 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225297 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225424 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225558 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225684 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225819 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.225953 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226087 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226214 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226339 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226465 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226599 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226726 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.226922 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227056 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227237 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227368 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227544 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227675 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227859 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.227989 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.228232 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.228439 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.228570 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.228735 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.228864 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.228990 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.229175 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.229332 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.229581 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.229712 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.229838 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.229962 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230087 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230226 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230362 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230489 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230659 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230789 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.230960 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.231091 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.231276 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.231405 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.231577 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.231708 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.231919 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232049 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232176 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232309 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232465 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232609 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232781 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.232919 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.233077 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.233207 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.233392 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.233523 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.233693 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.233827 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234011 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234141 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234320 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234466 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234630 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234760 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.234931 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235053 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235226 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235367 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235535 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235665 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235838 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.235974 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.236138 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.236278 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.236437 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.236567 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.236760 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.236901 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237078 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237222 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237359 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237485 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237676 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237806 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.237975 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.238114 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.238279 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.238410 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.238581 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.238711 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.238913 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.239045 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.239213 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.239351 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.239528 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.239764 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.239932 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240111 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240242 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240369 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240495 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240628 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240789 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.240920 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.241077 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.241208 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.241383 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.241523 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.241683 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.241825 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242029 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242159 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242286 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242421 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242548 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242674 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242841 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.242973 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.243139 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.243285 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.243434 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.243564 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.243751 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.243882 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244051 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244189 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244348 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244478 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244647 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244823 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.244964 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245092 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245257 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245396 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245558 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245684 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245862 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.245991 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.246159 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.246288 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.246470 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.246599 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.246771 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.246901 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247069 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247207 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247369 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247507 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247686 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247816 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.247991 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.248120 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.248300 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.248437 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.248607 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.248757 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.248942 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.249070 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.249252 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.249400 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.249557 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.249686 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.249893 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250022 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250147 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250281 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250463 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250593 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250772 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.250970 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.251100 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.251293 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.251424 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.251601 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.251732 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.251907 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.252059 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.252249 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.252376 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.252499 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.252801 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.252934 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.253123 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.253251 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.253429 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.253558 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.253732 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.253861 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254036 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254166 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254347 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254473 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254656 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254784 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.254963 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.255092 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.255270 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.255927 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.256087 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.256225 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.256395 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.256524 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.256738 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.256882 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.257058 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.257262 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.257388 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.257521 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.257693 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.257823 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258000 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258128 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258309 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258436 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258618 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258744 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.258925 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.259053 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.259228 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.259365 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.259534 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.259676 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.259841 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260052 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260181 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260313 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260440 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260575 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260748 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.260888 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261045 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261188 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261353 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261493 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261671 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261800 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.261997 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.262128 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.262315 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.262438 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.262625 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.262728 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.262934 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.263034 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.263244 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.263343 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.263611 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.263752 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.263899 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.264061 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.264202 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.264384 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.264515 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.264717 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.264850 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.265039 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.265171 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.265349 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.265614 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.265744 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.265924 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266068 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266253 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266385 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266551 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266679 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266856 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.266995 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.267161 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.267291 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.267461 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.267591 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.267776 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.267916 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.268076 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.268205 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.268374 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.268503 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.268678 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.268830 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.269004 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.269135 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.269305 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.269528 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.269671 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.269870 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270001 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270205 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270335 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270486 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270626 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270802 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.270931 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.271674 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.271861 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.271993 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.272278 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.272425 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.272624 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.272786 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.272918 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273054 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273194 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273322 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273484 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273625 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273785 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.273924 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274085 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274216 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274389 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274520 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274691 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274834 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.274988 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.275119 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.275292 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.275415 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.275588 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.275729 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.275888 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276048 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276198 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276328 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276494 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276624 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276824 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.276961 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.277110 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.277248 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.277406 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.277535 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.277705 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.277850 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278004 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278135 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278303 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278433 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278601 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278731 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.278896 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279025 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279194 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279331 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279493 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279622 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279792 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.279931 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.280092 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.280235 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.280434 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.280566 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.280773 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.280918 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281049 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281174 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281307 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281441 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281569 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281708 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.281909 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282043 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282212 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282357 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282510 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282666 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282857 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.282986 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.283114 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.283238 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.283400 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.283531 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.283711 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.283841 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.284017 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.284246 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.284386 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.284574 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.284723 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.284916 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.285047 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.285245 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.285392 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.285571 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.285700 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.285879 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.286098 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.286228 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.286428 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.286566 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.286821 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.286961 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.287127 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.287274 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.287435 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.287587 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.287741 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.287897 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288048 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288188 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288353 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288484 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288658 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288811 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.288994 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.289140 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.289299 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.289431 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.289604 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.289734 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.289907 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290040 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290211 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290342 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290556 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290694 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290832 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.290960 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.291087 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.291214 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.291389 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.291520 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.291724 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.291856 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.292038 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.292171 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.292343 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.292486 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.292650 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.292872 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293072 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293204 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293331 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293482 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293659 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293787 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.293913 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294039 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294165 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294290 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294450 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294581 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294774 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.294907 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.295082 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.295221 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.295383 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.295513 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.295686 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.295991 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.296129 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.296305 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.296442 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.296631 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.296782 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.296966 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.297113 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.297271 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.297401 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.297586 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.297903 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298033 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298210 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298349 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298528 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298658 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298834 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.298973 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.299149 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.299278 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.299473 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.299610 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.299794 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.299939 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.300106 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.300237 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.300405 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.300549 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.300767 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.300917 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301047 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301173 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301299 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301424 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301604 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301744 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.301910 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.302042 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.302235 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.302368 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.302606 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.302736 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.302907 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.303287 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.303415 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.303525 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.303525 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.303774 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.303900 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304026 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304152 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304304 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304433 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304559 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304684 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304855 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.304992 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305130 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305258 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305384 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305533 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305664 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305837 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.305985 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.306137 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.306268 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.306434 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.306564 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.306731 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.306871 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307028 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307157 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307325 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307453 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307621 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307756 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.307916 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308045 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308216 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308352 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308514 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308646 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308834 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.308961 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.309118 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.309249 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.309420 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.309554 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.309718 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.309848 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.310042 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.310173 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.310369 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.310502 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.310679 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.310886 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311029 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311171 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311309 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311446 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311594 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311725 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.311898 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.312042 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.312214 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.312345 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.312524 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.312653 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.312900 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313052 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313181 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313330 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313523 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313653 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313779 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.313914 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314066 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314195 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314363 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314492 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314694 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314834 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.314962 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.315103 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.315240 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.315368 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.315559 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.315692 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.315878 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316016 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316179 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316309 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316492 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316631 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316807 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.316936 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.317118 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.317262 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.317425 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.317556 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.317730 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.318362 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.318591 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.318731 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.318913 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319042 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319223 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319353 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319529 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319669 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319843 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.319973 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.320149 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.320312 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.320459 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.320596 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.320780 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.320925 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.321117 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.321248 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.321383 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.321518 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.321688 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.321819 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322010 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322141 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322330 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322462 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322635 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322768 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.322956 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.323094 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.323276 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.323407 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.323585 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.323708 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.323809 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:04:01.323906 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.324237 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.324557 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.324895 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.325202 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.325501 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:04:01.325740 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:04:01.478055 n-d-858383-17 devstack@n-api.service[104779]: INFO dbcounter [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Registered counter for database nova_api Oct 31 15:04:01.481116 n-d-858383-17 devstack@n-api.service[104778]: INFO dbcounter [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Registered counter for database nova_api Oct 31 15:04:01.499358 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_db.sqlalchemy.engines [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.501079 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_db.sqlalchemy.engines [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.506793 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writer thread running {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.508409 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writer thread running {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.565411 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.context [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=104778) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:04:01.569548 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.context [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=104779) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:04:01.569758 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:01.570221 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:01.571812 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:01.572506 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:01.572961 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:01.573402 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_concurrency.lockutils [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:01.573866 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_concurrency.lockutils [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:01.574957 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:01.575447 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_concurrency.lockutils [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:01.576143 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_concurrency.lockutils [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:04:01.576573 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_concurrency.lockutils [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:04:01.576936 n-d-858383-17 devstack@n-api.service[104778]: INFO dbcounter [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Registered counter for database nova_cell0 Oct 31 15:04:01.578571 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_concurrency.lockutils [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:04:01.580525 n-d-858383-17 devstack@n-api.service[104779]: INFO dbcounter [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Registered counter for database nova_cell0 Oct 31 15:04:01.580938 n-d-858383-17 devstack@n-api.service[104778]: INFO dbcounter [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Registered counter for database nova_cell1 Oct 31 15:04:01.585396 n-d-858383-17 devstack@n-api.service[104779]: INFO dbcounter [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Registered counter for database nova_cell1 Oct 31 15:04:01.588688 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_db.sqlalchemy.engines [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.591657 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_db.sqlalchemy.engines [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.593595 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_db.sqlalchemy.engines [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.595148 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_db.sqlalchemy.engines [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.595801 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writer thread running {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.600644 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writer thread running {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.603368 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writer thread running {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.733022 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writer thread running {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.743550 n-d-858383-17 devstack@n-api.service[104778]: INFO dbcounter [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Registered counter for database nova_cell0 Oct 31 15:04:01.744827 n-d-858383-17 devstack@n-api.service[104779]: INFO dbcounter [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Registered counter for database nova_cell0 Oct 31 15:04:01.752662 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_db.sqlalchemy.engines [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.757249 n-d-858383-17 devstack@n-api.service[104779]: DEBUG oslo_db.sqlalchemy.engines [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:04:01.758134 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writer thread running {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:01.762037 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writer thread running {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:04:02.098985 n-d-858383-17 devstack@n-api.service[104778]: WARNING keystonemiddleware.auth_token [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:04:02.102591 n-d-858383-17 devstack@n-api.service[104779]: WARNING keystonemiddleware.auth_token [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:04:02.107062 n-d-858383-17 devstack@n-api.service[104778]: WARNING keystonemiddleware.auth_token [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:04:02.109846 n-d-858383-17 devstack@n-api.service[104779]: WARNING keystonemiddleware.auth_token [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:04:02.450996 n-d-858383-17 devstack@n-api.service[104778]: WARNING keystonemiddleware.auth_token [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:04:02.456752 n-d-858383-17 devstack@n-api.service[104779]: WARNING keystonemiddleware.auth_token [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:04:02.457024 n-d-858383-17 devstack@n-api.service[104778]: WARNING keystonemiddleware.auth_token [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:04:02.462955 n-d-858383-17 devstack@n-api.service[104778]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c73b70f9c0 pid: 104778 (default app) Oct 31 15:04:02.463635 n-d-858383-17 devstack@n-api.service[104779]: WARNING keystonemiddleware.auth_token [None req-1469c3af-51d1-4ad6-b955-1d5015682a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:04:02.465077 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:04:02.466522 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002038 Oct 31 15:04:02.466932 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Oct 31 15:04:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:04:02.469233 n-d-858383-17 devstack@n-api.service[104779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c73b70f9c0 pid: 104779 (default app) Oct 31 15:05:23.951134 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:23.952300 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 31 15:05:23.953031 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:23.966464 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_api:SELECT=3 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:23.968412 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_cell1:SELECT=3 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:23.969858 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_cell0:SELECT=3 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:23.971901 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:24.849596 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-b48ab9d3-4ee7-40c9-be2e-6926bd311898 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:24.882162 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-b48ab9d3-4ee7-40c9-be2e-6926bd311898 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921701 Oct 31 15:05:24.883087 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:05:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:27.563355 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:27.565848 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-9127ef0b-924b-466a-98db-267a317fa21d None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003589 Oct 31 15:05:27.566444 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:05:28.039063 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-16168d56-02c8-4405-b5f6-f8dec38e2fc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:28.087220 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-16168d56-02c8-4405-b5f6-f8dec38e2fc4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.514645 Oct 31 15:05:28.088213 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:05:28.102738 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_api:SELECT=3 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:28.103979 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_cell1:SELECT=3 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:28.105923 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_cell0:SELECT=3 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:28.106683 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:28.314455 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-50b8ee99-2777-442b-87a0-d021564945b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:28.384829 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-50b8ee99-2777-442b-87a0-d021564945b0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287320 Oct 31 15:05:28.385470 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 31 15:05:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:05:31.102664 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-16168d56-02c8-4405-b5f6-f8dec38e2fc4 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:31.102664 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-16168d56-02c8-4405-b5f6-f8dec38e2fc4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 31 15:05:31.102664 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:32.005794 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-a989dda2-9096-4b53-84a8-fc40ec73c287 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "swap": 0}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:32.063094 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-a989dda2-9096-4b53-84a8-fc40ec73c287 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.951140 Oct 31 15:05:32.071809 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:05:32.082038 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-bf430659-01e0-4505-8cff-6dc21b06c5fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:32.144830 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-bf430659-01e0-4505-8cff-6dc21b06c5fc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071043 Oct 31 15:05:32.146603 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 31 15:05:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:35.039808 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-a989dda2-9096-4b53-84a8-fc40ec73c287 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:35.043339 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-a989dda2-9096-4b53-84a8-fc40ec73c287 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003229 Oct 31 15:05:35.068570 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:35.547841 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-4e50a24a-452d-4c64-bc6e-67e72ccabbab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "ram": 1024}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:35.568874 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-4e50a24a-452d-4c64-bc6e-67e72ccabbab admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510470 Oct 31 15:05:35.576279 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:05:35.582891 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-fa3085ab-e0cc-4bfc-b05d-61c923970c51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:35.613962 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-fa3085ab-e0cc-4bfc-b05d-61c923970c51 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034907 Oct 31 15:05:35.614644 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 31 15:05:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:38.276322 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-4e50a24a-452d-4c64-bc6e-67e72ccabbab admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:38.277300 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-4e50a24a-452d-4c64-bc6e-67e72ccabbab admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Oct 31 15:05:38.277707 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:38.758257 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-dc696462-707f-4c59-b321-ca0b5243a8b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "name": "ds2G", "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:38.785371 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-dc696462-707f-4c59-b321-ca0b5243a8b4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500500 Oct 31 15:05:38.785925 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:05:38.799109 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-98a62775-0dae-4fb4-9e3a-0f44bec00f4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:38.832313 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-98a62775-0dae-4fb4-9e3a-0f44bec00f4d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037816 Oct 31 15:05:38.835831 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 31 15:05:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:05:41.592746 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-dc696462-707f-4c59-b321-ca0b5243a8b4 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:41.594895 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-dc696462-707f-4c59-b321-ca0b5243a8b4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002685 Oct 31 15:05:41.605920 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:42.048296 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-e8dde57b-3b02-41ab-92fd-5418590cf8c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:42.077664 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-e8dde57b-3b02-41ab-92fd-5418590cf8c9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475760 Oct 31 15:05:42.091492 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-7b0f6f93-ed1c-4148-a71a-72d22f16b387 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:42.097080 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:05:42.146095 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-7b0f6f93-ed1c-4148-a71a-72d22f16b387 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058467 Oct 31 15:05:42.153063 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Oct 31 15:05:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:44.873282 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-e8dde57b-3b02-41ab-92fd-5418590cf8c9 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:44.874462 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-e8dde57b-3b02-41ab-92fd-5418590cf8c9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Oct 31 15:05:44.874788 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:45.344458 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-65c2d9d6-2d05-4e91-8577-0a21416599ca admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:45.369164 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-65c2d9d6-2d05-4e91-8577-0a21416599ca admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.488191 Oct 31 15:05:45.369712 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:05:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:05:48.070628 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-e8dde57b-3b02-41ab-92fd-5418590cf8c9 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:48.071699 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-e8dde57b-3b02-41ab-92fd-5418590cf8c9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Oct 31 15:05:48.071961 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:48.489166 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-bbd4db26-7803-43db-b070-245b98fd343d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:48.513490 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-bbd4db26-7803-43db-b070-245b98fd343d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.434745 Oct 31 15:05:48.514935 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:05:48.527294 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-130499c4-57c6-46c4-ab55-9f2012f2b173 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:48.555326 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-130499c4-57c6-46c4-ab55-9f2012f2b173 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031617 Oct 31 15:05:48.555927 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 31 15:05:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:05:51.181739 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-bbd4db26-7803-43db-b070-245b98fd343d admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:51.182862 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-bbd4db26-7803-43db-b070-245b98fd343d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Oct 31 15:05:51.183265 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:51.585669 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-4f3c5806-400b-42be-ab14-6bd70e9369ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:51.604556 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-4f3c5806-400b-42be-ab14-6bd70e9369ef admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414461 Oct 31 15:05:51.605584 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:05:51.617478 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-4fd61e6d-f572-4d26-9982-89de4ad655ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:51.640623 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-4fd61e6d-f572-4d26-9982-89de4ad655ab admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026894 Oct 31 15:05:51.641197 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 31 15:05:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:05:54.235111 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-4f3c5806-400b-42be-ab14-6bd70e9369ef admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:54.236147 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-4f3c5806-400b-42be-ab14-6bd70e9369ef admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 31 15:05:54.236504 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:54.598927 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-c75df306-01ca-4392-8221-588e81c70f9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:54.621856 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-c75df306-01ca-4392-8221-588e81c70f9c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.379319 Oct 31 15:05:54.622416 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:05:54.634275 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-73a8a323-f395-4577-a835-a9b038579a50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:54.640335 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:54.664142 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-73a8a323-f395-4577-a835-a9b038579a50 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033367 Oct 31 15:05:54.665062 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 31 15:05:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:05:57.413872 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-c75df306-01ca-4392-8221-588e81c70f9c admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:57.415503 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-c75df306-01ca-4392-8221-588e81c70f9c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Oct 31 15:05:57.415898 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:57.856893 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-9c185f37-8535-4e6a-9a6a-9f49d57c79fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:57.876440 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-9c185f37-8535-4e6a-9a6a-9f49d57c79fb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453926 Oct 31 15:05:57.880807 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:05:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:05:57.890096 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-77c266d1-e267-4ac4-992e-49e67ab8c3b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:05:57.915856 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-77c266d1-e267-4ac4-992e-49e67ab8c3b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030019 Oct 31 15:05:57.916536 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 31 15:05:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:06:00.555488 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-9c185f37-8535-4e6a-9a6a-9f49d57c79fb admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:00.556506 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-9c185f37-8535-4e6a-9a6a-9f49d57c79fb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 31 15:06:00.556938 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:01.008408 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-ffa37ca1-2690-4712-92dc-a8e8f68ddeee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:01.016271 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:01.035585 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-ffa37ca1-2690-4712-92dc-a8e8f68ddeee admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471780 Oct 31 15:06:01.036480 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Oct 31 15:06:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:06:01.048823 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-56482bde-bfd8-45c6-b9d6-7144514c7055 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:01.073209 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-56482bde-bfd8-45c6-b9d6-7144514c7055 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028170 Oct 31 15:06:01.074108 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Oct 31 15:06:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:06:22.539979 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-ffa37ca1-2690-4712-92dc-a8e8f68ddeee admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:22.541015 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-ffa37ca1-2690-4712-92dc-a8e8f68ddeee admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 31 15:06:22.541417 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:22.552011 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:06:22.932256 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-5e9ca3da-564e-4d08-bcb6-c2cbc8769461 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:22.950594 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-5e9ca3da-564e-4d08-bcb6-c2cbc8769461 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403025 Oct 31 15:06:22.951122 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:06:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:06:24.249629 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-ffa37ca1-2690-4712-92dc-a8e8f68ddeee admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:24.250618 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-ffa37ca1-2690-4712-92dc-a8e8f68ddeee admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 31 15:06:24.251009 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:24.781325 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-9a8249f2-2232-4759-b453-2572ff8dce09 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:24.786590 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.wsgi [None req-9a8249f2-2232-4759-b453-2572ff8dce09 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-9a8249f2-2232-4759-b453-2572ff8dce09 admin admin] Request method failure captured: Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Accept: application/json Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Accept-Encoding: gzip, deflate Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Connection: keep-alive Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Content-Length: 0 Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Host: 10.222.0.48 Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Openstack-Api-Version: compute 2.92 Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: Openstack-System-Scope: None Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: User-Agent: python-novaclient Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Auth-Token: gAAAAABjX-Rw6f2YqKzJaIFFJwdwMzoDjeYQkdS6vpQs9oj4cRnoNlvYapd9mXGH3Dsi7eOPdplCpXQO1dxYoTQDr2_Av9RrOiTU6jiSmnaXHRXGXvYVZrqPBR1hprz3RjnYn9dEIEwDh1oMrk8yFa35zPJ5JWUhCQwo5vIz-viH5DwB36o7HcE Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Domain-Id: None Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Domain-Name: None Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Identity-Status: Confirmed Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Is-Admin-Project: True Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Domain-Id: default Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Domain-Name: Default Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Name: admin Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Role: member,admin,reader Oct 31 15:06:24.789797 n-d-858383-17 devstack@n-api.service[104779]: X-Roles: member,admin,reader Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant: admin Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant-Name: admin Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-User: admin Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-User-Domain-Id: default Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-User-Domain-Name: Default Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-User-Id: c2af8e92738f4d919382350c34b5fc18 Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: X-User-Name: admin Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: method: > Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: exception: Flavor 42 could not be found. Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: action_args: {'id': '42'} Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:06:24.791450 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:24.792331 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.793774 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-9a8249f2-2232-4759-b453-2572ff8dce09 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:06:24.795694 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-9a8249f2-2232-4759-b453-2572ff8dce09 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389394 Oct 31 15:06:24.795694 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:06:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:24.801475 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-b300df66-3c64-409d-b098-c49df627fe03 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:24.823571 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-b300df66-3c64-409d-b098-c49df627fe03 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025671 Oct 31 15:06:24.824116 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 31 15:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:06:24.844836 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-bd800e6f-cbe7-4533-a816-34f1d2ea34e9 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:24.868047 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-bd800e6f-cbe7-4533-a816-34f1d2ea34e9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028093 Oct 31 15:06:24.868606 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 31 15:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:06:24.878261 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-2daef9f5-093c-4b8e-b815-c736baeb7dd4 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:24.883477 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.wsgi [None req-2daef9f5-093c-4b8e-b815-c736baeb7dd4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-2daef9f5-093c-4b8e-b815-c736baeb7dd4 admin admin] Request method failure captured: Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Accept: application/json Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Accept-Encoding: gzip, deflate Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Connection: keep-alive Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Content-Length: 0 Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Host: 10.222.0.48 Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Openstack-Api-Version: compute 2.92 Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: Openstack-System-Scope: None Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: User-Agent: python-novaclient Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Auth-Token: gAAAAABjX-Rw6f2YqKzJaIFFJwdwMzoDjeYQkdS6vpQs9oj4cRnoNlvYapd9mXGH3Dsi7eOPdplCpXQO1dxYoTQDr2_Av9RrOiTU6jiSmnaXHRXGXvYVZrqPBR1hprz3RjnYn9dEIEwDh1oMrk8yFa35zPJ5JWUhCQwo5vIz-viH5DwB36o7HcE Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Domain-Id: None Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Domain-Name: None Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Identity-Status: Confirmed Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Is-Admin-Project: True Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Domain-Id: default Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Domain-Name: Default Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Name: admin Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Role: member,admin,reader Oct 31 15:06:24.886731 n-d-858383-17 devstack@n-api.service[104778]: X-Roles: member,admin,reader Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant: admin Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant-Name: admin Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-User: admin Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-User-Domain-Id: default Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-User-Domain-Name: Default Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-User-Id: c2af8e92738f4d919382350c34b5fc18 Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: X-User-Name: admin Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: method: > Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: exception: Flavor 42 could not be found. Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: action_args: {'id': '42'} Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:06:24.888863 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:24.889816 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:24.890874 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-2daef9f5-093c-4b8e-b815-c736baeb7dd4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:06:24.891861 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-2daef9f5-093c-4b8e-b815-c736baeb7dd4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013443 Oct 31 15:06:24.891861 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:06:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:26.095765 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-bd800e6f-cbe7-4533-a816-34f1d2ea34e9 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:26.096822 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-bd800e6f-cbe7-4533-a816-34f1d2ea34e9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 31 15:06:26.097245 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:26.623006 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-d3fe1c88-7feb-4cea-91a7-fdacdb360f1e admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:26.628048 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.wsgi [None req-d3fe1c88-7feb-4cea-91a7-fdacdb360f1e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-d3fe1c88-7feb-4cea-91a7-fdacdb360f1e admin admin] Request method failure captured: Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Accept: application/json Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Accept-Encoding: gzip, deflate Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Connection: keep-alive Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Content-Length: 0 Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Host: 10.222.0.48 Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Openstack-Api-Version: compute 2.92 Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: Openstack-System-Scope: None Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: User-Agent: python-novaclient Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Auth-Token: gAAAAABjX-Rx6Mw0Jcuc3t3WOMA4qIMjyVDPtQG-2OReuBDuBhwcTzO0T6vjrxtsEbjPNZEBKnB4RrknKK5iELWVJm4B4V9cPOTyMh3ohCR9yIlPRVI18u1n-AWZhBA9jL8OaCYXntZVq8tYvw6I-mFdFVuu901a8y09EHeZMEN-y0ZT9Ap90gw Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Domain-Id: None Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Domain-Name: None Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Identity-Status: Confirmed Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Is-Admin-Project: True Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Domain-Id: default Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Domain-Name: Default Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Name: admin Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Role: member,admin,reader Oct 31 15:06:26.629576 n-d-858383-17 devstack@n-api.service[104778]: X-Roles: member,admin,reader Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant: admin Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant-Name: admin Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-User: admin Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-User-Domain-Id: default Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-User-Domain-Name: Default Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-User-Id: c2af8e92738f4d919382350c34b5fc18 Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: X-User-Name: admin Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: method: > Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: exception: Flavor 84 could not be found. Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: action_args: {'id': '84'} Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:06:26.631115 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:26.632017 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.633179 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-d3fe1c88-7feb-4cea-91a7-fdacdb360f1e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:06:26.634161 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-d3fe1c88-7feb-4cea-91a7-fdacdb360f1e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395093 Oct 31 15:06:26.634161 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:06:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:26.641156 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d63b27eb-d60c-4299-af3d-5529112f11e8 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:26.656282 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d63b27eb-d60c-4299-af3d-5529112f11e8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019363 Oct 31 15:06:26.656958 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 31 15:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:06:26.666304 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-3c2ecd03-3340-44bd-8bfe-79bfee993ef7 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:26.682359 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-3c2ecd03-3340-44bd-8bfe-79bfee993ef7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019569 Oct 31 15:06:26.682872 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 31 15:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:06:26.692472 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-2493e8af-e12b-4d40-9e1e-49782dd7e419 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:26.697314 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.wsgi [None req-2493e8af-e12b-4d40-9e1e-49782dd7e419 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-2493e8af-e12b-4d40-9e1e-49782dd7e419 admin admin] Request method failure captured: Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Accept: application/json Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Accept-Encoding: gzip, deflate Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Connection: keep-alive Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Content-Length: 0 Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Host: 10.222.0.48 Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Openstack-Api-Version: compute 2.92 Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: Openstack-System-Scope: None Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: User-Agent: python-novaclient Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Auth-Token: gAAAAABjX-Rx6Mw0Jcuc3t3WOMA4qIMjyVDPtQG-2OReuBDuBhwcTzO0T6vjrxtsEbjPNZEBKnB4RrknKK5iELWVJm4B4V9cPOTyMh3ohCR9yIlPRVI18u1n-AWZhBA9jL8OaCYXntZVq8tYvw6I-mFdFVuu901a8y09EHeZMEN-y0ZT9Ap90gw Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Domain-Id: None Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Domain-Name: None Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Identity-Status: Confirmed Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Is-Admin-Project: True Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Domain-Id: default Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Domain-Name: Default Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Name: admin Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Role: member,admin,reader Oct 31 15:06:26.698831 n-d-858383-17 devstack@n-api.service[104779]: X-Roles: member,admin,reader Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant: admin Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant-Name: admin Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-User: admin Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-User-Domain-Id: default Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-User-Domain-Name: Default Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-User-Id: c2af8e92738f4d919382350c34b5fc18 Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: X-User-Name: admin Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: method: > Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: exception: Flavor 84 could not be found. Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: action_args: {'id': '84'} Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:06:26.700208 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:26.701094 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:26.702143 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-2493e8af-e12b-4d40-9e1e-49782dd7e419 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:06:26.703164 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-2493e8af-e12b-4d40-9e1e-49782dd7e419 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011188 Oct 31 15:06:26.703164 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:06:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:27.917970 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-3c2ecd03-3340-44bd-8bfe-79bfee993ef7 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:27.918976 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-3c2ecd03-3340-44bd-8bfe-79bfee993ef7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 31 15:06:27.919915 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:28.437742 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-0e5aae9d-f356-455a-854b-e75ab6a5a86a admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:28.443558 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.wsgi [None req-0e5aae9d-f356-455a-854b-e75ab6a5a86a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-0e5aae9d-f356-455a-854b-e75ab6a5a86a admin admin] Request method failure captured: Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Accept: application/json Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Accept-Encoding: gzip, deflate Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Connection: keep-alive Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Content-Length: 0 Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Host: 10.222.0.48 Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Openstack-Api-Version: compute 2.92 Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: Openstack-System-Scope: None Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: User-Agent: python-novaclient Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Auth-Token: gAAAAABjX-RzdM8P-Z82g5mWeyh-V3j0WnM8f_XPKLPIiEpaIN-f2ukx8SkLCKEJmDwZyjLer8lkpKtaP5swVBCtM8rwvQU_k6kTQidXyb8M6cSvWrKPciUXA7k20T6DnbHXxldN8Py5a0_znv8AY_-UONgRJ_dc-7NsDbN_qp98BhrSQ3iaKzo Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Domain-Id: None Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Domain-Name: None Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Identity-Status: Confirmed Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Is-Admin-Project: True Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Domain-Id: default Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Domain-Name: Default Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Project-Name: admin Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Role: member,admin,reader Oct 31 15:06:28.445198 n-d-858383-17 devstack@n-api.service[104779]: X-Roles: member,admin,reader Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant: admin Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-Tenant-Name: admin Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-User: admin Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-User-Domain-Id: default Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-User-Domain-Name: Default Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-User-Id: c2af8e92738f4d919382350c34b5fc18 Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: X-User-Name: admin Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: method: > Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: exception: Flavor 451 could not be found. Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: action_args: {'id': '451'} Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:06:28.446715 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:28.447735 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.449135 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-0e5aae9d-f356-455a-854b-e75ab6a5a86a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:06:28.450369 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-0e5aae9d-f356-455a-854b-e75ab6a5a86a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390362 Oct 31 15:06:28.450369 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:06:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:28.456661 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-484be115-6212-4332-ba5b-d2e5393314be admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:28.471839 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-484be115-6212-4332-ba5b-d2e5393314be admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018698 Oct 31 15:06:28.472364 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 31 15:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:06:28.481509 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:28.496023 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018040 Oct 31 15:06:28.496545 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Oct 31 15:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:06:28.506140 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-5fef1a82-6abf-43cf-9959-8e59626a8570 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:28.511005 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.wsgi [None req-5fef1a82-6abf-43cf-9959-8e59626a8570 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-5fef1a82-6abf-43cf-9959-8e59626a8570 admin admin] Request method failure captured: Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Accept: application/json Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Accept-Encoding: gzip, deflate Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Connection: keep-alive Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Content-Length: 0 Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Host: 10.222.0.48 Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Openstack-Api-Version: compute 2.92 Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: Openstack-System-Scope: None Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: User-Agent: python-novaclient Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Auth-Token: gAAAAABjX-RzdM8P-Z82g5mWeyh-V3j0WnM8f_XPKLPIiEpaIN-f2ukx8SkLCKEJmDwZyjLer8lkpKtaP5swVBCtM8rwvQU_k6kTQidXyb8M6cSvWrKPciUXA7k20T6DnbHXxldN8Py5a0_znv8AY_-UONgRJ_dc-7NsDbN_qp98BhrSQ3iaKzo Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Domain-Id: None Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Domain-Name: None Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Identity-Status: Confirmed Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Is-Admin-Project: True Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Domain-Id: default Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Domain-Name: Default Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Project-Name: admin Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Role: member,admin,reader Oct 31 15:06:28.512490 n-d-858383-17 devstack@n-api.service[104778]: X-Roles: member,admin,reader Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7a641040fac14b93a7b6cc21510f36c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant: admin Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant-Id: 7a641040fac14b93a7b6cc21510f36c9 Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-Tenant-Name: admin Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-User: admin Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-User-Domain-Id: default Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-User-Domain-Name: Default Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-User-Id: c2af8e92738f4d919382350c34b5fc18 Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: X-User-Name: admin Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: method: > Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: exception: Flavor 451 could not be found. Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: action_args: {'id': '451'} Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:06:28.514674 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:28.515689 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: ERROR nova.api.openstack.wsgi Oct 31 15:06:28.517045 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-5fef1a82-6abf-43cf-9959-8e59626a8570 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:06:28.518268 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-5fef1a82-6abf-43cf-9959-8e59626a8570 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011925 Oct 31 15:06:28.518268 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:06:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:06:29.716915 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:29.717963 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 31 15:06:29.718342 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:30.238755 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-740761fe-aa20-46df-abc0-ac2c91a85dbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:30.257696 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-740761fe-aa20-46df-abc0-ac2c91a85dbe admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397525 Oct 31 15:06:30.258231 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 31 15:06:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:06:31.467857 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:31.468894 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 31 15:06:31.469285 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:32.063880 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-64602efe-5b2e-445c-9896-d10bd8a3b1a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:32.083953 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-64602efe-5b2e-445c-9896-d10bd8a3b1a1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.475506 Oct 31 15:06:32.084528 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 31 15:06:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:06:33.301751 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:33.302821 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 31 15:06:33.303207 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:33.821822 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-393255f2-a20c-478d-9700-a59c6b1362db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:33.840223 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-393255f2-a20c-478d-9700-a59c6b1362db admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399330 Oct 31 15:06:33.840778 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 31 15:06:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:06:35.047439 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:35.048425 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 31 15:06:35.048839 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:35.566587 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-3ca54cf3-c327-4b82-86ea-066088680c3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:06:35.584654 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-3ca54cf3-c327-4b82-86ea-066088680c3f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400037 Oct 31 15:06:35.585216 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Oct 31 15:06:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:06:36.785929 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:36.787187 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Oct 31 15:06:36.787653 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:06:37.301265 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-0d896380-9d19-42fa-b61e-e0c0ae0e4a94 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:06:37.320934 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-0d896380-9d19-42fa-b61e-e0c0ae0e4a94 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395717 Oct 31 15:06:37.321464 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Oct 31 15:06:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:07:33.854336 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:33.855254 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-d5190a08-6e50-49a9-8177-038d09e6ab66 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 31 15:07:33.855652 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Mon Oct 31 15:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:33.867019 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:34.248368 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-70230c5b-26a0-41d2-8dbd-54cd30f26c2d admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:34.269817 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-70230c5b-26a0-41d2-8dbd-54cd30f26c2d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407415 Oct 31 15:07:34.270348 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:07:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:07:34.291824 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_api:SELECT=14 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:34.295932 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-5ca73b10-0302-44b4-9806-ec9fecb43a94 admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:34.303310 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-5ca73b10-0302-44b4-9806-ec9fecb43a94 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012868 Oct 31 15:07:34.303819 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Mon Oct 31 15:07:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:34.315816 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-063f6cb7-5792-402f-99ec-ee28848aa310 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:34.322994 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-063f6cb7-5792-402f-99ec-ee28848aa310 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010812 Oct 31 15:07:34.323495 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Mon Oct 31 15:07:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:34.335235 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-dc5a1618-20eb-48d3-862f-9372c79db71e admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:34.343246 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-dc5a1618-20eb-48d3-862f-9372c79db71e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011458 Oct 31 15:07:34.343746 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Mon Oct 31 15:07:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:34.354639 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-9a13d507-626c-4e20-ad6c-5f64ec82d2af admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:34.362196 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-9a13d507-626c-4e20-ad6c-5f64ec82d2af admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010942 Oct 31 15:07:34.362701 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Mon Oct 31 15:07:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:12:55.441995 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-dc5a1618-20eb-48d3-862f-9372c79db71e admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:12:55.442993 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-dc5a1618-20eb-48d3-862f-9372c79db71e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 31 15:12:55.443379 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:12:55.586979 n-d-858383-17 devstack@n-api.service[104778]: DEBUG dbcounter [-] [104778] Writing DB stats nova_api:SELECT=6 {{(pid=104778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:55.726583 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:12:55.731200 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:55.731669 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:55.732088 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:55.732820 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:55.733264 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:55.733672 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:55.771735 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-e918e4ff-432b-4d42-9b00-02e7e930f4ea admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.185960 Oct 31 15:12:55.772283 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:12:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:12:56.836539 n-d-858383-17 devstack@n-api.service[104779]: DEBUG nova.api.openstack.wsgi [None req-dc5a1618-20eb-48d3-862f-9372c79db71e admin admin] Calling method '>' {{(pid=104779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:12:56.837566 n-d-858383-17 devstack@n-api.service[104779]: INFO nova.api.openstack.requestlog [None req-dc5a1618-20eb-48d3-862f-9372c79db71e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 31 15:12:56.837976 n-d-858383-17 devstack@n-api.service[104779]: [pid: 104779|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Oct 31 15:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:12:57.027293 n-d-858383-17 devstack@n-api.service[104778]: DEBUG nova.api.openstack.wsgi [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Calling method '>' {{(pid=104778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:12:57.030736 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:57.031195 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:57.031613 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:57.032307 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:12:57.032766 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:12:57.033228 n-d-858383-17 devstack@n-api.service[104778]: DEBUG oslo_concurrency.lockutils [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:12:57.055969 n-d-858383-17 devstack@n-api.service[104778]: INFO nova.api.openstack.requestlog [None req-d438f290-d6bc-4685-8975-545956a58001 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.080355 Oct 31 15:12:57.056511 n-d-858383-17 devstack@n-api.service[104778]: [pid: 104778|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:12:56 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:13:45.392354 n-d-858383-17 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 31 15:13:45.394601 n-d-858383-17 devstack@n-api.service[104777]: Mon Oct 31 15:13:45 2022 - graceful shutdown triggered... Oct 31 15:13:45.395083 n-d-858383-17 devstack@n-api.service[104778]: Gracefully killing worker 1 (pid: 104778)... Oct 31 15:13:45.395439 n-d-858383-17 devstack@n-api.service[104779]: Gracefully killing worker 2 (pid: 104779)... Oct 31 15:13:45.522583 n-d-858383-17 devstack@n-api.service[104779]: DEBUG dbcounter [-] [104779] Writing DB stats nova_api:SELECT=4 {{(pid=104779) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:46.395697 n-d-858383-17 devstack@n-api.service[104777]: worker 1 buried after 1 seconds Oct 31 15:13:46.395697 n-d-858383-17 devstack@n-api.service[104777]: worker 2 buried after 1 seconds Oct 31 15:13:46.395697 n-d-858383-17 devstack@n-api.service[104777]: goodbye to uWSGI. Oct 31 15:13:46.397467 n-d-858383-17 systemd[1]: devstack@n-api.service: Succeeded. Oct 31 15:13:46.398036 n-d-858383-17 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 31 15:13:46.400884 n-d-858383-17 systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 15:13:46.417849 n-d-858383-17 devstack@n-api.service[120615]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 15:13:46 2022] *** Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: nodename: n-d-858383-17 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: machine: x86_64 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: clock source: unix Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: pcre jit disabled Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: detected number of CPU cores: 4 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: current working directory: / Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: detected binary path: /usr/bin/uwsgi-core Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: your processes number limit is 47680 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: your memory page size is 4096 bytes Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: detected max file descriptor number: 2048 Oct 31 15:13:46.430159 n-d-858383-17 devstack@n-api.service[120615]: lock engine: pthread robust mutexes Oct 31 15:13:46.431240 n-d-858383-17 devstack@n-api.service[120615]: thunder lock: enabled Oct 31 15:13:46.431240 n-d-858383-17 devstack@n-api.service[120615]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 15:13:46.431240 n-d-858383-17 devstack@n-api.service[120615]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 15:13:46.472416 n-d-858383-17 devstack@n-api.service[120615]: Python main interpreter initialized at 0x55e9d77f29c0 Oct 31 15:13:46.472416 n-d-858383-17 devstack@n-api.service[120615]: python threads support enabled Oct 31 15:13:46.472416 n-d-858383-17 devstack@n-api.service[120615]: your server socket listen backlog is limited to 100 connections Oct 31 15:13:46.472416 n-d-858383-17 devstack@n-api.service[120615]: your mercy for graceful operations on workers is 90 seconds Oct 31 15:13:46.472918 n-d-858383-17 devstack@n-api.service[120615]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 15:13:46.472918 n-d-858383-17 devstack@n-api.service[120615]: *** Operational MODE: preforking *** Oct 31 15:13:46.473133 n-d-858383-17 devstack@n-api.service[120615]: *** uWSGI is running in multiple interpreter mode *** Oct 31 15:13:46.473133 n-d-858383-17 devstack@n-api.service[120615]: spawned uWSGI master process (pid: 120615) Oct 31 15:13:46.473358 n-d-858383-17 systemd[1]: Started Devstack devstack@n-api.service. Oct 31 15:13:46.473937 n-d-858383-17 devstack@n-api.service[120615]: spawned uWSGI worker 1 (pid: 120625, cores: 1) Oct 31 15:13:46.474484 n-d-858383-17 devstack@n-api.service[120615]: spawned uWSGI worker 2 (pid: 120626, cores: 1) Oct 31 15:13:46.474798 n-d-858383-17 devstack@n-api.service[120615]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 15:13:47.138938 n-d-858383-17 devstack@n-api.service[120626]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:13:47.140123 n-d-858383-17 devstack@n-api.service[120625]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:13:48.385718 n-d-858383-17 devstack@n-api.service[120625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:13:48.385718 n-d-858383-17 devstack@n-api.service[120625]: from cryptography.utils import int_from_bytes Oct 31 15:13:48.386453 n-d-858383-17 devstack@n-api.service[120625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:13:48.386453 n-d-858383-17 devstack@n-api.service[120625]: from cryptography.utils import int_from_bytes Oct 31 15:13:48.395601 n-d-858383-17 devstack@n-api.service[120626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:13:48.395601 n-d-858383-17 devstack@n-api.service[120626]: from cryptography.utils import int_from_bytes Oct 31 15:13:48.396109 n-d-858383-17 devstack@n-api.service[120626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:13:48.396109 n-d-858383-17 devstack@n-api.service[120626]: from cryptography.utils import int_from_bytes Oct 31 15:13:50.815273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:13:50.815847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:13:50.815962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:13:50.816329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:13:50.816590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:13:50.817007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.817337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.817664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.817987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.818320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.818638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.818968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.819290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.819619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.819884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.820207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.820534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-17 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.820885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.821202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.821512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.821831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.822141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.822467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.822775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.823277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.824410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.824410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.824410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.824676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.824980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.825290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.825614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.825926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.826253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.826564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.826965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-17 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.827284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.827601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.827915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.828332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.828647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.828995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.829318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.829645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.829952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.831198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.831512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.831842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.832171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.832479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.832818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.833134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.833456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.833763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.834073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.834326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.834637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.834961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.835286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.835610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.835866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.836119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.836441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.836787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.837102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.837411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.837719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.838028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.838336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.838647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.838958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.839271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.839590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.839913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.840235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.840544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.840891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.841294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.841548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.841859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.842200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.842399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:13:50.842805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.842907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:13:50.843298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.843442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.843589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:13:50.843692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.843785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:13:50.843987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.844089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:13:50.844293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.844401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.844601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.844791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.844948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.845087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.845275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.845411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.845584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.846374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.846548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.846811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.846924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.847951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.848056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.848275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.848368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.848577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.848673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-17 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.848910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.849970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.850156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.850282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.850462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.850558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.850767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.850876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.851997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.852219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.852325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.852559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.852666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.852900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.853935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.854140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.854246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.854449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.854544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.854773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.854874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-17 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.855081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.855206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.855389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.855491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.855709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.855804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.856975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.857144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.857287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.857470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.857607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.857784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.857918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.858133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.858237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.858457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.858558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.858780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.858887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.859101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.859247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.859405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.859506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.859705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.859850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.860943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.861048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.861199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.861331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.861562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.861728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.861887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.862028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.862207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.862366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.862549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.862695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.862881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.862983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.863195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.863299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.863517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.863663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.863843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.863991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.864155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.864267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.864469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.864562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.864805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.864922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.865118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.865221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.865429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.865531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.865741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.865835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.866052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.866158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.866360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.866463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.866678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.866767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.866998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.867094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.867325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.867426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.867637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.867738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.867953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.868046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.868276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.868370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.868590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.868685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.868930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.869025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.869257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.869402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.869581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.869690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.869892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.869993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.870220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.870326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.870542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.870652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.870856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.870960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.871166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.871268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.871478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.871586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.871801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.871903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.872117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.872218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.872423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.872525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.872679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.872793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.873006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.873111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.873317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.873420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.873638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.873787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.873950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.874043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.874262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.874360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.874574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.874677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.874878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.874972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.875188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.875283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.875498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.875591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.875809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.875902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.876121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.876215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.876432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.876539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.876811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.876986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.877202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.877473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.877579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.877789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.877888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.878100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.878198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.878412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.878517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.878727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.878832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.879035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.879141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.879342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.879460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.879653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.879762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.879962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.880069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.880268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.880379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.880590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.880688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.880926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.881043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.881238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.881337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.881567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.881665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.881875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.881979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.882182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.882286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.882492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.882589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.882805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.882913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.883109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.883201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.883426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.883529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.883730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.883881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.884035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.884142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.884352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.884452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.884663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.884780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.884996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.885101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.885302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.885395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.885608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.885711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.885914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.886018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.886221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.886333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.886528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.886629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.886834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.886943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.887138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.887239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.887448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.887549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.887771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.887877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.888082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.888183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.888394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.888494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.888719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.888816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.889044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:13:50.889140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.889367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.889485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.889697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.889835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.890964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.891076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.891272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.891381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.891580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.891674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.891887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.892036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.892196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.892305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.893036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.893204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.893390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.893531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.893707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.893851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.894034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.894139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.894359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.894496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.894694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.894798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.895950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.896052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.896272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.896373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.896596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.896780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.896950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.897054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.897269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.897370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.897604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.897734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.897940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.898990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.899210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.899312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.899522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.899615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.899835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.899976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.900157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.900259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.900477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.900580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.900822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.900919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.901140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.901246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.901458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.901559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.901769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.901870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.902091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.902195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.902400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.902494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.902715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.902814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.903036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.903131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.903355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.903451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.903682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.903774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.904976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.905078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.905290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.905385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.905602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.905696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.905916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.906957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.907163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.907256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.907474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.907580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.907784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.907887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.908102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.908220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.909986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.910096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.910302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.910404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.910619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.910713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.910934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.911975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.912181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.912274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.912491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.912582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.912834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.912945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.913145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.913245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.913457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.913560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.913767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.913861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.914074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.914209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.914391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.914494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.914700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.914801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.915946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.916045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.916260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.916369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.916574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.916674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.916923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.917961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.918181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.918293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.918489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.918595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.918796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.918891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.919103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.919197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.919410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.919510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.919720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.919821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.920986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.921082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.921296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.921396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.921605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.921698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.921911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.922949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.923153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.923245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.923461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.923569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.923811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.923915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.924128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.924265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.924455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.924558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.924788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.924896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.925102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.925203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.925414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.925518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.925720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.925814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.926031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.926124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.926348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.926452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.926663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.926920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.927995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.928231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.928334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.928547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.928657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.928903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.929949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.930161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.930253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.930477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.930570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.930786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.930881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.931100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.931202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.931409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.931516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.931717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.931813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.932964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.933980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.934192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.934331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.934506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.934611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.934815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.934915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.935127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.935229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.935438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.935530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.935743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.935835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.936045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.936183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.936351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.936459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.936713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.936811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.937997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.938107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.938312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.938416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.938615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.938707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.938927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.939027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.939238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.939339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.939583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.939678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.939904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.940991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.941193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.941331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.941506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.941643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.941817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.941915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.942125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.942227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.942442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.942582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.942769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.942907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.943084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.943177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.943404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.943507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.943715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.943813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.944973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.945986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.946204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.946313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.946508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.946611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.946814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.946929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.947119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.947222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.947430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.947524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.947741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.947843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.948043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.948136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.948365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.948467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.948677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.948835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.949932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.950959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.951183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.951276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.951489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.951584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.951801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.951938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.952104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.952205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.952410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.952503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.952729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.952839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.953044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.953141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.953351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.953615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.953758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.953948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.954981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.955777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.955883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.956104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.956250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.956418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.956516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.956713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.956809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.957073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.957182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.957383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.957485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.957694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.957794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.958954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.959987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.960192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.960287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.960501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.960594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.960836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.960948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.961146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.961246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.961454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.961549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.961768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.961862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.962079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.962180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.962390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.962484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.962708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.962856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.963946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.964047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.964259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.964353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.964571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.964750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.964908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.965990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.966166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.966310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.966481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.966577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.966791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.966891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.967098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.967204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.967412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.967511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.967720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.967819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.968278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.968386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.968592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.968685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.968928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.969951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.970162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.970264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.970467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.970560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.971328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.971644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.971897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.972985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.973216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.973318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.973539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.973647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.973846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.973947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.974166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.974268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.974475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.974569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.974783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.974899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.975090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.975222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.975404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.975542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.975717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.975860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.976025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.976195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.976352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.976480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.976668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.976825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.977939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.978111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.978254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.978438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.978568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.978748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.978895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.979083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.979221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.979480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.979575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.979798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.979899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.980109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.980205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.980420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.980517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.980792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.980902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.981973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.982131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.982280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.982442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.982587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.982760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.982913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.983074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.983224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.983403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.983535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.983731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.983833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.984049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.984151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.984369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.984470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.984678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.984841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.985998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.986100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.986406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.986731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.986890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.987995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.988090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.988314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.988415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.988621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.988773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.988959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.989995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.990219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.990322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.990538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.990640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.990853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.990948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.991160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.991262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.991469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.991606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.991786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.991888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.992098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.992245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.992491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.992638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.992827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.992950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.993998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.994129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.994310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.994442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.994623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.994754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.994933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.995056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.995241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.995371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.995548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.995670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.995880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.996011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.996187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.996320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.996493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.996622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.997728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.997918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.998982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.999125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.999218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.999397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.999500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.999716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:50.999811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.000035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.000137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.000359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.000462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.000666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.000806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.001004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.001100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.001312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.001415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.001630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.001724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.002035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.002175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.002330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.002481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.002722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.002831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.003052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.003158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.003364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.003467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.003693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.003788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.004959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.005073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.005301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.005394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.005608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.005716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.005942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.006038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.006256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.006359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.006589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.006672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.006914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.007993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.008192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.008323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.008511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.008655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.008888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.008989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.009158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.009299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.009479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.009615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.009799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.009945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.010121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.010277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.010596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.010698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.010918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.011983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.012203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.012305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.012520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.012625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.012867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.012988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.013181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.013299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.013495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.013618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.013807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.013948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.014138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.014281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.014464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.014596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.014793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.014908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.015130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.015233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.015454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.015550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.015772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.015867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.016090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.016194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.016408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.016514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.016765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.016876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.017087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.017197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.017395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.017497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.018292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.018388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.018612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.018809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.018934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.019145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.019249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.019459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.019563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.019791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.019884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.020127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.020225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.020457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.020561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.020797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.020886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.021128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.021475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.021793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.022000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.022719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.022909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.023165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.023329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.023495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.023667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.023843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.023999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.024162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.024326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.024440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.024538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.024634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.024875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.025919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.026128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.026231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.026450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.026543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.026772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.026876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.027082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.027184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.027394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.027512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.027703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.027797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.028987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.029110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.029311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.029419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.029617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.029730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.029931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.030021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.030249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.030499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.030583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.030786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.031038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.031125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.031449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.031777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.032139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.032267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.032432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.032548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.032767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.032902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.033098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.033869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.033999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.034238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.034333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.034567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.034664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.034914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.035936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.036154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.036266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.036461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.036556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.036847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.037001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.037169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.037306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.037492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.037614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.038768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.038874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.038971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.039919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.040943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.041090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.041185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.041404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.041498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.041766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.041870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.042085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.042181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.042393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.042488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.042712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.042806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.043955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.044050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.044280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.044375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.044596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.044705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.044934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.045031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.045266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.045376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.045594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.045694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.045939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.046136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.046239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.046475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.046580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.046801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.046902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.047138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.047240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.047471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.047566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.047780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.047872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.048091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.048230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.048401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.048506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.048743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.048887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.049081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.049275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.049400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.049600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.049720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.049920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.050050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.050237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.050392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.050552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.050719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.050867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.051038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.051183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.051358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.051498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.051682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.051811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.052131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.052226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.052446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.052540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.052782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.052879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.053099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.053204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.053411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.053551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.053730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.053888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.054074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.054213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.054399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.054509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.054722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.054828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.055963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.056064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.056271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.056373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.056583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.056712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.056928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.057037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.057252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.057346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.057564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.057659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.057871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.058111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.058300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.058473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.058619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.058800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.058946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.059141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.059270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.059472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.059579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.059798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.059897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.060114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.060209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.060446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.060542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.060786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.060886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.061112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.061241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.061456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.061572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.061774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.061862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.062654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.062819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.062948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.063901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.064984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.065361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.065640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.065955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.066267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.066580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.066890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.067209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.067519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.067832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.068146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.068291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.068476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.068642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.068882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.069999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.070178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.070332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.070474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.070656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.070807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.070979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.071123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.071301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.071450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.071622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.071768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.071946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.072084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.072266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.072448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.072578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.072784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.072918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.073226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.073339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.073542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.073682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.073858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.074013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.074163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.074356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.074502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.074719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.074847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.075044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.075172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.075371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.075505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.075683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.075827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.076012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.076160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.076331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.076477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.076650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.076832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.077989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.078149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.078306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.078468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.078637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.078792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.078965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.079114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.079326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.079436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.079661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.079759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.079979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.080751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.080968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.081078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.081300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.081432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.081616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.081715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.081953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.082060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.082279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.082375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.082612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.082708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.082937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.083040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.083259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.083368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.083595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.083690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.083911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.084982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.085205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.085311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.085531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.085631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.085844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.085945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.086163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.086259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.086486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.086582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.086807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.086901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.087143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.087247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.087477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.087572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.087794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.087890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.088128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.088232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.088445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.088591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.088813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.088930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.089135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.089231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.089484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.089644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.089807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.089916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.090130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.090235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.090449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.090552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.090761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.090865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.091007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:13:51.091108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.091372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.091689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.092015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.092332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.092645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.093239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.093556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.093868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.094180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.094493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.094805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.095120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.095430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.096393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.096809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.097127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.097441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.097756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.098075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.098389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.098708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.099019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.099331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.099643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.099980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.100320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.100639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.101012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.101332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.101661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.101977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.102306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.102632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.102970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.103270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.103609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.103941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.104263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.104586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.104934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.105267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.105586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.105921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.106255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.106568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.106901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.107226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.107553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.107879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.108197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.108533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.108893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.109210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.109526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.109845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.110162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.110485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.110802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.111120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.111467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.111791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.112121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.112453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.113928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.114224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.114582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.114956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.115319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.115686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.116034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.116366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.116720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.117041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:13:51.117294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:13:51.154959 n-d-858383-17 devstack@n-api.service[120625]: INFO dbcounter [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Registered counter for database nova_api Oct 31 15:13:51.176633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.182353 n-d-858383-17 devstack@n-api.service[120626]: INFO dbcounter [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Registered counter for database nova_api Oct 31 15:13:51.183645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.203128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_db.sqlalchemy.engines [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.210889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writer thread running {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.242010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.context [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=120625) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:13:51.246161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:13:51.246650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:13:51.248236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:13:51.248996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:13:51.249447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:13:51.251455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:13:51.254137 n-d-858383-17 devstack@n-api.service[120625]: INFO dbcounter [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Registered counter for database nova_cell0 Oct 31 15:13:51.258735 n-d-858383-17 devstack@n-api.service[120625]: INFO dbcounter [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Registered counter for database nova_cell1 Oct 31 15:13:51.266372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.269892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.context [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=120626) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:13:51.271859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.274071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:13:51.274562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:13:51.276540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:13:51.277321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:13:51.277777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:13:51.279824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:13:51.281939 n-d-858383-17 devstack@n-api.service[120626]: INFO dbcounter [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Registered counter for database nova_cell0 Oct 31 15:13:51.287349 n-d-858383-17 devstack@n-api.service[120626]: INFO dbcounter [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Registered counter for database nova_cell1 Oct 31 15:13:51.295087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_db.sqlalchemy.engines [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.297782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_db.sqlalchemy.engines [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.304874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writer thread running {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.306183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writer thread running {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.423446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.428063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.436774 n-d-858383-17 devstack@n-api.service[120625]: INFO dbcounter [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Registered counter for database nova_cell0 Oct 31 15:13:51.444875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.449562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.458031 n-d-858383-17 devstack@n-api.service[120626]: INFO dbcounter [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Registered counter for database nova_cell0 Oct 31 15:13:51.464729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_db.sqlalchemy.engines [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:13:51.469426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writer thread running {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:13:51.777826 n-d-858383-17 devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:13:51.785274 n-d-858383-17 devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:13:51.789720 n-d-858383-17 devstack@n-api.service[120626]: WARNING keystonemiddleware.auth_token [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:13:51.797263 n-d-858383-17 devstack@n-api.service[120626]: WARNING keystonemiddleware.auth_token [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:13:52.128947 n-d-858383-17 devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:13:52.134980 n-d-858383-17 devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-021f86c1-30b4-41a8-bb22-890a3690931c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:13:52.140301 n-d-858383-17 devstack@n-api.service[120626]: WARNING keystonemiddleware.auth_token [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:13:52.140682 n-d-858383-17 devstack@n-api.service[120625]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9d77f29c0 pid: 120625 (default app) Oct 31 15:13:52.146920 n-d-858383-17 devstack@n-api.service[120626]: WARNING keystonemiddleware.auth_token [None req-177a2bda-f672-4470-b3b3-dd63f0926b5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:13:52.152209 n-d-858383-17 devstack@n-api.service[120626]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9d77f29c0 pid: 120626 (default app) Oct 31 15:14:31.322731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:31.323894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:31.325332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:31.326790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:32.666458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Calling method '.version_select at 0x7f5ca3f9bf70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:32.671402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:32.672462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:32.672995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:32.673733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:32.674187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:32.674613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:32.720891 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ce824b1-f326-41ed-a0d9-c90b6df3349c tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.405013 Oct 31 15:14:32.721961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Oct 31 15:14:31 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:32.732432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:32.735061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:32.736016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:32.737273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:33.151153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cda196c-9c22-4273-934a-4278fda7e6c8 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Calling method '.version_select at 0x7f5ca3fc3f70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.152755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6cda196c-9c22-4273-934a-4278fda7e6c8 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '3a76c9a75b1049969a83515f9524face', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4abb0e2b9564c159d85f7aa362bb6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cda196c-9c22-4273-934a-4278fda7e6c8 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Request method failure captured: Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZVW4jjHNX6-YwQ2QWzUITEOiszVLmEclufOdqY65fF0i-QIqKKC83_FWWG-w7Cm2C35YQxHLrt3PS_YUuCHEg1aFr08pfxoYbwxKP_i6b9KeTDnz9428rDokt9fPYfqyO6lf56NorAiI8B8GwEVpYIcjZwUqzY5hREH_0697pSZuM Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:33.158489 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3a76c9a75b1049969a83515f9524face Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:14:33.160104 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.161599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 15:14:33.163195 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.164646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cda196c-9c22-4273-934a-4278fda7e6c8 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.164646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6cda196c-9c22-4273-934a-4278fda7e6c8 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.430686 Oct 31 15:14:33.168041 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Oct 31 15:14:32 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 438 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:14:33.568245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dcbd8506-336a-4956-a5d1-61e56c061310 tempest-AZAdminNegativeTestJSON-1261909279 tempest-AZAdminNegativeTestJSON-1261909279-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.570031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dcbd8506-336a-4956-a5d1-61e56c061310 tempest-AZAdminNegativeTestJSON-1261909279 tempest-AZAdminNegativeTestJSON-1261909279-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c95a56158b234f5c93d6c847eeca75da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804be501eeb849d38a8ab3e438ae0e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dcbd8506-336a-4956-a5d1-61e56c061310 tempest-AZAdminNegativeTestJSON-1261909279 tempest-AZAdminNegativeTestJSON-1261909279-project] Request method failure captured: Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZWXiVvdsZVVsX9E6kfcLyV2KSq5RdLE2aGENT9vs8P_nu_VYsM7P1ADU5fgJK03t_gN7g9wMBQ4z9Fe41ITeU89M_5mvPp_KU6i9JC43pF_JHiUkyDwyEzxzrGzxjj9pJsuLjkcvwLjjFbMuWxuUZhZpglVLuo6Ooa1P1XMyZ6-Uk Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 804be501eeb849d38a8ab3e438ae0e4b Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1261909279 Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:33.571991 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/804be501eeb849d38a8ab3e438ae0e4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/804be501eeb849d38a8ab3e438ae0e4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_804be501eeb849d38a8ab3e438ae0e4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/804be501eeb849d38a8ab3e438ae0e4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AZAdminNegativeTestJSON-1261909279 Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 804be501eeb849d38a8ab3e438ae0e4b Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1261909279 Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AZAdminNegativeTestJSON-1261909279-project Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c95a56158b234f5c93d6c847eeca75da Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AZAdminNegativeTestJSON-1261909279-project Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 15:14:33.573717 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.574650 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 15:14:33.575998 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.577978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dcbd8506-336a-4956-a5d1-61e56c061310 tempest-AZAdminNegativeTestJSON-1261909279 tempest-AZAdminNegativeTestJSON-1261909279-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.578812 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dcbd8506-336a-4956-a5d1-61e56c061310 tempest-AZAdminNegativeTestJSON-1261909279 tempest-AZAdminNegativeTestJSON-1261909279-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.409578 Oct 31 15:14:33.583666 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3/3] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:33.584633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c44529c2-96dd-4b0a-8909-44764ffc26c5 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Calling method '.version_select at 0x7f5ca3e6d790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.586747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c44529c2-96dd-4b0a-8909-44764ffc26c5 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '3a76c9a75b1049969a83515f9524face', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4abb0e2b9564c159d85f7aa362bb6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c44529c2-96dd-4b0a-8909-44764ffc26c5 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Request method failure captured: Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/n-d-858383-17/reboot HTTP/1.1 Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZVW4jjHNX6-YwQ2QWzUITEOiszVLmEclufOdqY65fF0i-QIqKKC83_FWWG-w7Cm2C35YQxHLrt3PS_YUuCHEg1aFr08pfxoYbwxKP_i6b9KeTDnz9428rDokt9fPYfqyO6lf56NorAiI8B8GwEVpYIcjZwUqzY5hREH_0697pSZuM Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:33.588717 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3a76c9a75b1049969a83515f9524face Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'n-d-858383-17'} Oct 31 15:14:33.590440 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.591407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 15:14:33.593401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.595328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c44529c2-96dd-4b0a-8909-44764ffc26c5 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.595328 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c44529c2-96dd-4b0a-8909-44764ffc26c5 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-858383-17/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009470 Oct 31 15:14:33.595328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-hosts/n-d-858383-17/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:33.600126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bea11bbb-0d66-471a-8453-1bc555dd20b1 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Calling method '.version_select at 0x7f5ca3fc3ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.637617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-bea11bbb-0d66-471a-8453-1bc555dd20b1 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bea11bbb-0d66-471a-8453-1bc555dd20b1 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:33.643000 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:14:33.644618 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:33.645872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 15:14:33.647438 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bea11bbb-0d66-471a-8453-1bc555dd20b1 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bea11bbb-0d66-471a-8453-1bc555dd20b1 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.047907 Oct 31 15:14:33.648788 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:14:33.654957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0450a946-fa3e-4afc-a318-0c4ee5fd5aa1 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Calling method '.version_select at 0x7f5ca3ce8700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.657053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0450a946-fa3e-4afc-a318-0c4ee5fd5aa1 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '3a76c9a75b1049969a83515f9524face', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4abb0e2b9564c159d85f7aa362bb6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0450a946-fa3e-4afc-a318-0c4ee5fd5aa1 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Request method failure captured: Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/n-d-858383-17 HTTP/1.1 Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZVW4jjHNX6-YwQ2QWzUITEOiszVLmEclufOdqY65fF0i-QIqKKC83_FWWG-w7Cm2C35YQxHLrt3PS_YUuCHEg1aFr08pfxoYbwxKP_i6b9KeTDnz9428rDokt9fPYfqyO6lf56NorAiI8B8GwEVpYIcjZwUqzY5hREH_0697pSZuM Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:33.658643 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3a76c9a75b1049969a83515f9524face Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'n-d-858383-17'} Oct 31 15:14:33.660014 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.661324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 15:14:33.662635 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.663768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0450a946-fa3e-4afc-a318-0c4ee5fd5aa1 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.663768 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0450a946-fa3e-4afc-a318-0c4ee5fd5aa1 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-858383-17" status: 403 len: 109 microversion: 2.1 time: 0.009145 Oct 31 15:14:33.663768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-hosts/n-d-858383-17 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:33.668918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f7b5aa0-a607-49bd-be5b-575367fb9514 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Calling method '.version_select at 0x7f5ca3cfc280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.676987 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9f7b5aa0-a607-49bd-be5b-575367fb9514 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f7b5aa0-a607-49bd-be5b-575367fb9514 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:33.678591 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:14:33.680106 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.681165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.682697 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.685165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f7b5aa0-a607-49bd-be5b-575367fb9514 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.685165 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f7b5aa0-a607-49bd-be5b-575367fb9514 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018667 Oct 31 15:14:33.685442 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:14:33.694389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44f10356-8559-41e0-9369-477fb7429c59 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Calling method '.version_select at 0x7f5ca3ce8820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.696179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-44f10356-8559-41e0-9369-477fb7429c59 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '3a76c9a75b1049969a83515f9524face', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4abb0e2b9564c159d85f7aa362bb6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44f10356-8559-41e0-9369-477fb7429c59 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Request method failure captured: Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/n-d-858383-17/shutdown HTTP/1.1 Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZVW4jjHNX6-YwQ2QWzUITEOiszVLmEclufOdqY65fF0i-QIqKKC83_FWWG-w7Cm2C35YQxHLrt3PS_YUuCHEg1aFr08pfxoYbwxKP_i6b9KeTDnz9428rDokt9fPYfqyO6lf56NorAiI8B8GwEVpYIcjZwUqzY5hREH_0697pSZuM Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:33.697874 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3a76c9a75b1049969a83515f9524face Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'n-d-858383-17'} Oct 31 15:14:33.699379 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.701274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 15:14:33.702544 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.703716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44f10356-8559-41e0-9369-477fb7429c59 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.703716 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44f10356-8559-41e0-9369-477fb7429c59 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-858383-17/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008584 Oct 31 15:14:33.703716 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1197 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-hosts/n-d-858383-17/shutdown => generated 113 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:14:33.708364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1aaa524-b913-4c56-9461-743a227bdcdb tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Calling method '.version_select at 0x7f5ca3cfc940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.717972 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c1aaa524-b913-4c56-9461-743a227bdcdb tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1aaa524-b913-4c56-9461-743a227bdcdb tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:33.719701 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:14:33.721507 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:33.722503 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 15:14:33.723923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1aaa524-b913-4c56-9461-743a227bdcdb tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1aaa524-b913-4c56-9461-743a227bdcdb tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.016726 Oct 31 15:14:33.725319 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 9/9] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:14:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:14:33.966403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:33.972343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:33.972849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:33.973284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:33.973995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:33.974434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:33.974845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.046137 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbd36e5a-a36f-47b3-bd50-0fa0e5e0d633 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.318782 Oct 31 15:14:34.047279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1/10] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:14:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.049825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d683611f-0b92-45a5-bac4-eb0ec8b6a278 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-344125969", "id": 1128268904, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.055739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d1cef95-e791-47e0-8c24-e9557adf4259 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Calling method '.version_select at 0x7f5ca3e62d30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.057669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d1cef95-e791-47e0-8c24-e9557adf4259 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '3a76c9a75b1049969a83515f9524face', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4abb0e2b9564c159d85f7aa362bb6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d1cef95-e791-47e0-8c24-e9557adf4259 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Request method failure captured: Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hosts/n-d-858383-17/startup HTTP/1.1 Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZVW4jjHNX6-YwQ2QWzUITEOiszVLmEclufOdqY65fF0i-QIqKKC83_FWWG-w7Cm2C35YQxHLrt3PS_YUuCHEg1aFr08pfxoYbwxKP_i6b9KeTDnz9428rDokt9fPYfqyO6lf56NorAiI8B8GwEVpYIcjZwUqzY5hREH_0697pSZuM Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:14:34.061486 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3a76c9a75b1049969a83515f9524face Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'n-d-858383-17'} Oct 31 15:14:34.062762 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:34.063490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 15:14:34.065688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.066413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d1cef95-e791-47e0-8c24-e9557adf4259 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:34.066413 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d1cef95-e791-47e0-8c24-e9557adf4259 tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-858383-17/startup" status: 403 len: 110 microversion: 2.1 time: 0.013256 Oct 31 15:14:34.066413 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1194 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hosts/n-d-858383-17/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:34.116275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d683611f-0b92-45a5-bac4-eb0ec8b6a278 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.393077 Oct 31 15:14:34.117357 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 10/12] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:33 2022] POST /compute/v2.1/flavors => generated 429 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.133725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca3e2ddc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.143024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.143456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.144964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.145697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.146153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.146581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.174770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d26e1411-15d6-41c6-95da-81bd83ddc4e2 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.110174 Oct 31 15:14:34.175347 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3/13] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.195473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '.version_select at 0x7f5ca3ce8430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.202667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=120625) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 31 15:14:34.204135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.204603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.205081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.224649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.225162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.225590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.238303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.238782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.239356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.245738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb5bf5a3-ddb6-4251-9ee6-c414a3017446 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.127364 Oct 31 15:14:34.249186 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:34.367126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Calling method '.version_select at 0x7f5ca3e62a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.378512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=120626) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 31 15:14:34.379532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.380033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.380460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.417347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.417842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.418273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.431947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.432485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.433083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.440764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09f6a620-5f57-4cb1-9429-a08a32bcf3fa tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.264418 Oct 31 15:14:34.441332 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 4/15] 10.222.0.48 () {60 vars in 1208 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:14:34.443866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30bdb4e6-27c9-41c4-8e43-d762e0890265 tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-805545038", "id": 1484665566, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.445642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cfaa97c-f997-4739-b210-0e1480ca5bcb tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-512752638"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.466522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-1cfaa97c-f997-4739-b210-0e1480ca5bcb tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 9d5a7b83-4118-40ef-888a-202eea1cd120 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:34.466693 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30bdb4e6-27c9-41c4-8e43-d762e0890265 tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.214856 Oct 31 15:14:34.467337 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 12/16] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:14:34 2022] POST /compute/v2.1/flavors => generated 448 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:34.472763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df8f1771-57ce-42dd-abbd-287f02c5cef7 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Calling method '.version_select at 0x7f5ca3cc4ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.485810 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-df8f1771-57ce-42dd-abbd-287f02c5cef7 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df8f1771-57ce-42dd-abbd-287f02c5cef7 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:34.490036 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:14:34.491259 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:34.491997 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 15:14:34.493166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:34.494710 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.496799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df8f1771-57ce-42dd-abbd-287f02c5cef7 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:34.497668 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df8f1771-57ce-42dd-abbd-287f02c5cef7 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.028883 Oct 31 15:14:34.498217 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 13/17] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:14:34.503361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e64a68c-e134-4683-a0d7-72ebca17ed73 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.536149 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e64a68c-e134-4683-a0d7-72ebca17ed73 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1128268904" status: 202 len: 0 microversion: 2.1 time: 0.036422 Oct 31 15:14:34.536657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 14/18] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:34 2022] DELETE /compute/v2.1/flavors/1128268904 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:34.542295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca3c59790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.545656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1cfaa97c-f997-4739-b210-0e1480ca5bcb tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.103285 Oct 31 15:14:34.545772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.546401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.547390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.548362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 5/19] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.554498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.555109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.555620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.581287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb1b4aba-b778-4227-af1f-3b59c1b9884c tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.043579 Oct 31 15:14:34.581884 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 15/20] 10.222.0.48 () {58 vars in 1139 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.586415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68d7613e-fbab-46f6-8c66-f95c3beed5cc tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca3c6e790>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68d7613e-fbab-46f6-8c66-f95c3beed5cc tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/os-hosts/n-d-858383-17 HTTP/1.1 Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 51 Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:34.591621 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: {"status": "enable", "maintenance_mode": "invalid"} Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:34.593273 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'n-d-858383-17', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.594492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.595769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68d7613e-fbab-46f6-8c66-f95c3beed5cc tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:34.596607 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68d7613e-fbab-46f6-8c66-f95c3beed5cc tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-858383-17" status: 400 len: 199 microversion: 2.1 time: 0.010332 Oct 31 15:14:34.598764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 16/21] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:14:34 2022] PUT /compute/v2.1/os-hosts/n-d-858383-17 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:14:34.603435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c08d9885-2822-4e91-8cdb-3139acde7b05 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.636286 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c08d9885-2822-4e91-8cdb-3139acde7b05 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.036272 Oct 31 15:14:34.637117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 17/22] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:34.641878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f1e53b5-b1e8-4c88-8b81-2b21ccc9e151 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.657546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f1e53b5-b1e8-4c88-8b81-2b21ccc9e151 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.658110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f1e53b5-b1e8-4c88-8b81-2b21ccc9e151 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.658611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f1e53b5-b1e8-4c88-8b81-2b21ccc9e151 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.699270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-46688699-86cb-4716-bd1a-2c72c9edacb1 tempest-FlavorsV255TestJSON-363754226 tempest-FlavorsV255TestJSON-363754226-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.735551 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-46688699-86cb-4716-bd1a-2c72c9edacb1 tempest-FlavorsV255TestJSON-363754226 tempest-FlavorsV255TestJSON-363754226-project] 10.222.0.48 "GET /compute/v2.1/flavors/1484665566" status: 200 len: 448 microversion: 2.55 time: 0.185837 Oct 31 15:14:34.736139 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 6/23] 10.222.0.48 () {60 vars in 1199 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/flavors/1484665566 => generated 448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:34.740543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca3d6ff70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.745336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.746213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.746982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.748274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.749214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.750009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.776119 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ac645c5-9208-4d79-a418-1a444222d5e9 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.038940 Oct 31 15:14:34.776733 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 7/24] 10.222.0.48 () {58 vars in 1145 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:14:34.787651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2b6ea76-123e-4303-b2da-1f64e8ecf39a tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca3db9f70>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2b6ea76-123e-4303-b2da-1f64e8ecf39a tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/os-hosts/n-d-858383-17 HTTP/1.1 Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 51 Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:14:34.793382 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: {"status": "invalid", "maintenance_mode": "enable"} Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:14:34.794389 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'n-d-858383-17', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.795015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.796125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2b6ea76-123e-4303-b2da-1f64e8ecf39a tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2b6ea76-123e-4303-b2da-1f64e8ecf39a tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-858383-17" status: 400 len: 189 microversion: 2.1 time: 0.010669 Oct 31 15:14:34.798483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 8/25] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:14:34 2022] PUT /compute/v2.1/os-hosts/n-d-858383-17 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:14:34.802161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a462db01-ace8-462e-b421-c3ac13208fd0 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-992663484", "id": 1068670676, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.833556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a462db01-ace8-462e-b421-c3ac13208fd0 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.037340 Oct 31 15:14:34.834459 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 9/26] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:34 2022] POST /compute/v2.1/flavors => generated 416 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.839366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0fac9f7-2fb6-409e-810d-c7fd25a30782 tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca436df70>, body: {"flavor": {"description": "new"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.888155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0fac9f7-2fb6-409e-810d-c7fd25a30782 tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1484665566" status: 200 len: 449 microversion: 2.55 time: 0.052225 Oct 31 15:14:34.897763 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 10/27] 10.222.0.48 () {62 vars in 1219 bytes} [Mon Oct 31 15:14:34 2022] PUT /compute/v2.1/flavors/1484665566 => generated 449 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:34.902694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22816d3b-a966-423a-a214-e693d01dc04f tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Action: 'update', calling method: .version_select at 0x7f5ca35234c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:34.910854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-22816d3b-a966-423a-a214-e693d01dc04f tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '3a76c9a75b1049969a83515f9524face', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4abb0e2b9564c159d85f7aa362bb6b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22816d3b-a966-423a-a214-e693d01dc04f tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Request method failure captured: Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/os-hosts/n-d-858383-17 HTTP/1.1 Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 50 Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZVW4jjHNX6-YwQ2QWzUITEOiszVLmEclufOdqY65fF0i-QIqKKC83_FWWG-w7Cm2C35YQxHLrt3PS_YUuCHEg1aFr08pfxoYbwxKP_i6b9KeTDnz9428rDokt9fPYfqyO6lf56NorAiI8B8GwEVpYIcjZwUqzY5hREH_0697pSZuM Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:14:34.913944 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4abb0e2b9564c159d85f7aa362bb6b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a4abb0e2b9564c159d85f7aa362bb6b4 Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1733864283 Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3a76c9a75b1049969a83515f9524face Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1733864283-project Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: {"status": "enable", "maintenance_mode": "enable"} Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 15:14:34.915021 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'n-d-858383-17', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:34.915717 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 15:14:34.916607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:34.917572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22816d3b-a966-423a-a214-e693d01dc04f tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:34.919792 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22816d3b-a966-423a-a214-e693d01dc04f tempest-HostsAdminNegativeTestJSON-1733864283 tempest-HostsAdminNegativeTestJSON-1733864283-project] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-858383-17" status: 403 len: 111 microversion: 2.1 time: 0.019423 Oct 31 15:14:34.921441 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 11/28] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:14:34 2022] PUT /compute/v2.1/os-hosts/n-d-858383-17 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:34.926241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-521b9669-828c-4c46-a17d-01eeb51ce7f0 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.964350 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-521b9669-828c-4c46-a17d-01eeb51ce7f0 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.041836 Oct 31 15:14:34.965261 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 12/29] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:34.970403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a93d9d4-c976-4e4b-aa16-3ea7b2f721b6 tempest-FlavorsV255TestJSON-363754226 tempest-FlavorsV255TestJSON-363754226-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.009237 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a93d9d4-c976-4e4b-aa16-3ea7b2f721b6 tempest-FlavorsV255TestJSON-363754226 tempest-FlavorsV255TestJSON-363754226-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.039919 Oct 31 15:14:35.010293 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 13/30] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:14:35.016078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d83b90dd-3088-4fb2-b4aa-b11528791a02 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca34eb5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d83b90dd-3088-4fb2-b4aa-b11528791a02 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/os-hosts/n-d-858383-17 HTTP/1.1 Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 42 Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:14:35.022093 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: {"status": null, "maintenance_mode": null} Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 15:14:35.023092 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'n-d-858383-17', 'body': {'status': None, 'maintenance_mode': None}} Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi None Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:35.023729 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:35.024872 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:35.025731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:14:35.025731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:14:35.025731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 15:14:35.025731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.026753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d83b90dd-3088-4fb2-b4aa-b11528791a02 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:35.027755 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d83b90dd-3088-4fb2-b4aa-b11528791a02 tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-858383-17" status: 400 len: 127 microversion: 2.1 time: 0.015692 Oct 31 15:14:35.028740 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 14/31] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:14:35 2022] PUT /compute/v2.1/os-hosts/n-d-858383-17 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:14:35.033843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cce6eeab-e051-4109-88ba-5fcee31e1747 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.059301 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f1e53b5-b1e8-4c88-8b81-2b21ccc9e151 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.420844 Oct 31 15:14:35.059915 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 18/32] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:14:34 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.066900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae809f46-7539-48cc-a45e-247afce4c9b4 tempest-FlavorsV255TestJSON-363754226 tempest-FlavorsV255TestJSON-363754226-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.069380 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cce6eeab-e051-4109-88ba-5fcee31e1747 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1068670676" status: 202 len: 0 microversion: 2.1 time: 0.039176 Oct 31 15:14:35.070111 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:35 2022] DELETE /compute/v2.1/flavors/1068670676 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:35.078579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9156d485-5c7b-48f0-aa19-4306f08d80fa tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca3523550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.081818 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.hosts [None req-9156d485-5c7b-48f0-aa19-4306f08d80fa tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Enabling host nonexistent_hostname. Oct 31 15:14:35.093127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9156d485-5c7b-48f0-aa19-4306f08d80fa tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:35.097928 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae809f46-7539-48cc-a45e-247afce4c9b4 tempest-FlavorsV255TestJSON-363754226 tempest-FlavorsV255TestJSON-363754226-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.036424 Oct 31 15:14:35.098514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 19/34] 10.222.0.48 () {60 vars in 1166 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9156d485-5c7b-48f0-aa19-4306f08d80fa tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Request method failure captured: Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 50 Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZX_VgukeCpzheAiopSZVt2hFj2FXEESl35YkCmG1ipYZoeLa6kMHAKCs77stIoX7Zyl9P6w_oSKG6Jh0ft05kzxcPawbX4hugPx_7tpKGfezG51BQeIf0AQ8aT2bAbS2Go1f5T4dPdYjBnPx6b7PFAN_tu9z63dK_q58Akyf6e7ns Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:14:35.099319 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6659b5023784a82a1749ecea813e399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6659b5023784a82a1749ecea813e399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6659b5023784a82a1749ecea813e399"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6659b5023784a82a1749ecea813e399 Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-365579836 Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ea2fd5df4e9a4d878cbbb010a9897e6f Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HostsAdminNegativeTestJSON-365579836-project-admin Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: {"status": "enable", "maintenance_mode": "enable"} Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:35.100586 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:14:35.101446 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:35.102472 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.103600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9156d485-5c7b-48f0-aa19-4306f08d80fa tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:35.104464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9156d485-5c7b-48f0-aa19-4306f08d80fa tempest-HostsAdminNegativeTestJSON-365579836 tempest-HostsAdminNegativeTestJSON-365579836-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026046 Oct 31 15:14:35.104464 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 16/35] 10.222.0.48 () {60 vars in 1211 bytes} [Mon Oct 31 15:14:35 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:14:35.109641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ca03ece-d87d-486b-9d66-3cd817668e07 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.116109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.127920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:35.128462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:35.128941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:35.132628 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ca03ece-d87d-486b-9d66-3cd817668e07 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.030116 Oct 31 15:14:35.133513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 17/36] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.138302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee343349-25d9-449a-901c-fa620f8d794b tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.170461 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee343349-25d9-449a-901c-fa620f8d794b tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1484665566" status: 202 len: 0 microversion: 2.55 time: 0.034746 Oct 31 15:14:35.170461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Oct 31 15:14:35 2022] DELETE /compute/v2.1/flavors/1484665566 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:14:35.176987 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-858383-17. Oct 31 15:14:35.177125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e1e1f17-35a0-4d11-b9f6-3d59c7a60754 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1651347806", "id": 1435705967, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 40 Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:35.191648 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: {"add_host": {"host": "n-h2-858383-17"}} Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:35.193064 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate 1 already has host n-h2-858383-17. Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-858383-17'}}} Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:14:35.193923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858383-17-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:14:35.195060 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:14:35.196135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:14:35.197179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858383-17-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 15, 14, 35, 153023), 'updated_at': None, 'host': 'n-h2-858383-17', 'aggregate_id': 1}] Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.198196 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6643, in add_host_to_aggregate Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-858383-17. Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.199198 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-858383-17. Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:35.200520 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:35.203176 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-858383-17. Oct 31 15:14:35.203176 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:35.203176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-858383-17. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:35.203176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0609c24c-bad3-4c6a-a393-ee664718199f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.095882 Oct 31 15:14:35.203176 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 31 15:14:35.203176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec8ca163-7220-4d13-9c9a-b1a5cc2ab82a tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.205360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e1e1f17-35a0-4d11-b9f6-3d59c7a60754 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.033994 Oct 31 15:14:35.207257 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.213569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c79c9be-457e-41d7-a54c-05ddf25744bd tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.224613 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec8ca163-7220-4d13-9c9a-b1a5cc2ab82a tempest-FlavorsV255TestJSON-589252612 tempest-FlavorsV255TestJSON-589252612-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.027217 Oct 31 15:14:35.225510 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:14:35.228120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c79c9be-457e-41d7-a54c-05ddf25744bd tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:35.228715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c79c9be-457e-41d7-a54c-05ddf25744bd tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:35.229253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c79c9be-457e-41d7-a54c-05ddf25744bd tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:35.232969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-925eabb3-8cdd-42e8-a368-158d4a07aece tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.262910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-925eabb3-8cdd-42e8-a368-158d4a07aece tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1435705967" status: 202 len: 0 microversion: 2.1 time: 0.036479 Oct 31 15:14:35.267032 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:35 2022] DELETE /compute/v2.1/flavors/1435705967 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:35.272329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15bf6c00-96e4-4e75-8882-532019ab7f18 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.299762 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15bf6c00-96e4-4e75-8882-532019ab7f18 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031591 Oct 31 15:14:35.300812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 23/42] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.320435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0d5718c-dbe6-44ae-8f7d-a3433acc4aee tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1272171349", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.339053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0d5718c-dbe6-44ae-8f7d-a3433acc4aee tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.022934 Oct 31 15:14:35.339914 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 24/43] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/flavors => generated 507 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:35.353762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ddf4bfdf-fad2-4b90-b677-4a394d31fb3c tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.371572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ddf4bfdf-fad2-4b90-b677-4a394d31fb3c tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/145904d9-45bb-415a-a256-088ad32a5e1d" status: 202 len: 0 microversion: 2.1 time: 0.022223 Oct 31 15:14:35.375648 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 25/44] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:14:35 2022] DELETE /compute/v2.1/flavors/145904d9-45bb-415a-a256-088ad32a5e1d => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:35.381260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f82862f-c19c-4acd-b783-3b7663e30363 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.401751 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f82862f-c19c-4acd-b783-3b7663e30363 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024700 Oct 31 15:14:35.402446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 26/45] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.425406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c68a7fd1-b48a-4666-abaf-4d5706611378 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2104123448", "id": "5249c0b4-c4f4-4ef4-842a-d469ca0f8770", "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.449200 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c68a7fd1-b48a-4666-abaf-4d5706611378 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.029325 Oct 31 15:14:35.450099 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 27/46] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/flavors => generated 507 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.464036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32bfbf26-3e2d-4d3e-b5fc-0d200fc86f88 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.486976 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32bfbf26-3e2d-4d3e-b5fc-0d200fc86f88 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/5249c0b4-c4f4-4ef4-842a-d469ca0f8770" status: 202 len: 0 microversion: 2.1 time: 0.027600 Oct 31 15:14:35.487671 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 28/47] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:14:35 2022] DELETE /compute/v2.1/flavors/5249c0b4-c4f4-4ef4-842a-d469ca0f8770 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:35.496002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb92eb80-7ce2-46ff-8395-952e6764804a tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.517864 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb92eb80-7ce2-46ff-8395-952e6764804a tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025919 Oct 31 15:14:35.521052 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 29/48] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.541157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c865c440-faaa-4b81-869b-9ea9e814758d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-412791379", "id": 1650060360, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.560123 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c865c440-faaa-4b81-869b-9ea9e814758d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.022655 Oct 31 15:14:35.560637 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 30/49] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/flavors => generated 413 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.575644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-becbb302-b354-47f0-a2b9-399e8157ab7d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.591675 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-becbb302-b354-47f0-a2b9-399e8157ab7d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1650060360" status: 200 len: 413 microversion: 2.1 time: 0.022860 Oct 31 15:14:35.593089 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 31/50] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/1650060360 => generated 413 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.826414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-931bc0b6-1f4d-4593-8cf9-1c68519fa640 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.836789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:35.853107 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-931bc0b6-1f4d-4593-8cf9-1c68519fa640 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.250716 Oct 31 15:14:35.853709 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 32/51] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.874385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d4df08e-2343-4a7a-a1f0-21643b7ddfa9 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.896069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d4df08e-2343-4a7a-a1f0-21643b7ddfa9 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1650060360" status: 202 len: 0 microversion: 2.1 time: 0.025236 Oct 31 15:14:35.900205 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 33/52] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:35 2022] DELETE /compute/v2.1/flavors/1650060360 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:14:35.905228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d4de596-1a4a-4b2f-a9f1-956d192e0972 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.926825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d4de596-1a4a-4b2f-a9f1-956d192e0972 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025262 Oct 31 15:14:35.927414 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 34/53] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:35.947466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76e2e1aa-3c09-4f7a-bf3b-2e1d83b37286 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-868025121", "id": 1107009496, "os-flavor-access:is_public": "False"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:35.968497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76e2e1aa-3c09-4f7a-bf3b-2e1d83b37286 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.023993 Oct 31 15:14:35.970056 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 35/54] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/flavors => generated 429 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.982995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8be9f1c9-7d98-4196-af4b-24c4d56b3907 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "1107009496"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.004095 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8be9f1c9-7d98-4196-af4b-24c4d56b3907 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] HTTP exception thrown: Flavor 1107009496 could not be found. Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8be9f1c9-7d98-4196-af4b-24c4d56b3907 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] Request method failure captured: Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 107 Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZXgoH_Pl5qNFYWbLPZBX4Y1NUWe1l4K5uLHmpFW3G3TY1azLGI6DRHszUw5RnVzgo8t9N5N-Qec1v0E8GfzlZ0U_8xwOpl1FnCXpT7N5Jt34aZUeR1yHmCANNDpIzSdCu04zhs2iKI1E05oUhgUzEtvpffIBdkw5hDKCaEc7hb2zM Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3235ccdc4b4a4a319e3720e2f72997fb Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsAdminTestJSON-646462992 Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:36.007579 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3235ccdc4b4a4a319e3720e2f72997fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3235ccdc4b4a4a319e3720e2f72997fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3235ccdc4b4a4a319e3720e2f72997fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3235ccdc4b4a4a319e3720e2f72997fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsAdminTestJSON-646462992 Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3235ccdc4b4a4a319e3720e2f72997fb Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-646462992 Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsAdminTestJSON-646462992-project Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: afeb3b8d9f0b4ef388f8b1abc24ef4af Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsAdminTestJSON-646462992-project Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "test", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "1107009496"}} Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:36.008652 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor 1107009496 could not be found. Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '1107009496'}}} Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1107009496 could not be found. Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.009386 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1107009496 could not be found. Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.010342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1107009496 could not be found. Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8be9f1c9-7d98-4196-af4b-24c4d56b3907 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] Returning 400 to user: Flavor 1107009496 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8be9f1c9-7d98-4196-af4b-24c4d56b3907 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.030636 Oct 31 15:14:36.011390 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 36/55] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/servers => generated 81 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:36.021993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-194d680b-20ec-465d-a860-edb1c0126017 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.041210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-194d680b-20ec-465d-a860-edb1c0126017 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1107009496" status: 202 len: 0 microversion: 2.1 time: 0.026753 Oct 31 15:14:36.041823 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 37/56] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:36 2022] DELETE /compute/v2.1/flavors/1107009496 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:36.050849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01293828-3fd9-46e4-972c-e9288f582698 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.071653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01293828-3fd9-46e4-972c-e9288f582698 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025130 Oct 31 15:14:36.072265 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 38/57] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:36.094854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-100d629d-e4b4-4889-b460-e8bb9fdfbb2d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-605363420", "id": 1922596129, "os-flavor-access:is_public": "False"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.118870 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-100d629d-e4b4-4889-b460-e8bb9fdfbb2d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029067 Oct 31 15:14:36.125489 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 39/58] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/flavors => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:36.133645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2be06d3b-819b-474f-b7ce-f495fd6c2cd6 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1812031189", "id": 311948462, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.156752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2be06d3b-819b-474f-b7ce-f495fd6c2cd6 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.026802 Oct 31 15:14:36.157733 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 40/59] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/flavors => generated 411 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:36.172582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14750fca-9b96-4787-96fb-b497f41cacc8 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.197270 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14750fca-9b96-4787-96fb-b497f41cacc8 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.031196 Oct 31 15:14:36.197931 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 41/60] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:36.212009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6801808-dc43-4566-b63a-91a484639f56 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.224599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6801808-dc43-4566-b63a-91a484639f56 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.016161 Oct 31 15:14:36.225402 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 42/61] 10.222.0.48 () {58 vars in 1177 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:36.240193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-486e93d7-3f32-483b-a0cf-5914b7c133da tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.251886 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-486e93d7-3f32-483b-a0cf-5914b7c133da tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.017260 Oct 31 15:14:36.261366 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 43/62] 10.222.0.48 () {58 vars in 1171 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:36.267094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a052202-3f29-4af6-933e-40bb5a7fa018 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.271695 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c79c9be-457e-41d7-a54c-05ddf25744bd tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 1.061359 Oct 31 15:14:36.280367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 20/63] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:14:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:36.280522 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a052202-3f29-4af6-933e-40bb5a7fa018 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.015897 Oct 31 15:14:36.280522 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 44/64] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:36.287453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-011fb942-c3db-4e6f-a998-9b46d346453e tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.296373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2934541e-cd14-4b6c-a903-5fffe0b68855 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.336082 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-011fb942-c3db-4e6f-a998-9b46d346453e tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.053046 Oct 31 15:14:36.337071 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 21/65] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:36 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:14:36.338692 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2934541e-cd14-4b6c-a903-5fffe0b68855 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.049280 Oct 31 15:14:36.339473 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 45/66] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:36.354884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f4270eb-754e-4e7a-82c3-fb31716d2bc3 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1296635370"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.354884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-1f4270eb-754e-4e7a-82c3-fb31716d2bc3 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 4abb9d83-dffd-412f-9e03-f1f50c07ac80 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:36.361368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14055df4-c446-407d-8c56-8723efb19a36 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.382859 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f4270eb-754e-4e7a-82c3-fb31716d2bc3 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038751 Oct 31 15:14:36.383694 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 22/67] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:36.384009 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14055df4-c446-407d-8c56-8723efb19a36 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.027580 Oct 31 15:14:36.393842 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 46/68] 10.222.0.48 () {58 vars in 1175 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:36.404606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25cdefe7-b4d1-4f8c-92f8-bb028a0dd429 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.430441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25cdefe7-b4d1-4f8c-92f8-bb028a0dd429 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.029496 Oct 31 15:14:36.431054 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 47/69] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:36.449434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53042c45-a372-4599-bd1f-e1c9a1e15e1d tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-756225527"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.457075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-53042c45-a372-4599-bd1f-e1c9a1e15e1d tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Generated uuid d1334640-02af-41eb-a774-30a8ad3e0537 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:36.509562 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53042c45-a372-4599-bd1f-e1c9a1e15e1d tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.069205 Oct 31 15:14:36.510193 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 48/70] 10.222.0.48 () {62 vars in 1205 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:36.519246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bce6684f-6569-4e2d-b689-45e064dfc206 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.540977 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bce6684f-6569-4e2d-b689-45e064dfc206 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.029609 Oct 31 15:14:36.541840 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 49/71] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:36.547284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30bb0d38-ae9b-4a47-b66c-57ef9e52c09d tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1787774775"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.663257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30bb0d38-ae9b-4a47-b66c-57ef9e52c09d tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.119392 Oct 31 15:14:36.664374 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 50/72] 10.222.0.48 () {62 vars in 1210 bytes} [Mon Oct 31 15:14:36 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:36.670772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6002e843-2448-467c-90ba-44c859100e19 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.690635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf3f60d2-15a4-4bab-a597-491f6a6ffdb4 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.695880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cf3f60d2-15a4-4bab-a597-491f6a6ffdb4 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2dc81e159f534d30984b9ee0823f2537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f9c4d5abe43d192a9501ca16e228c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf3f60d2-15a4-4bab-a597-491f6a6ffdb4 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Request method failure captured: Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 40 Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZWmp03unN5KTHU7ldHVoxvKA_WDelQSO5n_l0mifvS-h_rzCgW4017f4guE42fSW7zeP855CHdbshw7aH4RJxBoivPz_fi96baE_Km8NH9IYrPYGPUgcyP_w8S1tMGkNzDl9hU7KiVmJDMOPE6bGSWqQV8MgH8UwYmeNzZwSslhLI Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:14:36.698739 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 2dc81e159f534d30984b9ee0823f2537 Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: {"add_host": {"host": "n-h2-858383-17"}} Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:14:36.700046 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-858383-17'}}} Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:36.700975 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 15:14:36.702087 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.707551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf3f60d2-15a4-4bab-a597-491f6a6ffdb4 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:36.708671 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf3f60d2-15a4-4bab-a597-491f6a6ffdb4 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.315023 Oct 31 15:14:36.709393 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 23/73] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 316 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:36.719351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6002e843-2448-467c-90ba-44c859100e19 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/311948462" status: 202 len: 0 microversion: 2.1 time: 0.053395 Oct 31 15:14:36.720766 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 51/74] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:14:36 2022] DELETE /compute/v2.1/flavors/311948462 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:36.724747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2648dd6e-7bd0-4a5c-aa0a-d6017c2caafc tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.731041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be014576-c430-4b38-967a-9b3757c6e33c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.737980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2648dd6e-7bd0-4a5c-aa0a-d6017c2caafc tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.026724 Oct 31 15:14:36.741821 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 24/75] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:36.750845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ebba0c8-7dbf-44a4-8947-6daff2aa29fb tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.776571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be014576-c430-4b38-967a-9b3757c6e33c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.054540 Oct 31 15:14:36.779841 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 52/76] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:36 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:14:36.791927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-939dcaa7-2102-4117-8411-351e0c281b14 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.811187 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ebba0c8-7dbf-44a4-8947-6daff2aa29fb tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066399 Oct 31 15:14:36.812392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 25/77] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:36.816744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-939dcaa7-2102-4117-8411-351e0c281b14 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:36.817243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-939dcaa7-2102-4117-8411-351e0c281b14 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:36.817679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-939dcaa7-2102-4117-8411-351e0c281b14 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:36.817983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a7c8de3-feaf-467b-8186-0b76af8d341f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-7556991"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.822386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-9a7c8de3-feaf-467b-8186-0b76af8d341f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 494eb809-b251-4f74-a5eb-43b86e152349 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:36.869416 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a7c8de3-feaf-467b-8186-0b76af8d341f tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.054501 Oct 31 15:14:36.871772 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 26/78] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:36.878799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d54fcf7e-50ba-4087-b054-01bc9ce5c512 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.908557 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d54fcf7e-50ba-4087-b054-01bc9ce5c512 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1922596129" status: 202 len: 0 microversion: 2.1 time: 0.035598 Oct 31 15:14:36.909494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 27/79] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:36 2022] DELETE /compute/v2.1/flavors/1922596129 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:36.914186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-822775120"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:36.927402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:36.928040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:36.929456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:36.940184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:36.940785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:36.941246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:36.950085 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-822775120 could not be found. Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 57 Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:14:36.952684 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: {"add_host": {"host": "tempest-nonexist_host-822775120"}} Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:14:36.954365 n-d-858383-17 devstack@n-api.service[120626]: exception: Compute host tempest-nonexist_host-822775120 could not be found. Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-822775120'}}} Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-822775120' is not mapped to any cell Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.955010 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6623, in add_host_to_aggregate Oct 31 15:14:36.955910 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-822775120 could not be found. Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-822775120 could not be found. Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:36.957083 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-822775120 could not be found. Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-822775120 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3e22c11-72dc-43f8-b024-218711afeb77 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.044061 Oct 31 15:14:36.958471 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 28/80] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:36.963582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d861178-88e2-4e22-8b3c-7f69ebb84f9a tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:36.986657 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d861178-88e2-4e22-8b3c-7f69ebb84f9a tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026992 Oct 31 15:14:36.987239 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 29/81] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.001091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-591f86a6-8025-4d64-9692-b168634a9f80 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.001091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:37.027520 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-939dcaa7-2102-4117-8411-351e0c281b14 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.41 time: 0.246414 Oct 31 15:14:37.027705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-591f86a6-8025-4d64-9692-b168634a9f80 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.039177 Oct 31 15:14:37.033427 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 53/82] 10.222.0.48 () {62 vars in 1232 bytes} [Mon Oct 31 15:14:36 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:37.041971 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 30/83] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:36 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:14:37.043466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-890f36eb-ecbf-49c4-8367-9208b2989f65 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1371837666", "id": 1805449026, "os-flavor-access:is_public": "False"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.053336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1cbe759-bf4d-4f2f-9f60-90e38baf7d65 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1cbe759-bf4d-4f2f-9f60-90e38baf7d65 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 283 Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:14:37.060320 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.061530 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:14:37.062658 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.063160 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.064161 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.064999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:14:37.064999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:14:37.064999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:14:37.064999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.064999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1cbe759-bf4d-4f2f-9f60-90e38baf7d65 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.065400 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d1cbe759-bf4d-4f2f-9f60-90e38baf7d65 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.020574 Oct 31 15:14:37.065400 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 31/84] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:14:37.077520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2a9f364-3395-4aa2-b19b-2f30b0b60299 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.078621 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-890f36eb-ecbf-49c4-8367-9208b2989f65 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.043895 Oct 31 15:14:37.087244 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 54/85] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/flavors => generated 415 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.095144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf1cdc4e-26c6-42a4-9dfb-14a0baf8f743 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.097383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2a9f364-3395-4aa2-b19b-2f30b0b60299 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:37.098500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2a9f364-3395-4aa2-b19b-2f30b0b60299 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf1cdc4e-26c6-42a4-9dfb-14a0baf8f743 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 27 Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:37.099054 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: {"aggregate": {"name": ""}} Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:37.100260 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '' Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.100932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:14:37.102041 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.103011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf1cdc4e-26c6-42a4-9dfb-14a0baf8f743 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.103011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf1cdc4e-26c6-42a4-9dfb-14a0baf8f743 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012181 Oct 31 15:14:37.104278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2a9f364-3395-4aa2-b19b-2f30b0b60299 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:37.105522 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 55/86] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:14:37.111410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-faf79ed5-6cdb-4806-9115-6b015864dfbc tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.134350 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-faf79ed5-6cdb-4806-9115-6b015864dfbc tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027586 Oct 31 15:14:37.148276 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 56/87] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.153954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8aa23263-1570-46ba-92d6-1ca6319b571e tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-292283596"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.158860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8aa23263-1570-46ba-92d6-1ca6319b571e tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2dc81e159f534d30984b9ee0823f2537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f9c4d5abe43d192a9501ca16e228c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8aa23263-1570-46ba-92d6-1ca6319b571e tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Request method failure captured: Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 59 Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZWmp03unN5KTHU7ldHVoxvKA_WDelQSO5n_l0mifvS-h_rzCgW4017f4guE42fSW7zeP855CHdbshw7aH4RJxBoivPz_fi96baE_Km8NH9IYrPYGPUgcyP_w8S1tMGkNzDl9hU7KiVmJDMOPE6bGSWqQV8MgH8UwYmeNzZwSslhLI Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:37.160882 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 2dc81e159f534d30984b9ee0823f2537 Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: {"aggregate": {"name": "tempest-test_aggregate-292283596"}} Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:37.161965 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-292283596'}}} Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:37.163094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:37.164366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 15:14:37.165362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.167094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8aa23263-1570-46ba-92d6-1ca6319b571e tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.168164 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8aa23263-1570-46ba-92d6-1ca6319b571e tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018680 Oct 31 15:14:37.169131 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 57/88] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:37.181716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3cfa494-4577-4feb-b46e-160f07d5a523 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.212084 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3cfa494-4577-4feb-b46e-160f07d5a523 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041616 Oct 31 15:14:37.213098 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 58/89] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.218099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dde93059-2f27-4b31-ba95-0eece7be9428 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1562067902"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.223487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-dde93059-2f27-4b31-ba95-0eece7be9428 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid f7710567-4150-4cae-8b04-3296b01d7c5b for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:37.262111 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dde93059-2f27-4b31-ba95-0eece7be9428 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047695 Oct 31 15:14:37.268748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 59/90] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.268904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5badc35b-b63a-4b98-a09f-d85e43ca7dbd tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.295472 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2a9f364-3395-4aa2-b19b-2f30b0b60299 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.224486 Oct 31 15:14:37.296361 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 32/91] 10.222.0.48 () {62 vars in 1232 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:14:37.304152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89d89d6e-5149-446a-a8f0-e269f9ef57be tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1562067902"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.308239 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5badc35b-b63a-4b98-a09f-d85e43ca7dbd tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1805449026" status: 202 len: 0 microversion: 2.1 time: 0.043837 Oct 31 15:14:37.308815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-89d89d6e-5149-446a-a8f0-e269f9ef57be tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 98e47dba-dd80-4950-8cef-9ee8327b5231 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:37.308932 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 60/92] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/flavors/1805449026 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:37.319313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b5cec96-ff7f-4fe8-8dc8-437835ca0498 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.324398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-89d89d6e-5149-446a-a8f0-e269f9ef57be tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1562067902 already exists. Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89d89d6e-5149-446a-a8f0-e269f9ef57be tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 60 Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:14:37.327154 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: {"aggregate": {"name": "tempest-test_aggregate-1562067902"}} Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:14:37.328957 n-d-858383-17 devstack@n-api.service[120626]: exception: Aggregate tempest-test_aggregate-1562067902 already exists. Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1562067902'}}} Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6460, in create_aggregate Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 31 15:14:37.329724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1562067902 already exists. Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:37.331229 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1562067902 already exists. Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1562067902 already exists. Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89d89d6e-5149-446a-a8f0-e269f9ef57be tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1562067902 already exists. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.332923 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89d89d6e-5149-446a-a8f0-e269f9ef57be tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.029771 Oct 31 15:14:37.334075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=14,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:37.334166 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 33/93] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 32 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:14:37.340008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d0875ce-b8f8-4387-9e47-f24235a6ff5d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.371892 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b5cec96-ff7f-4fe8-8dc8-437835ca0498 tempest-AggregatesAdminTestV241-648751414 tempest-AggregatesAdminTestV241-648751414-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.061598 Oct 31 15:14:37.373641 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 61/94] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.374612 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d0875ce-b8f8-4387-9e47-f24235a6ff5d tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039514 Oct 31 15:14:37.376135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 34/95] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.388350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-291c151f-93b2-4e7a-b911-5acfdaaf4c05 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.397996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69a42667-bce1-4a2d-8f3b-c39618e78b9b tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-280796664", "id": 1584218539, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.425897 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69a42667-bce1-4a2d-8f3b-c39618e78b9b tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031882 Oct 31 15:14:37.434415 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 35/96] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:37.453360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8f83663-109c-42ba-9398-9d092051b539 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1344093250", "name": "tempest-test_aggregate-1525342823"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.457451 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-291c151f-93b2-4e7a-b911-5acfdaaf4c05 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.072828 Oct 31 15:14:37.458309 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 62/97] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:14:37.467923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce36f862-3146-434a-804a-729ef9518252 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.490696 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce36f862-3146-434a-804a-729ef9518252 tempest-FlavorsAdminTestJSON-646462992 tempest-FlavorsAdminTestJSON-646462992-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.026976 Oct 31 15:14:37.491612 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 63/98] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.498176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-f8f83663-109c-42ba-9398-9d092051b539 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid 5c890b6e-da6d-4e36-b6d6-3546e7e2d3b5 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:37.500969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4a14671-80b8-4d1b-9439-e1b824a19b8a tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1581244191"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.505929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-d4a14671-80b8-4d1b-9439-e1b824a19b8a tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 15afb28d-113a-401b-baa7-70644ab9fa76 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:37.538316 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8f83663-109c-42ba-9398-9d092051b539 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.102627 Oct 31 15:14:37.540670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 36/99] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.545617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dcf0f9d-205c-494d-98b0-e9468f74f3eb tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.562843 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4a14671-80b8-4d1b-9439-e1b824a19b8a tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069088 Oct 31 15:14:37.564854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 64/100] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.571038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0ae4544-e422-4e27-9899-b392c59576f2 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.575853 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dcf0f9d-205c-494d-98b0-e9468f74f3eb tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1584218539" status: 202 len: 0 microversion: 2.1 time: 0.033968 Oct 31 15:14:37.576814 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 37/101] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/flavors/1584218539 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:37.583524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a630bdf9-aecd-4732-87ac-2ec54acd608c tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.585321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a630bdf9-aecd-4732-87ac-2ec54acd608c tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2dc81e159f534d30984b9ee0823f2537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f9c4d5abe43d192a9501ca16e228c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a630bdf9-aecd-4732-87ac-2ec54acd608c tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Request method failure captured: Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZWmp03unN5KTHU7ldHVoxvKA_WDelQSO5n_l0mifvS-h_rzCgW4017f4guE42fSW7zeP855CHdbshw7aH4RJxBoivPz_fi96baE_Km8NH9IYrPYGPUgcyP_w8S1tMGkNzDl9hU7KiVmJDMOPE6bGSWqQV8MgH8UwYmeNzZwSslhLI Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:14:37.587019 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 2dc81e159f534d30984b9ee0823f2537 Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 15:14:37.588125 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '7'} Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:37.588741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.589635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a630bdf9-aecd-4732-87ac-2ec54acd608c tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.590479 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a630bdf9-aecd-4732-87ac-2ec54acd608c tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.010432 Oct 31 15:14:37.592839 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 38/102] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:37.594028 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0ae4544-e422-4e27-9899-b392c59576f2 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.024878 Oct 31 15:14:37.596878 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 65/103] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.598856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d035001-4d36-4ad9-890b-80f26e9028c5 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.601802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb2136c8-d8b4-4200-bc3c-e279aa7e1b81 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.621731 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d035001-4d36-4ad9-890b-80f26e9028c5 tempest-FlavorsAdminTestJSON-673181827 tempest-FlavorsAdminTestJSON-673181827-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026620 Oct 31 15:14:37.622924 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 39/104] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:37.629453 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb2136c8-d8b4-4200-bc3c-e279aa7e1b81 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.031541 Oct 31 15:14:37.630206 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 66/105] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:14:37.640404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9b77318-2518-4894-9769-32b13ae20532 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.646321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24cbe019-6b5c-44ec-a570-069e6420b6ce tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.659406 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-24cbe019-6b5c-44ec-a570-069e6420b6ce tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 31 15:14:37.659535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b77318-2518-4894-9769-32b13ae20532 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:37.659924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b77318-2518-4894-9769-32b13ae20532 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24cbe019-6b5c-44ec-a570-069e6420b6ce tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:37.661096 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate -1 could not be found. Oct 31 15:14:37.662411 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '-1'} Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:14:37.663136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.664579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.665681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24cbe019-6b5c-44ec-a570-069e6420b6ce tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.666366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b77318-2518-4894-9769-32b13ae20532 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:37.666446 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24cbe019-6b5c-44ec-a570-069e6420b6ce tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020749 Oct 31 15:14:37.666446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 67/106] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:14:37.673208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4a4c26a-5301-4df6-b78a-40f3b952b989 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1444846219"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:37.677378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-a4a4c26a-5301-4df6-b78a-40f3b952b989 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 26056a18-37ed-489b-87c1-bbcef1586deb for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:14:37.705347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4a4c26a-5301-4df6-b78a-40f3b952b989 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036825 Oct 31 15:14:37.706717 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 68/107] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:37.722570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e303a16c-1f45-44f9-94d9-1ada63430a61 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.724174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e303a16c-1f45-44f9-94d9-1ada63430a61 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2dc81e159f534d30984b9ee0823f2537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f9c4d5abe43d192a9501ca16e228c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e303a16c-1f45-44f9-94d9-1ada63430a61 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Request method failure captured: Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZWmp03unN5KTHU7ldHVoxvKA_WDelQSO5n_l0mifvS-h_rzCgW4017f4guE42fSW7zeP855CHdbshw7aH4RJxBoivPz_fi96baE_Km8NH9IYrPYGPUgcyP_w8S1tMGkNzDl9hU7KiVmJDMOPE6bGSWqQV8MgH8UwYmeNzZwSslhLI Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:37.725743 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 2dc81e159f534d30984b9ee0823f2537 Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 15:14:37.727036 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '8'} Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:37.727821 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.728978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e303a16c-1f45-44f9-94d9-1ada63430a61 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.729826 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e303a16c-1f45-44f9-94d9-1ada63430a61 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.012168 Oct 31 15:14:37.732827 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 69/108] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:14:37.746122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c609bd55-3092-42e4-ac03-5c9e15697928 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.778627 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c609bd55-3092-42e4-ac03-5c9e15697928 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.036306 Oct 31 15:14:37.780549 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 70/109] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:14:37.791817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03222af1-37d1-4382-af36-c9e73500a434 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.808320 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-03222af1-37d1-4382-af36-c9e73500a434 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03222af1-37d1-4382-af36-c9e73500a434 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:37.810063 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate -1 could not be found. Oct 31 15:14:37.811162 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '-1'} Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.811756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 31 15:14:37.813533 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.814393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03222af1-37d1-4382-af36-c9e73500a434 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.814393 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03222af1-37d1-4382-af36-c9e73500a434 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024000 Oct 31 15:14:37.814393 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 71/110] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:14:37.824517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbe5636d-4d7e-4c2c-bdb6-f1baba1dc2fc tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:37.826196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe5636d-4d7e-4c2c-bdb6-f1baba1dc2fc tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2dc81e159f534d30984b9ee0823f2537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f9c4d5abe43d192a9501ca16e228c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbe5636d-4d7e-4c2c-bdb6-f1baba1dc2fc tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Request method failure captured: Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZWmp03unN5KTHU7ldHVoxvKA_WDelQSO5n_l0mifvS-h_rzCgW4017f4guE42fSW7zeP855CHdbshw7aH4RJxBoivPz_fi96baE_Km8NH9IYrPYGPUgcyP_w8S1tMGkNzDl9hU7KiVmJDMOPE6bGSWqQV8MgH8UwYmeNzZwSslhLI Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:37.828460 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 2dc81e159f534d30984b9ee0823f2537 Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 15:14:37.829559 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:37.830154 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 15:14:37.831091 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:37.833049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbe5636d-4d7e-4c2c-bdb6-f1baba1dc2fc tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:37.834015 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fbe5636d-4d7e-4c2c-bdb6-f1baba1dc2fc tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.015131 Oct 31 15:14:37.834973 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 72/111] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:14:37 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:37.894538 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9b77318-2518-4894-9769-32b13ae20532 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 316 microversion: 2.1 time: 0.270294 Oct 31 15:14:37.895395 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 40/112] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:14:37 2022] POST /compute/v2.1/os-aggregates/6/action => generated 316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:38.561449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1750827653", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "availability_zone": "tempest-test_az-1344093250"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:38.581324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:38.583203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:38.584865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:38.585936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:38.586817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:38.587434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:39.485095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:14:39.839046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:14:39.839648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:14:39.840487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:14:39.840917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:14:39.843849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:14:39.858754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:39.860279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:39.861153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:39.862054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:39.862680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:39.863410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:39.900720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Getting quotas for project bd00e0f8144e4e47a71b9ac4e77f292f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:14:39.909823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Getting quotas for user 031531300e214b66bea9d3563317712a and project bd00e0f8144e4e47a71b9ac4e77f292f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:14:39.943757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:14:39.947236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:14:40.019891 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-873e5ba2-bb82-44ac-a1c4-4265942d0a0e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.860728 Oct 31 15:14:40.020648 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 73/113] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:14:40.032423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f550d38-ea2d-4a29-904d-eabe7852d071 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:40.035505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f550d38-ea2d-4a29-904d-eabe7852d071 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:41.056125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1039846148", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:41.134888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:14:41.272379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f550d38-ea2d-4a29-904d-eabe7852d071 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:41.305972 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f550d38-ea2d-4a29-904d-eabe7852d071 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1243 microversion: 2.1 time: 1.277164 Oct 31 15:14:41.308340 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 41/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:40 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1243 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:41.509769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:14:41.510414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:14:41.511036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:14:41.511620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:14:41.512188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:14:41.522042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:41.522532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:41.529341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:41.530146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:41.531178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:41.531617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:41.551314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Getting quotas for project bd5058292e9d48358327b2127517ea93. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:14:41.556347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Getting quotas for user 152129719036444687e3b8e8bd5460e7 and project bd5058292e9d48358327b2127517ea93. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:14:41.568387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:14:41.570899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:14:41.640459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87fdd3b3-9c78-4527-92a0-087b51fa5036 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041239 Oct 31 15:14:41.649470 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 74/115] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:14:41.657304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-553f3dfa-172c-48e1-80a6-3754b1e7e97e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:41.658268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-553f3dfa-172c-48e1-80a6-3754b1e7e97e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:41.720044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-553f3dfa-172c-48e1-80a6-3754b1e7e97e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:41.729347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-553f3dfa-172c-48e1-80a6-3754b1e7e97e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1220 microversion: 2.1 time: 0.078420 Oct 31 15:14:41.730274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 42/116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:41 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:42.332206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:42.333524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:42.361251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.365082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.365785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.371483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.372357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.372966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.595741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:42.613547 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70cde528-e161-40e6-b081-3c11e213cd8f tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1309 microversion: 2.1 time: 0.286011 Oct 31 15:14:42.614716 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 75/117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:42 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:42.844142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:42.848957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.853921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.854192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.855135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.855818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.856391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.882691 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5839f9fe-d704-4c00-8275-58ad7d6ab89a tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 971 microversion: 2.1 time: 0.477190 Oct 31 15:14:42.883856 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 43/118] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:14:42 2022] GET /compute/v2.1/os-services => generated 971 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:42.904992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:42.909285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:42.918659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.919153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.919595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:42.920441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:42.920932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:42.921884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.099917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:43.118528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Calling method '.version_select at 0x7f5ca30c03a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.120419 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae98c1c0-7e01-47c6-a268-662c5dddfebf tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1224 microversion: 2.1 time: 0.235264 Oct 31 15:14:43.121450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.122232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.122603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 44/119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:42 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:43.122727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.130561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.139208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.141377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.142365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.143320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.145155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.148192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.169748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.173991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.174602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.217878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c84dedc7-adfc-400c-8110-91560144f265 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-858383-17" status: 200 len: 581 microversion: 2.1 time: 0.092149 Oct 31 15:14:43.221231 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 45/120] 10.222.0.48 () {58 vars in 1174 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/os-services?host=n-d-858383-17 => generated 581 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:43.223116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.225481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.226405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.237052 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-682ef3aa-20aa-4bb4-a6c2-5103a5b89000 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.620888 Oct 31 15:14:43.238028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.245146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.245146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.248239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.251566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.252792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.256075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.257691 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 76/121] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:43.284135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Calling method '.version_select at 0x7f5ca3042b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.286595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.287272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.287871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.330406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.331118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.331731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.335203 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-29cdfc54-93e9-4ba9-bfc4-e1039a50127b tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 404 microversion: 2.1 time: 0.102724 Oct 31 15:14:43.339221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 46/122] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:43.352480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.356545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.360536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.361327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.363808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.364428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.365173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.402027 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4f79bd94-a0d6-4bd0-9b01-9aa9fc06d4e1 tempest-ServicesAdminTestJSON-1648277816 tempest-ServicesAdminTestJSON-1648277816-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 971 microversion: 2.1 time: 0.053426 Oct 31 15:14:43.411850 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 47/123] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/os-services => generated 971 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:43.444204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.447911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.448363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.456274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5996f2d-c39b-4af0-88d9-6bfb658dfde8 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h2-858383-17/servers" status: 200 len: 197 microversion: 2.1 time: 0.197287 Oct 31 15:14:43.457215 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 77/124] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-17/servers => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:43.473775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Calling method '.version_select at 0x7f5ca33533a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.475689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.476310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.477164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.507663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.508907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.510954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.539118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.539900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.540554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.550344 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0489a2f0-ba31-4730-87e7-f0363149c16b tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.080253 Oct 31 15:14:43.558185 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 48/125] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:14:43.563982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Calling method '.version_select at 0x7f5ca3042790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.566162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.566947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.567735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.584343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.585157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.585737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.594738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1116c42-d3ac-4a21-8cad-935cf5071ed1 tempest-HypervisorAdminUnderV252Test-1435081150 tempest-HypervisorAdminUnderV252Test-1435081150-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h2-858383-17/search" status: 200 len: 105 microversion: 2.1 time: 0.035478 Oct 31 15:14:43.603092 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 78/126] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-17/search => generated 105 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:43.643127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:43.644884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:43.666639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.670203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.671769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.674982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:43.675714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:43.677695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:43.829516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:43.843751 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d86b4161-4ff8-4a3a-9fb0-62018cf5b0ed tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1297 microversion: 2.1 time: 0.202011 Oct 31 15:14:43.845933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 49/127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:43 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1297 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:44.152348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:44.153062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:44.168396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:44.169367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:44.170024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:44.171495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:44.172614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:44.173260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:44.347070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:44.361704 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb5c6abe-984b-428b-a604-8d5af22a9014 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1278 microversion: 2.1 time: 0.216233 Oct 31 15:14:44.364310 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 79/128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:44 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:44.881562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:44.882490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:44.908888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:44.909790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:44.911581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:44.914029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:44.916711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:44.917448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:45.389054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:45.391539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:45.404911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:45.418616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:45.419988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:45.426039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:45.427788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:45.428933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:45.511813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:45.526743 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d43155d-cf3a-4f56-a916-89d46fb914b3 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.656902 Oct 31 15:14:45.529752 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 50/129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:44 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:45.968767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:45.985187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5632ed04-e9ee-4165-8259-f2b41868d127 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1278 microversion: 2.1 time: 0.597667 Oct 31 15:14:46.003523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 80/130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:45 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1278 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:46.553783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:46.554385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:46.566381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:46.567052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:46.567540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:46.568277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:46.573431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:46.574097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:46.652457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00f3786f-c377-44b0-bc16-30a5dd9d6e7a tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-718462132", "id": 591848486, "os-flavor-access:is_public": "False"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:46.699853 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00f3786f-c377-44b0-bc16-30a5dd9d6e7a tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.891492 Oct 31 15:14:46.713098 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 51/131] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:45 2022] POST /compute/v2.1/flavors => generated 427 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:46.731394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52f6aae9-b4be-45e4-9021-f053227612a4 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "141b76e29c5c497485ecfb1ed072f5ef"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:46.960655 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52f6aae9-b4be-45e4-9021-f053227612a4 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/591848486/action" status: 200 len: 96 microversion: 2.1 time: 0.243569 Oct 31 15:14:46.962864 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 52/132] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Oct 31 15:14:46 2022] POST /compute/v2.1/flavors/591848486/action => generated 96 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:14:47.077510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:47.095221 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7ea040b-85df-459d-8818-6b96d69d0adc tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.545605 Oct 31 15:14:47.098981 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 81/133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:46 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:47.131054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:47.131842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:47.141757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:47.144387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:47.146213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:47.149126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:47.151455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:47.153262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:47.441120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4d95758-a346-4ee6-a7ca-d7a199f95609 tempest-FlavorsAccessTestJSON-1803660186 tempest-FlavorsAccessTestJSON-1803660186-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:47.490755 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4d95758-a346-4ee6-a7ca-d7a199f95609 tempest-FlavorsAccessTestJSON-1803660186 tempest-FlavorsAccessTestJSON-1803660186-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.520319 Oct 31 15:14:47.501055 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 53/134] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:46 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:47.512757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:47.514568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8c1af563-a3bd-4b49-9069-04a15a0ef5d6 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "141b76e29c5c497485ecfb1ed072f5ef"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:47.530930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1e2b061-6807-4a0a-92dc-17c535b62849 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.427978 Oct 31 15:14:47.532044 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 82/135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:47 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:48.128682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:48.130145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:48.139846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:48.142132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:48.145861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:48.147681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:48.149523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:48.150770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:48.758559 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8c1af563-a3bd-4b49-9069-04a15a0ef5d6 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/591848486/action" status: 200 len: 21 microversion: 2.1 time: 1.249083 Oct 31 15:14:48.767253 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 54/136] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Oct 31 15:14:47 2022] POST /compute/v2.1/flavors/591848486/action => generated 21 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:14:48.777556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:48.778396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:48.784813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=7,nova_api:INSERT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:48.803382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:48.807026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:48.807594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:48.808900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:48.809462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:48.812086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.133096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:49.147595 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1eb4a62-17c3-4c10-a331-285d6bd5bd7d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 1.025215 Oct 31 15:14:49.164910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 83/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:48 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:49.170142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-947c0c53-bffe-4f46-850f-2082f36435d8 tempest-FlavorsAccessTestJSON-1803660186 tempest-FlavorsAccessTestJSON-1803660186-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:49.200573 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-947c0c53-bffe-4f46-850f-2082f36435d8 tempest-FlavorsAccessTestJSON-1803660186 tempest-FlavorsAccessTestJSON-1803660186-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034169 Oct 31 15:14:49.209949 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 84/138] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:49.714236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:49.735209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bda35d0-9026-4053-865d-9c59ad70e053 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.959984 Oct 31 15:14:49.737084 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 55/139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:48 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:49.755571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f58c6d32-b479-45dd-8ef9-81635f94dea0 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:49.802263 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f58c6d32-b479-45dd-8ef9-81635f94dea0 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/591848486" status: 202 len: 0 microversion: 2.1 time: 0.060781 Oct 31 15:14:49.804447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65be82c3-f36a-43bc-9357-f0898994c466", "tag": "ec06af38-1ce3-4f5a-a45a-62f59304d41e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:49.805146 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 56/140] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:14:49 2022] DELETE /compute/v2.1/flavors/591848486 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:49.820061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78ba5d57-fe12-43a0-a690-0e4aa71a51a0 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:49.843813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:49.848387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:49.849567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.871238 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78ba5d57-fe12-43a0-a690-0e4aa71a51a0 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061557 Oct 31 15:14:49.872594 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 57/141] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:49.901721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Creating event network-changed:ec06af38-1ce3-4f5a-a45a-62f59304d41e for instance 65be82c3-f36a-43bc-9357-f0898994c466 on n-h2-858383-17 Oct 31 15:14:49.902673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:14:49.904053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9e76003-e5a0-4033-9945-9920d28f2953 req-461261c1-5874-4641-a3b7-e561109ad3b8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:14:49.907056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:49.909880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:49.911837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.913216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:49.914649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:49.915361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:49.920349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8fc6a5f6-6e3e-4a96-9a42-3097ba5281e6 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1015877384", "id": 980004590, "os-flavor-access:is_public": "False"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:49.943494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.compute.rpcapi [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 31 15:14:49.948317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] Releasing lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:14:49.978000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8fc6a5f6-6e3e-4a96-9a42-3097ba5281e6 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.082111 Oct 31 15:14:49.979084 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 58/142] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:14:49 2022] POST /compute/v2.1/flavors => generated 428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:49.993431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f781eb3-f302-4ddd-831f-965d90a0145b tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:49.994500 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-873edb8e-0cc6-402f-939c-4a52df18e4eb None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.781684 Oct 31 15:14:49.995203 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 85/143] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:50.041988 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f781eb3-f302-4ddd-831f-965d90a0145b tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/980004590/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.051941 Oct 31 15:14:50.046974 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 59/144] 10.222.0.48 () {58 vars in 1206 bytes} [Mon Oct 31 15:14:49 2022] GET /compute/v2.1/flavors/980004590/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:14:50.058363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a10e533c-669d-416c-8ae2-95990fb810e5 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:50.063079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:50.097861 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a10e533c-669d-416c-8ae2-95990fb810e5 tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/980004590" status: 202 len: 0 microversion: 2.1 time: 0.044648 Oct 31 15:14:50.099053 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 86/145] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:14:50 2022] DELETE /compute/v2.1/flavors/980004590 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:14:50.107544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ab60141-3615-4bba-91dd-c4b068117ffe tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:50.157219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ab60141-3615-4bba-91dd-c4b068117ffe tempest-FlavorsAccessTestJSON-309235470 tempest-FlavorsAccessTestJSON-309235470-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053156 Oct 31 15:14:50.158350 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 60/146] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:14:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:50.193525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:50.194886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:50.201465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:50.205489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:50.206130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:50.207852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:50.208553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:50.216877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:50.769227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:50.770388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:50.801647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:50.809350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:50.810416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:50.813152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:50.813848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:50.814359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:51.089756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:51.118933 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5fdb75ff-ee68-48ee-b1b5-33e03fadc87a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.945596 Oct 31 15:14:51.144973 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 87/147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:50 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:51.295132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:51.314615 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1a050f2a-69ac-40c5-b90e-949238b34736 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.551151 Oct 31 15:14:51.332807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 61/148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:50 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:52.143494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f78be50b-bb29-4e6c-95a6-234c9cc51e80 req-31381879-0d9f-417f-ab04-e393610db077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39bdd042-06d6-4246-bd3b-2c46f8bc0aae", "tag": "3031d493-51a0-4ae9-ac48-a9238fa75913"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:14:52.149020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:52.149974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:52.165915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:52.168319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f78be50b-bb29-4e6c-95a6-234c9cc51e80 req-31381879-0d9f-417f-ab04-e393610db077 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.172457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f78be50b-bb29-4e6c-95a6-234c9cc51e80 req-31381879-0d9f-417f-ab04-e393610db077 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.173300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f78be50b-bb29-4e6c-95a6-234c9cc51e80 req-31381879-0d9f-417f-ab04-e393610db077 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:52.178672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:52.189507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.190150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.190652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:52.191522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.192036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f78be50b-bb29-4e6c-95a6-234c9cc51e80 req-31381879-0d9f-417f-ab04-e393610db077 service nova] Creating event network-changed:3031d493-51a0-4ae9-ac48-a9238fa75913 for instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae on n-h1-858383-17 Oct 31 15:14:52.192146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.192576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:52.199969 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f78be50b-bb29-4e6c-95a6-234c9cc51e80 req-31381879-0d9f-417f-ab04-e393610db077 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064651 Oct 31 15:14:52.201500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 88/149] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:52.511766 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2918ec5d-b168-4afc-986b-ead204efb176 tempest-TenantUsagesNegativeTestJSON-2083670590 tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-30T15%3A14%3A52.140078&end=2022-11-01T15%3A14%3A52.140078" status: 404 len: 112 microversion: - time: 0.308615 Oct 31 15:14:52.522911 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 89/150] 10.222.0.48 () {58 vars in 1316 bytes} [Mon Oct 31 15:14:52 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-30T15%3A14%3A52.140078&end=2022-11-01T15%3A14%3A52.140078 => generated 112 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:14:52.538633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:52.541671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:52.558345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.559233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.559971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:52.561721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:52.564259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:52.565108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:53.381291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=16 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:53.599061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:53.612258 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-647df465-ffed-41ed-a8a3-e97c7bc14113 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 1.080083 Oct 31 15:14:53.614677 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 90/151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:52 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:53.629572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb1c68e0-c052-4686-b9dd-d6abb1fe33d8 tempest-TenantUsagesNegativeTestJSON-2083670590 tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin] Calling method '.version_select at 0x7f5ca2f39ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:53.650449 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-fb1c68e0-c052-4686-b9dd-d6abb1fe33d8 tempest-TenantUsagesNegativeTestJSON-2083670590 tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 31 15:14:53.655443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb1c68e0-c052-4686-b9dd-d6abb1fe33d8 tempest-TenantUsagesNegativeTestJSON-2083670590 tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin] Request method failure captured: Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-simple-tenant-usage/92af85e8bc9a4cc09d4641798d16c1c7?start=2022-11-01T15%3A14%3A52.140078&end=2022-10-30T15%3A14%3A52.140078 HTTP/1.1 Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Zrl-jtk5kgbtTbj2T_dfXJ3LYiD7YKOfNdFlb59EriIPBHS3TjKXy_fZHC1ZpgazVS4Gb-KGLo_GdKlQIwSRAtWYm5dz-z8F-mBPlXSb9pAAG9fGWJ90_5WestBZm8gTX4bR_eFCnuahm5QKC_Z2ZbZRJDdcES_qAD-rLGyF-xLpw Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c82aa4744b64d95970cfb833e551937 Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2083670590 Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:14:53.660647 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c82aa4744b64d95970cfb833e551937"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c82aa4744b64d95970cfb833e551937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c82aa4744b64d95970cfb833e551937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c82aa4744b64d95970cfb833e551937"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2083670590 Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c82aa4744b64d95970cfb833e551937 Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2083670590 Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: dd834d54b0cd449195d22116ce5f85fe Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid start time. The start time cannot occur after the end time. Oct 31 15:14:53.662220 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '92af85e8bc9a4cc09d4641798d16c1c7'} Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:14:53.663094 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb1c68e0-c052-4686-b9dd-d6abb1fe33d8 tempest-TenantUsagesNegativeTestJSON-2083670590 tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:53.664235 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb1c68e0-c052-4686-b9dd-d6abb1fe33d8 tempest-TenantUsagesNegativeTestJSON-2083670590 tempest-TenantUsagesNegativeTestJSON-2083670590-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/92af85e8bc9a4cc09d4641798d16c1c7?start=2022-11-01T15%3A14%3A52.140078&end=2022-10-30T15%3A14%3A52.140078" status: 400 len: 111 microversion: 2.1 time: 0.046982 Oct 31 15:14:53.664994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 91/152] 10.222.0.48 () {58 vars in 1412 bytes} [Mon Oct 31 15:14:53 2022] GET /compute/v2.1/os-simple-tenant-usage/92af85e8bc9a4cc09d4641798d16c1c7?start=2022-11-01T15%3A14%3A52.140078&end=2022-10-30T15%3A14%3A52.140078 => generated 111 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:14:53.678690 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73b4617d-a929-46c7-a28f-e0606dafeb57 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 1.528751 Oct 31 15:14:53.698372 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 62/153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:52 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:14:54.066693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6060cc9a-913c-4254-bbf0-c028b9772243 tempest-TenantUsagesNegativeTestJSON-1474161157 tempest-TenantUsagesNegativeTestJSON-1474161157-project] Calling method '.version_select at 0x7f5ca2f1e790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:54.073457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6060cc9a-913c-4254-bbf0-c028b9772243 tempest-TenantUsagesNegativeTestJSON-1474161157 tempest-TenantUsagesNegativeTestJSON-1474161157-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e5cac8a05b954063b65498498123f626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92af85e8bc9a4cc09d4641798d16c1c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6060cc9a-913c-4254-bbf0-c028b9772243 tempest-TenantUsagesNegativeTestJSON-1474161157 tempest-TenantUsagesNegativeTestJSON-1474161157-project] Request method failure captured: Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A14%3A52.140078&end=2022-11-01T15%3A14%3A52.140078&detailed=1 HTTP/1.1 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Zq1lGCIIb-eLpz-IUTPNDpZevkCiZ2Y99wkSnBKrpv1jQovKy3aPDHLL1J7KcGdkMBMsqPke5n49W3cS46lgcHky52CJaYL1jTnBGs-FVY_A1khpvTEHEmwqVwVXarLI2ZIsE62FKRpy7sUlZvLUh7Dhjg0QTS60vu86DAxf5scW4 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 92af85e8bc9a4cc09d4641798d16c1c7 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1474161157 Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:14:54.075796 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92af85e8bc9a4cc09d4641798d16c1c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92af85e8bc9a4cc09d4641798d16c1c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92af85e8bc9a4cc09d4641798d16c1c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92af85e8bc9a4cc09d4641798d16c1c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1474161157 Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 92af85e8bc9a4cc09d4641798d16c1c7 Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1474161157 Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TenantUsagesNegativeTestJSON-1474161157-project Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: e5cac8a05b954063b65498498123f626 Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1474161157-project Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:14:54.077618 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:14:54.078301 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:14:54.079355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:14:54.081530 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 15:14:54.081530 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:14:54.082693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6060cc9a-913c-4254-bbf0-c028b9772243 tempest-TenantUsagesNegativeTestJSON-1474161157 tempest-TenantUsagesNegativeTestJSON-1474161157-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:14:54.084227 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6060cc9a-913c-4254-bbf0-c028b9772243 tempest-TenantUsagesNegativeTestJSON-1474161157 tempest-TenantUsagesNegativeTestJSON-1474161157-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A14%3A52.140078&end=2022-11-01T15%3A14%3A52.140078&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.410403 Oct 31 15:14:54.101850 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 92/154] 10.222.0.48 () {58 vars in 1335 bytes} [Mon Oct 31 15:14:53 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A14%3A52.140078&end=2022-11-01T15%3A14%3A52.140078&detailed=1 => generated 123 bytes in 428 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:54.642358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:54.643095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:54.656644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:54.657162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:54.657663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:54.658463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:54.658969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:54.659479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:54.711225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:54.712082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:54.732188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:54.735254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:54.738110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:54.740866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:54.744181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:54.746763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:54.828557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:55.714688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:55.730071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:55.732259 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-29fbd10b-3217-4591-b1f1-626bfd521b9f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 1.094819 Oct 31 15:14:55.737279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 63/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:54 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:55.761544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eebeed2d-e93a-4bc9-9cd6-7c695e707e95 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 1.055209 Oct 31 15:14:55.762697 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 93/156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:54 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:56.774667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:56.776168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:56.791254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:56.792158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:56.809076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:56.812191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:56.812798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:56.814954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:56.815763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:56.818121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:56.818874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:56.823345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:56.824191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:56.827601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:56.827891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:56.832598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:57.684024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:57.693705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f37a9ad3-b8a7-4afc-856f-723d87229534 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.923482 Oct 31 15:14:57.694337 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 64/157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:56 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:58.645870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:14:58.674623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0008d2e-9062-41e7-a172-3c99f83953df tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 1.882740 Oct 31 15:14:58.699577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 94/158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:56 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:58.721900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:58.722635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:58.747969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:58.749989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:58.750581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:58.752589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:58.753216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:58.753768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:59.703882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:59.704485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:14:59.722377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:59.722893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:59.729283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:59.730120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:59.730609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:59.740689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:59.934213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:00.187575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:00.197731 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8995f8db-522c-4272-9874-3c045f49d800 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 1.480861 Oct 31 15:15:00.203830 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 65/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:58 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:01.011187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5776e8f9-297e-482c-830c-d0488ee6d32e tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-147351772", "id": 910409882, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:01.081857 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5776e8f9-297e-482c-830c-d0488ee6d32e tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.435349 Oct 31 15:15:01.082536 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 66/160] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:15:00 2022] POST /compute/v2.1/flavors => generated 467 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:01.098875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78bdbfaf-2e38-4d2a-9c2a-3897d0e90a70 tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:01.256356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:01.267262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5f4e751-b397-437b-8df7-9377c0d501f5 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 1.567603 Oct 31 15:15:01.267867 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 95/161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:14:59 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:01.289794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:01.290418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:01.336855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:01.337382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:01.337827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:01.338555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:01.339017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:01.339452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:01.750505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78bdbfaf-2e38-4d2a-9c2a-3897d0e90a70 tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/910409882/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.653866 Oct 31 15:15:01.753600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 67/162] 10.222.0.48 () {62 vars in 1262 bytes} [Mon Oct 31 15:15:01 2022] POST /compute/v2.1/flavors/910409882/os-extra_specs => generated 62 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:01.766102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e6bb87f-978d-4375-9571-6b7d85549336 tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:01.857290 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e6bb87f-978d-4375-9571-6b7d85549336 tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/910409882" status: 202 len: 0 microversion: 2.86 time: 0.098291 Oct 31 15:15:01.858969 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 68/163] 10.222.0.48 () {60 vars in 1199 bytes} [Mon Oct 31 15:15:01 2022] DELETE /compute/v2.1/flavors/910409882 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:15:01.867876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8bf2f43a-25b7-4124-8a68-03fbb958bcf9 tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:01.947872 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8bf2f43a-25b7-4124-8a68-03fbb958bcf9 tempest-FlavorMetadataValidation-1719564190 tempest-FlavorMetadataValidation-1719564190-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.084373 Oct 31 15:15:01.949840 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 69/164] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:15:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:15:02.297671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:02.298240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:02.320950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:02.321564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:02.322022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:02.322764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:02.323231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:02.323658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:02.347332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:02.360506 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d1d7f95-d551-48a3-b435-717c6eead976 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 1.078437 Oct 31 15:15:02.360506 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 96/165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:01 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:02.682069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:02.702256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:02.716095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bfcbcffc-523a-4699-a353-f7d95731beae tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.424139 Oct 31 15:15:02.719851 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 70/166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:02 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:03.139314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1286145308", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:03.215863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:03.383304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:03.383927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:03.391409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:03.396166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:03.402707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:03.403675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:03.404529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:03.405397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:03.980005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:03.991048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b61226e7-1519-49ac-9960-5bd2b83994ff tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.611522 Oct 31 15:15:03.997465 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 71/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:03 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:04.006232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:04.007081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:04.023925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:04.024832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:04.026820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:04.027442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:04.027950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:04.028387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:04.028819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:04.029207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:04.029352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:04.031128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:04.032139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:04.050009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:04.050496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:04.050931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:04.051706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:04.052201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:04.053091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:04.082571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Getting quotas for project 8bac2d5104974de8961402403f40e257. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:04.088768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Getting quotas for user 4fdcccbb6840445290ea2e578488e759 and project 8bac2d5104974de8961402403f40e257. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:04.106588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:15:04.110240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:15:04.194792 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdfac771-615d-4473-90a7-cf1b7a411fc5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422363 Oct 31 15:15:04.197969 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 97/168] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:15:04.210472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69c876cd-ca35-45b7-bb96-e1e75b2b43fa tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:04.211657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69c876cd-ca35-45b7-bb96-e1e75b2b43fa tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:04.661430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69c876cd-ca35-45b7-bb96-e1e75b2b43fa tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:04.690287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69c876cd-ca35-45b7-bb96-e1e75b2b43fa tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1217 microversion: 2.1 time: 0.484086 Oct 31 15:15:04.691107 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 98/169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:04 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1217 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:04.867310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:04.883162 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7b43c66b-28b8-412b-b7ac-1dcebe391510 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.880872 Oct 31 15:15:04.902538 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 72/170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:03 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:05.024486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:05.025405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:05.034606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.042390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.043621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:05.044539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.045952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.046695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:05.389876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:05.403539 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e106428-683f-4171-8d68-e4041e4d0f3d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.383373 Oct 31 15:15:05.405288 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 99/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:05 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:05.714870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:05.720023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:05.734985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.735734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.736352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:05.737312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.737773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.738202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:05.913760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:05.914547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:05.916336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:05.934289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c1c1a4f-fc4a-4895-b577-35b15f968fef tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1221 microversion: 2.1 time: 0.221473 Oct 31 15:15:05.938216 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 73/172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:05 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:05.949675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.951941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.952613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:05.953622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:05.960368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:05.960846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:06.320893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:06.329100 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f8e69bc-59d8-4ee5-ae06-b97a1a172f1a tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.419798 Oct 31 15:15:06.329685 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 100/173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:05 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:06.427260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:06.427865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:06.436214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:06.436654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:06.450108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:06.452940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:06.453643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:06.455356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:06.740325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:06.760239 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a370b82-222f-4119-89fd-cb1f236c0d20 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.336285 Oct 31 15:15:06.773745 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 74/174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:06 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:06.967784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:06.972684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:07.021102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.022728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.023546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.024420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.025188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.025831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.199632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:07.208649 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccd123f7-1f21-4a3c-b184-3f0ec53a9b18 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1287 microversion: 2.1 time: 0.247300 Oct 31 15:15:07.231352 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 101/175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:06 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1287 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:07.357380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:07.358710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:07.368386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.371031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.371756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.373819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.376382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.376880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.787448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:07.788668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:07.795899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.796838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.797437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:07.798417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:07.799111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:07.799775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:08.242105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:08.255730 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bfc164d9-3ab4-40fe-9dfd-88f6af843644 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.902907 Oct 31 15:15:08.259603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 75/176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:07 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:08.276613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:08.282128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:08.289893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:08.290385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:08.297438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:08.298282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:08.298771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:08.307563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:08.483322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:08.495816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2e90669-d2ea-4bb4-8262-decbdeaf1ae7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1275 microversion: 2.1 time: 0.234767 Oct 31 15:15:08.496404 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 76/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:08 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:08.566012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:08.579790 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bcbd2b59-379b-4da7-82ec-17a50702fdac tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.797466 Oct 31 15:15:08.581282 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 102/178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:07 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:09.249548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Calling method '.version_select at 0x7f5ca32408b0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:09.251892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.252541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.253186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.284997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:09.286402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:09.302730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.303605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.304720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.305372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.306115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.306727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.307592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.308230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.308934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.332197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.334571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.336614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.366136 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41a69ce8-9317-4296-814e-650994d8d88d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.399429 Oct 31 15:15:09.374446 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 77/179] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:15:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:09.565688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f02708f-942b-4b1b-ba2e-382943ee8022 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Calling method '.version_select at 0x7f5ca31f4ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:09.567797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f02708f-942b-4b1b-ba2e-382943ee8022 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '91f7c230e5c74ce58682784a4b2f6a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd85f92af0479092d0b62afab42d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f02708f-942b-4b1b-ba2e-382943ee8022 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Request method failure captured: Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hypervisors/n-h2-858383-17/search HTTP/1.1 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z74UGCmqQernxMzlf3bZ4izF4UdHbwBQLDAQIBhYlRn-iOHGF1GXZQMfIlGRA5UdJSxNmiuJTHdKvpXR6TZ7Tt1qJqQ2q_qqo0T1JGU46xOWxouqzIrJAHB_2j4RWxh9mO_2t85VdCDj22oJu3RhjBfW9FF-5vxNhS9aVAd6mT2n4 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 84cd85f92af0479092d0b62afab42d76 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1404382751 Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:09.569867 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84cd85f92af0479092d0b62afab42d76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84cd85f92af0479092d0b62afab42d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84cd85f92af0479092d0b62afab42d76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84cd85f92af0479092d0b62afab42d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1404382751 Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 84cd85f92af0479092d0b62afab42d76 Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1404382751 Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 91f7c230e5c74ce58682784a4b2f6a8c Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 15:15:09.571183 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'n-h2-858383-17'} Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:09.571992 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 15:15:09.574009 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:09.575219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f02708f-942b-4b1b-ba2e-382943ee8022 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:09.575219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f02708f-942b-4b1b-ba2e-382943ee8022 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h2-858383-17/search" status: 403 len: 117 microversion: 2.1 time: 0.195247 Oct 31 15:15:09.575219 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 78/180] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Oct 31 15:15:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-17/search => generated 117 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:15:09.588724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:09.589380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:09.602648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.603145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.603585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.605219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.605969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.606569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.670976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:09.684617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27a4497b-252c-46d3-a314-b2c9f180f50e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.403173 Oct 31 15:15:09.686531 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 103/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:09 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:09.695863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Calling method '.version_select at 0x7f5ca3ce89d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:09.700254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.700841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.704905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.726921 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Request method failure captured: Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Z87v67bM-sQ0A1X6YwanOXm9CbHdSXAYFV9v9JZsn3H6eSLbe5N3w6618lpP5ypBfoLgiB68WKBuA28QGIo_MDdqMvG9RVHXQKUmp1F2oOPzDwXVwR5gqMsR6SBcxvrk-eY5lTkj9-bvT6PRlLjYgGfdBjixIJp4FTq8Qn6xvdopA Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9fd7c2a5ee8a4255851584e9ac5bf837 Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-815146795 Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:09.731316 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-815146795 Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9fd7c2a5ee8a4255851584e9ac5bf837 Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-815146795 Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8246d6abc13444d38453cd5a341aad63 Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:15:09.733304 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:09.733966 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:09.734992 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:09.734992 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:09.734992 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:09.734992 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:15:09.734992 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:09.737367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:09.739736 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b65cd2a9-0310-465f-9bbb-23fe1576b37d tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.052073 Oct 31 15:15:09.753575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 104/182] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:15:09 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:09.761830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:09.763185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:09.776648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.777233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.777673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:09.778389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:09.779751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:09.783080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:10.250077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:10.264519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f337f4e9-90ad-48dc-a2bf-f22c0463d328 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.691402 Oct 31 15:15:10.284422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 79/183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:09 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:10.289723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Calling method '.version_select at 0x7f5ca31f4f70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:10.291578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:10.292121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:10.292776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:10.308295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:10.309127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:10.309752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:10.322854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:10.323670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:10.324444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:10.332365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bb648cb-3d93-4efd-b9bc-163593ec77de tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.046382 Oct 31 15:15:10.340677 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 80/184] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:15:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:10.347093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d553d08-2e8d-446a-9048-fa4bf452e3c6 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Calling method '.version_select at 0x7f5ca32409d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:10.350016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d553d08-2e8d-446a-9048-fa4bf452e3c6 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '91f7c230e5c74ce58682784a4b2f6a8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84cd85f92af0479092d0b62afab42d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d553d08-2e8d-446a-9048-fa4bf452e3c6 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Request method failure captured: Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z74UGCmqQernxMzlf3bZ4izF4UdHbwBQLDAQIBhYlRn-iOHGF1GXZQMfIlGRA5UdJSxNmiuJTHdKvpXR6TZ7Tt1qJqQ2q_qqo0T1JGU46xOWxouqzIrJAHB_2j4RWxh9mO_2t85VdCDj22oJu3RhjBfW9FF-5vxNhS9aVAd6mT2n4 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 84cd85f92af0479092d0b62afab42d76 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1404382751 Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:10.352092 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84cd85f92af0479092d0b62afab42d76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84cd85f92af0479092d0b62afab42d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84cd85f92af0479092d0b62afab42d76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84cd85f92af0479092d0b62afab42d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1404382751 Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 84cd85f92af0479092d0b62afab42d76 Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1404382751 Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 91f7c230e5c74ce58682784a4b2f6a8c Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 15:15:10.353229 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1'} Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:10.353857 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 15:15:10.354791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:10.358220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d553d08-2e8d-446a-9048-fa4bf452e3c6 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:10.359325 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d553d08-2e8d-446a-9048-fa4bf452e3c6 tempest-HypervisorAdminNegativeUnderV252Test-1404382751 tempest-HypervisorAdminNegativeUnderV252Test-1404382751-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016471 Oct 31 15:15:10.364901 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 81/185] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:15:10 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:10.372266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Calling method '.version_select at 0x7f5ca3278a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:10.374640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:10.375191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:10.375814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:10.391354 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] HTTP exception thrown: No hypervisor matching '86eb337f-62d6-4acf-a835-59ff9725c331' could be found. Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Request method failure captured: Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hypervisors/86eb337f-62d6-4acf-a835-59ff9725c331/servers HTTP/1.1 Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z87v67bM-sQ0A1X6YwanOXm9CbHdSXAYFV9v9JZsn3H6eSLbe5N3w6618lpP5ypBfoLgiB68WKBuA28QGIo_MDdqMvG9RVHXQKUmp1F2oOPzDwXVwR5gqMsR6SBcxvrk-eY5lTkj9-bvT6PRlLjYgGfdBjixIJp4FTq8Qn6xvdopA Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9fd7c2a5ee8a4255851584e9ac5bf837 Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-815146795 Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:15:10.392867 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd7c2a5ee8a4255851584e9ac5bf837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-815146795 Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9fd7c2a5ee8a4255851584e9ac5bf837 Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-815146795 Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8246d6abc13444d38453cd5a341aad63 Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: exception: No hypervisor matching '86eb337f-62d6-4acf-a835-59ff9725c331' could be found. Oct 31 15:15:10.394135 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '86eb337f-62d6-4acf-a835-59ff9725c331'} Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '86eb337f-62d6-4acf-a835-59ff9725c331' could be found. Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:10.395202 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '86eb337f-62d6-4acf-a835-59ff9725c331' could be found. Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] Returning 404 to user: No hypervisor matching '86eb337f-62d6-4acf-a835-59ff9725c331' could be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:10.396492 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d973b2b-025c-4b16-ba70-5e8ba599db86 tempest-HypervisorAdminNegativeUnderV252Test-815146795 tempest-HypervisorAdminNegativeUnderV252Test-815146795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/86eb337f-62d6-4acf-a835-59ff9725c331/servers" status: 404 len: 123 microversion: 2.1 time: 0.028080 Oct 31 15:15:10.400864 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 82/186] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Oct 31 15:15:10 2022] GET /compute/v2.1/os-hypervisors/86eb337f-62d6-4acf-a835-59ff9725c331/servers => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:10.453630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:10.466187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-734ee979-981b-41aa-8cbd-bb40862873a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.709766 Oct 31 15:15:10.469389 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 105/187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:09 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:10.713322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:10.714108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:10.724307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:10.724750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:10.725158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:10.725959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:10.726410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:10.726828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:11.073350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:11.086326 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-676de969-decc-448b-a0be-afac305a18b8 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.380560 Oct 31 15:15:11.088525 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 83/188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:10 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:11.291941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:11.293548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:11.305720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:11.308786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:11.309835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:11.314144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:11.316209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:11.316954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:11.486510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6ea33cb-c759-4081-9639-7f6aacf3cb6e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:11.496297 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6ea33cb-c759-4081-9639-7f6aacf3cb6e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.316384 Oct 31 15:15:11.499224 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 106/189] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:15:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:11.511096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:11.511713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:11.519473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:11.519970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:11.520513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:11.521274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:11.521732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:11.522279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.016461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:12.029815 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-805445fe-7419-4d97-91e6-cd6b3f033230 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.528962 Oct 31 15:15:12.030711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 107/190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:11 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:12.122738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de0dc670-d4a5-48db-a4da-f343940aff7b tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1318919137", "id": 686017506, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:12.159217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de0dc670-d4a5-48db-a4da-f343940aff7b tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.126119 Oct 31 15:15:12.161142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 108/191] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:12 2022] POST /compute/v2.1/flavors => generated 422 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:12.175834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:12.176106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:12.183292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:12.184058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:12.184641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.187595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:12.188466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:12.189093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.196801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:12.211267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e67ccda-436b-4599-bcc8-3a61a06e3ac0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.921094 Oct 31 15:15:12.212424 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 84/192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:11 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:12.233301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b7c7637-cc90-4f15-b1d7-5d22e27c06a1 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:12.251107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b7c7637-cc90-4f15-b1d7-5d22e27c06a1 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036325 Oct 31 15:15:12.252188 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 85/193] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Oct 31 15:15:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:12.261360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e1365f4-1b67-417a-afeb-15930907866a tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1950427367", "id": 298499287, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:12.364336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e1365f4-1b67-417a-afeb-15930907866a tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.105467 Oct 31 15:15:12.375774 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 86/194] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:12 2022] POST /compute/v2.1/flavors => generated 422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:12.385915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-473f48fc-a423-4f89-966c-e2aa9cbc05bc tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:12.407511 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-473f48fc-a423-4f89-966c-e2aa9cbc05bc tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025498 Oct 31 15:15:12.408246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 87/195] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Oct 31 15:15:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:12.421571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09c350ea-c08e-41fb-a82f-7d14de223d73 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Action: 'create', calling method: .version_select at 0x7f5ca31a29d0>, body: {"keypair": {"name": "tempest-keypair-785399804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMudxIJWkR8O+6UPzb96HMQ5wrriRX6M25+QwSqlKKC/XFOMhbGoOBEW1lmoDKT6DQ3vKByX6g7PHbkaS1BiYUBpWMfvh7JcdnUk8nKWB6KVxdvaCYQ2gZaX0Hgz6YZAg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:12.468127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-09c350ea-c08e-41fb-a82f-7d14de223d73 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Getting quotas for project e7b5e7bae2ce41279db848f24326b3ee. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:12.478172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-09c350ea-c08e-41fb-a82f-7d14de223d73 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Getting quotas for user 9b24aa0edeef4cf58c624bee5f7478fb and project e7b5e7bae2ce41279db848f24326b3ee. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:12.541022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:12.600280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:12.600828 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09c350ea-c08e-41fb-a82f-7d14de223d73 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183081 Oct 31 15:15:12.604565 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 88/196] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:15:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:12.609612 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a27542c-6166-4d1c-bafc-b31694b2bd41 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.447146 Oct 31 15:15:12.622252 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 109/197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:12 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:12.668223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-198a64f6-37be-46ae-b26a-950a0584494d req-dd42066d-cb78-4d21-8622-7cbdcfea6b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:12.688120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-198a64f6-37be-46ae-b26a-950a0584494d req-dd42066d-cb78-4d21-8622-7cbdcfea6b97 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:12.692561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-198a64f6-37be-46ae-b26a-950a0584494d req-dd42066d-cb78-4d21-8622-7cbdcfea6b97 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:12.693238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-198a64f6-37be-46ae-b26a-950a0584494d req-dd42066d-cb78-4d21-8622-7cbdcfea6b97 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.714176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-198a64f6-37be-46ae-b26a-950a0584494d req-dd42066d-cb78-4d21-8622-7cbdcfea6b97 service nova] Creating event network-changed:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:15:12.730031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-198a64f6-37be-46ae-b26a-950a0584494d req-dd42066d-cb78-4d21-8622-7cbdcfea6b97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066524 Oct 31 15:15:12.731737 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 110/198] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:12.849860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65be82c3-f36a-43bc-9357-f0898994c466", "name": "network-vif-plugged", "status": "completed", "tag": "ec06af38-1ce3-4f5a-a45a-62f59304d41e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:12.887478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:12.890150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:12.891357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.954353 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Creating event network-vif-plugged:ec06af38-1ce3-4f5a-a45a-62f59304d41e for instance 65be82c3-f36a-43bc-9357-f0898994c466 on n-h2-858383-17 Oct 31 15:15:12.957188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:15:12.958058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60a41295-dda1-4fa3-ba1e-f13d89a83b11 req-48e4cc13-6494-4064-babb-28dee23959a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:15:12.959102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:12.963322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:12.969151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.970841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:12.970967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:12.971404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:12.994987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.rpcapi [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 31 15:15:12.996490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] Releasing lock "compute-rpcapi-router" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:15:13.029628 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-70d45194-eb42-40e9-84dc-d7cf6d2da2de None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421331 Oct 31 15:15:13.036457 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 89/199] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:13.059334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:13.059962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:13.073080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:13.074936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:13.075614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:13.079742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:13.080420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:13.081914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:13.255855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:13.257263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:13.283285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:13.283831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:13.289324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:13.290412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:13.290817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:13.297218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:14.069587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:14.109121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:14.131149 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ca90b26-a76c-42c0-9220-03ace05004f1 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 1.076268 Oct 31 15:15:14.132731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:14.141671 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08bfb8da-67e7-4019-a86d-a6692b95a8d2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.903513 Oct 31 15:15:14.147031 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 90/200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:13 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:14.150316 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 111/201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:13 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:14.161774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:14.162534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:14.178331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:14.178811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:14.179813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:14.187597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:14.188093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:14.188722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:14.646925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:14.663208 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fae993f5-c0a1-4aaa-8af7-a4d5bcabe1b6 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.513982 Oct 31 15:15:14.663907 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 91/202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:14 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:15.158062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:15.158688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:15.195636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-020412be-cac5-4323-9639-5aa8fe6d40c8 req-924022ba-3713-47c9-837e-27caed060c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39bdd042-06d6-4246-bd3b-2c46f8bc0aae", "name": "network-vif-plugged", "status": "completed", "tag": "3031d493-51a0-4ae9-ac48-a9238fa75913"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:15.206159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:15.209260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.211364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.212412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:15.213408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.224724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.226461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:15.253222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-020412be-cac5-4323-9639-5aa8fe6d40c8 req-924022ba-3713-47c9-837e-27caed060c23 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.278654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-020412be-cac5-4323-9639-5aa8fe6d40c8 req-924022ba-3713-47c9-837e-27caed060c23 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.278654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-020412be-cac5-4323-9639-5aa8fe6d40c8 req-924022ba-3713-47c9-837e-27caed060c23 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:15.332371 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-020412be-cac5-4323-9639-5aa8fe6d40c8 req-924022ba-3713-47c9-837e-27caed060c23 service nova] Creating event network-vif-plugged:3031d493-51a0-4ae9-ac48-a9238fa75913 for instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae on n-h1-858383-17 Oct 31 15:15:15.343643 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-020412be-cac5-4323-9639-5aa8fe6d40c8 req-924022ba-3713-47c9-837e-27caed060c23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178611 Oct 31 15:15:15.350166 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 92/203] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:15.364070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:15.382122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:15.392265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.392950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.393452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:15.394231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.394893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.395518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:15.848840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:15.861602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:15.887265 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b45a3ae-b79f-4dbf-a566-d4dced32afcd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.535385 Oct 31 15:15:15.893030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 93/204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:15 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:15.893230 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03bd39d3-4d88-4332-a9ac-7e479d6b3591 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.734454 Oct 31 15:15:15.893230 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 112/205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:15 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:15.898420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1338991122", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "298499287", "adminPass": "***", "networks": [{"uuid": "ac0fcd3c-61d1-4bc0-b880-177007295db5"}], "security_groups": [{"name": "tempest-securitygroup--1639260900"}], "key_name": "tempest-keypair-785399804", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:15.902541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:15.910463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:15.918456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.919247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.921110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:15.922162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:15.923158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:15.924032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:16.233934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:16.243537 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41e847ad-7ba0-4b9a-b02c-987434f00b36 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1339 microversion: 2.1 time: 0.351002 Oct 31 15:15:16.268765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 113/206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:15 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1339 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:16.395584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] validate_networks() for [('ac0fcd3c-61d1-4bc0-b880-177007295db5', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:16.911396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:16.912221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:16.925251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:16.926865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:16.930722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:16.931589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:16.938977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:16.945225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:17.638605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:17.643932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:17.660530 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-589bbc0f-127c-41ff-842e-91a6105ef680 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.746918 Oct 31 15:15:17.663319 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 114/207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:16 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:17.668301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:17.669746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:17.697108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:17.698023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:17.698733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:17.699733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:17.700414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:17.701200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:18.206219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:18.219905 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5064045a-1a2b-4eb5-9943-1e67828443b2 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.550900 Oct 31 15:15:18.238077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 115/208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:17 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:18.243391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:18.243868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:18.270158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:18.271468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:18.274669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:18.276295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:18.279375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:18.280310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:18.711257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:18.714516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:18.715222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:18.715821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:18.716461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:18.732577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:18.733513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:18.734134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:18.737022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:18.737875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:18.738600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:18.783290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Getting quotas for project e7b5e7bae2ce41279db848f24326b3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:18.784474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:18.790981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Getting quotas for user 9b24aa0edeef4cf58c624bee5f7478fb and project e7b5e7bae2ce41279db848f24326b3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:18.794055 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b72f4105-f673-4564-b4a1-6424ed9c62ab tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1488 microversion: 2.1 time: 0.554559 Oct 31 15:15:18.802988 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 116/209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:18 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1488 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:18.810549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:15:18.813554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:15:18.901544 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17400be9-118f-4847-9553-a5dc49fa6af5 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.012178 Oct 31 15:15:18.902402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 94/210] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:15:18.913700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:18.914583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:18.927551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:18.928585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:18.929222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:18.931652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:18.932307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:18.932956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.071069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c41cd2cd-94f7-4a78-99ca-c83e61a822a5 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.073883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c41cd2cd-94f7-4a78-99ca-c83e61a822a5 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c41cd2cd-94f7-4a78-99ca-c83e61a822a5 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin] Request method failure captured: Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-aFD1vjRJzIEeUkYuaUWBFyiigWtJf3KZJxJZsdGi7ZtQfLW8Mxjn0_lXM0OKv4w8b0ffI2u_QEv3E87jflUocNlAm1FcZBX3H9JPhKmawTX5vXqPn629NOZxg6Amoi0RhPu7QF4fetSnIO8m_A93VMCX_d6W4lsZOO0ykN7g6W6xM Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a6e99c8f924a4ff1b034a7cae6a8d533 Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:19.082772 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6e99c8f924a4ff1b034a7cae6a8d533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e99c8f924a4ff1b034a7cae6a8d533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6e99c8f924a4ff1b034a7cae6a8d533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e99c8f924a4ff1b034a7cae6a8d533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a6e99c8f924a4ff1b034a7cae6a8d533 Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9c6863b212654cdf940cf993bb8ba95e Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:19.084417 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid timestamp for date invalid_time Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'invalid_time'} Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:19.085278 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c41cd2cd-94f7-4a78-99ca-c83e61a822a5 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:19.086571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c41cd2cd-94f7-4a78-99ca-c83e61a822a5 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524 tempest-InstanceUsageAuditLogNegativeTestJSON-1864382524-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.280315 Oct 31 15:15:19.090041 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 117/211] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:19.094587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.095203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:19.134309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:19.134810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:19.135871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.136611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:19.137582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:19.138074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.189782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:19.197216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:19.209703 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbc43e2f-cce1-4e2e-90ec-661e85f11da1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.304711 Oct 31 15:15:19.210311 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 95/212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:18 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:19.219043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1eac6f5-db11-46e8-8082-7d54d2835bb7 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.226316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e1eac6f5-db11-46e8-8082-7d54d2835bb7 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:19.351543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e1eac6f5-db11-46e8-8082-7d54d2835bb7 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:19.361647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e1eac6f5-db11-46e8-8082-7d54d2835bb7 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1262 microversion: 2.1 time: 0.149596 Oct 31 15:15:19.363548 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 96/213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:19 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:19.645602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27c4ca5b-ff22-4a20-9cdf-e5132447e223 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.647596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27c4ca5b-ff22-4a20-9cdf-e5132447e223 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5f3de79015044f4c80600b60d5eb5b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab51e3953f0544479d1ee614e5e073c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27c4ca5b-ff22-4a20-9cdf-e5132447e223 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Request method failure captured: Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-aErCIEQM-7nMnIScFd49-ahG-xTA0L3gpcZONxKdIerb8GuJL3XujDZoZGQuVwDGE2mor3ZJzf6gCN82sSYgyYow99eaX0APiJBnaFKpSCI0wmSLTZ46zScvZKprMgE1V9_33jaFZp0xalFIqgFooYRvFjGx2HkfQT-QhtWfKJ-8Q Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: ab51e3953f0544479d1ee614e5e073c0 Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:19.649499 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: ab51e3953f0544479d1ee614e5e073c0 Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 5f3de79015044f4c80600b60d5eb5b4b Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project Oct 31 15:15:19.650733 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: action_args: {} Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:19.651280 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 15:15:19.652348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.657712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27c4ca5b-ff22-4a20-9cdf-e5132447e223 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:19.657712 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27c4ca5b-ff22-4a20-9cdf-e5132447e223 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.285889 Oct 31 15:15:19.657712 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 97/214] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:15:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 289 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:19.658081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.658433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:19.668195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:19.668195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:19.668626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.669405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:19.670559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:19.670996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.705035 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-812e69f9-5bde-439e-84d4-1553d4ebe99c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1641 microversion: 2.1 time: 0.614353 Oct 31 15:15:19.715224 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 118/215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:19 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1641 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:19.729960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62f4a5c7-31c7-4717-85b1-1eb99480eb84 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.734685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-62f4a5c7-31c7-4717-85b1-1eb99480eb84 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5f3de79015044f4c80600b60d5eb5b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab51e3953f0544479d1ee614e5e073c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62f4a5c7-31c7-4717-85b1-1eb99480eb84 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Request method failure captured: Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2015:15:19 HTTP/1.1 Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-aErCIEQM-7nMnIScFd49-ahG-xTA0L3gpcZONxKdIerb8GuJL3XujDZoZGQuVwDGE2mor3ZJzf6gCN82sSYgyYow99eaX0APiJBnaFKpSCI0wmSLTZ46zScvZKprMgE1V9_33jaFZp0xalFIqgFooYRvFjGx2HkfQT-QhtWfKJ-8Q Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: ab51e3953f0544479d1ee614e5e073c0 Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:15:19.743693 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ab51e3953f0544479d1ee614e5e073c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: ab51e3953f0544479d1ee614e5e073c0 Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 5f3de79015044f4c80600b60d5eb5b4b Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project Oct 31 15:15:19.745188 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '2022-10-31 15:15:19'} Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:19.745850 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 15:15:19.747179 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:19.749346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62f4a5c7-31c7-4717-85b1-1eb99480eb84 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:19.749346 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62f4a5c7-31c7-4717-85b1-1eb99480eb84 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791 tempest-InstanceUsageAuditLogNegativeTestJSON-2029105791-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31 15:15:19" status: 403 len: 128 microversion: 2.1 time: 0.029080 Oct 31 15:15:19.749346 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 119/216] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:15:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2015%3A15%3A19 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:19.777883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:19.778386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:19.795971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:19.797652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:19.798083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.800398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:19.803105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:19.803718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:19.875219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:15:19.956786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:19.966613 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ba80796-e1a5-4ff2-ac39-e6b569c3d2f4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1320 microversion: 2.1 time: 0.312365 Oct 31 15:15:19.976748 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 98/217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:19 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:20.156565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:20.208154 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af39af46-6bfb-4669-8af8-e6336df4a8da tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 204 len: 0 microversion: 2.1 time: 0.460078 Oct 31 15:15:20.209060 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 120/218] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:15:19 2022] DELETE /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:15:20.220604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:20.221542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:20.232200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:20.232725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:20.233657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:20.235283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:20.235753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:20.236212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:20.278921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2120556089", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "635e1e0a-6ae3-43b6-936a-df7141d79dfa"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:20.362879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] validate_networks() for [('635e1e0a-6ae3-43b6-936a-df7141d79dfa', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:20.517173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:20.533557 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3e3ffdf-ea66-4ed5-a635-aba9e02cca2d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1494 microversion: 2.1 time: 0.311315 Oct 31 15:15:20.534193 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 121/219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:20 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1494 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:20.538856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:20.539464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:20.565153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:20.566270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:20.567324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:20.569535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:20.572212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:20.573897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:20.901749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:20.927151 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5799e6d-333e-4ff1-8182-e20d07cfbdfb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.381612 Oct 31 15:15:20.960918 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 122/220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:20 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:20.971320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:20.975619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:21.009552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.010213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.010795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.011525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.011915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.012335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.097404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:21.098769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:21.099573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:21.100300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:21.100972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:21.115038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:21.120839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.121459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.123672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.124591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.125455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.126508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.130919 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0023f1a4-d045-405e-9029-f9f0b9f5e659 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1280 microversion: 2.1 time: 0.168626 Oct 31 15:15:21.136571 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 123/221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:20 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:21.148971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:21.148971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:21.186608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.188576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.189174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.190987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.194812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.195507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.197629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:21.205426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for user 8c9c59f229134e1ab069e18a116ebdf2 and project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:21.237681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:15:21.239852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:15:21.396743 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e88e31ff-356d-4c92-935e-f3bd01d482d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.285850 Oct 31 15:15:21.408973 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 99/222] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:15:21.432058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-95cc659b-c86e-428c-b2c1-6a7467ff06f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:21.443404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95cc659b-c86e-428c-b2c1-6a7467ff06f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:21.598349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:21.612097 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95cf83e0-b57d-4432-b5e7-22cca0de2523 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1470 microversion: 2.1 time: 0.466251 Oct 31 15:15:21.613714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 124/223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:21 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:21.632304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:21.632964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:21.654831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.669629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.670211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.671084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:21.671563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:21.671986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:21.704085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95cc659b-c86e-428c-b2c1-6a7467ff06f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:21.715020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95cc659b-c86e-428c-b2c1-6a7467ff06f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:21.722385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95cc659b-c86e-428c-b2c1-6a7467ff06f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:21.723990 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-95cc659b-c86e-428c-b2c1-6a7467ff06f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1262 microversion: 2.25 time: 0.305180 Oct 31 15:15:21.737787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 100/224] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:21 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1262 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:22.390732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:22.392064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:22.400908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.408725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.413292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.414352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.416281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.418273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.508109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:15:22.525474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:22.536651 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ac23868-bc24-48af-9afa-d619b04aa47d tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1494 microversion: 2.1 time: 0.921657 Oct 31 15:15:22.545894 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 125/225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:21 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1494 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:22.552784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a91a5819-d9f6-4b3a-8373-717f07262835 req-f400e0bb-a639-478b-876a-845559d4f50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "name": "network-vif-plugged", "status": "completed", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:22.581496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a91a5819-d9f6-4b3a-8373-717f07262835 req-f400e0bb-a639-478b-876a-845559d4f50a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.582229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a91a5819-d9f6-4b3a-8373-717f07262835 req-f400e0bb-a639-478b-876a-845559d4f50a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.582939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a91a5819-d9f6-4b3a-8373-717f07262835 req-f400e0bb-a639-478b-876a-845559d4f50a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.617183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a91a5819-d9f6-4b3a-8373-717f07262835 req-f400e0bb-a639-478b-876a-845559d4f50a service nova] Creating event network-vif-plugged:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:15:22.626554 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a91a5819-d9f6-4b3a-8373-717f07262835 req-f400e0bb-a639-478b-876a-845559d4f50a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078342 Oct 31 15:15:22.635117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 126/226] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:22.651057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:22.652256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:22.667893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.668656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.669941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.671019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.671721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.672290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.750178 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-abbe495d-a6da-4cbd-9aa1-dc4a33145ba6 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 204 len: 0 microversion: 2.1 time: 1.010585 Oct 31 15:15:22.755913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 101/227] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:15:21 2022] DELETE /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:15:22.765584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:22.770497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:22.778827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.779525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.780124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.781319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:22.781933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:22.782513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:22.957790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:22.971344 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-486152d6-dfd1-4a5c-b2fa-b4e3f0d9272a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1342 microversion: 2.1 time: 0.213411 Oct 31 15:15:22.986372 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 102/228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:22 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:22.997479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:22.998242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:23.006368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:23.007086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:23.007698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:23.008596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:23.009235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:23.009830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:23.195759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:23.204898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:23.213486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bf598ae-e864-411b-8acf-a9189538a1f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.575514 Oct 31 15:15:23.214844 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 127/229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:22 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:23.237190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:23.241667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:23.242268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:23.245012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:23.246143 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf706b59-3991-4b7a-a8a3-87078b9fcfc7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1336 microversion: 2.25 time: 0.258638 Oct 31 15:15:23.246703 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 103/230] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:22 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1336 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:23.252739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:23.253244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:23.253814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:23.254530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:23.254985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:23.255401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:23.572969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:23.573766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:23.590883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:23.591546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:23.593186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:23.597173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:23.598001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:23.602227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:23.629270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:23.641584 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bd8cb15-48da-4049-bf78-4f55f87c290e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1476 microversion: 2.1 time: 0.409149 Oct 31 15:15:23.642177 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 128/231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:23 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:24.000859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:24.001467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:24.009719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.012869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.013490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.015112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.016593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.018370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.136308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031531300e214b66bea9d3563317712a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd00e0f8144e4e47a71b9ac4e77f292f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:24.145146 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-084cf5f0-3110-4986-8fff-211921a85855 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 200 len: 1452 microversion: 2.1 time: 0.586389 Oct 31 15:15:24.145727 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 104/232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:23 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 1452 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:24.194475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9e53dcbc-d44b-444a-8dd0-091d4f8353c1 req-1255aefc-1aef-4abe-adfd-5841d427066c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65be82c3-f36a-43bc-9357-f0898994c466", "name": "network-vif-deleted", "tag": "ec06af38-1ce3-4f5a-a45a-62f59304d41e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:24.215471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9e53dcbc-d44b-444a-8dd0-091d4f8353c1 req-1255aefc-1aef-4abe-adfd-5841d427066c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.219850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9e53dcbc-d44b-444a-8dd0-091d4f8353c1 req-1255aefc-1aef-4abe-adfd-5841d427066c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.220417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9e53dcbc-d44b-444a-8dd0-091d4f8353c1 req-1255aefc-1aef-4abe-adfd-5841d427066c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.242985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9e53dcbc-d44b-444a-8dd0-091d4f8353c1 req-1255aefc-1aef-4abe-adfd-5841d427066c service nova] Creating event network-vif-deleted:ec06af38-1ce3-4f5a-a45a-62f59304d41e for instance 65be82c3-f36a-43bc-9357-f0898994c466 on n-h2-858383-17 Oct 31 15:15:24.251402 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9e53dcbc-d44b-444a-8dd0-091d4f8353c1 req-1255aefc-1aef-4abe-adfd-5841d427066c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060863 Oct 31 15:15:24.252170 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 105/233] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:24.269883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:24.270780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:24.285317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.285585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.286007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.286702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.287151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.289196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.488214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:24.498295 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bd351fa-9814-413c-8583-cda0d4bac709 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1342 microversion: 2.1 time: 0.502134 Oct 31 15:15:24.499006 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 129/234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:23 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1342 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:24.513786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:24.514420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:24.529253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.530223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.530670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.531390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.531853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.532284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.721592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:24.736105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:24.738600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:24.740532 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35b56f8c-b608-4f39-ba3f-67f3c49d716d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1342 microversion: 2.25 time: 0.238803 Oct 31 15:15:24.743307 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 130/235] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:24 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:24.761289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:24.765777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:24.776324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.776848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.781339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.784611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:24.785551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:24.786544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:24.922491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:24.937503 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-61b17cd9-e5fe-4cd4-828e-a1c36e62959f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1317 microversion: 2.1 time: 0.678348 Oct 31 15:15:24.938696 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 106/236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:24 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:25.146887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-580dbc08-191b-4f8f-ba1a-97f03493f6a6 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Action: 'create', calling method: .version_select at 0x7f5ca3278dc0>, body: {"keypair": {"name": "tempest-keypair-1296564288", "type": "ssh", "user_id": "38c64932910b4daf98078e7555135e72", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZq90GI57HE1PcfMSlUHSza+oLCPa4fcuZejFZeRuTcWXipv26S9HExxj4ggKjtTT1PGePD0i/buRlMDQicFD6vIu0cqtgrd4N686QPGqP1LWgrI7hx0iBvRYtbwnypjg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:25.180897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-580dbc08-191b-4f8f-ba1a-97f03493f6a6 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Getting quotas for project 9453e422a6fe482383384cfe451d558c. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:25.186079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-580dbc08-191b-4f8f-ba1a-97f03493f6a6 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Getting quotas for user 79cef896a0484380a30d6e56f8d17c68 and project 9453e422a6fe482383384cfe451d558c. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:25.216453 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-580dbc08-191b-4f8f-ba1a-97f03493f6a6 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.276338 Oct 31 15:15:25.217501 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 107/237] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:15:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 278 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:15:25.241438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.242277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:25.249567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.250283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.250863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.251833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.252469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.253196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.271143 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] HTTP exception thrown: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Request method failure captured: Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 HTTP/1.1 Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZXZqFCY5A8rYv7qtS5a4sZr1naXvcHJAiX95LQ_L618KSiLOISquFlxH4vUQbotkBvcc2tB-yWDdIsuBMgqRrv08aZc-0_IZEAoNv_SOEa0412Xa2kK--e5VUdRoIQpO5ZlwXOhJkhR9U5221IkEvdUY4Wv4w6sRvCvK93HqE04J8 Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bd00e0f8144e4e47a71b9ac4e77f292f Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:25.274160 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bd00e0f8144e4e47a71b9ac4e77f292f Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminTestJSON-1622362723-project Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 031531300e214b66bea9d3563317712a Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminTestJSON-1622362723-project Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:25.275348 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '65be82c3-f36a-43bc-9357-f0898994c466'} Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:25.276001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:25.277043 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:25.281786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Returning 404 to user: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:25.282919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80744a10-f18d-44fb-aa9f-55b960fd99a4 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 404 len: 111 microversion: 2.1 time: 0.054961 Oct 31 15:15:25.285294 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 108/238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:25.298563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b84f231-72f1-4d58-85af-1c273f01b133 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Action: 'create', calling method: .version_select at 0x7f5ca3211790>, body: {"keypair": {"name": "tempest-keypair-1738030253", "type": "ssh", "user_id": "38c64932910b4daf98078e7555135e72", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHN0U9SeXsCKPzIOT4OQ2deDn7mlNgf/S/L5puZCnTrRENlZ2rdVL93/FvnBmjkAejla3vITUt7LELVS0hrMjY5Rs7mlT+I4ZFNFtzkYh5b1Lzo1oR9U/ipk5zz32BEfhw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:25.324584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-2b84f231-72f1-4d58-85af-1c273f01b133 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Getting quotas for project 9453e422a6fe482383384cfe451d558c. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:25.330934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-2b84f231-72f1-4d58-85af-1c273f01b133 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Getting quotas for user 79cef896a0484380a30d6e56f8d17c68 and project 9453e422a6fe482383384cfe451d558c. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:25.347379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:25.370582 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b84f231-72f1-4d58-85af-1c273f01b133 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.083810 Oct 31 15:15:25.371402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 109/239] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:15:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:15:25.382280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-291e0fef-7099-40cb-9280-9d91b1a0bfd8 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:25.394297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-291e0fef-7099-40cb-9280-9d91b1a0bfd8 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.394787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-291e0fef-7099-40cb-9280-9d91b1a0bfd8 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.395397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-291e0fef-7099-40cb-9280-9d91b1a0bfd8 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.480529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:25.489146 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86580c61-da39-4a9e-8c56-b4b5323afc91 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1476 microversion: 2.1 time: 0.744546 Oct 31 15:15:25.496082 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 131/240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:24 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1476 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:25.512449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b2f1ceb-1b88-49f5-b568-abb6ed59da43 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Calling method '.version_select at 0x7f5ca2f9cc10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.551480 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b2f1ceb-1b88-49f5-b568-abb6ed59da43 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1296564288?user_id=38c64932910b4daf98078e7555135e72" status: 200 len: 512 microversion: 2.10 time: 0.053913 Oct 31 15:15:25.553563 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 132/241] 10.222.0.48 () {60 vars in 1340 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1296564288?user_id=38c64932910b4daf98078e7555135e72 => generated 512 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:25.567439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.568312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:25.588328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.589025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.589598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.590430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.592351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.592549 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-291e0fef-7099-40cb-9280-9d91b1a0bfd8 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 300 microversion: 2.1 time: 0.212662 Oct 31 15:15:25.593045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.593183 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 110/242] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:15:25 2022] POST /compute/v2.1/os-aggregates/6/action => generated 300 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:25.612771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9fa4fcb-21c3-4f82-86ff-fd645d822496 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Action: 'create', calling method: .version_select at 0x7f5ca3278a60>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-788655509", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdHtOs1XcGuRhDu9tGqlPJ9HnANMnFA8YBHhv8ndAsJfg58RVUuB9aaZrxn5ZiiKRTVoi8D1O0mwAv8M3STk2tD9tsPtIIqNavFNTlgQxCnK9fHZA7HD9Vt9rgzKQ6Tqw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:25.644350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:25.653101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f9fa4fcb-21c3-4f82-86ff-fd645d822496 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Getting quotas for project 9453e422a6fe482383384cfe451d558c. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:25.659026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f9fa4fcb-21c3-4f82-86ff-fd645d822496 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Getting quotas for user 79cef896a0484380a30d6e56f8d17c68 and project 9453e422a6fe482383384cfe451d558c. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:25.686078 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9fa4fcb-21c3-4f82-86ff-fd645d822496 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.083280 Oct 31 15:15:25.686733 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 111/243] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:15:25 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:15:25.705316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a32b6d6-775a-4a02-9dbe-77218f1aa456 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.750736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a32b6d6-775a-4a02-9dbe-77218f1aa456 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.054047 Oct 31 15:15:25.755858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 112/244] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:25 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:25.763322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1170d080-7ba6-44dc-9679-89f80bd78918 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Calling method '.version_select at 0x7f5ca3278280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.769555 n-d-858383-17 devstack@n-api.service[120626]: WARNING oslo_db.sqlalchemy.utils [None req-1170d080-7ba6-44dc-9679-89f80bd78918 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:15:25.782507 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1170d080-7ba6-44dc-9679-89f80bd78918 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs?user_id=38c64932910b4daf98078e7555135e72" status: 200 len: 726 microversion: 2.10 time: 0.024868 Oct 31 15:15:25.783338 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 113/245] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/os-keypairs?user_id=38c64932910b4daf98078e7555135e72 => generated 726 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:25.799048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca2fb4ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.805500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.806285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.807025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.810251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.811050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.811668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.854076 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-953015f2-c6f9-42e6-9f18-675e69d8d065 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.061298 Oct 31 15:15:25.855463 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 114/246] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:25.862715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:25.863708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:25.871325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.874828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.875619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:25.876586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:25.877299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:25.878279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.059064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:26.068000 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-73b0f646-d078-4773-94b4-d02f55615d50 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.513176 Oct 31 15:15:26.070289 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 133/247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:26.075755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19be085b-84ec-4e19-afd7-af645d4e4e7e tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Calling method '.version_select at 0x7f5ca2f859d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.099596 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19be085b-84ec-4e19-afd7-af645d4e4e7e tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-788655509" status: 204 len: 0 microversion: 2.10 time: 0.027740 Oct 31 15:15:26.100535 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 134/248] 10.222.0.48 () {60 vars in 1322 bytes} [Mon Oct 31 15:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-788655509 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:15:26.109618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca2fc08b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.113146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.113631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.114069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.115604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.116079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.116510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.183994 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-019d5479-8c43-4ae9-8dd3-c08ac8553b7d tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.078939 Oct 31 15:15:26.193160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 135/249] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:26.198387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.199314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:26.206362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.207381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.208022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.209758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:26.210273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.210790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.211426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.224881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:26.226379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:26.227515 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df19a409-3c78-498b-afe7-cc0c125bf82c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.370943 Oct 31 15:15:26.233718 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 115/250] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:25 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:26.242101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa2f46ea-4cf7-460c-94a5-1c1ec0c1416f tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Calling method '.version_select at 0x7f5ca2f0e0d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.283240 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa2f46ea-4cf7-460c-94a5-1c1ec0c1416f tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738030253?user_id=38c64932910b4daf98078e7555135e72" status: 204 len: 0 microversion: 2.10 time: 0.048224 Oct 31 15:15:26.284576 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 116/251] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738030253?user_id=38c64932910b4daf98078e7555135e72 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:15:26.291376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca2f0ef70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.297549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.298364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.299014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.300369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.301169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.301791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.346254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0e30032-0039-4537-8a72-e546095ea7d1 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.060282 Oct 31 15:15:26.354360 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 117/252] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:26.360178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c05de14-064b-4a0f-97d9-391da2d9c9e0 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1800252657"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:26.364893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-5c05de14-064b-4a0f-97d9-391da2d9c9e0 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid 1f85eddd-a16d-4595-86de-d67995966896 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:26.389571 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c05de14-064b-4a0f-97d9-391da2d9c9e0 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033585 Oct 31 15:15:26.397676 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 118/253] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:26.404003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0807d243-4390-45ec-94c2-4a9f3a99f781 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] Calling method '.version_select at 0x7f5ca2f8df70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.441120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0807d243-4390-45ec-94c2-4a9f3a99f781 tempest-KeyPairsV210TestJSON-288198300 tempest-KeyPairsV210TestJSON-288198300-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296564288?user_id=38c64932910b4daf98078e7555135e72" status: 204 len: 0 microversion: 2.10 time: 0.041188 Oct 31 15:15:26.443174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 119/254] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296564288?user_id=38c64932910b4daf98078e7555135e72 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:15:26.452857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca3211280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.464020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.464923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.466418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.486358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.487273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.487897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.546311 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc97cff6-271c-4c45-a67b-78e468e44f83 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h2-858383-17" status: 200 len: 603 microversion: 2.1 time: 0.101682 Oct 31 15:15:26.563321 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 120/255] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/os-hosts/n-h2-858383-17 => generated 603 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:26.570053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57ce370e-fe00-452e-b295-989727144153 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:26.596281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ce370e-fe00-452e-b295-989727144153 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.596798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ce370e-fe00-452e-b295-989727144153 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.597232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ce370e-fe00-452e-b295-989727144153 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.773196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:26.787390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6855087e-db4d-4d61-94e3-a837bf7bb6c2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1466 microversion: 2.1 time: 0.592768 Oct 31 15:15:26.793968 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 136/256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1466 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:26.800868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1a9abd2d-6968-4a7d-b398-ad4fb1566390 req-53f4a570-47f1-4ed0-9d4d-30dd97366777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39bdd042-06d6-4246-bd3b-2c46f8bc0aae", "name": "network-vif-deleted", "tag": "3031d493-51a0-4ae9-ac48-a9238fa75913"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:26.805130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57ce370e-fe00-452e-b295-989727144153 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.239675 Oct 31 15:15:26.806260 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 121/257] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:15:26 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:26.821944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.822625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:26.834971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.835459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.841882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.842686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.843316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.843896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.847996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1a9abd2d-6968-4a7d-b398-ad4fb1566390 req-53f4a570-47f1-4ed0-9d4d-30dd97366777 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.852495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1a9abd2d-6968-4a7d-b398-ad4fb1566390 req-53f4a570-47f1-4ed0-9d4d-30dd97366777 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.853173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1a9abd2d-6968-4a7d-b398-ad4fb1566390 req-53f4a570-47f1-4ed0-9d4d-30dd97366777 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.887128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1a9abd2d-6968-4a7d-b398-ad4fb1566390 req-53f4a570-47f1-4ed0-9d4d-30dd97366777 service nova] Creating event network-vif-deleted:3031d493-51a0-4ae9-ac48-a9238fa75913 for instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae on n-h1-858383-17 Oct 31 15:15:26.902484 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1a9abd2d-6968-4a7d-b398-ad4fb1566390 req-53f4a570-47f1-4ed0-9d4d-30dd97366777 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103521 Oct 31 15:15:26.903634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 137/258] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:26.917524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Calling method '.version_select at 0x7f5ca2e580d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:26.935782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.936262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.936709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.939252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.940098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.940540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.941813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 39bdd042-06d6-4246-bd3b-2c46f8bc0aae {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:26.976038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.976742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.977542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.002605 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee417216-e516-4e87-b58a-8f1ed9a7ebc8 tempest-HostsAdminTestJSON-871850566 tempest-HostsAdminTestJSON-871850566-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h1-858383-17" status: 200 len: 603 microversion: 2.1 time: 0.097411 Oct 31 15:15:27.003478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 138/259] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/os-hosts/n-h1-858383-17 => generated 603 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:27.011633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-611889879", "metadata": {"image_type": "test"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:27.015868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:27.023113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.023836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.024815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.025673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.026308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.026947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.070010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Getting quotas for project 8bac2d5104974de8961402403f40e257. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:27.075625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Getting quotas for user 4fdcccbb6840445290ea2e578488e759 and project 8bac2d5104974de8961402403f40e257. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:27.102680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:27.111505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bba79770-591c-4a43-9262-2bdc08d1be97 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 200 len: 1310 microversion: 2.1 time: 0.294062 Oct 31 15:15:27.126155 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 122/260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:26 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 1310 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:27.138373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cbb523b-dd67-463c-a5f7-ec00eddfead9 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:27.143205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1cbb523b-dd67-463c-a5f7-ec00eddfead9 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2dc81e159f534d30984b9ee0823f2537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c0f9c4d5abe43d192a9501ca16e228c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cbb523b-dd67-463c-a5f7-ec00eddfead9 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Request method failure captured: Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 43 Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZWmp03unN5KTHU7ldHVoxvKA_WDelQSO5n_l0mifvS-h_rzCgW4017f4guE42fSW7zeP855CHdbshw7aH4RJxBoivPz_fi96baE_Km8NH9IYrPYGPUgcyP_w8S1tMGkNzDl9hU7KiVmJDMOPE6bGSWqQV8MgH8UwYmeNzZwSslhLI Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:27.144826 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c0f9c4d5abe43d192a9501ca16e228c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3c0f9c4d5abe43d192a9501ca16e228c Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-634551215 Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 2dc81e159f534d30984b9ee0823f2537 Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-634551215-project Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: {"remove_host": {"host": "n-h2-858383-17"}} Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:27.146053 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h2-858383-17'}}} Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:27.146766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 15:15:27.147750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:27.149929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cbb523b-dd67-463c-a5f7-ec00eddfead9 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:27.149929 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1cbb523b-dd67-463c-a5f7-ec00eddfead9 tempest-AggregatesAdminNegativeTestJSON-634551215 tempest-AggregatesAdminNegativeTestJSON-634551215-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.014793 Oct 31 15:15:27.151374 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 123/261] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:15:27 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:27.158393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:27.159629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:27.173557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.174032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.174539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.175170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.175662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.176056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.510538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75c92af4-3a5b-4660-b9c4-b50b6db3fa6b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "POST /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94/action" status: 202 len: 0 microversion: 2.1 time: 0.505000 Oct 31 15:15:27.516425 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 139/262] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:15:27 2022] POST /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:15:27.530326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25b16402-f12a-46c6-8c1c-b1f0afbdcd93 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:27.558755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25b16402-f12a-46c6-8c1c-b1f0afbdcd93 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.559908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25b16402-f12a-46c6-8c1c-b1f0afbdcd93 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.560568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25b16402-f12a-46c6-8c1c-b1f0afbdcd93 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.634751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:27.648199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a325819f-cbef-4189-a08f-44d2e21f4a3d tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.495544 Oct 31 15:15:27.650601 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 124/263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:27 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:27.666056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:27.666970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:27.685317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.687746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.692183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.692974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:27.693604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:27.694198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:27.792081 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25b16402-f12a-46c6-8c1c-b1f0afbdcd93 tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.272936 Oct 31 15:15:27.792721 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 140/264] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Oct 31 15:15:27 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:28.008395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-39ffb2a8-08de-4750-950d-83d60174b6f7 req-673a9659-5fd1-4bb9-b798-3482d5d1d9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4230e338-4315-412b-ae2c-f9b1cc15fbee", "tag": "72f7a598-0311-4580-973c-6321a81b4a0f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:28.026472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-39ffb2a8-08de-4750-950d-83d60174b6f7 req-673a9659-5fd1-4bb9-b798-3482d5d1d9f2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.027318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-39ffb2a8-08de-4750-950d-83d60174b6f7 req-673a9659-5fd1-4bb9-b798-3482d5d1d9f2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.027983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-39ffb2a8-08de-4750-950d-83d60174b6f7 req-673a9659-5fd1-4bb9-b798-3482d5d1d9f2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.046466 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-39ffb2a8-08de-4750-950d-83d60174b6f7 req-673a9659-5fd1-4bb9-b798-3482d5d1d9f2 service nova] Creating event network-changed:72f7a598-0311-4580-973c-6321a81b4a0f for instance 4230e338-4315-412b-ae2c-f9b1cc15fbee on n-h2-858383-17 Oct 31 15:15:28.058998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-39ffb2a8-08de-4750-950d-83d60174b6f7 req-673a9659-5fd1-4bb9-b798-3482d5d1d9f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257256 Oct 31 15:15:28.062989 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 141/265] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:28.077455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a32527b9-bb54-45ff-8fdb-5613b821fd97 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca317c430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:28.143079 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a32527b9-bb54-45ff-8fdb-5613b821fd97 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.077332 Oct 31 15:15:28.143999 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 142/266] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:28 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:28.148986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3aabf09-eb58-4d93-bf6d-e63a19b6212d tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:28.181843 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3aabf09-eb58-4d93-bf6d-e63a19b6212d tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.036702 Oct 31 15:15:28.188227 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 143/267] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:28 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:28.194312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:28.195051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:28.211105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.211798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.212260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.213051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.213597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.213946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.238941 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] HTTP exception thrown: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Request method failure captured: Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae HTTP/1.1 Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZeAf0JV0KbfRDfJGoGbxrjRQcIOwbjnHzo6ggYlFF-Onmol9mOCdxzJVWwkrHNY-BBry2S0OWaezvOLEyDqvKQx9QEKuaKfxBb2cvVnDO4NugB64UnuYUVOiWiAj5Cqd5ZwxntwOiVntVcE5t_y6OVIUDM99ZbHrIT60qwJUzAVAE Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:15:28.241145 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd5058292e9d48358327b2127517ea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd5058292e9d48358327b2127517ea93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 152129719036444687e3b8e8bd5460e7 Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:28.242317 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '39bdd042-06d6-4246-bd3b-2c46f8bc0aae'} Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:28.243030 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:28.244076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.249830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Returning 404 to user: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:28.249830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-18b6525b-b339-47ed-8be0-8e88022ccf36 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 404 len: 111 microversion: 2.1 time: 0.052895 Oct 31 15:15:28.249830 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 144/268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:28 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:28.253113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:28.255234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c38bdb4-00a6-4caa-8b0f-e6bcf799964a tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1447772669"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:28.267488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:28.268982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:28.270109 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8fc1c28a-505c-4914-a5ed-27ec0543bc08 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.617479 Oct 31 15:15:28.271246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-3c38bdb4-00a6-4caa-8b0f-e6bcf799964a tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Generated uuid d5b2dd02-9a8a-4bfb-a02a-64265da59ca6 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:28.279095 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 125/269] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:27 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:28.283763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-593fb7c5-f4a7-4fbe-8b4e-f99e6c7dbcda tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-539600792"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:28.293217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-593fb7c5-f4a7-4fbe-8b4e-f99e6c7dbcda tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid 7fb572f6-9aec-48f1-b5ca-ea2aba614bb0 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:28.321017 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c38bdb4-00a6-4caa-8b0f-e6bcf799964a tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.076655 Oct 31 15:15:28.330543 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 145/270] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:28.332871 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-593fb7c5-f4a7-4fbe-8b4e-f99e6c7dbcda tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052628 Oct 31 15:15:28.337040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:28.339488 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 126/271] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:28.351710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b759dc9-1c0f-4568-a44e-b6a3db5e6c60 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:28.361225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.361867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.362335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.370666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.371153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.371584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.382754 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.compute.aggregates [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 31 15:15:28.383329 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Request method failure captured: Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 42 Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZYRPfWAq1LqtKPhSU0LmFOpGRNpIk1z-KdWTWNNJ6rWROLP9El0Pn8u83GvRGu-zksBY3ncGST0CxZFYmAUL2XsKV-MjkBBjVCJfma2s3roUiFwoIz6Uuw4m03WSyf_cLAJR94Y6wGFdkz4gFRxu_TLFgNpnaO6WnRrTFYzh3Adic Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:28.385374 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e323e2e34014d629877290222bda64e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e323e2e34014d629877290222bda64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e323e2e34014d629877290222bda64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 0e323e2e34014d629877290222bda64e Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-128588702 Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 623f80dced80418fb2aa021c995a2bdf Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: {"remove_host": {"host": "nonexist_host"}} Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:28.386576 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot remove host nonexist_host in aggregate 10 Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 31 15:15:28.387314 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6685, in remove_host_from_aggregate Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 31 15:15:28.389141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.390215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:28.391363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:28.391761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b759dc9-1c0f-4568-a44e-b6a3db5e6c60 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.391761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b759dc9-1c0f-4568-a44e-b6a3db5e6c60 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.391908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3eea9c86-d074-48d9-a86a-5ae856d0956c tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.054836 Oct 31 15:15:28.391981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b759dc9-1c0f-4568-a44e-b6a3db5e6c60 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.392052 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 146/272] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:28 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:15:28.396883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f62f0193-47d1-4464-8aa9-97df3e46bd2b tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:28.440720 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f62f0193-47d1-4464-8aa9-97df3e46bd2b tempest-AggregatesAdminNegativeTestJSON-128588702 tempest-AggregatesAdminNegativeTestJSON-128588702-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.047259 Oct 31 15:15:28.441366 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 147/273] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:28 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:28.483523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:28.489137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1922187610", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:28.588858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:28.665194 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b759dc9-1c0f-4568-a44e-b6a3db5e6c60 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.317008 Oct 31 15:15:28.676939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 127/274] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:28 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:28.682685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:28.682884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:28.694757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.695361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.695840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:28.696712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:28.697187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:28.697686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.267593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:29.268142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:29.268546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:29.268999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:29.269469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:29.294343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.298803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.301015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.301951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.302836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.304500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.355574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Getting quotas for project bd5058292e9d48358327b2127517ea93. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:29.373910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Getting quotas for user 152129719036444687e3b8e8bd5460e7 and project bd5058292e9d48358327b2127517ea93. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:29.410962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:29.413535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:15:29.421039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:15:29.424444 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f023633-1fa1-47ee-a41a-2d6a8815d581 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.744571 Oct 31 15:15:29.425584 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 128/275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:28 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:29.436856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:29.439589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b35f441-deab-4670-8d5e-d32f735629a6 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:29.459637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b35f441-deab-4670-8d5e-d32f735629a6 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.031533 Oct 31 15:15:29.464237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 129/276] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:29 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:29.476655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2186fed6-7fc4-412f-811e-e12b32ffd643 req-07cf9a2e-77ab-4945-b059-fc89199c09e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493610b0-1112-44d9-9df3-ad5800017cbd", "tag": "5ebe398a-c1d4-4693-900e-5b7c3460fcdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:29.492276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2186fed6-7fc4-412f-811e-e12b32ffd643 req-07cf9a2e-77ab-4945-b059-fc89199c09e0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.493377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2186fed6-7fc4-412f-811e-e12b32ffd643 req-07cf9a2e-77ab-4945-b059-fc89199c09e0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.493971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2186fed6-7fc4-412f-811e-e12b32ffd643 req-07cf9a2e-77ab-4945-b059-fc89199c09e0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.496318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a80f3de-09f2-42a9-8a69-ba1cbcc20636 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013564 Oct 31 15:15:29.498033 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 148/277] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:15:29.508104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-133d85bc-6d41-46d1-9eaa-ac82afa7cf37 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2fc09d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:29.508320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2186fed6-7fc4-412f-811e-e12b32ffd643 req-07cf9a2e-77ab-4945-b059-fc89199c09e0 service nova] Creating event network-changed:5ebe398a-c1d4-4693-900e-5b7c3460fcdb for instance 493610b0-1112-44d9-9df3-ad5800017cbd on n-h2-858383-17 Oct 31 15:15:29.515608 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2186fed6-7fc4-412f-811e-e12b32ffd643 req-07cf9a2e-77ab-4945-b059-fc89199c09e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049497 Oct 31 15:15:29.516131 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 130/278] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:29.522079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:29.522963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:29.525272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:29.531077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.532077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.532908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.534167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.534787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.542992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.569609 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-133d85bc-6d41-46d1-9eaa-ac82afa7cf37 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.070482 Oct 31 15:15:29.570539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 149/279] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:29 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:29.583220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51fe0659-6913-4aaa-bc6b-2cd773d97467 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:29.602165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51fe0659-6913-4aaa-bc6b-2cd773d97467 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:29.602650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51fe0659-6913-4aaa-bc6b-2cd773d97467 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:29.603095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51fe0659-6913-4aaa-bc6b-2cd773d97467 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:29.733431 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51fe0659-6913-4aaa-bc6b-2cd773d97467 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.162033 Oct 31 15:15:29.734008 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 150/280] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:29 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:29.739403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81193f29-c05a-4db8-b42a-d1c74d078633 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:29.741742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-81193f29-c05a-4db8-b42a-d1c74d078633 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:29.968143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-81193f29-c05a-4db8-b42a-d1c74d078633 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:29.979251 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81193f29-c05a-4db8-b42a-d1c74d078633 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1220 microversion: 2.1 time: 0.243781 Oct 31 15:15:29.979920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 151/281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:29 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1220 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:29.986012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49bd31b5-0f06-4624-a73e-10cc6f19c79a tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:30.021121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49bd31b5-0f06-4624-a73e-10cc6f19c79a tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.039675 Oct 31 15:15:30.021890 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 152/282] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:29 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:30.035639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61ebaae9-f588-41c5-814f-3008d301476e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-155437133"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:30.040081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-61ebaae9-f588-41c5-814f-3008d301476e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid 78b4f0eb-3e8b-4f31-a9c2-935caa7be1c1 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:30.093810 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61ebaae9-f588-41c5-814f-3008d301476e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063872 Oct 31 15:15:30.094783 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 153/283] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:30.106959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e541a32f-4aac-47ed-8b85-fe83311998eb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:30.121572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e541a32f-4aac-47ed-8b85-fe83311998eb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:30.122526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e541a32f-4aac-47ed-8b85-fe83311998eb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:30.123126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e541a32f-4aac-47ed-8b85-fe83311998eb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:30.191841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:30.207497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:30.208978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:30.210394 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f450b3fe-a7ee-4553-9255-ceeab1948460 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.692429 Oct 31 15:15:30.210964 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 131/284] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:29 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:30.288812 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e541a32f-4aac-47ed-8b85-fe83311998eb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.186597 Oct 31 15:15:30.302719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 154/285] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:30 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:30.314502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd79ef5a-7919-450a-b6af-71c3672f1971 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:30.327318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd79ef5a-7919-450a-b6af-71c3672f1971 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.016499 Oct 31 15:15:30.331879 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 132/286] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:15:30 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:30.345894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70536518-e886-4798-a8cf-72afa8c0956e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:30.362994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70536518-e886-4798-a8cf-72afa8c0956e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:30.364282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70536518-e886-4798-a8cf-72afa8c0956e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:30.365077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70536518-e886-4798-a8cf-72afa8c0956e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:30.450604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:30.451364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:30.460450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:30.464668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:30.465171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:30.465944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:30.466499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:30.469299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:30.522456 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70536518-e886-4798-a8cf-72afa8c0956e tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.182767 Oct 31 15:15:30.523487 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 155/287] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:30 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:30.536200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68172667-3976-42c7-a0f3-ee328bc48e88 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:30.581659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68172667-3976-42c7-a0f3-ee328bc48e88 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.050273 Oct 31 15:15:30.587751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 156/288] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:30 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 15:15:30.596078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61b392f3-2acd-4378-9db0-690cb5316198 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2e58790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:30.694118 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61b392f3-2acd-4378-9db0-690cb5316198 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.110049 Oct 31 15:15:30.697714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 157/289] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:30 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:30.716200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09de6fe8-4586-4082-873f-1928bc6b662d tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-962544391"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:30.734451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-09de6fe8-4586-4082-873f-1928bc6b662d tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid 96270c12-1a69-4d75-8e2f-eab16d021ef6 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:30.778683 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09de6fe8-4586-4082-873f-1928bc6b662d tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075776 Oct 31 15:15:30.779353 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 158/290] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:30.792442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b0aad7e-58bc-4ffb-95b9-d002f4665eea tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:30.813510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b0aad7e-58bc-4ffb-95b9-d002f4665eea tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:30.814118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b0aad7e-58bc-4ffb-95b9-d002f4665eea tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:30.814545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b0aad7e-58bc-4ffb-95b9-d002f4665eea tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:30.816359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:30.824307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c01f0c0-c719-41b4-98fc-296c468af549 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.378268 Oct 31 15:15:30.828985 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 133/291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:30 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:31.007866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.011612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:31.020178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.023299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.023775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.027819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.028361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.031388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.084741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b0aad7e-58bc-4ffb-95b9-d002f4665eea tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.297739 Oct 31 15:15:31.088760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 159/292] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:30 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:31.102312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d10f441-5d29-4252-99f9-839dc77e5fe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:31.125719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d10f441-5d29-4252-99f9-839dc77e5fe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.126656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d10f441-5d29-4252-99f9-839dc77e5fe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.127281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d10f441-5d29-4252-99f9-839dc77e5fe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.246077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:31.261107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e613c9e0-43bf-4ff7-8078-4ad36ac46723 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1280 microversion: 2.1 time: 0.260556 Oct 31 15:15:31.280207 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 134/293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:30 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1280 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:31.280207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.289464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:31.312805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.313379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.313829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.315247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.315883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.321018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.395892 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d10f441-5d29-4252-99f9-839dc77e5fe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.299656 Oct 31 15:15:31.398025 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 160/294] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:31 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:31.409529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0aa5f7d0-9e6f-4f58-9d14-5fb6be6f8306 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.450708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0aa5f7d0-9e6f-4f58-9d14-5fb6be6f8306 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.044785 Oct 31 15:15:31.452460 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 161/295] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:31 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:31.464817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8970e8e-4c65-4670-9157-761faf4239fd tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1287558022"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:31.474996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-d8970e8e-4c65-4670-9157-761faf4239fd tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid aed3243d-ec19-43f6-8eec-fb20486d465e for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:31.528198 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8970e8e-4c65-4670-9157-761faf4239fd tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070196 Oct 31 15:15:31.529144 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 162/296] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:31.539921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f25953f-7463-4448-9473-fae6bb6a8cdb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.604959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f25953f-7463-4448-9473-fae6bb6a8cdb tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.063952 Oct 31 15:15:31.609294 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 163/297] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:31 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 15:15:31.630756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89359c5a-cc4b-4f5c-99e8-35ab5449ff10 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.644441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-89359c5a-cc4b-4f5c-99e8-35ab5449ff10 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89359c5a-cc4b-4f5c-99e8-35ab5449ff10 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Request method failure captured: Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZZP2j0EHBYjyTCgDfS0yd4sDfCXSfnx8sOEQrv4OwUb4dPmChKz2ql4CLXtHrXItSycLklDcdoggvRG4bZf3epgydsqjnpqcZ-_UxYoptya-CpwIUabjY5I9A3D15sIUghaOaUK4hCa18YVOb04L8yIkZ87wjA_FGIqOrH9_S0HzY Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:31.646269 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ef5e85605e2d416f874c31995a7f7f26 Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate 14 could not be found. Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '14'} Oct 31 15:15:31.647508 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:31.648305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 31 15:15:31.649436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.650644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89359c5a-cc4b-4f5c-99e8-35ab5449ff10 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:31.650644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89359c5a-cc4b-4f5c-99e8-35ab5449ff10 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.030421 Oct 31 15:15:31.650644 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 164/298] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:31 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:15:31.660026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fe6b195-0a52-47d1-91b3-ffc809af9d58 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.676347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6fe6b195-0a52-47d1-91b3-ffc809af9d58 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fe6b195-0a52-47d1-91b3-ffc809af9d58 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Request method failure captured: Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZZP2j0EHBYjyTCgDfS0yd4sDfCXSfnx8sOEQrv4OwUb4dPmChKz2ql4CLXtHrXItSycLklDcdoggvRG4bZf3epgydsqjnpqcZ-_UxYoptya-CpwIUabjY5I9A3D15sIUghaOaUK4hCa18YVOb04L8yIkZ87wjA_FGIqOrH9_S0HzY Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:31.678831 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ef5e85605e2d416f874c31995a7f7f26 Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate 14 could not be found. Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '14'} Oct 31 15:15:31.680204 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:15:31.681028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:31.682042 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:31.683128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:31.683128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:31.683128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:31.683128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 31 15:15:31.683128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:31.686441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fe6b195-0a52-47d1-91b3-ffc809af9d58 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:31.689377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fe6b195-0a52-47d1-91b3-ffc809af9d58 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.034440 Oct 31 15:15:31.695061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 165/299] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:31 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:15:31.702151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e26cf74-98fd-49aa-9af2-bd10524d4c15 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1869679105", "name": "tempest-test_aggregate-1514975722"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:31.736756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-3e26cf74-98fd-49aa-9af2-bd10524d4c15 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid 31bc7929-4de4-49c9-a4b9-61a543ff6b67 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:31.792393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:31.803761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:31.807969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:31.810190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c68fe0f-83f2-4785-96cf-23e2b55a044c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.538989 Oct 31 15:15:31.816616 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e26cf74-98fd-49aa-9af2-bd10524d4c15 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.114889 Oct 31 15:15:31.817447 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 166/300] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Oct 31 15:15:31 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:31.825625 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 135/301] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:31 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:31.838871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb091297-3c82-4f9f-9531-4c21cafe9920 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2db7430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.842766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b717d693-9a1b-4353-a854-1bd32e1c889c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.892746 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b717d693-9a1b-4353-a854-1bd32e1c889c tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.065645 Oct 31 15:15:31.898172 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 136/302] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:31 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:31.904812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.905442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:31.924898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.928431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.929033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.930271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:31.930753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:31.931186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:31.964418 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb091297-3c82-4f9f-9531-4c21cafe9920 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.138920 Oct 31 15:15:31.975906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 167/303] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:31 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:31.986900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00b4dd5c-ddb8-4f20-b4b9-bc245a925291 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:31.995221 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-00b4dd5c-ddb8-4f20-b4b9-bc245a925291 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00b4dd5c-ddb8-4f20-b4b9-bc245a925291 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Request method failure captured: Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZZP2j0EHBYjyTCgDfS0yd4sDfCXSfnx8sOEQrv4OwUb4dPmChKz2ql4CLXtHrXItSycLklDcdoggvRG4bZf3epgydsqjnpqcZ-_UxYoptya-CpwIUabjY5I9A3D15sIUghaOaUK4hCa18YVOb04L8yIkZ87wjA_FGIqOrH9_S0HzY Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:31.998345 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ef5e85605e2d416f874c31995a7f7f26 Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate 15 could not be found. Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '15'} Oct 31 15:15:31.999762 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:32.000722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 31 15:15:32.001825 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.003767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00b4dd5c-ddb8-4f20-b4b9-bc245a925291 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:32.004910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00b4dd5c-ddb8-4f20-b4b9-bc245a925291 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.027483 Oct 31 15:15:32.005672 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 168/304] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:31 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:15:32.018079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b11534ff-2b63-41f1-8252-89c9fabcced3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.036805 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b11534ff-2b63-41f1-8252-89c9fabcced3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b11534ff-2b63-41f1-8252-89c9fabcced3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Request method failure captured: Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZZP2j0EHBYjyTCgDfS0yd4sDfCXSfnx8sOEQrv4OwUb4dPmChKz2ql4CLXtHrXItSycLklDcdoggvRG4bZf3epgydsqjnpqcZ-_UxYoptya-CpwIUabjY5I9A3D15sIUghaOaUK4hCa18YVOb04L8yIkZ87wjA_FGIqOrH9_S0HzY Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:15:32.042285 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7d8519ee3d14639bf53c22b9e7d42a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f7d8519ee3d14639bf53c22b9e7d42a8 Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1922617396 Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ef5e85605e2d416f874c31995a7f7f26 Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AggregatesAdminTestJSON-1922617396-project-admin Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: exception: Aggregate 15 could not be found. Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '15'} Oct 31 15:15:32.044107 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:15:32.044833 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:32.045871 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:32.046972 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:32.046972 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:32.046972 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:32.046972 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 31 15:15:32.046972 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:32.047253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b11534ff-2b63-41f1-8252-89c9fabcced3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:32.050733 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b11534ff-2b63-41f1-8252-89c9fabcced3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.036391 Oct 31 15:15:32.052494 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 169/305] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:32 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:15:32.064349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb1bdfea-24aa-4b4e-8e6c-9146baa9ea5b tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-435647920"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:32.080144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-fb1bdfea-24aa-4b4e-8e6c-9146baa9ea5b tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid f582e0b8-6fbf-4707-a036-d5e96dd7d752 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:32.161158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb1bdfea-24aa-4b4e-8e6c-9146baa9ea5b tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103278 Oct 31 15:15:32.161951 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 170/306] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:32.194799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b731bac-651e-4bec-bb9e-bc52c1327ba3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.216078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=78,nova_api:DELETE=11 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:32.220716 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b731bac-651e-4bec-bb9e-bc52c1327ba3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.049763 Oct 31 15:15:32.220929 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 171/307] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:32.237341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8b6cf24-bf12-4387-a404-b12ea201ec27 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:32.269665 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8b6cf24-bf12-4387-a404-b12ea201ec27 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.040871 Oct 31 15:15:32.271205 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 172/308] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:15:32 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:32.284538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3cd7141-7c72-4d69-a285-07815e7fc866 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.302377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3cd7141-7c72-4d69-a285-07815e7fc866 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.023869 Oct 31 15:15:32.303039 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 173/309] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:32.316419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.317069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:32.323326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.326827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.327073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:32.327614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.328048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.328517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.328965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.357456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6ffa305-d04c-4988-b72a-2f134a3c1095 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.454894 Oct 31 15:15:32.358223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 137/310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:31 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:32.372090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa146df2-e74b-409a-aead-f8366830e796 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.424627 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa146df2-e74b-409a-aead-f8366830e796 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.062382 Oct 31 15:15:32.428633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:32.432626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 138/311] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:32 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:32.442515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9128298f-01a0-4ae8-834b-eb3ae6b25f1f tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1278 microversion: 2.1 time: 0.130445 Oct 31 15:15:32.443100 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 174/312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:32.463923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e5cd453-dd99-4822-b804-4ab6fbffce57 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1735199108", "availability_zone": "tempest-test_az-1800147402"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:32.504881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-0e5cd453-dd99-4822-b804-4ab6fbffce57 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid dc683c7f-352a-458e-aed6-6612a872834d for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:32.549495 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e5cd453-dd99-4822-b804-4ab6fbffce57 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.109678 Oct 31 15:15:32.551710 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 139/313] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Oct 31 15:15:32 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:32.563447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ceb08666-ea07-4245-a8f0-23ff6aa6edf3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1735199108_new", "availability_zone": "tempest-test_az-1800147402_new"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:32.622650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb08666-ea07-4245-a8f0-23ff6aa6edf3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.623770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb08666-ea07-4245-a8f0-23ff6aa6edf3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.625202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceb08666-ea07-4245-a8f0-23ff6aa6edf3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.705170 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ceb08666-ea07-4245-a8f0-23ff6aa6edf3 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.145577 Oct 31 15:15:32.705778 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 175/314] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Oct 31 15:15:32 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:32.721966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39d4d4fa-cc4d-4bfb-b3ce-a3cd298ef893 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.736726 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39d4d4fa-cc4d-4bfb-b3ce-a3cd298ef893 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.022980 Oct 31 15:15:32.745582 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 140/315] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:32.754188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6addc793-8b89-4f4a-a80a-651d5f713f53 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.804634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6addc793-8b89-4f4a-a80a-651d5f713f53 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.055789 Oct 31 15:15:32.805593 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 176/316] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:32 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:32.815089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8b7b25c-010c-4c07-b0bc-f48afe6ad3b1 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1104495839"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:32.818530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.aggregate [None req-e8b7b25c-010c-4c07-b0bc-f48afe6ad3b1 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Generated uuid 7ede503a-7fcf-4130-9b02-b703b161a672 for aggregate {{(pid=120626) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:15:32.846899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.849171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:32.860647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8b7b25c-010c-4c07-b0bc-f48afe6ad3b1 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049132 Oct 31 15:15:32.861602 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 141/317] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:15:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:32.872752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-925e5dba-4490-4e43-9094-1d233a5b132a tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.874661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.875172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.875606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.879874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.880738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.881183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:32.883876 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-925e5dba-4490-4e43-9094-1d233a5b132a tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.015152 Oct 31 15:15:32.888462 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 142/318] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:32.899092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af009884-10b6-4491-996f-5508c0e0abe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.943413 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-af009884-10b6-4491-996f-5508c0e0abe0 tempest-AggregatesAdminTestJSON-1922617396 tempest-AggregatesAdminTestJSON-1922617396-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.047987 Oct 31 15:15:32.946930 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 143/319] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:15:32 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:32.958243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:32.958750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:32.995967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:32.996468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:32.999758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.003708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.005388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.005948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.034937 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] HTTP exception thrown: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Request method failure captured: Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 HTTP/1.1 Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZXZqFCY5A8rYv7qtS5a4sZr1naXvcHJAiX95LQ_L618KSiLOISquFlxH4vUQbotkBvcc2tB-yWDdIsuBMgqRrv08aZc-0_IZEAoNv_SOEa0412Xa2kK--e5VUdRoIQpO5ZlwXOhJkhR9U5221IkEvdUY4Wv4w6sRvCvK93HqE04J8 Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bd00e0f8144e4e47a71b9ac4e77f292f Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:33.037440 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bd00e0f8144e4e47a71b9ac4e77f292f Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminTestJSON-1622362723-project Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 031531300e214b66bea9d3563317712a Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminTestJSON-1622362723-project Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.038975 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '65be82c3-f36a-43bc-9357-f0898994c466'} Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:33.040033 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.041405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.062155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Returning 404 to user: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:33.064428 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbf3642e-d0db-4152-9480-5989d3ddf899 tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 404 len: 111 microversion: 2.1 time: 0.110786 Oct 31 15:15:33.066224 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 144/320] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:15:32 2022] DELETE /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:33.074436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54e655cd-bd16-4b17-a2cf-9dce2884e8dc tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca3052820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:33.149500 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-54e655cd-bd16-4b17-a2cf-9dce2884e8dc tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.080458 Oct 31 15:15:33.150087 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 145/321] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:33 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:33.173930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:33.174962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] [instance: 65be82c3-f36a-43bc-9357-f0898994c466] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:33.189377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.194034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.194986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.196077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.197163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.198305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.219667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] HTTP exception thrown: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Request method failure captured: Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 HTTP/1.1 Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZXZqFCY5A8rYv7qtS5a4sZr1naXvcHJAiX95LQ_L618KSiLOISquFlxH4vUQbotkBvcc2tB-yWDdIsuBMgqRrv08aZc-0_IZEAoNv_SOEa0412Xa2kK--e5VUdRoIQpO5ZlwXOhJkhR9U5221IkEvdUY4Wv4w6sRvCvK93HqE04J8 Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bd00e0f8144e4e47a71b9ac4e77f292f Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:33.221984 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd00e0f8144e4e47a71b9ac4e77f292f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bd00e0f8144e4e47a71b9ac4e77f292f Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1622362723 Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AggregatesAdminTestJSON-1622362723-project Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 031531300e214b66bea9d3563317712a Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AggregatesAdminTestJSON-1622362723-project Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.223477 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '65be82c3-f36a-43bc-9357-f0898994c466'} Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:33.224284 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. Oct 31 15:15:33.225733 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:33.227013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] Returning 404 to user: Instance 65be82c3-f36a-43bc-9357-f0898994c466 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:33.227013 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d498e1cb-272f-4fc8-9162-7f84b18bb24e tempest-AggregatesAdminTestJSON-1622362723 tempest-AggregatesAdminTestJSON-1622362723-project] 10.222.0.48 "GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466" status: 404 len: 111 microversion: 2.1 time: 0.064945 Oct 31 15:15:33.230385 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 146/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:33 2022] GET /compute/v2.1/servers/65be82c3-f36a-43bc-9357-f0898994c466 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:33.244990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:33.260327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:33.262290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:33.263679 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b46d49a2-5241-4811-9c09-e77d4c442359 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.426174 Oct 31 15:15:33.264248 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 177/323] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:32 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:15:33.384825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:33.385547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:33.399313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.402412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.405713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.408396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.409503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.411030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.472574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:33.473234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:33.482086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.483447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.483910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.484632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:33.485132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:33.485564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:33.846475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:33.859587 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f355d97-c05b-4602-a54e-770be82b048e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.480008 Oct 31 15:15:33.860406 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 147/324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:33 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:33.940967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:33.953693 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57ff3ddb-5c54-4bc3-a69d-c2b6a7746e7d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.486969 Oct 31 15:15:33.954797 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 178/325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:33 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:33.974350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f1a80be2-3c94-4d23-aca1-1932b07d3dfc req-d6e1eb8c-a005-49c0-b2c5-6d6fe52985eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "name": "network-vif-plugged", "status": "completed", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:34.008613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f1a80be2-3c94-4d23-aca1-1932b07d3dfc req-d6e1eb8c-a005-49c0-b2c5-6d6fe52985eb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.009352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f1a80be2-3c94-4d23-aca1-1932b07d3dfc req-d6e1eb8c-a005-49c0-b2c5-6d6fe52985eb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.010052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f1a80be2-3c94-4d23-aca1-1932b07d3dfc req-d6e1eb8c-a005-49c0-b2c5-6d6fe52985eb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:34.028952 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f1a80be2-3c94-4d23-aca1-1932b07d3dfc req-d6e1eb8c-a005-49c0-b2c5-6d6fe52985eb service nova] Creating event network-vif-plugged:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:15:34.036747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f1a80be2-3c94-4d23-aca1-1932b07d3dfc req-d6e1eb8c-a005-49c0-b2c5-6d6fe52985eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065477 Oct 31 15:15:34.037835 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 148/326] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:34.178618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef51adbd-fbb2-4f9d-9d7a-561f87e8046e tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d405e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:34.237860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef51adbd-fbb2-4f9d-9d7a-561f87e8046e tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.062992 Oct 31 15:15:34.240139 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 179/327] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:34 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:34.294905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:34.296955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:34.306045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.306950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.308180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:34.309901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.310714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.311786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:34.888751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:34.890141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:34.900461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.902461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.904461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:34.905238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:34.905704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:34.906131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:35.038655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:35.053472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:35.059684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:35.061162 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d8238aad-ce7b-4915-a684-20dff03b0e7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.775132 Oct 31 15:15:35.061922 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 149/328] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:34 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:35.070757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:35.075582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:35.087595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:35.091034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:35.093309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:35.096203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:35.096744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:35.102008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:35.209978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:35.222701 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff61e151-2798-4e06-b303-5e71c74dab22 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.338674 Oct 31 15:15:35.224157 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 180/329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:34 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:35.258383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11256e63-8c51-4903-a03e-35e92b33d2f2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d87310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:35.330497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11256e63-8c51-4903-a03e-35e92b33d2f2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.077596 Oct 31 15:15:35.331751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 181/330] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:35 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:35.337859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4607932b-3ccc-432f-b1f3-ec1767633e87 req-f7cf39a4-3676-40ae-a1a0-b3784916f1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b7e3259-1b68-489e-ab02-d4ea91763d40", "tag": "b21fc65e-80e2-4b64-ad5e-217d2fa3fe88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:35.362072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4607932b-3ccc-432f-b1f3-ec1767633e87 req-f7cf39a4-3676-40ae-a1a0-b3784916f1d6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:35.367489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4607932b-3ccc-432f-b1f3-ec1767633e87 req-f7cf39a4-3676-40ae-a1a0-b3784916f1d6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:35.368186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4607932b-3ccc-432f-b1f3-ec1767633e87 req-f7cf39a4-3676-40ae-a1a0-b3784916f1d6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:35.397644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4607932b-3ccc-432f-b1f3-ec1767633e87 req-f7cf39a4-3676-40ae-a1a0-b3784916f1d6 service nova] Creating event network-changed:b21fc65e-80e2-4b64-ad5e-217d2fa3fe88 for instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 on n-h1-858383-17 Oct 31 15:15:35.405872 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4607932b-3ccc-432f-b1f3-ec1767633e87 req-f7cf39a4-3676-40ae-a1a0-b3784916f1d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072085 Oct 31 15:15:35.407072 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 182/331] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:35.435509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:35.444346 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6564e856-a212-42f3-b772-d42c9712bdf4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.379791 Oct 31 15:15:35.445220 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 150/332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:35 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:35.866349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9139000a-18f4-4974-8ab9-b874fddb88c0 tempest-InstanceUsageAuditLogTestJSON-1996680317 tempest-InstanceUsageAuditLogTestJSON-1996680317-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:35.914685 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9139000a-18f4-4974-8ab9-b874fddb88c0 tempest-InstanceUsageAuditLogTestJSON-1996680317 tempest-InstanceUsageAuditLogTestJSON-1996680317-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31 15:15:35" status: 200 len: 318 microversion: 2.1 time: 0.502872 Oct 31 15:15:35.926059 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 183/333] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:15:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2015%3A15%3A35 => generated 318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:35.930777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef5f85ac-8ea8-4d73-a67e-7a154c693a04 tempest-InstanceUsageAuditLogTestJSON-1996680317 tempest-InstanceUsageAuditLogTestJSON-1996680317-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:35.937082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=32 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:35.988117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef5f85ac-8ea8-4d73-a67e-7a154c693a04 tempest-InstanceUsageAuditLogTestJSON-1996680317 tempest-InstanceUsageAuditLogTestJSON-1996680317-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.060203 Oct 31 15:15:35.990010 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 151/334] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:15:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:36.113831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493610b0-1112-44d9-9df3-ad5800017cbd", "name": "network-vif-plugged", "status": "completed", "tag": "5ebe398a-c1d4-4693-900e-5b7c3460fcdb"}, {"server_uuid": "4230e338-4315-412b-ae2c-f9b1cc15fbee", "name": "network-vif-plugged", "status": "completed", "tag": "72f7a598-0311-4580-973c-6321a81b4a0f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:36.115309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:36.116076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:36.145284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.145782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.148651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.150665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.151627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.152288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.153566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.154357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.160034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.187617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] Creating event network-vif-plugged:5ebe398a-c1d4-4693-900e-5b7c3460fcdb for instance 493610b0-1112-44d9-9df3-ad5800017cbd on n-h2-858383-17 Oct 31 15:15:36.188482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] Creating event network-vif-plugged:72f7a598-0311-4580-973c-6321a81b4a0f for instance 4230e338-4315-412b-ae2c-f9b1cc15fbee on n-h2-858383-17 Oct 31 15:15:36.219782 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2465c770-ff8a-4982-9156-a8df0fa2a735 req-0f79b4cd-df41-4f9e-bc80-0771b1835d23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115001 Oct 31 15:15:36.221830 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 152/335] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:36.235901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:36.251987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:36.252687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:36.267622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.268677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.269472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.270376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.271010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.271611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.332478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:36.508116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:36.519349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:36.521205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:36.526576 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb95485e-4f0c-46dd-bc65-2f31007143d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.430554 Oct 31 15:15:36.527432 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 184/336] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:36 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:36.544721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1a59982-47f8-48ea-afad-2eca8bb59ecb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d87ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:36.648219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1a59982-47f8-48ea-afad-2eca8bb59ecb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.117733 Oct 31 15:15:36.650813 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 185/337] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:36 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:36.667509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:36.668393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:36.686182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.686916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.687595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.688391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:36.689009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:36.689528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:36.769714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:36.785417 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da09d924-7bf1-4459-9d91-7718f1feead2 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.537396 Oct 31 15:15:36.786548 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 153/338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:36 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:37.031897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:37.044530 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-adafb6f9-63f8-4880-8d4b-bff8fd35c65e tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.390586 Oct 31 15:15:37.058350 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 186/339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:36 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:37.555970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:37.556584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:37.564478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.565249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.565881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.566947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.567564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.568164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.621470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:37.624067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.625183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.625840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.626915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.627579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.628209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.710530 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4352b6e1-ac5b-4dd5-97b2-e5684904e07d tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.581320 Oct 31 15:15:37.714683 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 154/340] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Oct 31 15:15:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:37.726605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3d223e4-ae4f-49a5-8c6b-7199272bb3b4 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca3052ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:37.831750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3d223e4-ae4f-49a5-8c6b-7199272bb3b4 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.113883 Oct 31 15:15:37.832323 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 155/341] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:37 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:37.839718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:37.845005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.852107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.857440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.858522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.859196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.859907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.925979 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b05c7cd-2275-474e-a90b-764f35a06aed tempest-AZAdminV2TestJSON-676159111 tempest-AZAdminV2TestJSON-676159111-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.091607 Oct 31 15:15:37.926877 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 156/342] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:15:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:37.945733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:37.950044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:37.957280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:37.966343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:37.972121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:37.976938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.983623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab5ead56-7446-457b-ab20-eb8d445b3582 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1362 microversion: 2.25 time: 0.431357 Oct 31 15:15:37.985423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 187/343] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:37 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:37.986408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.991376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:37.992369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:37.993041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:37.993675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:38.068307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:38.069646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:38.081786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:38.082526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:38.084427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:38.085340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:38.086267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:38.088377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:38.436517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:38.455393 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afad8de3-e3b1-49bf-b423-94d9a809b672 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1388 microversion: 2.1 time: 0.509369 Oct 31 15:15:38.458361 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 157/344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:37 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1388 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:38.741190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:38.755590 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13935d1c-f851-4ac1-a3e6-f90c84a52de4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.691798 Oct 31 15:15:38.757444 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 188/345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:38 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:38.847879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0102054-5627-4d8c-90d1-9397c1df76a2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca30529d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:38.932726 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0102054-5627-4d8c-90d1-9397c1df76a2 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.088709 Oct 31 15:15:38.942798 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 158/346] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:38 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:39.013907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:39.015924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:39.024587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.025115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.029096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.029916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.030557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.030994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.331797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:39.417693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:39.427627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:39.449584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:39.462549 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a3acd3d-5feb-43eb-bdfb-50a1faab4eee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1559 microversion: 2.25 time: 0.452902 Oct 31 15:15:39.463881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 189/347] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:39 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1559 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:39.492365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:39.493475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:39.506271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.507101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.507911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.509468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.510134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.510974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.895287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:39.909858 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f9bc8f6-444a-46bd-bdda-9b2547ea2fb9 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1587 microversion: 2.1 time: 0.429634 Oct 31 15:15:39.933909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:39.934712 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 159/348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:39 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1587 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:39.935152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:39.942950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:39.944961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:39.953537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.955044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.955698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.956422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.956990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.957438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.957557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.958061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.958504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:39.959221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:39.959685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:39.960732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.330449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:40.332386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 4230e338-4315-412b-ae2c-f9b1cc15fbee {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:40.342084 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02d771f1-d819-4417-a4fb-b67423a3e541 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.402261 Oct 31 15:15:40.343309 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 160/349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:39 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:40.349380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:40.350094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:40.357935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.359009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.359587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.360632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.361275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.361851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.501220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb6cd177-cc2c-402f-b9a7-c3b9284d8d99 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 2054 microversion: 2.25 time: 1.012875 Oct 31 15:15:40.503855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 190/350] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:39 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 2054 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:15:40.516499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bda4a68a-542f-42cc-9ad5-1c75d7c62ab0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2ce6550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:40.553453 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0695f60-965f-42ac-b5a1-38f434c42f0c tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208858 Oct 31 15:15:40.569047 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 161/351] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:15:40 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:40.573289 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bda4a68a-542f-42cc-9ad5-1c75d7c62ab0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.067601 Oct 31 15:15:40.574220 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 191/352] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:40 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:40.576316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:40.579619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:40.599189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.599955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.600588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.603093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.604521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.605170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.664343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:40.886014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 4230e338-4315-412b-ae2c-f9b1cc15fbee {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:40.951128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5778ceab-bc2f-4348-af39-41139cdd3ec1 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 2054 microversion: 2.25 time: 0.380099 Oct 31 15:15:40.952677 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 162/353] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:40 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 2054 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:40.979848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:40.983962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.985088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.985539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:40.986291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:40.986754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:40.987175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:41.073745 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9fc8272-b5de-430c-9583-ccd76f0d10ea tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.098244 Oct 31 15:15:41.079615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 192/354] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Oct 31 15:15:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:41.090531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": "auto"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:41.093723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:41.112906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:41.113402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:41.113858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:41.114562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:41.115017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:41.115448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:41.267942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'flavor' on Instance uuid 4230e338-4315-412b-ae2c-f9b1cc15fbee {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:41.367090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:41.368383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:41.374670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Going to try to live migrate instance to n-h1-858383-17 {{(pid=120626) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:15:41.384806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:41.388504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:41.391402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:41.392406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:41.395734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:41.397011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:41.397695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:41.882403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:41.891983 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48b18267-bb79-43ad-bebc-f8e8c5620ea8 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.529221 Oct 31 15:15:41.901910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 193/355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:41 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:41.919143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-233e10b8-4864-4154-a82a-359e6ac1acf0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2cd5280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:42.004750 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-233e10b8-4864-4154-a82a-359e6ac1acf0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.100750 Oct 31 15:15:42.014706 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 194/356] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:41 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:42.023054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-18daa4e7-df36-4741-908c-42b9d2342533 req-5a4c0b7c-f73f-40f6-b8b7-89046495005a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7e3259-1b68-489e-ab02-d4ea91763d40", "name": "network-vif-plugged", "status": "completed", "tag": "b21fc65e-80e2-4b64-ad5e-217d2fa3fe88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:42.056899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-18daa4e7-df36-4741-908c-42b9d2342533 req-5a4c0b7c-f73f-40f6-b8b7-89046495005a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:42.057694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-18daa4e7-df36-4741-908c-42b9d2342533 req-5a4c0b7c-f73f-40f6-b8b7-89046495005a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:42.060899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-18daa4e7-df36-4741-908c-42b9d2342533 req-5a4c0b7c-f73f-40f6-b8b7-89046495005a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:42.087431 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-18daa4e7-df36-4741-908c-42b9d2342533 req-5a4c0b7c-f73f-40f6-b8b7-89046495005a service nova] Creating event network-vif-plugged:b21fc65e-80e2-4b64-ad5e-217d2fa3fe88 for instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 on n-h1-858383-17 Oct 31 15:15:42.109279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-18daa4e7-df36-4741-908c-42b9d2342533 req-5a4c0b7c-f73f-40f6-b8b7-89046495005a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092826 Oct 31 15:15:42.111573 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 195/357] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:42.819906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c3a244c-fe7c-4c1e-b902-7f3917d4c0ee tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-903984881", "ram": 512, "vcpus": 1, "disk": 10, "id": 702234317, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:42.890767 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c3a244c-fe7c-4c1e-b902-7f3917d4c0ee tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.776985 Oct 31 15:15:42.901605 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 196/358] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:42 2022] POST /compute/v2.1/flavors => generated 412 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:42.907490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d596dac-ad44-4be2-9070-4fd024af0dff tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:42.971372 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d596dac-ad44-4be2-9070-4fd024af0dff tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067816 Oct 31 15:15:42.972784 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 197/359] 10.222.0.48 () {60 vars in 1221 bytes} [Mon Oct 31 15:15:42 2022] POST /compute/v2.1/flavors/702234317/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:42.982674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:42.983419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:42.991501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:42.991997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:42.992428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:42.993216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:42.993683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:42.994103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:43.255135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:43.271796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-002529aa-7b5f-4242-b666-8e4b3e9d0f38 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1320 microversion: 2.1 time: 0.297947 Oct 31 15:15:43.273793 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 198/360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:42 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:43.848554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8be7850f-adda-46d7-ac11-fc0f7345257a tempest-FlavorsExtraSpecsTestJSON-606668670 tempest-FlavorsExtraSpecsTestJSON-606668670-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:43.872577 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8be7850f-adda-46d7-ac11-fc0f7345257a tempest-FlavorsExtraSpecsTestJSON-606668670 tempest-FlavorsExtraSpecsTestJSON-606668670-project] 10.222.0.48 "GET /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.597243 Oct 31 15:15:43.873203 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 199/361] 10.222.0.48 () {58 vars in 1200 bytes} [Mon Oct 31 15:15:43 2022] GET /compute/v2.1/flavors/702234317/os-extra_specs => generated 66 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:43.883522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1128cf4d-e3e8-4ee5-929b-b6da2d86a4ab tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d40790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:43.965036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1128cf4d-e3e8-4ee5-929b-b6da2d86a4ab tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.085437 Oct 31 15:15:43.967554 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 200/362] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:43 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:43.977094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:43.977708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:43.993884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:43.998560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:43.999377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:44.001239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:44.003505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:44.004177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:44.262243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:44.274821 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23c68111-585c-43a3-8ebd-037b66f6ae8e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 200 len: 1587 microversion: 2.1 time: 0.303597 Oct 31 15:15:44.277566 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 201/363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:43 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 1587 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:44.303433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-69d96b27-b191-4f66-8ad8-0990879c9acd req-eb67d6ae-a4df-4e69-a840-12fc69af71d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493610b0-1112-44d9-9df3-ad5800017cbd", "tag": "5ebe398a-c1d4-4693-900e-5b7c3460fcdb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:44.345354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-69d96b27-b191-4f66-8ad8-0990879c9acd req-eb67d6ae-a4df-4e69-a840-12fc69af71d1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:44.346150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-69d96b27-b191-4f66-8ad8-0990879c9acd req-eb67d6ae-a4df-4e69-a840-12fc69af71d1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:44.346801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-69d96b27-b191-4f66-8ad8-0990879c9acd req-eb67d6ae-a4df-4e69-a840-12fc69af71d1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:44.365161 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-69d96b27-b191-4f66-8ad8-0990879c9acd req-eb67d6ae-a4df-4e69-a840-12fc69af71d1 service nova] Creating event network-changed:5ebe398a-c1d4-4693-900e-5b7c3460fcdb for instance 493610b0-1112-44d9-9df3-ad5800017cbd on n-h2-858383-17 Oct 31 15:15:44.379291 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-69d96b27-b191-4f66-8ad8-0990879c9acd req-eb67d6ae-a4df-4e69-a840-12fc69af71d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082082 Oct 31 15:15:44.392668 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 202/364] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:44.403566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97ce9390-7282-422c-8129-6eb6d8c75f73 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:44.446294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:44.459150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97ce9390-7282-422c-8129-6eb6d8c75f73 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062364 Oct 31 15:15:44.472947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 203/365] 10.222.0.48 () {60 vars in 1221 bytes} [Mon Oct 31 15:15:44 2022] POST /compute/v2.1/flavors/702234317/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:44.483354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:44.495472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:44.515010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:44.518214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:44.518736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:44.521216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:44.522460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:44.524737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:44.934799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:44.945805 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-070e47e2-beca-406d-94d4-a8b5562d9cbc tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1470 microversion: 2.1 time: 0.468807 Oct 31 15:15:44.946375 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 204/366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:44 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:44.956970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed7cc159-962d-4eb5-b712-105ab09e65ca tempest-FlavorsExtraSpecsTestJSON-606668670 tempest-FlavorsExtraSpecsTestJSON-606668670-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:44.990346 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed7cc159-962d-4eb5-b712-105ab09e65ca tempest-FlavorsExtraSpecsTestJSON-606668670 tempest-FlavorsExtraSpecsTestJSON-606668670-project] 10.222.0.48 "GET /compute/v2.1/flavors/702234317/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040221 Oct 31 15:15:44.991258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 205/367] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:15:44 2022] GET /compute/v2.1/flavors/702234317/os-extra_specs/hw:numa_nodes => generated 22 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:45.241958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1746469022", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:45.350115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:45.901753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:45.981406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:46.009647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:46.010197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:46.010637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:46.011056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:46.011556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:46.027672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:46.028770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:46.029416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:46.030520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:46.031141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:46.031728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:46.051828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:46.056365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:46.074030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:15:46.083274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:15:46.200777 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe523973-0378-4aeb-b891-2630027d5aed tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205540 Oct 31 15:15:46.206262 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 206/368] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:15:46.564879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1640704159", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:46.632779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:46.633270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:46.633810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:46.634481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:46.635159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:46.648293 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db0e1da8-1e3f-40a3-9e53-bc2ef681995d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee/action" status: 202 len: 0 microversion: 2.25 time: 5.560053 Oct 31 15:15:46.650673 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 163/369] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:15:41 2022] POST /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee/action => generated 0 bytes in 5566 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:15:46.651231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:46.652141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:46.653105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:46.654597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:46.655243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:46.655952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:46.659140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:46.661519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:46.689396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Getting quotas for project 6fbb8ccf45644c14a3bd483416186461. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:46.693911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Getting quotas for user 57e01cb3ed2f49778623932a0732b158 and project 6fbb8ccf45644c14a3bd483416186461. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:46.705099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:46.706928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:46.707964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:15:46.708975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:46.710948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:15:46.711331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:46.712946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:46.715661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:46.789899 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66139acc-016f-40a1-a215-c0078d1574a1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.582168 Oct 31 15:15:46.792179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 207/370] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:15:46.812676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d1f0085-c032-47e6-b637-e4bd1cae366b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2ce6ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:46.892020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d1f0085-c032-47e6-b637-e4bd1cae366b tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.097438 Oct 31 15:15:46.912809 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 208/371] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:46 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:46.923594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccdbae73-d2f9-46cd-9eb6-f1857cc2c09f tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:46.939363 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c2116d1-e906-4104-a8f0-4a7e211ed5b4 tempest-DeleteServersAdminTestJSON-1894514470 tempest-DeleteServersAdminTestJSON-1894514470-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40/action" status: 202 len: 0 microversion: 2.1 time: 0.284504 Oct 31 15:15:46.941967 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 164/372] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:15:46 2022] POST /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:15:46.950755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4460f3db-46d7-4092-af88-d9b77dc03b7b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:46.951384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4460f3db-46d7-4092-af88-d9b77dc03b7b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:46.989271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccdbae73-d2f9-46cd-9eb6-f1857cc2c09f tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074676 Oct 31 15:15:46.990427 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 209/373] 10.222.0.48 () {60 vars in 1221 bytes} [Mon Oct 31 15:15:46 2022] POST /compute/v2.1/flavors/702234317/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:47.213538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2db71f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:47.327983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.329414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.329818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.330626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.331095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.331559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.368032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4460f3db-46d7-4092-af88-d9b77dc03b7b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.397477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4460f3db-46d7-4092-af88-d9b77dc03b7b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1217 microversion: 2.1 time: 0.454386 Oct 31 15:15:47.398375 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 165/374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:46 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1217 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:47.423906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:47.427454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:47.434829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.435549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.436162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.437071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.437683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.438270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.540824 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3cee62aa-9839-4994-8b63-95f92ad7dfa6 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed" status: 200 len: 240 microversion: 2.36 time: 0.548896 Oct 31 15:15:47.548107 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 210/375] 10.222.0.48 () {62 vars in 1303 bytes} [Mon Oct 31 15:15:46 2022] PUT /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed => generated 240 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:47.548107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e215356-49fa-4eba-af3c-d6bcf5f82774 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:47.552426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e215356-49fa-4eba-af3c-d6bcf5f82774 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:47.776424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e215356-49fa-4eba-af3c-d6bcf5f82774 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.789961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e215356-49fa-4eba-af3c-d6bcf5f82774 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.797507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e215356-49fa-4eba-af3c-d6bcf5f82774 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.813591 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e215356-49fa-4eba-af3c-d6bcf5f82774 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "PUT /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1359 microversion: 2.75 time: 0.270649 Oct 31 15:15:47.814264 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 211/376] 10.222.0.48 () {62 vars in 1297 bytes} [Mon Oct 31 15:15:47 2022] PUT /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:47.820110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:47.820918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:47.828343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.829061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.829687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.830733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.831345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.832053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.850489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.866151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.873147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:47.874414 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-37b96966-b98f-4662-b7eb-69fa405e31a9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.474847 Oct 31 15:15:47.875006 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 166/377] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:47 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:47.881970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f686f59c-d064-48d2-a502-0a14067a4155 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:47.909064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:47.910594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:47.911441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:47.918902 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f686f59c-d064-48d2-a502-0a14067a4155 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041060 Oct 31 15:15:47.925445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:47.926304 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 167/378] 10.222.0.48 () {58 vars in 1200 bytes} [Mon Oct 31 15:15:47 2022] GET /compute/v2.1/flavors/702234317/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:47.928590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:47.937434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Calling method '.version_select at 0x7f5ca2d64310>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.072049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.072661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.073180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.074894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.075683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.076202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.099956 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08836159-08a9-4360-9a64-9f85c8e0e51a tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed/detail" status: 200 len: 672 microversion: 2.36 time: 0.172361 Oct 31 15:15:48.101201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 168/379] 10.222.0.48 () {60 vars in 1304 bytes} [Mon Oct 31 15:15:47 2022] GET /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed/detail => generated 672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:48.107758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.109382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:48.119457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.120447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.121729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.124016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.125321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.125986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.134184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:48.145949 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f84db71f-180d-481a-8aa5-65bedf1f2fae tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1453 microversion: 2.1 time: 0.330132 Oct 31 15:15:48.166536 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 212/380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:47 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1453 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:48.169477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9932903f-a2d5-4e47-9098-37de86d34504 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d04670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.257683 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9932903f-a2d5-4e47-9098-37de86d34504 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.094976 Oct 31 15:15:48.261074 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 213/381] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:48 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:48.283753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6a3b7aa-1470-47f9-8d6d-0d19bb659118 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:48.353756 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6a3b7aa-1470-47f9-8d6d-0d19bb659118 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/702234317/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.081289 Oct 31 15:15:48.362992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 214/382] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:15:48 2022] PUT /compute/v2.1/flavors/702234317/os-extra_specs/hw:numa_nodes => generated 22 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:48.377364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.377904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:48.398100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.398596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.399036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.399752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.400212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.400636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.458993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:15:48.517525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:48.530481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:48.536242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:48.558202 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b471745c-ce7f-46ff-846a-e79b89aebf2b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1355 microversion: 2.75 time: 0.455666 Oct 31 15:15:48.561261 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 169/383] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:48 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1355 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:48.571722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e17359f-6959-4e7d-b7ef-3058ac9c6111 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.593086 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e17359f-6959-4e7d-b7ef-3058ac9c6111 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028994 Oct 31 15:15:48.594495 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 170/384] 10.222.0.48 () {58 vars in 1200 bytes} [Mon Oct 31 15:15:48 2022] GET /compute/v2.1/flavors/702234317/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:48.607255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2de1ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:48.613671 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a97e3b11-f361-4c85-a229-e087abfdcc5c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 204 len: 0 microversion: 2.1 time: 0.248880 Oct 31 15:15:48.616674 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 215/385] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:15:48 2022] DELETE /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:15:48.626848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.631515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:48.646761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.647360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.648033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.648778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.649262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.649686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.713422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.714007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.715078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.715872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.716853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.717343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.747692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:48.753602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:48.756373 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2921e1a-098f-41b1-8731-06657a997de9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1275 microversion: 2.1 time: 0.136244 Oct 31 15:15:48.757281 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 216/386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:48 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:48.765207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0540044d-8d3e-4f98-abe5-15f39f95ec31 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.769447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.769947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.770582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.771516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.772125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.772919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.775275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:48.803816 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0540044d-8d3e-4f98-abe5-15f39f95ec31 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/702234317/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045232 Oct 31 15:15:48.805069 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 217/387] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:15:48 2022] DELETE /compute/v2.1/flavors/702234317/os-extra_specs/hw:numa_nodes => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:48.810687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.811586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:48.819865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.820618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.821268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.822183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.822786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.823383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.864425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:48.865061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:48.865642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:48.866084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:48.875868 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d470c9e-5331-419f-ba37-1d7ad512e028 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed?user_id=683091b7dba0443a99b0210ab9d76135" status: 200 len: 240 microversion: 2.36 time: 0.280087 Oct 31 15:15:48.876796 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 171/388] 10.222.0.48 () {62 vars in 1384 bytes} [Mon Oct 31 15:15:48 2022] PUT /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed?user_id=683091b7dba0443a99b0210ab9d76135 => generated 240 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:48.882016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52ab6bf9-2800-43b9-a3d4-30a9d73400af tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:48.915182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52ab6bf9-2800-43b9-a3d4-30a9d73400af tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/702234317/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036896 Oct 31 15:15:48.919724 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 172/389] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:15:48 2022] DELETE /compute/v2.1/flavors/702234317/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:15:48.927181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e919a088-ef70-4a83-afdc-0a779785c977 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] Calling method '.version_select at 0x7f5ca2d4ff70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.018607 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e919a088-ef70-4a83-afdc-0a779785c977 tempest-QuotasAdminTestV236-1354085459 tempest-QuotasAdminTestV236-1354085459-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed?user_id=683091b7dba0443a99b0210ab9d76135" status: 200 len: 282 microversion: 2.36 time: 0.096303 Oct 31 15:15:49.019402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 173/390] 10.222.0.48 () {60 vars in 1364 bytes} [Mon Oct 31 15:15:48 2022] GET /compute/v2.1/os-quota-sets/d6179bdf24ee48dfadc9064f7e0053ed?user_id=683091b7dba0443a99b0210ab9d76135 => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:49.035923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.037420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:49.051386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:49.051961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:49.052682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:49.054952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:49.055103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.061444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:49.061980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:49.065519 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a6e0634-c83c-4775-9c38-10a70b8f3abe tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1459 microversion: 2.1 time: 0.259106 Oct 31 15:15:49.066216 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 218/391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:48 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1459 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:49.086338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50d8b130-51f8-43fa-86c6-b8dd2c5944bc tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.097386 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50d8b130-51f8-43fa-86c6-b8dd2c5944bc tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/702234317/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019109 Oct 31 15:15:49.097968 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 219/392] 10.222.0.48 () {58 vars in 1200 bytes} [Mon Oct 31 15:15:49 2022] GET /compute/v2.1/flavors/702234317/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:15:49.111211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-614be87b-b6b5-46a9-98da-607246b66fbd tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.141521 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-614be87b-b6b5-46a9-98da-607246b66fbd tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/702234317" status: 202 len: 0 microversion: 2.1 time: 0.034089 Oct 31 15:15:49.142384 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 220/393] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:15:49 2022] DELETE /compute/v2.1/flavors/702234317 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:15:49.158245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ec0f3d9-3753-411c-93db-fc8779c90861 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.197278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ec0f3d9-3753-411c-93db-fc8779c90861 tempest-FlavorsExtraSpecsTestJSON-258194829 tempest-FlavorsExtraSpecsTestJSON-258194829-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.048906 Oct 31 15:15:49.198201 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 221/394] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:15:49 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:49.267327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.276615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-245a8d37-75c5-41eb-b924-48a60e16f8da tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d878b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.278648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.280584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.282194 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e845f9c5-e4b8-4a3e-b71c-3f8da5ccf7c4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.261080 Oct 31 15:15:49.282913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 174/395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:49 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:49.345318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-245a8d37-75c5-41eb-b924-48a60e16f8da tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.072392 Oct 31 15:15:49.346554 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 222/396] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:49 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:49.594664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.596600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:49.607835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:49.608334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:49.608801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:49.609510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:49.615679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:49.616147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:49.758481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.767358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.768995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.781108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:49.782083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:49.787340 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20faf11c-3248-4c7c-be2f-bfc577f8c9c6 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1411 microversion: 2.75 time: 0.198632 Oct 31 15:15:49.790144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 175/397] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:49 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1411 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:49.791896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:49.793142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:49.794092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:49.795017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:49.795631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:49.796370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:49.882595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:49.904441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13920b5b-7b98-48a7-9fbe-c7bb5c3b8297 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1275 microversion: 2.1 time: 0.118125 Oct 31 15:15:49.909800 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 223/398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:49 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:50.089287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:50.090809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:50.098228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.098719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.099385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:50.100572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.101264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.102124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:50.211707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.214073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.215372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:50.216007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:50.314618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:50.315252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:50.330157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.331214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.331670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:50.332537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.339173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.340328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:50.757150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:50.773328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:50.775331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:50.777936 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c79f5d28-47f3-4c07-ba1d-9bd3cfdc28c1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.468485 Oct 31 15:15:50.778749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 224/399] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:50 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:15:50.786238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bea9a6d7-1d34-473e-b030-bcf24379b772 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2d87160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:50.898201 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bea9a6d7-1d34-473e-b030-bcf24379b772 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.116261 Oct 31 15:15:50.913509 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 225/400] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:50 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:50.930713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:50.933713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:50.951314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.952210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.954152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:50.956026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:50.957473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:50.958143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:51.079435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:51.093429 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-83bb4f7b-e89c-4ff8-9f77-e9bab14034a4 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1459 microversion: 2.1 time: 1.004434 Oct 31 15:15:51.095245 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 176/401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:50 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1459 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:51.112084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:51.114455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:51.130270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:51.135782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:51.136771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:51.139583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:51.142643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:51.143259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:51.411696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:51.421241 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e8369db-6fb1-4454-97b5-1f09c027e915 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1275 microversion: 2.1 time: 0.323905 Oct 31 15:15:51.422426 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 177/402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:51 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:51.424303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:51.435113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:51.436567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:51.454135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6de54b70-df78-40de-acbf-4c1876821451 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1419 microversion: 2.75 time: 0.539110 Oct 31 15:15:51.484983 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 226/403] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:50 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1419 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:51.532344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6952f7b0-39bf-4115-92a6-951ce2cf4c4e req-510ff405-e6f4-4b04-9ae5-20b3963b3bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4230e338-4315-412b-ae2c-f9b1cc15fbee", "name": "network-vif-unplugged", "status": "completed", "tag": "72f7a598-0311-4580-973c-6321a81b4a0f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:51.549907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6952f7b0-39bf-4115-92a6-951ce2cf4c4e req-510ff405-e6f4-4b04-9ae5-20b3963b3bab service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:51.550878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6952f7b0-39bf-4115-92a6-951ce2cf4c4e req-510ff405-e6f4-4b04-9ae5-20b3963b3bab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:51.551906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6952f7b0-39bf-4115-92a6-951ce2cf4c4e req-510ff405-e6f4-4b04-9ae5-20b3963b3bab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:51.570137 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6952f7b0-39bf-4115-92a6-951ce2cf4c4e req-510ff405-e6f4-4b04-9ae5-20b3963b3bab service nova] Creating event network-vif-unplugged:72f7a598-0311-4580-973c-6321a81b4a0f for instance 4230e338-4315-412b-ae2c-f9b1cc15fbee on n-h2-858383-17 Oct 31 15:15:51.586673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6952f7b0-39bf-4115-92a6-951ce2cf4c4e req-510ff405-e6f4-4b04-9ae5-20b3963b3bab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060371 Oct 31 15:15:51.592076 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 178/404] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:51.815472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:51.816980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:51.823543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:51.825189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:51.825792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:51.826807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:51.827426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:51.828039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:51.916887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32468d76-1887-40a3-94e3-bd6421103657 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2c4ea60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:51.982219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32468d76-1887-40a3-94e3-bd6421103657 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1423 microversion: 2.1 time: 0.070323 Oct 31 15:15:51.982809 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 179/405] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:51 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:52.126934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:52.127505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:52.153031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.153834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.155285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.158258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.179704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.186288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.307407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.307906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.308463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.309240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:52.554018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.568264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-462f1618-fbdf-4ae6-a04a-201c2c3929d9 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1417 microversion: 2.1 time: 0.450617 Oct 31 15:15:52.569128 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 180/406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:52 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1417 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:52.595102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.598226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-27a3e662-8f0e-4674-98dd-9a97185b4209 req-05181ead-9888-4fba-a59d-5f9194aadc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7e3259-1b68-489e-ab02-d4ea91763d40", "name": "network-vif-deleted", "tag": "b21fc65e-80e2-4b64-ad5e-217d2fa3fe88"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:52.610892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.616316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-27a3e662-8f0e-4674-98dd-9a97185b4209 req-05181ead-9888-4fba-a59d-5f9194aadc51 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.616517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.618598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-27a3e662-8f0e-4674-98dd-9a97185b4209 req-05181ead-9888-4fba-a59d-5f9194aadc51 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.621384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-27a3e662-8f0e-4674-98dd-9a97185b4209 req-05181ead-9888-4fba-a59d-5f9194aadc51 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.622712 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-794a944e-f714-41b6-a7f8-a28f5dfaf8c9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.811630 Oct 31 15:15:52.626038 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 227/407] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:51 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:52.639053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:52.640346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:52.649052 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-27a3e662-8f0e-4674-98dd-9a97185b4209 req-05181ead-9888-4fba-a59d-5f9194aadc51 service nova] Creating event network-vif-deleted:b21fc65e-80e2-4b64-ad5e-217d2fa3fe88 for instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 on n-h1-858383-17 Oct 31 15:15:52.659486 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-27a3e662-8f0e-4674-98dd-9a97185b4209 req-05181ead-9888-4fba-a59d-5f9194aadc51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065552 Oct 31 15:15:52.660524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 181/408] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:52.664057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.664363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.664854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.666017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.666482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.666905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.678242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:52.679301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:52.687173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.698990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.699673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.700621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:52.701319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:52.701955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:52.860102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.870879 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32e997ec-6328-4945-9676-0739ee45f0b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1275 microversion: 2.1 time: 0.242100 Oct 31 15:15:52.887583 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 228/409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:52 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:52.904941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.918783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:52.932271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.940047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:52.956192 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c8a1d21-2fa7-41c8-9384-4e9f7efab9b2 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1417 microversion: 2.75 time: 0.291430 Oct 31 15:15:52.957328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 182/410] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:52 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1417 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:53.000378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-420600d4-b772-493a-9b65-866e35faa2a7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2c18820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.078349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-420600d4-b772-493a-9b65-866e35faa2a7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1432 microversion: 2.1 time: 0.082274 Oct 31 15:15:53.079241 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 229/411] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:52 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1432 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:53.095164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-933c2d23-e79b-4a13-bd97-7694953cc48e tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2ca30d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.154816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-933c2d23-e79b-4a13-bd97-7694953cc48e tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 200 len: 1432 microversion: 2.1 time: 0.065484 Oct 31 15:15:53.164974 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 183/412] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:53 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 1432 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:53.170972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.171593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:53.179577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.180272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.180936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.181654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.182270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.182859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.463463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:53.474082 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6f0cdad-a6cb-4be5-965f-dc4bfea4f9f3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1479 microversion: 2.1 time: 0.307609 Oct 31 15:15:53.474976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 230/413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:53 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1479 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:53.600454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.601349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:53.609142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5168c76d-03ce-41f5-92c1-a4451e383f1d req-57b1a09e-a38f-4291-acbd-5ece3cf34801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4230e338-4315-412b-ae2c-f9b1cc15fbee", "tag": "72f7a598-0311-4580-973c-6321a81b4a0f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:53.610565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.611061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.611695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.612650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.613305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.613904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.626736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5168c76d-03ce-41f5-92c1-a4451e383f1d req-57b1a09e-a38f-4291-acbd-5ece3cf34801 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.627228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5168c76d-03ce-41f5-92c1-a4451e383f1d req-57b1a09e-a38f-4291-acbd-5ece3cf34801 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.627710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5168c76d-03ce-41f5-92c1-a4451e383f1d req-57b1a09e-a38f-4291-acbd-5ece3cf34801 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.642717 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5168c76d-03ce-41f5-92c1-a4451e383f1d req-57b1a09e-a38f-4291-acbd-5ece3cf34801 service nova] Creating event network-changed:72f7a598-0311-4580-973c-6321a81b4a0f for instance 4230e338-4315-412b-ae2c-f9b1cc15fbee on n-h2-858383-17 Oct 31 15:15:53.648321 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5168c76d-03ce-41f5-92c1-a4451e383f1d req-57b1a09e-a38f-4291-acbd-5ece3cf34801 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046046 Oct 31 15:15:53.649675 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 231/414] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:53.656074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.657008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.657766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.658550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:53.667126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.668412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:53.682752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.683376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.683825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.684982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.687358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.688862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.704982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:53.713150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69289a04-1a07-4a86-8616-21f7a749798c tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1417 microversion: 2.1 time: 0.125452 Oct 31 15:15:53.717211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 184/415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:53 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1417 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:53.897992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.899340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:53.910616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.913050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.913606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.914569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:53.915184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:53.915764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:53.955965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:53.967239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:53.968935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:53.970767 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6eb92e68-322e-44a0-bfc7-03c74c69d660 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.315165 Oct 31 15:15:53.972404 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 232/416] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:53 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:53.995835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:53.996802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:54.017696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.017696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.023020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.023852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.024672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.025157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.243896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:54.246547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:54.250679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:54.266529 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bda554e3-0dbe-44f0-b3a7-4c879006ba38 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1417 microversion: 2.75 time: 0.277916 Oct 31 15:15:54.273064 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 233/417] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:53 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1417 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:15:54.299417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:54.312862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f611330-d1e3-41fa-8247-34d45a9d3100 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.422093 Oct 31 15:15:54.313784 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 185/418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:53 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:54.498347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:54.499145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:54.505409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.506391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.507195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.508316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.508909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.509668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.793379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93aad387-1d1e-4026-95a4-8744a9100d43 tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1546912971", "id": 765445147, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:54.827142 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93aad387-1d1e-4026-95a4-8744a9100d43 tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.253441 Oct 31 15:15:54.827962 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 186/419] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:15:54 2022] POST /compute/v2.1/flavors => generated 465 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:54.833073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:54.833873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:54.844343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:54.849930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.850667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.851263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.852138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.852819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.853625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.861467 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9c1d98e-9ff5-4952-90e4-bab5ec8fb489 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1479 microversion: 2.1 time: 0.365994 Oct 31 15:15:54.862875 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 234/420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:54 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1479 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:15:54.903367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:54.905869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:54.906736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:54.907355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:54.907813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:55.007752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.017733 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75405da0-a3eb-4d2d-9b8b-5a1ac2e6d3ad tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1310 microversion: 2.1 time: 0.188361 Oct 31 15:15:55.018847 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 187/421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:54 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:55.039317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.040610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:55.049169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.049673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.050383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.051264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.051873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.052559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.091405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8885ba25-9648-41ab-ab0a-2c207e2317df tempest-FlavorsV261TestJSON-2135074730 tempest-FlavorsV261TestJSON-2135074730-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.100990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8885ba25-9648-41ab-ab0a-2c207e2317df tempest-FlavorsV261TestJSON-2135074730 tempest-FlavorsV261TestJSON-2135074730-project] 10.222.0.48 "GET /compute/v2.1/flavors/765445147" status: 200 len: 465 microversion: 2.61 time: 0.235442 Oct 31 15:15:55.101539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 235/422] 10.222.0.48 () {60 vars in 1196 bytes} [Mon Oct 31 15:15:54 2022] GET /compute/v2.1/flavors/765445147 => generated 465 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:15:55.115240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3b5c478-8d6c-4903-8b2c-3a04c7892401 tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca436ba60>, body: {"flavor": {"description": "new"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:55.153974 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3b5c478-8d6c-4903-8b2c-3a04c7892401 tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/765445147" status: 200 len: 466 microversion: 2.61 time: 0.042304 Oct 31 15:15:55.154583 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 236/423] 10.222.0.48 () {62 vars in 1216 bytes} [Mon Oct 31 15:15:55 2022] PUT /compute/v2.1/flavors/765445147 => generated 466 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:15:55.274159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2404e635-f878-47c5-8e40-1091ccb73bf3 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Calling method '.version_select at 0x7f5ca2c82550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.300440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.310918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.314115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.316065 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42d8747a-bbb7-467e-b2f7-b7c2e9eb303d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.295342 Oct 31 15:15:55.316716 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 188/424] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:55.330227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-954f4872-77ea-4c3f-8380-2b85ca82adae tempest-FlavorsV261TestJSON-2135074730 tempest-FlavorsV261TestJSON-2135074730-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.351342 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2404e635-f878-47c5-8e40-1091ccb73bf3 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 371 microversion: 2.1 time: 0.195701 Oct 31 15:15:55.351928 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 237/425] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:55.358255 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-954f4872-77ea-4c3f-8380-2b85ca82adae tempest-FlavorsV261TestJSON-2135074730 tempest-FlavorsV261TestJSON-2135074730-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 7151 microversion: 2.61 time: 0.032648 Oct 31 15:15:55.358980 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 189/426] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/flavors/detail => generated 7151 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:55.364104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.364897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:55.365043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.365718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:55.372001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.372610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.372958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.373342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.373457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.374018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.374343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.374714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.375001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.375531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.375660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.376223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.470738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.478766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.480870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.485890 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f029ec1-3598-43fa-bd30-674567e5919b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1417 microversion: 2.75 time: 0.125074 Oct 31 15:15:55.486467 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 238/427] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1417 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:55.491384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2c82b80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:55.539364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:55.549610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bba78c97-59f0-432a-8d96-ada68d7d5f18 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.188809 Oct 31 15:15:55.560761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 190/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:55.560761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f769b44b-8b6d-4b95-b3bf-0965a19f992e tempest-FlavorsV261TestJSON-2135074730 tempest-FlavorsV261TestJSON-2135074730-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.581276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.582165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.582782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.583691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.588320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.588790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.598544 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f769b44b-8b6d-4b95-b3bf-0965a19f992e tempest-FlavorsV261TestJSON-2135074730 tempest-FlavorsV261TestJSON-2135074730-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3678 microversion: 2.61 time: 0.046227 Oct 31 15:15:55.601124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 191/429] 10.222.0.48 () {60 vars in 1166 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/flavors => generated 3678 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:55.620769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2f02517-9089-4cd0-bbd3-d97b3e1842fa tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.643423 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2f02517-9089-4cd0-bbd3-d97b3e1842fa tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/765445147" status: 202 len: 0 microversion: 2.61 time: 0.025708 Oct 31 15:15:55.648216 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 192/430] 10.222.0.48 () {60 vars in 1199 bytes} [Mon Oct 31 15:15:55 2022] DELETE /compute/v2.1/flavors/765445147 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:15:55.654652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-449462b3-511d-495d-b401-78e62deee3a9 tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.683104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-449462b3-511d-495d-b401-78e62deee3a9 tempest-FlavorsV261TestJSON-868337948 tempest-FlavorsV261TestJSON-868337948-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.033001 Oct 31 15:15:55.683721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 193/431] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:55.685110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2735222f-0a40-4435-8861-cf5a819a30cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 328 microversion: 2.1 time: 0.195253 Oct 31 15:15:55.685986 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 239/432] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:15:55 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:55.689009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-440f6ecf-fbad-4934-81a7-a1295eda1de5 req-b16fb21b-fd7f-4be0-94bd-cff96c1bde60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806", "tag": "fc5fea4c-684c-42ac-8570-5fdf23b00582"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:55.719762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-440f6ecf-fbad-4934-81a7-a1295eda1de5 req-b16fb21b-fd7f-4be0-94bd-cff96c1bde60 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.720145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-440f6ecf-fbad-4934-81a7-a1295eda1de5 req-b16fb21b-fd7f-4be0-94bd-cff96c1bde60 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.722852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-440f6ecf-fbad-4934-81a7-a1295eda1de5 req-b16fb21b-fd7f-4be0-94bd-cff96c1bde60 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.736261 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-440f6ecf-fbad-4934-81a7-a1295eda1de5 req-b16fb21b-fd7f-4be0-94bd-cff96c1bde60 service nova] Creating event network-changed:fc5fea4c-684c-42ac-8570-5fdf23b00582 for instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 on n-h1-858383-17 Oct 31 15:15:55.742458 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-440f6ecf-fbad-4934-81a7-a1295eda1de5 req-b16fb21b-fd7f-4be0-94bd-cff96c1bde60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056597 Oct 31 15:15:55.743428 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 194/433] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:55.885047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2053939441", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:55.887834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:55.888523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:55.895174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.895653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.896081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.896788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:55.897232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:55.897679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:55.950919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:56.172745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.182084 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1057a51d-628e-4921-a143-b6cf2246cbf6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1466 microversion: 2.1 time: 0.298805 Oct 31 15:15:56.183443 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 195/434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:55 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1466 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:56.202446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:56.203077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:56.209483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.210444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.210444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.211064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.211519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.211934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.244131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.244610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.245084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.246123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lazy-loading 'fault' on Instance uuid 5b7e3259-1b68-489e-ab02-d4ea91763d40 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:15:56.285354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:56.285852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:56.286396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:56.287910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:56.289148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:56.304902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152129719036444687e3b8e8bd5460e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5058292e9d48358327b2127517ea93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.306257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.306822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.307327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.309475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.310016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.310509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.313606 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e9a9dcf-11ec-4b7f-8bfc-cfca34df4f11 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 200 len: 1310 microversion: 2.1 time: 0.128966 Oct 31 15:15:56.314179 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 196/435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:56 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 1310 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:56.327730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e1809d2-91ff-4bc1-bbf3-da3cc141c547 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2ca3280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:56.336605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Getting quotas for project d0ff37f42fa844bb911ef63630550a48. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:56.342330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Getting quotas for user 712962b6996746d494c5b5ee2eda845a and project d0ff37f42fa844bb911ef63630550a48. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:56.358155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.utils [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] cores quota exceeded for d0ff37f42fa844bb911ef63630550a48, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120625) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 15:15:56.359006 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Request method failure captured: Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 145 Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-aqdXbFQLoh9nwldGgde3bAwNQGyj9-jQYhEfGmmHc-GSqen6OvAsjbAYbk-2bZ9_sln6jxchEirT-IyM82vQPdoQEqebz0i0yjgTDQcDnfZt2OmQiYlzs7O_-LRHksPcyZJJKzci786kC_zeQDMls06RIPfqIw-ikqc6vhvd3qEGY Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:15:56.363592 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 712962b6996746d494c5b5ee2eda845a Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2053939441", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} Oct 31 15:15:56.365084 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2053939441', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452'}}} Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 15:15:56.366062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:56.367614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.369069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:56.371089 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:56.371089 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:56.371089 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:56.371089 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:56.371089 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:15:56.371089 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:56.372464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:56.373468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f24d089f-2b5a-45cf-a02d-1de5ba7e1e7e tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.551768 Oct 31 15:15:56.377376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 240/436] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:55 2022] POST /compute/v2.1/servers => generated 111 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:15:56.378906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:56.379513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:56.380577 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e1809d2-91ff-4bc1-bbf3-da3cc141c547 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/967f19e9-45bc-4d95-8300-59f1ed239b9a" status: 200 len: 784 microversion: 2.1 time: 0.065207 Oct 31 15:15:56.382123 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 197/437] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:56 2022] GET /compute/v2.1/images/967f19e9-45bc-4d95-8300-59f1ed239b9a => generated 784 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:56.387097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2de1e50>, body: {"quota_set": {"cores": 20}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:56.400676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.401315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.402336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.403736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.404205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.404968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.693864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.710744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.715206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.716891 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b3dc1cc-f29a-4fe1-9a88-92154b2684b7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.341868 Oct 31 15:15:56.724272 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 241/438] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:56 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:56.729795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-415fef0d-df5c-4408-8a18-7d4b91b894c3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:56.742590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:56.749520 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-415fef0d-df5c-4408-8a18-7d4b91b894c3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023827 Oct 31 15:15:56.750788 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 242/439] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:15:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:56.764026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:56.764669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.764953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:56.765181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.765772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.766490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.767122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.767539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.771708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.772203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.772637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.773443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.774778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.775152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.845833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b44bcf47-adca-4c35-ba15-edbdce0cd2b1 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 329 microversion: 2.1 time: 0.462356 Oct 31 15:15:56.846477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 198/440] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:15:56 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 329 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:56.851716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:56.852639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:56.860045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.860523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.860958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.862211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:56.862896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:56.863412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:56.867391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.877255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.878712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:56.883853 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b03b79a7-84f3-4eb5-a6ab-99b068c88329 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1438 microversion: 2.75 time: 0.131878 Oct 31 15:15:56.884419 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 243/441] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:56 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:56.890033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c31760ea-6b81-463e-83b7-0036c14cc2cd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2c18c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.011923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.019770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db46d78e-07fd-41d4-9291-2e100909cae5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.172122 Oct 31 15:15:57.021039 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 199/442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:56 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:57.026786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc94b76c-b3b6-439a-bb27-7822e3f8c1c3 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Calling method '.version_select at 0x7f5ca2c5c790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.272013 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc94b76c-b3b6-439a-bb27-7822e3f8c1c3 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 371 microversion: 2.1 time: 0.249799 Oct 31 15:15:57.273349 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 200/443] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:15:57 2022] GET /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:57.282831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:57.285924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.293888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.295000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.295451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.296240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.296805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.297673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.389701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:57.390278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:57.390583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:57.390959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:57.391553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:57.461828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.474809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.476843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.478750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.482346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.482948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.485193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.573077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.582716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.584384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.589788 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c31760ea-6b81-463e-83b7-0036c14cc2cd tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "DELETE /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 204 len: 0 microversion: 2.1 time: 0.703735 Oct 31 15:15:57.590371 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 244/444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:56 2022] DELETE /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:15:57.594599 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2e1ef3e-8da2-46ce-a44e-3ed41fe12956 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "POST /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4/action" status: 202 len: 1495 microversion: 2.75 time: 0.316621 Oct 31 15:15:57.595032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2bb1310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:57.595262 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 201/445] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:15:57 2022] POST /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4/action => generated 1495 bytes in 321 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:15:57.599831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.600443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.612112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.613097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.613771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.614855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.615574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.616827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.632963 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] HTTP exception thrown: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Request method failure captured: Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 HTTP/1.1 Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZeAf0JV0KbfRDfJGoGbxrjRQcIOwbjnHzo6ggYlFF-Onmol9mOCdxzJVWwkrHNY-BBry2S0OWaezvOLEyDqvKQx9QEKuaKfxBb2cvVnDO4NugB64UnuYUVOiWiAj5Cqd5ZwxntwOiVntVcE5t_y6OVIUDM99ZbHrIT60qwJUzAVAE Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:57.634669 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd5058292e9d48358327b2127517ea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd5058292e9d48358327b2127517ea93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 152129719036444687e3b8e8bd5460e7 Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.636156 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5b7e3259-1b68-489e-ab02-d4ea91763d40'} Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:57.637063 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.638397 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.639595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Returning 404 to user: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:57.639595 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39a437d7-6f58-4726-99a9-c4f8f486c823 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 404 len: 111 microversion: 2.1 time: 0.039863 Oct 31 15:15:57.639595 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 202/446] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:57 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:57.641611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fb96cdd7-75b8-4ec9-b5d2-6ebc74c87571 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2c13ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.666559 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-fb96cdd7-75b8-4ec9-b5d2-6ebc74c87571 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] HTTP exception thrown: Image not found. Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fb96cdd7-75b8-4ec9-b5d2-6ebc74c87571 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Request method failure captured: Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e HTTP/1.1 Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2SSLbqIL43MZq4-WoxYC_WNecvteE7XnLRoHAh6_pn6jus3WOwHtLtv_mGaqOVpZrieaAimDTNinyy6uNWCVyBJWgi62S5AjBWgWC-sLuNpf2f-bJ174o_IE1zrcmt-_jqMUoc6PyGnih6do3v-qEbhB4fnTiQqIh7IaMKH1f9kY Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8bac2d5104974de8961402403f40e257 Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:57.675418 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bac2d5104974de8961402403f40e257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bac2d5104974de8961402403f40e257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bac2d5104974de8961402403f40e257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bac2d5104974de8961402403f40e257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8bac2d5104974de8961402403f40e257 Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesOneServerTestJSON-1821284362-project Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 4fdcccbb6840445290ea2e578488e759 Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesOneServerTestJSON-1821284362-project Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '024df0ec-f5a1-417b-903f-b9a1a366a01e'} Oct 31 15:15:57.681211 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:15:57.682313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 024df0ec-f5a1-417b-903f-b9a1a366a01e Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:15:57.684181 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 024df0ec-f5a1-417b-903f-b9a1a366a01e could not be found. Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:15:57.687320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fb96cdd7-75b8-4ec9-b5d2-6ebc74c87571 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:57.689389 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fb96cdd7-75b8-4ec9-b5d2-6ebc74c87571 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 404 len: 62 microversion: 2.1 time: 0.039344 Oct 31 15:15:57.690604 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 203/447] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:57 2022] GET /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:15:57.690604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.690604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.693316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.693999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.694450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.696198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.696316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.696763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.775076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.783566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.785183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:57.790230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-386d6f20-3e4c-4c9c-a1bc-168fe1c5673f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.111194 Oct 31 15:15:57.790912 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 204/448] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:57 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:57.796376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.796959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.803229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.804149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.804819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.805691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.806439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.807058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.822511 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] HTTP exception thrown: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Request method failure captured: Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 HTTP/1.1 Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZeAf0JV0KbfRDfJGoGbxrjRQcIOwbjnHzo6ggYlFF-Onmol9mOCdxzJVWwkrHNY-BBry2S0OWaezvOLEyDqvKQx9QEKuaKfxBb2cvVnDO4NugB64UnuYUVOiWiAj5Cqd5ZwxntwOiVntVcE5t_y6OVIUDM99ZbHrIT60qwJUzAVAE Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:57.824585 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd5058292e9d48358327b2127517ea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd5058292e9d48358327b2127517ea93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 152129719036444687e3b8e8bd5460e7 Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.825827 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5b7e3259-1b68-489e-ab02-d4ea91763d40'} Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:57.826490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:57.827606 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:57.828715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Returning 404 to user: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:57.828715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-001e88fb-b37c-470f-ade3-7a602a79a12d tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 404 len: 111 microversion: 2.1 time: 0.034059 Oct 31 15:15:57.828715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 205/449] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:15:57 2022] DELETE /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:57.831466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1302201988"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:57.833863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.840953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.841702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.842139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.843509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.844766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.845247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.918590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.919115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.919631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.920549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.921094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.921582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.974603 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c76706aa-7f37-495c-ae48-460e40fcf19d tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 328 microversion: 2.1 time: 0.382676 Oct 31 15:15:57.975688 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 245/450] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:15:57 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 328 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:57.981563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:57.982351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:57.990646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.991341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.991966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:57.993324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:57.993949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:57.994576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.059390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:58.094041 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a181625-95ab-4ff6-a909-737b0dd3d116 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "POST /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94/action" status: 202 len: 0 microversion: 2.1 time: 0.265925 Oct 31 15:15:58.095356 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 206/451] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:15:57 2022] POST /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:15:58.102073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.103026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 5b7e3259-1b68-489e-ab02-d4ea91763d40] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:58.116511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.117703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.118343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.119393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.120302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.120953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.139931 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] HTTP exception thrown: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Request method failure captured: Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 HTTP/1.1 Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ZeAf0JV0KbfRDfJGoGbxrjRQcIOwbjnHzo6ggYlFF-Onmol9mOCdxzJVWwkrHNY-BBry2S0OWaezvOLEyDqvKQx9QEKuaKfxBb2cvVnDO4NugB64UnuYUVOiWiAj5Cqd5ZwxntwOiVntVcE5t_y6OVIUDM99ZbHrIT60qwJUzAVAE Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:58.142218 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd5058292e9d48358327b2127517ea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd5058292e9d48358327b2127517ea93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 152129719036444687e3b8e8bd5460e7 Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:58.143607 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5b7e3259-1b68-489e-ab02-d4ea91763d40'} Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:58.144401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. Oct 31 15:15:58.145761 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.149010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Returning 404 to user: Instance 5b7e3259-1b68-489e-ab02-d4ea91763d40 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:58.150483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45efda46-4e76-4a87-97c4-a930314b9632 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40" status: 404 len: 111 microversion: 2.1 time: 0.053523 Oct 31 15:15:58.151223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 207/452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:58 2022] GET /compute/v2.1/servers/5b7e3259-1b68-489e-ab02-d4ea91763d40 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:58.170435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.171365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:58.180963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.181458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.181891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.182617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.183637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.184100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.429542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.438703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.440153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.442984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59e007d1-488f-4d03-8c97-748ebcc1d3dc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.466149 Oct 31 15:15:58.443122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.443616 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 246/453] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:57 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:58.448043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-215fd747-ed0e-4483-aa15-e520b5c45e7f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b4aee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.460637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2400b4ac-356f-405f-b1b2-34cefdc68b82 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.302589 Oct 31 15:15:58.461237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 208/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:58 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:58.466343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1062659593", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:58.512844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-215fd747-ed0e-4483-aa15-e520b5c45e7f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.061510 Oct 31 15:15:58.513315 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 247/455] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:58 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:15:58.517913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.518406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:58.529127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:15:58.529287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.529817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.530394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.531670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.532311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.532826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.549656 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] HTTP exception thrown: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Request method failure captured: Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae HTTP/1.1 Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZeAf0JV0KbfRDfJGoGbxrjRQcIOwbjnHzo6ggYlFF-Onmol9mOCdxzJVWwkrHNY-BBry2S0OWaezvOLEyDqvKQx9QEKuaKfxBb2cvVnDO4NugB64UnuYUVOiWiAj5Cqd5ZwxntwOiVntVcE5t_y6OVIUDM99ZbHrIT60qwJUzAVAE Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:15:58.552201 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd5058292e9d48358327b2127517ea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd5058292e9d48358327b2127517ea93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 152129719036444687e3b8e8bd5460e7 Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.553685 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '39bdd042-06d6-4246-bd3b-2c46f8bc0aae'} Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:58.554493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.555795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.557345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Returning 404 to user: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:58.557345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ba99de6-02fc-46eb-8a67-ffabb7e22e13 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "DELETE /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 404 len: 111 microversion: 2.1 time: 0.039375 Oct 31 15:15:58.557345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 248/456] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:15:58 2022] DELETE /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:58.563621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.564393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] [instance: 39bdd042-06d6-4246-bd3b-2c46f8bc0aae] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:58.570945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.571428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.571856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.572555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.573035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.573481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.587030 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] HTTP exception thrown: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Request method failure captured: Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae HTTP/1.1 Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ZeAf0JV0KbfRDfJGoGbxrjRQcIOwbjnHzo6ggYlFF-Onmol9mOCdxzJVWwkrHNY-BBry2S0OWaezvOLEyDqvKQx9QEKuaKfxBb2cvVnDO4NugB64UnuYUVOiWiAj5Cqd5ZwxntwOiVntVcE5t_y6OVIUDM99ZbHrIT60qwJUzAVAE Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:15:58.589370 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bd5058292e9d48358327b2127517ea93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bd5058292e9d48358327b2127517ea93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bd5058292e9d48358327b2127517ea93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bd5058292e9d48358327b2127517ea93 Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-77448585 Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 152129719036444687e3b8e8bd5460e7 Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersAdminTestJSON-77448585-project Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.590994 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '39bdd042-06d6-4246-bd3b-2c46f8bc0aae'} Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:58.593777 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. Oct 31 15:15:58.598051 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.601092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Returning 404 to user: Instance 39bdd042-06d6-4246-bd3b-2c46f8bc0aae could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:58.601092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae" status: 404 len: 111 microversion: 2.1 time: 0.031674 Oct 31 15:15:58.601092 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 249/457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:58 2022] GET /compute/v2.1/servers/39bdd042-06d6-4246-bd3b-2c46f8bc0aae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:15:58.743261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:15:58.743921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:15:58.744591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:15:58.745765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:15:58.746326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:15:58.756838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.757323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.757753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.758471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.758921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.759342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.772798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.773773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff64e6cb-dd92-448e-bc33-8182a96e5f66 tempest-DeleteServersAdminTestJSON-77448585 tempest-DeleteServersAdminTestJSON-77448585-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001326 Oct 31 15:15:58.774440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 250/458] 10.222.0.48 () {56 vars in 886 bytes} [Mon Oct 31 15:15:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:15:58.781580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Getting quotas for project d0ff37f42fa844bb911ef63630550a48. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:15:58.785817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Getting quotas for user 712962b6996746d494c5b5ee2eda845a and project d0ff37f42fa844bb911ef63630550a48. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:15:58.797726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.utils [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] instances quota exceeded for d0ff37f42fa844bb911ef63630550a48, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120626) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 15:15:58.798746 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Request method failure captured: Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 145 Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-aqdXbFQLoh9nwldGgde3bAwNQGyj9-jQYhEfGmmHc-GSqen6OvAsjbAYbk-2bZ9_sln6jxchEirT-IyM82vQPdoQEqebz0i0yjgTDQcDnfZt2OmQiYlzs7O_-LRHksPcyZJJKzci786kC_zeQDMls06RIPfqIw-ikqc6vhvd3qEGY Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:15:58.802184 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 712962b6996746d494c5b5ee2eda845a Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1062659593", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} Oct 31 15:15:58.803463 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1062659593', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452'}}} Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 15:15:58.804142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.810069 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.811205 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cbcc740a-7b8e-48f0-8909-5d0302333c24 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.341544 Oct 31 15:15:58.812297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 209/459] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:15:58 2022] POST /compute/v2.1/servers => generated 119 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:58.814399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2c183a0>, body: {"quota_set": {"instances": 10}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:58.823273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:58.825279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:58.833256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.833830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.834278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.835013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:58.835473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:58.835901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:58.910877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.919094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.920550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:15:58.925657 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-434c3f7f-1ae6-46bc-ab1d-a45942da4bec tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.107833 Oct 31 15:15:58.926547 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 210/460] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:58 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:59.108827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.110297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.110935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.112089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.112804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.113437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.123074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:59.178928 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-996fdf38-dc0a-4ce1-b42c-ee929ada63cb tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 329 microversion: 2.1 time: 0.369384 Oct 31 15:15:59.179512 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 251/461] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:15:58 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 329 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:59.193386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a47c60fc-08de-4d69-8e90-f8a742e276ac tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Calling method '.version_select at 0x7f5ca2ca38b0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:59.337480 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a47c60fc-08de-4d69-8e90-f8a742e276ac tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 371 microversion: 2.1 time: 0.148042 Oct 31 15:15:59.338371 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 211/462] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:15:59 2022] GET /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:15:59.351258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2bb1d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:15:59.468682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:59.469928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:59.482622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.483496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.484113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.489600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.490389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.492836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.539546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.540036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.540473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.541373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.544622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.545263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.618426 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71dd020d-add1-4a89-a3c6-d9801317a1c6 tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 325 microversion: 2.1 time: 0.270942 Oct 31 15:15:59.619937 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 252/463] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:15:59 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:15:59.619937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:15:59.619937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:15:59.658136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.658677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.659747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.660962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:59.664295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:59.664767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:59.992228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.003194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.007045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.008518 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08fe0f15-7980-44d7-804a-b1e1df4b0838 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.544797 Oct 31 15:16:00.009626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 212/464] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:15:59 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:00.026629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-36dac16c-c1af-43a6-bbea-c85463e84020 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b78940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:00.118446 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-36dac16c-c1af-43a6-bbea-c85463e84020 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.107407 Oct 31 15:16:00.119176 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 213/465] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:00 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:00.126868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.127366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1145331135", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:00.138890 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80dbc3e1-697b-4cce-88ab-8bb13a4d473b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.511467 Oct 31 15:16:00.140008 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 253/466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:15:59 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:00.145613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-066d5fee-c014-406a-a66b-0dc598f6aacd req-51e563e5-a00c-4913-8739-5f4c9e3a03ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "name": "network-vif-unplugged", "status": "completed", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:00.162603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-066d5fee-c014-406a-a66b-0dc598f6aacd req-51e563e5-a00c-4913-8739-5f4c9e3a03ba service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:00.163594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-066d5fee-c014-406a-a66b-0dc598f6aacd req-51e563e5-a00c-4913-8739-5f4c9e3a03ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:00.164272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-066d5fee-c014-406a-a66b-0dc598f6aacd req-51e563e5-a00c-4913-8739-5f4c9e3a03ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:00.190904 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-066d5fee-c014-406a-a66b-0dc598f6aacd req-51e563e5-a00c-4913-8739-5f4c9e3a03ba service nova] Creating event network-vif-unplugged:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:16:00.197938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-066d5fee-c014-406a-a66b-0dc598f6aacd req-51e563e5-a00c-4913-8739-5f4c9e3a03ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055880 Oct 31 15:16:00.199615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 254/467] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:00.207684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:00.221631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:00.222841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:00.231761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:00.232721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:00.233429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:00.234732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:00.235459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:00.236100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:00.364279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.374371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.376574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:00.384135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e183f740-f778-4a2a-8b62-0f013e1f6f52 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.182698 Oct 31 15:16:00.385469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 255/468] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:00 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:00.664819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:00.665896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:00.666685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:00.667879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:00.668496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:00.677599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:00.678606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:00.679292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:00.680117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:00.680675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:00.681223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:00.694987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:00.703460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Getting quotas for project d0ff37f42fa844bb911ef63630550a48. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:00.708192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Getting quotas for user 712962b6996746d494c5b5ee2eda845a and project d0ff37f42fa844bb911ef63630550a48. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:00.721741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.utils [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] ram quota exceeded for d0ff37f42fa844bb911ef63630550a48, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120626) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 15:16:00.722554 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Request method failure captured: Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 145 Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-aqdXbFQLoh9nwldGgde3bAwNQGyj9-jQYhEfGmmHc-GSqen6OvAsjbAYbk-2bZ9_sln6jxchEirT-IyM82vQPdoQEqebz0i0yjgTDQcDnfZt2OmQiYlzs7O_-LRHksPcyZJJKzci786kC_zeQDMls06RIPfqIw-ikqc6vhvd3qEGY Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:16:00.725004 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 712962b6996746d494c5b5ee2eda845a Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1145331135", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} Oct 31 15:16:00.726162 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1145331135', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452'}}} Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 15:16:00.726838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:00.727795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.728942 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:00.731071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:00.731071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:00.731071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:00.731071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:00.731071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:16:00.731071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:00.733582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:00.734559 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6e552f1-3902-4dad-b51c-07ad16ccf1e3 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.614430 Oct 31 15:16:00.735471 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 214/469] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:00 2022] POST /compute/v2.1/servers => generated 110 bytes in 616 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:00.743287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2b4ab80>, body: {"quota_set": {"ram": 51200}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:01.034840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:01.035454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:01.043022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.043509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.044167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.045083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.045725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.046334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.125638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.126124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.126813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.127550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.128174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.128802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.231464 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e9b55e3-22ee-4a95-9b63-bbd339fe232f tempest-QuotasAdminNegativeTest-369188483 tempest-QuotasAdminNegativeTest-369188483-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 200 len: 329 microversion: 2.1 time: 0.491775 Oct 31 15:16:01.232955 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 256/470] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:16:00 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 329 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:01.238004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54a30b60-d54e-4247-b91c-8b8452145ce7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2ba2c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:01.290711 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54a30b60-d54e-4247-b91c-8b8452145ce7 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.056623 Oct 31 15:16:01.292585 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 257/471] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:01 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:01.297712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:01.298576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:01.305091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.305585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.306020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.306723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.307271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.308470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.313911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.322334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.326354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.339613 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90d4a046-4023-4c36-b611-9d3129e1f01d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.307197 Oct 31 15:16:01.342415 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 215/472] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:01 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:16:01.347383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d7b61fe-6e84-4db0-aa6f-7696a3b11569 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Action: 'update', calling method: .version_select at 0x7f5ca2b784c0>, body: {"quota_set": {"ram": 0}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:01.358796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2d7b61fe-6e84-4db0-aa6f-7696a3b11569 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '712962b6996746d494c5b5ee2eda845a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ff37f42fa844bb911ef63630550a48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d7b61fe-6e84-4db0-aa6f-7696a3b11569 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Request method failure captured: Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 HTTP/1.1 Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 25 Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-aqdXbFQLoh9nwldGgde3bAwNQGyj9-jQYhEfGmmHc-GSqen6OvAsjbAYbk-2bZ9_sln6jxchEirT-IyM82vQPdoQEqebz0i0yjgTDQcDnfZt2OmQiYlzs7O_-LRHksPcyZJJKzci786kC_zeQDMls06RIPfqIw-ikqc6vhvd3qEGY Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:16:01.361655 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0ff37f42fa844bb911ef63630550a48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d0ff37f42fa844bb911ef63630550a48 Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1047601437 Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 712962b6996746d494c5b5ee2eda845a Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-QuotasAdminNegativeTest-1047601437-project Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: {"quota_set": {"ram": 0}} Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 15:16:01.362876 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd0ff37f42fa844bb911ef63630550a48', 'body': {'quota_set': {'ram': 0}}} Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:01.363659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:01.366075 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d7b61fe-6e84-4db0-aa6f-7696a3b11569 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2d7b61fe-6e84-4db0-aa6f-7696a3b11569 tempest-QuotasAdminNegativeTest-1047601437 tempest-QuotasAdminNegativeTest-1047601437-project] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48" status: 403 len: 116 microversion: 2.1 time: 0.019533 Oct 31 15:16:01.367317 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 216/473] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:16:01 2022] PUT /compute/v2.1/os-quota-sets/d0ff37f42fa844bb911ef63630550a48 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:01.413891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:01.414940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:01.427394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.428493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.429817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.430743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:01.431534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:01.432358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:01.540241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.553079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.554772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.561652 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-886539d3-27fa-4a3c-abd8-85e0af2a207b tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.153429 Oct 31 15:16:01.572930 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 217/474] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:01 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:16:01.616077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:01.624775 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1074d7d2-2555-40ef-be72-34ad91c30d07 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.330837 Oct 31 15:16:01.625574 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 258/475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:01 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:02.307518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3dcf2288-279d-4aa7-bf73-2ce888113256 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b7bf70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:02.369554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:02.373773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:02.381522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.382229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.382838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:02.383607 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3dcf2288-279d-4aa7-bf73-2ce888113256 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.080275 Oct 31 15:16:02.383979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.384596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.385148 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 218/476] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:02 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:02.385355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:02.490004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bb1ddc38-0ac0-472b-ba02-52e7bf079b8b req-f251d39c-1f9e-4330-899f-89ba0ef67da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806", "name": "network-vif-plugged", "status": "completed", "tag": "fc5fea4c-684c-42ac-8570-5fdf23b00582"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:02.514530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bb1ddc38-0ac0-472b-ba02-52e7bf079b8b req-f251d39c-1f9e-4330-899f-89ba0ef67da3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.516039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bb1ddc38-0ac0-472b-ba02-52e7bf079b8b req-f251d39c-1f9e-4330-899f-89ba0ef67da3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.517106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bb1ddc38-0ac0-472b-ba02-52e7bf079b8b req-f251d39c-1f9e-4330-899f-89ba0ef67da3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:02.553066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bb1ddc38-0ac0-472b-ba02-52e7bf079b8b req-f251d39c-1f9e-4330-899f-89ba0ef67da3 service nova] Creating event network-vif-plugged:fc5fea4c-684c-42ac-8570-5fdf23b00582 for instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 on n-h1-858383-17 Oct 31 15:16:02.558450 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bb1ddc38-0ac0-472b-ba02-52e7bf079b8b req-f251d39c-1f9e-4330-899f-89ba0ef67da3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081581 Oct 31 15:16:02.559780 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 219/477] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:02.595541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:02.596229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:02.602551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.603236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.603814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:02.604771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.605413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.605990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:02.724571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:02.728163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:02.737343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:02.740253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:02.746356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:02.747640 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fde3e58d-249a-444b-867c-84a093fac83f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.156407 Oct 31 15:16:02.748994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:02.749140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 220/478] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:02 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:16:02.753891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:02.754823 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2a8ffae-5ed7-4fac-bb1c-dfee02f0f4cd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.388789 Oct 31 15:16:02.755164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:02.772489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.772890 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 259/479] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:02 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:02.775887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.776975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:02.778261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:02.778726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:02.779157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.011503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:03.019270 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7285cb64-99dd-48a2-94da-b476159f5efb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.269187 Oct 31 15:16:03.019847 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 221/480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:02 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:03.391069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c10d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.394406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.395166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.395681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.408814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1703868178", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:03.428148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.428637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.429981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.444544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.445070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.445850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.453305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30c9c849-99b4-401f-bd30-e904c71a4ff7 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.229923 Oct 31 15:16:03.460411 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 260/481] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:03.465649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-549e274f-4724-43c8-8614-f887db0fb37f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2bb1dc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.487219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:03.515703 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-549e274f-4724-43c8-8614-f887db0fb37f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.054174 Oct 31 15:16:03.516482 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 261/482] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:03.521516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c18790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.523519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.524159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.524590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.540189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.540673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.541157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.552285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.552797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.553241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.559323 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0dc3312e-0247-4d44-a326-e970dde11f15 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.041431 Oct 31 15:16:03.559909 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 262/483] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:03.577506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c10af0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.579444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.579925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.580352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.595884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.596425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.596881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.608215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.608715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.609214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.615670 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ebe0a42-b21d-4324-aea7-af431796a84c tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.042673 Oct 31 15:16:03.616257 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 263/484] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:03.630247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c18a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.632436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.633112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.633868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.648684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:03.653314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.653977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.654567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.662716 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92e524ac-40da-4a55-8f02-c529ddf0c156 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.036455 Oct 31 15:16:03.664197 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 264/485] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:03.681640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58741408-6412-4dba-98ae-1b8d46f9d53b tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c18430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.683951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58741408-6412-4dba-98ae-1b8d46f9d53b tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.684628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58741408-6412-4dba-98ae-1b8d46f9d53b tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.685099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58741408-6412-4dba-98ae-1b8d46f9d53b tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.703779 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58741408-6412-4dba-98ae-1b8d46f9d53b tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027606 Oct 31 15:16:03.705336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 265/486] 10.222.0.48 () {58 vars in 1179 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:03.713315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:03.713315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:03.713315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:03.713315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:03.713315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:03.717486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c180d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.719949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.720678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.721276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.723260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.723807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.724305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.725134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.725652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.726135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.738975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.739476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.739912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.747335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:03.750969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.751455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.751608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for user 8184a0251b8e4cb882556b458bbc4de7 and project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:03.751890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.757888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42efb3b0-96cc-4cfb-9b09-818262ca0474 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.044300 Oct 31 15:16:03.759085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 266/487] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:03.768616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:03.769302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2c101f0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.771159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.771411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:03.771798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.772156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.786814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.787386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.787893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.798986 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49d6ffc3-cc43-4649-9765-c22575e0720a tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.033022 Oct 31 15:16:03.799989 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 267/488] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:03.806207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.807049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:03.816068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.816172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.816543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.817448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.817868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.818316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.832076 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-97381f1c-28b4-4a1f-aa35-1c7ed411f331 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590667 Oct 31 15:16:03.832838 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 222/489] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:16:03.837798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.838545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:03.847683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.848291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.848855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.849630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.850149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.851315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.913295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:03.925187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:03.927056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:03.935647 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-420995e8-4237-4c0e-b6ce-b919607258ce tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.134414 Oct 31 15:16:03.936565 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 268/490] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:03.957955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2b4a790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:03.961067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.961691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.962339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.977025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:03.977649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:03.978200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:03.988473 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3677ee89-cbf7-4e60-b1db-03c26f190f7d tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.050349 Oct 31 15:16:03.989937 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 269/491] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:04.004506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be1ba962-ac93-4f3a-beb1-ff5c00332885 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:04.005528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-be1ba962-ac93-4f3a-beb1-ff5c00332885 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:04.065716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:04.088016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:04.089687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:04.090901 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80889d49-d938-4c2c-8ceb-7fcaf5d05288 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1569 microversion: 2.25 time: 0.256985 Oct 31 15:16:04.091858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-be1ba962-ac93-4f3a-beb1-ff5c00332885 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:04.093754 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 223/492] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:04.099395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Calling method '.version_select at 0x7f5ca2b7bf70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:04.101335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.102201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.102783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:04.110539 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be1ba962-ac93-4f3a-beb1-ff5c00332885 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1213 microversion: 2.1 time: 0.119238 Oct 31 15:16:04.113115 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 270/493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:03 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:04.117814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:04.118427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:04.121446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.122049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.122674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:04.125729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.126378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.126972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:04.127839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.128484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.129084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:04.136211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.137230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.137752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:04.165748 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a1e49376-b672-4366-ac25-044550276d49 tempest-HypervisorAdminTestJSON-273135468 tempest-HypervisorAdminTestJSON-273135468-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.070429 Oct 31 15:16:04.167888 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 224/494] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Oct 31 15:16:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:04.356249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:04.366984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4488fa8a-1986-4a3e-bf5f-8d5fcbfe4690 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1317 microversion: 2.1 time: 0.252568 Oct 31 15:16:04.367651 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 271/495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:04 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:04.533905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b45ffb9b-4c30-4017-add4-16d7241a29f0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b7e550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:04.621922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b45ffb9b-4c30-4017-add4-16d7241a29f0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.092847 Oct 31 15:16:04.623327 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 225/496] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:04 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:04.969723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:04.970933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:04.977739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.978553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.980018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:04.981620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:04.982306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:04.983001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.059188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.068480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.069961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.077041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1bda2cdb-490f-417f-bfc2-761cd6d756ac tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.112931 Oct 31 15:16:05.078181 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 272/497] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:04 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:05.121197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:05.122131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:05.129654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.131716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.131716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.131978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.132756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.133435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.140629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:05.141288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:05.148948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.149525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.149963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.150900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.151922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.153066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.251042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.263943 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f141b9e-43a2-48ce-87ac-78d4c75a8a89 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1265 microversion: 2.1 time: 0.127495 Oct 31 15:16:05.265202 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 273/498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:05.342051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.351055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.353150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.355662 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcf7ca02-2d6b-491a-aea9-ad98a66da559 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1559 microversion: 2.25 time: 0.240041 Oct 31 15:16:05.357633 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 226/499] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1559 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:05.383678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-537e0df0-0e07-40e5-8b24-d9876be6846d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '.version_select at 0x7f5ca317c430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:05.388040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-537e0df0-0e07-40e5-8b24-d9876be6846d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.389495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-537e0df0-0e07-40e5-8b24-d9876be6846d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.390659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-537e0df0-0e07-40e5-8b24-d9876be6846d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.396608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:05.397550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:05.408688 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-537e0df0-0e07-40e5-8b24-d9876be6846d tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.028785 Oct 31 15:16:05.409415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.409976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.410137 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 274/500] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:05.411162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.412045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.412655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.413606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.425443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:05.426281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:05.432647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.433504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.434265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.435184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:05.435753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:05.436292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:05.763080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:05.772515 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aed88c3b-31c6-4161-be21-94cd351bc7f7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1467 microversion: 2.1 time: 0.380604 Oct 31 15:16:05.786238 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 227/501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1467 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:05.788059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:05.797598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 4230e338-4315-412b-ae2c-f9b1cc15fbee {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:05.831017 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d18f209-eaa9-4e31-9316-6f0de7c8ebfb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 2054 microversion: 2.25 time: 0.406421 Oct 31 15:16:05.836752 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 275/502] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 2054 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:16:05.836993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-065ea592-6c06-43ff-a620-5e6d49d4f02e tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2bb1310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:05.908531 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-065ea592-6c06-43ff-a620-5e6d49d4f02e tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.075411 Oct 31 15:16:05.910996 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 276/503] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:06.096850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-169512400", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:06.138384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:06.139000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:06.146172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:06.146665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:06.147104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:06.147807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:06.148319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:06.148672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:06.162238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:06.704866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:06.705288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:06.706335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:06.706449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:06.706891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:06.719633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:06.720113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:06.720753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:06.721664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:06.722135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:06.722640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:06.742638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Getting quotas for project 7da73ebe589d4f5491a4f4c6fe01fc67. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:06.747739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Getting quotas for user d1de4076f673437bb1e71a5f84afa452 and project 7da73ebe589d4f5491a4f4c6fe01fc67. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:06.760806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:06.763237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:06.825804 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b31a7b0b-9853-4af6-aaca-c8cc56831b5b tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038007 Oct 31 15:16:06.826760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 228/504] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:06.831536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1775230946", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "635e1e0a-6ae3-43b6-936a-df7141d79dfa"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:06.907697 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a6090fe-9187-479d-83d1-ddf0b1b324c4 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1620 microversion: 2.1 time: 0.994868 Oct 31 15:16:06.910393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] validate_networks() for [('635e1e0a-6ae3-43b6-936a-df7141d79dfa', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:06.917664 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 277/505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:05 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1620 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:06.941019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:06.943279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:06.955918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:06.957227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:06.957844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:06.959614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:06.960638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:06.962634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.100441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:07.113625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:07.116096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:07.124421 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-252755a1-b8e5-44ec-ac82-7e29de83d69c tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.205014 Oct 31 15:16:07.125512 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 278/506] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:06 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:07.148398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:07.149527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:07.166296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.166897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.167354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.168076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.168542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.168997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.311194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:07.322362 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3eabc30-f9f1-4d2f-b4cb-93f033c8512c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1271 microversion: 2.1 time: 0.187536 Oct 31 15:16:07.323349 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 279/507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:07 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:07.329853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-02322302-a6d4-41a1-8a87-9f6fc6666ef3 req-11445a74-b3e5-4e09-bb65-db355862599a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "name": "network-vif-plugged", "status": "completed", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:07.349460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-02322302-a6d4-41a1-8a87-9f6fc6666ef3 req-11445a74-b3e5-4e09-bb65-db355862599a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.349626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-02322302-a6d4-41a1-8a87-9f6fc6666ef3 req-11445a74-b3e5-4e09-bb65-db355862599a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.350270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-02322302-a6d4-41a1-8a87-9f6fc6666ef3 req-11445a74-b3e5-4e09-bb65-db355862599a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.364352 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-02322302-a6d4-41a1-8a87-9f6fc6666ef3 req-11445a74-b3e5-4e09-bb65-db355862599a service nova] Creating event network-vif-plugged:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:16:07.370681 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-02322302-a6d4-41a1-8a87-9f6fc6666ef3 req-11445a74-b3e5-4e09-bb65-db355862599a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045208 Oct 31 15:16:07.371532 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 280/508] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:07.386328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:07.388472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:07.400355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.401818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.402438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.403407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.404041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.404641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.506548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:07.516717 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5039bb8d-786a-48d2-b9f7-15ea64a4debe tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1226 microversion: 2.1 time: 0.143609 Oct 31 15:16:07.517299 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 281/509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:07 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:07.522372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4b3c706-8059-4beb-9d80-2a4e90738d5d tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b00430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:07.571399 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4b3c706-8059-4beb-9d80-2a4e90738d5d tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.052845 Oct 31 15:16:07.581275 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 282/510] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:07 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:07.587439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f604aeb8-8302-49e5-b93f-884a9dfded50 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: .version_select at 0x7f5ca2b00b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-507544226", "policies": ["affinity"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:07.615494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f604aeb8-8302-49e5-b93f-884a9dfded50 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:07.620632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f604aeb8-8302-49e5-b93f-884a9dfded50 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:07.658391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:07.659050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:07.659669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:07.660275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:07.660923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:07.680579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.681481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.682315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.683052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:07.685306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:07.686677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:07.689591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f604aeb8-8302-49e5-b93f-884a9dfded50 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:07.694725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f604aeb8-8302-49e5-b93f-884a9dfded50 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:07.708789 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f604aeb8-8302-49e5-b93f-884a9dfded50 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.126142 Oct 31 15:16:07.709925 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 283/511] 10.222.0.48 () {60 vars in 1174 bytes} [Mon Oct 31 15:16:07 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:07.732472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:07.740186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for user 8c9c59f229134e1ab069e18a116ebdf2 and project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:07.759927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:07.762685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:07.857644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1664866450", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "02de2e26-4114-4a63-b2f0-1fd858bafc1f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:07.860367 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b915131-d4ac-474e-a18b-05c376338393 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.032354 Oct 31 15:16:07.864070 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 229/512] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:16:07.875587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e113953-9d40-4e68-9037-52d18d5e56d8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:07.877677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e113953-9d40-4e68-9037-52d18d5e56d8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:07.965673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:08.002441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e113953-9d40-4e68-9037-52d18d5e56d8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.013067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e113953-9d40-4e68-9037-52d18d5e56d8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.015574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e113953-9d40-4e68-9037-52d18d5e56d8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.017090 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e113953-9d40-4e68-9037-52d18d5e56d8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1262 microversion: 2.25 time: 0.145557 Oct 31 15:16:08.018766 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 230/513] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:07 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:08.156150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.157097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:08.168226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.169216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.170506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.171458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.172139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.172810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.339870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.363042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.364674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.374619 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad3bedde-dd57-48fd-bc07-002d564a0c47 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.223754 Oct 31 15:16:08.375765 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 231/514] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:08.397012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.397902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:08.409714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.410266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.410688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.413422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.415435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.416393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.578768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:08.579336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:08.579876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:08.580383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:08.580924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:08.625112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.626033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.626542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.627509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.628248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.628919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.657461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:08.662029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:08.677086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Going to run 2 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:08.680048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:08.730256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120625) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 31 15:16:08.758067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.761093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:08.765339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:08.767341 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2b5b6ac-f496-4cc6-a121-f157875af03a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1313 microversion: 2.1 time: 0.390403 Oct 31 15:16:08.785108 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 232/515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:08.790874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.792672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:08.801057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.802220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.802904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.803817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:08.804466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:08.805128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:08.825582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.851859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:08.857383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:08.874999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=2e2557bf-9d54-4682-8964-1fd936d0d706,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:08.891503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:08.895681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.911491 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6d3bbce-31bd-42ac-834b-ac719676d4af tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1280 microversion: 2.1 time: 0.124887 Oct 31 15:16:08.912202 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 233/516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:08.935087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8c9f7c4f-b023-442e-9edd-fd304648b5b0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b21d30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.943586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:08.948505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:08.997877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:09.004156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:09.010935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:09.022940 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8c9f7c4f-b023-442e-9edd-fd304648b5b0 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.093553 Oct 31 15:16:09.023530 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 234/517] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:09.068681 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cece5075-95dc-47c7-b40f-0bd6ebaf2ab1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.214953 Oct 31 15:16:09.069734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 284/518] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:16:09.076160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.076925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:09.084870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.085536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.086062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.086885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.087709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.087828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.194211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.205710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Calling method '.version_select at 0x7f5ca2b784c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.207452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.207932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.208361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.214393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.216452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.220782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25c49be0-04f3-41b1-9701-838bbe40636a tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1314 microversion: 2.25 time: 0.149793 Oct 31 15:16:09.221604 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 285/519] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:09.228123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.238920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.239701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.240484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.244552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.246814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Searching by: {'deleted': False, 'project_id': '4366c148cab043bc8a653080ba52e8c6'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:16:09.261941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.262734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.263799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.271378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8db2a8a9-cc0c-4ae5-a163-2b12bd404202 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.246669 Oct 31 15:16:09.272234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 235/520] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:09.288109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Calling method '.version_select at 0x7f5ca2b21790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.290922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.292347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.292640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.293167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.293446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.299474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.300307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.301253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.301696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.340577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:09.349109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.352901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.356413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.400171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=23 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:09.418077 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0c42dd86-cddc-4b19-97d1-36e5b9842525 tempest-HypervisorAdminV228Test-1408458474 tempest-HypervisorAdminV228Test-1408458474-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.136518 Oct 31 15:16:09.421572 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 236/521] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:16:09.444831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.449197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:09.462565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.465481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.466361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.467287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.469263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.469709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.558804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:16:09.697496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.739283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.741235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:09.754249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-28fe3c26-66a1-4f14-923c-c1c8cf6cd83e tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.327491 Oct 31 15:16:09.758756 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 237/522] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:09.776598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d2db1578-c3bd-469d-b4af-c6a518ef4483 req-406f3eea-b72a-4e9a-8006-f6a0f2eac748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:09.795911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d2db1578-c3bd-469d-b4af-c6a518ef4483 req-406f3eea-b72a-4e9a-8006-f6a0f2eac748 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.798538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d2db1578-c3bd-469d-b4af-c6a518ef4483 req-406f3eea-b72a-4e9a-8006-f6a0f2eac748 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.800607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d2db1578-c3bd-469d-b4af-c6a518ef4483 req-406f3eea-b72a-4e9a-8006-f6a0f2eac748 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.842770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d2db1578-c3bd-469d-b4af-c6a518ef4483 req-406f3eea-b72a-4e9a-8006-f6a0f2eac748 service nova] Creating event network-changed:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h2-858383-17 Oct 31 15:16:09.857974 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d2db1578-c3bd-469d-b4af-c6a518ef4483 req-406f3eea-b72a-4e9a-8006-f6a0f2eac748 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094587 Oct 31 15:16:09.860279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 238/523] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:09.863933 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8fed7b90-6d2e-439e-b7f6-132ba96c32f1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.641440 Oct 31 15:16:09.868261 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 286/524] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/servers => generated 1004 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:09.875811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.878837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:09.888334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb43365a-a1ee-4471-96f6-fe3fdddb9714 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.889958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb43365a-a1ee-4471-96f6-fe3fdddb9714 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:09.898726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.900842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.903502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.905838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.908402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.910832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.166003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb43365a-a1ee-4471-96f6-fe3fdddb9714 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:10.178587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb43365a-a1ee-4471-96f6-fe3fdddb9714 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1219 microversion: 2.1 time: 0.305128 Oct 31 15:16:10.179915 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 287/525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:10.210967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.217241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:10.233042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.233536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.233983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.235574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.236043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.236458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.462180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:10.479069 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e85c1ec-604f-466a-b8d6-758a10b54a0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1313 microversion: 2.1 time: 0.616171 Oct 31 15:16:10.490367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 239/526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:10.508255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b768c459-5e20-4450-8ac4-93286e761e1d tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b3fe50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.590261 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b768c459-5e20-4450-8ac4-93286e761e1d tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.089244 Oct 31 15:16:10.599954 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 240/527] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:10.607068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.608258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:10.617220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.617948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.618592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.620553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.621612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.622578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.177681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.189224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.190923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.192684 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49d79dcc-45d4-48c7-a28c-9c4ee3a432ab tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1320 microversion: 2.25 time: 0.590757 Oct 31 15:16:11.193709 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 241/528] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:11.205164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.206473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:11.213155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.214433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.215055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.216295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.217114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.217933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.483961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.497447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.500245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.510784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47950dfa-c10b-41a0-ad0b-c3e8aa2e17f5 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.315047 Oct 31 15:16:11.517541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.529627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 242/529] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:11.539215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-91bb96ea-a41d-42fa-874e-d42a69db77b2 req-2e0b0303-e2d9-489a-a535-2ad8a2585fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8162776-f600-4766-a801-4af50feda6db", "tag": "c86f2068-480a-462e-bdd3-11f993e633b0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.550826 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdc2de8b-cfe9-45f8-97ee-8226f54355ef tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1322 microversion: 2.1 time: 1.363329 Oct 31 15:16:11.551566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-91bb96ea-a41d-42fa-874e-d42a69db77b2 req-2e0b0303-e2d9-489a-a535-2ad8a2585fb6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.552444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-91bb96ea-a41d-42fa-874e-d42a69db77b2 req-2e0b0303-e2d9-489a-a535-2ad8a2585fb6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.553458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-91bb96ea-a41d-42fa-874e-d42a69db77b2 req-2e0b0303-e2d9-489a-a535-2ad8a2585fb6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.561039 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 288/530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1322 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:11.565917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.566533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:11.568454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-91bb96ea-a41d-42fa-874e-d42a69db77b2 req-2e0b0303-e2d9-489a-a535-2ad8a2585fb6 service nova] Creating event network-changed:c86f2068-480a-462e-bdd3-11f993e633b0 for instance e8162776-f600-4766-a801-4af50feda6db on n-h2-858383-17 Oct 31 15:16:11.574509 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-91bb96ea-a41d-42fa-874e-d42a69db77b2 req-2e0b0303-e2d9-489a-a535-2ad8a2585fb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043043 Oct 31 15:16:11.575767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 243/531] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:11.585989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.587187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:11.595101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.595898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.596539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.597657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.598395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.599019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.601952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.602468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.602912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.603638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.604425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.605350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.076251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:12.094070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-73fe2ba8-e045-4b7a-b35c-4ef2aad95095 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1215 microversion: 2.1 time: 0.530951 Oct 31 15:16:12.096047 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 289/532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1215 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.108343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb74b17a-e2dc-4faa-9bf0-dca18d6313fb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca296e3a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.197748 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb74b17a-e2dc-4faa-9bf0-dca18d6313fb tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.099758 Oct 31 15:16:12.202074 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 290/533] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.212417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.215747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:12.232171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.232613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.236650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.237592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.241822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.243997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.301175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:16:12.391260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:12.400429 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ec95d00f-52c2-4490-ba8f-676981a85d96 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1313 microversion: 2.1 time: 0.822338 Oct 31 15:16:12.418035 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 244/534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1313 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.431965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.432587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:12.448107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.450914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.453147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.458615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.459616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.460220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.471856 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b614143-52f5-41d2-be13-ffe3841e7ce0 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 204 len: 0 microversion: 2.1 time: 0.263610 Oct 31 15:16:12.472734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 291/535] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:12 2022] DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:12.546673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.547380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:12.565528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.566292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.566751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.567513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.567978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.568422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.801407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:12.815865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:12.821572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:12.846873 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85ae1a6e-52fc-4890-be8f-867a95dc6960 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.303996 Oct 31 15:16:12.848160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 292/536] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:12.853657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.855072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:12.886996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.889305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.890110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.894495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.897338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.898485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:13.193601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:13.210720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:13.212311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:13.214075 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89d88883-6eb4-4f93-bab9-7c1985d0170c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 0.794765 Oct 31 15:16:13.214816 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 245/537] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:13.220245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1821075805", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "686017506", "adminPass": "***", "networks": [{"uuid": "ac0fcd3c-61d1-4bc0-b880-177007295db5"}], "security_groups": [{"name": "tempest-securitygroup--1639260900"}], "key_name": "tempest-keypair-785399804", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:13.415768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:13.429212 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b78e558-f4f5-4bc6-aedc-202abed642a6 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1322 microversion: 2.1 time: 0.578726 Oct 31 15:16:13.445152 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 293/538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.448377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.448377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:13.468317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:13.469232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:13.469862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:13.470995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:13.471615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:13.472918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:13.656427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] validate_networks() for [('ac0fcd3c-61d1-4bc0-b880-177007295db5', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:13.673272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:13.685544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea42e921-731d-4f6c-9edf-32e83047e726 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1277 microversion: 2.1 time: 0.252527 Oct 31 15:16:13.686776 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 294/539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.692080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b1ba64c-b630-48c5-b9f7-ff30f9be28b1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2a765e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.772572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b1ba64c-b630-48c5-b9f7-ff30f9be28b1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.084220 Oct 31 15:16:13.773645 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 295/540] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.784893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.786294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:13.795897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:13.796629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:13.797276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:13.798194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:13.798808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:13.799389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:14.479334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:14.488984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05946c89-2700-4c81-bbea-fe2a862a1a04 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1313 microversion: 2.1 time: 0.713529 Oct 31 15:16:14.493517 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 296/541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:14.505969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:14.507082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:14.521810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:14.522549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:14.523576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:14.524385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:14.524972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:14.526048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:14.554523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:14.977350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:14.998181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:14.999757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:15.024600 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9054cef0-991f-4ec9-bef3-ec1f85617b21 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.527219 Oct 31 15:16:15.036736 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 297/542] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:14 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:15.048035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:15.051347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:15.069340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:15.075210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:15.078721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:15.079827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:15.080449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:15.081095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.265158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:16.265912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:16.266402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:16.266812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:16.267219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:16.287565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=65 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:16.289121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.289821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.290040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.290770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.297632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.298036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.329653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Getting quotas for project e7b5e7bae2ce41279db848f24326b3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:16.335675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Getting quotas for user 9b24aa0edeef4cf58c624bee5f7478fb and project e7b5e7bae2ce41279db848f24326b3ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:16.352335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:16.358647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:16.485706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb835381-5bd3-4aab-a0df-5a794a0cd429 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.269654 Oct 31 15:16:16.489724 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 246/543] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:16.499145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:16.499942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:16.507825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.508477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.509302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.510955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.511603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.512143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.669043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:16.689524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:16.701180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:16.702813 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6c5d26e-c501-4305-b361-048824f3c1f0 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 1.673850 Oct 31 15:16:16.703448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 298/544] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:15 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:16.723980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:16.724890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:16.750241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.750995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.751593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:16.754644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:16.755281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:16.755747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:17.753858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:17.779949 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b682d0b-81a7-4850-be22-8f13865ed8c0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 1.070192 Oct 31 15:16:17.781906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 299/545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:16 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:17.805997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6a8389c-d72e-424d-b99e-433fb98a82f5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca297f310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:17.824438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:17.855327 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a4ab265-3a2d-42f8-852c-847870ef0573 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1322 microversion: 2.1 time: 1.362295 Oct 31 15:16:17.859269 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 247/546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:16 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1322 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:17.893420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6a8389c-d72e-424d-b99e-433fb98a82f5 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.109965 Oct 31 15:16:17.898506 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 300/547] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:17 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:17.907518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:17.914484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:17.939163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:17.944767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:17.948369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:17.949542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:17.950393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:17.951581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.308938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ad034cd-d0df-4a54-ac5e-f6aa06dbd30f tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Calling method '.version_select at 0x7f5ca2b3b670>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:18.310832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ad034cd-d0df-4a54-ac5e-f6aa06dbd30f tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '0ef114a5c0ea4b8c89f344e3c15c2a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8ece32a69a4986b1427aa5b4a92d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ad034cd-d0df-4a54-ac5e-f6aa06dbd30f tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Request method failure captured: Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-a98gsgS29__s4y-wDKvsI-UnBTYWv_zF8xnhLoJpGfl_BiwdEvMGyQUylskkjHsuhSr1-PFzjZR0ZD-_psy8CTCsWsXbW9IfGm3wRq-vUGS-X7eEJmo7in3LJBU1E1wwNXsRVxtPxlWgEdCLSN0hmfcHMOYcilHTO-SLhXpLtZyLs Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:16:18.312447 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0ef114a5c0ea4b8c89f344e3c15c2a0a Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: action_args: {} Oct 31 15:16:18.313759 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:18.314637 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 15:16:18.315746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:18.316833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ad034cd-d0df-4a54-ac5e-f6aa06dbd30f tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:18.316833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ad034cd-d0df-4a54-ac5e-f6aa06dbd30f tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.453922 Oct 31 15:16:18.319825 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 248/548] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 31 15:16:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:18.331579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:18.331826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:18.350925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.351690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.352138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.353065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.353640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.354161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.425650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.434241 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ceeca672-0e4c-4520-99c3-cc34316fa027 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1313 microversion: 2.1 time: 0.530485 Oct 31 15:16:18.437614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 301/549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:17 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:18.442943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:18.452916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:18.469605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.470332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.470990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.471931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.472607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.473288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.774469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.783214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.784663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.798223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f3d4b85-c1d3-4084-9744-b81e4a87495f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.471210 Oct 31 15:16:18.805420 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 249/550] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:18 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:18.813438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4ba337d8-e61d-425d-866c-29ab5095853c req-a01d8ecb-8c06-40f4-b76b-ae29e6706204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "name": "network-vif-plugged", "status": "completed", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:18.854176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4ba337d8-e61d-425d-866c-29ab5095853c req-a01d8ecb-8c06-40f4-b76b-ae29e6706204 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.855478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4ba337d8-e61d-425d-866c-29ab5095853c req-a01d8ecb-8c06-40f4-b76b-ae29e6706204 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.856954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4ba337d8-e61d-425d-866c-29ab5095853c req-a01d8ecb-8c06-40f4-b76b-ae29e6706204 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.907209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4ba337d8-e61d-425d-866c-29ab5095853c req-a01d8ecb-8c06-40f4-b76b-ae29e6706204 service nova] Creating event network-vif-plugged:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h2-858383-17 Oct 31 15:16:18.916659 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4ba337d8-e61d-425d-866c-29ab5095853c req-a01d8ecb-8c06-40f4-b76b-ae29e6706204 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109291 Oct 31 15:16:18.917498 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 250/551] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:18.922242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.938837 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f351ac8b-491f-4fce-b7d4-7e94e9b096d6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1314 microversion: 2.1 time: 0.499309 Oct 31 15:16:18.941271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:18.942005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:18.949599 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 302/552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:18 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:18.967161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c241723a-5732-4a91-a88d-937d8903d79a req-0c6e0dfb-bdbd-47cd-be95-bebea92a1876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d916d41e-cdb8-41c4-9491-b4ab391d1ca7", "tag": "9e8bd758-ca0a-4f0c-b03b-dc89859f27ed"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:18.967669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.968186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.968638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.971325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.971853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.972281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.991997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c241723a-5732-4a91-a88d-937d8903d79a req-0c6e0dfb-bdbd-47cd-be95-bebea92a1876 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:18.992645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c241723a-5732-4a91-a88d-937d8903d79a req-0c6e0dfb-bdbd-47cd-be95-bebea92a1876 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:18.993219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c241723a-5732-4a91-a88d-937d8903d79a req-0c6e0dfb-bdbd-47cd-be95-bebea92a1876 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.020870 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c241723a-5732-4a91-a88d-937d8903d79a req-0c6e0dfb-bdbd-47cd-be95-bebea92a1876 service nova] Creating event network-changed:9e8bd758-ca0a-4f0c-b03b-dc89859f27ed for instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 on n-h1-858383-17 Oct 31 15:16:19.032281 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c241723a-5732-4a91-a88d-937d8903d79a req-0c6e0dfb-bdbd-47cd-be95-bebea92a1876 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074902 Oct 31 15:16:19.033625 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 303/553] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:19.038948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4f2c2115-6efb-4367-ab3f-96b8d0846a1a req-e41772d8-d85a-4217-8e60-f0f17344c97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1da379-7eab-4e0e-a269-1b980bcd964e", "tag": "8f534018-dae0-4a5a-8e50-e009f54ec704"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:19.066663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4f2c2115-6efb-4367-ab3f-96b8d0846a1a req-e41772d8-d85a-4217-8e60-f0f17344c97d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.069325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4f2c2115-6efb-4367-ab3f-96b8d0846a1a req-e41772d8-d85a-4217-8e60-f0f17344c97d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.070691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4f2c2115-6efb-4367-ab3f-96b8d0846a1a req-e41772d8-d85a-4217-8e60-f0f17344c97d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.103320 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4f2c2115-6efb-4367-ab3f-96b8d0846a1a req-e41772d8-d85a-4217-8e60-f0f17344c97d service nova] Creating event network-changed:8f534018-dae0-4a5a-8e50-e009f54ec704 for instance 0e1da379-7eab-4e0e-a269-1b980bcd964e on n-h2-858383-17 Oct 31 15:16:19.113859 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4f2c2115-6efb-4367-ab3f-96b8d0846a1a req-e41772d8-d85a-4217-8e60-f0f17344c97d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078648 Oct 31 15:16:19.118198 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 304/554] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:19.133559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1639f237-2966-4d7c-b1d0-750940587a42 tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Calling method '.version_select at 0x7f5ca2978e50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:19.139964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1639f237-2966-4d7c-b1d0-750940587a42 tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '0ef114a5c0ea4b8c89f344e3c15c2a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8ece32a69a4986b1427aa5b4a92d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1639f237-2966-4d7c-b1d0-750940587a42 tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Request method failure captured: Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-a98gsgS29__s4y-wDKvsI-UnBTYWv_zF8xnhLoJpGfl_BiwdEvMGyQUylskkjHsuhSr1-PFzjZR0ZD-_psy8CTCsWsXbW9IfGm3wRq-vUGS-X7eEJmo7in3LJBU1E1wwNXsRVxtPxlWgEdCLSN0hmfcHMOYcilHTO-SLhXpLtZyLs Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:16:19.144130 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0ef114a5c0ea4b8c89f344e3c15c2a0a Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:16:19.145524 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:19.146280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 15:16:19.147404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:19.151035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1639f237-2966-4d7c-b1d0-750940587a42 tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:19.154826 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1639f237-2966-4d7c-b1d0-750940587a42 tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.033707 Oct 31 15:16:19.156976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 305/555] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:19 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:19.180392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:19.182009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:19.204519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.206302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.208616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.209612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.210291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.218972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.505469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:19.944475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:19.962790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:19.965349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:19.966912 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bc89d2a1-ef18-4836-9ff1-3a22d4f3f28f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 1.048170 Oct 31 15:16:19.968039 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 251/556] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:18 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:19.973378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:19.974379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:19.984744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:19.998720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.998947 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0869df8-78a6-4526-b582-f44fa216177e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 0.837253 Oct 31 15:16:19.999223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.999666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.000387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.000747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 306/557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:19 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:20.004888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.005270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.019414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bf9ee0f-187b-40a5-9cc5-215a7fd1689f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca297fee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.100680 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bf9ee0f-187b-40a5-9cc5-215a7fd1689f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.098859 Oct 31 15:16:20.101568 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 307/558] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:20.114723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2fc6eed-5931-4237-965d-33365192a0dc tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Calling method '.version_select at 0x7f5ca2945c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.125062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2fc6eed-5931-4237-965d-33365192a0dc tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '0ef114a5c0ea4b8c89f344e3c15c2a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8ece32a69a4986b1427aa5b4a92d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2fc6eed-5931-4237-965d-33365192a0dc tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Request method failure captured: Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-a98gsgS29__s4y-wDKvsI-UnBTYWv_zF8xnhLoJpGfl_BiwdEvMGyQUylskkjHsuhSr1-PFzjZR0ZD-_psy8CTCsWsXbW9IfGm3wRq-vUGS-X7eEJmo7in3LJBU1E1wwNXsRVxtPxlWgEdCLSN0hmfcHMOYcilHTO-SLhXpLtZyLs Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:16:20.130260 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0ef114a5c0ea4b8c89f344e3c15c2a0a Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:16:20.131718 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:20.132725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 15:16:20.134166 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:20.136909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2fc6eed-5931-4237-965d-33365192a0dc tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:20.140371 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2fc6eed-5931-4237-965d-33365192a0dc tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.034811 Oct 31 15:16:20.141508 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 308/559] 10.222.0.48 () {58 vars in 1179 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:20.151166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.153448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:20.172444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.174692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.175445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.180204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.184300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.185021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.186183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:20.494803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:20.504443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-daa86fa4-1e8b-425f-b01a-9c78930d4d5a tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1322 microversion: 2.1 time: 0.535321 Oct 31 15:16:20.509250 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 252/560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:19 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:20.523239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.526603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:20.547491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.548251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.548966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.550910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.551543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.553706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.580867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:20.591056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0461d4d-a3f7-49e0-9c8b-6a79761521a7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1313 microversion: 2.1 time: 0.447934 Oct 31 15:16:20.606989 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 309/561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:20.615831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.616462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:20.665318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.665766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.668354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.669159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.670785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.674126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.464884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:21.483410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:21.485066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:21.500740 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7369796-9198-441c-b3c1-ad9fa0a8614a tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.983442 Oct 31 15:16:21.505915 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 253/562] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:21.633541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Calling method '.version_select at 0x7f5ca2b3ff70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:21.639165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.639845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.640442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.665480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.666741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.667381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.686454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.687200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.687798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.695532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:21.709839 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45424e64-20e8-4cc6-b279-18220be8fea1 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.202416 Oct 31 15:16:21.711794 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 254/563] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:21.714442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82dc8a51-8a75-43db-a4c1-e0bd608eec72 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 1.105860 Oct 31 15:16:21.715142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 310/564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:21.719431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-917e6a0f-a628-422c-a86c-a671a3e89daa req-702b0091-a4df-4447-aa1a-2e133dec9379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8162776-f600-4766-a801-4af50feda6db", "name": "network-vif-plugged", "status": "completed", "tag": "c86f2068-480a-462e-bdd3-11f993e633b0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:21.727133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:21.727749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:21.731812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-917e6a0f-a628-422c-a86c-a671a3e89daa req-702b0091-a4df-4447-aa1a-2e133dec9379 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.732514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-917e6a0f-a628-422c-a86c-a671a3e89daa req-702b0091-a4df-4447-aa1a-2e133dec9379 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.733138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-917e6a0f-a628-422c-a86c-a671a3e89daa req-702b0091-a4df-4447-aa1a-2e133dec9379 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.745296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.745788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.746621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.750271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-917e6a0f-a628-422c-a86c-a671a3e89daa req-702b0091-a4df-4447-aa1a-2e133dec9379 service nova] Creating event network-vif-plugged:c86f2068-480a-462e-bdd3-11f993e633b0 for instance e8162776-f600-4766-a801-4af50feda6db on n-h2-858383-17 Oct 31 15:16:21.750800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.754929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.755951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.757637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-917e6a0f-a628-422c-a86c-a671a3e89daa req-702b0091-a4df-4447-aa1a-2e133dec9379 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042969 Oct 31 15:16:21.763257 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 255/565] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:21.770345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:21.771127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:21.786834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.788173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.788971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.790147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.791213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.795748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.529017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:22.538878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c185607c-a688-481a-bb15-4931159996b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 0.774218 Oct 31 15:16:22.544519 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 256/566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:21 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:22.552412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0bdab0a-ec0c-4484-957e-581d6d0916a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2c080d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.614502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:22.624408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:22.625702 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0bdab0a-ec0c-4484-957e-581d6d0916a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.079792 Oct 31 15:16:22.628586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 257/567] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:22.635804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:22.637283 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-819de95e-5fdd-4115-8ed2-501b594ae609 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 0.920955 Oct 31 15:16:22.638022 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 311/568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:21 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:22.645815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8f8023f3-457e-4bb1-9680-dd20d81ecf4c req-3c571654-d950-4768-8cc3-758d1cb847a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2557bf-9d54-4682-8964-1fd936d0d706", "tag": "337e551d-0dda-4efa-b391-e4efad616e8c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:22.659037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a82cb761-03be-4cb4-8a68-7893128d7cd2 req-22f786ba-ebc1-4d02-b51f-bfefc92d7a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493610b0-1112-44d9-9df3-ad5800017cbd", "name": "network-vif-deleted", "tag": "5ebe398a-c1d4-4693-900e-5b7c3460fcdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:22.663368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8f8023f3-457e-4bb1-9680-dd20d81ecf4c req-3c571654-d950-4768-8cc3-758d1cb847a2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.664223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8f8023f3-457e-4bb1-9680-dd20d81ecf4c req-3c571654-d950-4768-8cc3-758d1cb847a2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.664989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8f8023f3-457e-4bb1-9680-dd20d81ecf4c req-3c571654-d950-4768-8cc3-758d1cb847a2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.684687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a82cb761-03be-4cb4-8a68-7893128d7cd2 req-22f786ba-ebc1-4d02-b51f-bfefc92d7a75 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.685216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a82cb761-03be-4cb4-8a68-7893128d7cd2 req-22f786ba-ebc1-4d02-b51f-bfefc92d7a75 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.685656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a82cb761-03be-4cb4-8a68-7893128d7cd2 req-22f786ba-ebc1-4d02-b51f-bfefc92d7a75 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.694292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:22.705676 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8f8023f3-457e-4bb1-9680-dd20d81ecf4c req-3c571654-d950-4768-8cc3-758d1cb847a2 service nova] Creating event network-changed:337e551d-0dda-4efa-b391-e4efad616e8c for instance 2e2557bf-9d54-4682-8964-1fd936d0d706 on n-h1-858383-17 Oct 31 15:16:22.720514 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a82cb761-03be-4cb4-8a68-7893128d7cd2 req-22f786ba-ebc1-4d02-b51f-bfefc92d7a75 service nova] Creating event network-vif-deleted:5ebe398a-c1d4-4693-900e-5b7c3460fcdb for instance 493610b0-1112-44d9-9df3-ad5800017cbd on n-h2-858383-17 Oct 31 15:16:22.725509 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8f8023f3-457e-4bb1-9680-dd20d81ecf4c req-3c571654-d950-4768-8cc3-758d1cb847a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084996 Oct 31 15:16:22.725912 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a82cb761-03be-4cb4-8a68-7893128d7cd2 req-22f786ba-ebc1-4d02-b51f-bfefc92d7a75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094238 Oct 31 15:16:22.726453 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 312/569] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:22.727356 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 258/570] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:22.733814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.735065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:22.740043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.740773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:22.741925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.742786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.743898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.745163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.745811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.746396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.754431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.754968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.755358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.756071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.756535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.757059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.183679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.201892 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8cb8e669-ec1c-4321-bd4e-608a4cb44c20 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1463 microversion: 2.1 time: 0.472446 Oct 31 15:16:23.205431 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 259/571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1463 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.210138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.217025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-541acfc7-b264-4bdb-86d8-e7542296954e tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Calling method '.version_select at 0x7f5ca2b3f280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.218887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-541acfc7-b264-4bdb-86d8-e7542296954e tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '0ef114a5c0ea4b8c89f344e3c15c2a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8ece32a69a4986b1427aa5b4a92d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-541acfc7-b264-4bdb-86d8-e7542296954e tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Request method failure captured: Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-a98gsgS29__s4y-wDKvsI-UnBTYWv_zF8xnhLoJpGfl_BiwdEvMGyQUylskkjHsuhSr1-PFzjZR0ZD-_psy8CTCsWsXbW9IfGm3wRq-vUGS-X7eEJmo7in3LJBU1E1wwNXsRVxtPxlWgEdCLSN0hmfcHMOYcilHTO-SLhXpLtZyLs Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:16:23.220783 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0ef114a5c0ea4b8c89f344e3c15c2a0a Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1'} Oct 31 15:16:23.222249 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:23.223101 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 15:16:23.224294 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.227494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a128aea5-d2bb-4253-a8be-6b434af7e92f tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1322 microversion: 2.1 time: 0.497710 Oct 31 15:16:23.228346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-541acfc7-b264-4bdb-86d8-e7542296954e tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:23.235319 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-541acfc7-b264-4bdb-86d8-e7542296954e tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.028822 Oct 31 15:16:23.236428 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 260/572] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:23.237155 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 313/573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.243911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.244522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:23.246345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.248769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:23.257159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.257956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.258736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.260385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.260727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.260907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.261559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.261679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.262105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.263384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.264076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.264685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.408119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.423473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.425488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.433166 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de5d5b11-aee7-46d2-b05c-3d55438d25a9 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.195497 Oct 31 15:16:23.448720 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 261/574] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:23.491523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.502076 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4cc7fba0-d790-4484-9cc9-75c5d55e5af1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 0.263561 Oct 31 15:16:23.503474 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 314/575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.511225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23cdc166-cd73-4b55-873f-dec2e909a0d3 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Calling method '.version_select at 0x7f5ca297f9d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.515659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-23cdc166-cd73-4b55-873f-dec2e909a0d3 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] HTTP exception thrown: Hypervisor with ID 'cb53da09-6a7b-495a-a62b-13852409a720' could not be found. Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23cdc166-cd73-4b55-873f-dec2e909a0d3 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Request method failure captured: Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hypervisors/cb53da09-6a7b-495a-a62b-13852409a720/uptime HTTP/1.1 Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-a-Y6JFSMjpKjJOs419X47nBdAFwcusDzjk1w08VO7TcWR5z5MR0RyCPMYUFOqgSput3J0MFB9xS568bdpieuHme2pf4N68WyNoGuigh2L0BibwCNv9Tsx00h3WuVgsz8u7epAnthEioaDiAdTBOBlrKzN_3sWgorfnlBAAnur4uBc Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e1a0b5ac380643708f619e4d1a84733c Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-394567945 Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:16:23.525454 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-394567945 Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e1a0b5ac380643708f619e4d1a84733c Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-394567945 Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8737dd94d29d4e3ba0db40435689d52b Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: exception: Hypervisor with ID 'cb53da09-6a7b-495a-a62b-13852409a720' could not be found. Oct 31 15:16:23.527499 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'cb53da09-6a7b-495a-a62b-13852409a720'} Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cb53da09-6a7b-495a-a62b-13852409a720' Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 31 15:16:23.528665 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cb53da09-6a7b-495a-a62b-13852409a720' could not be found. Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:23.531943 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cb53da09-6a7b-495a-a62b-13852409a720' could not be found. Oct 31 15:16:23.535080 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.537257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23cdc166-cd73-4b55-873f-dec2e909a0d3 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Returning 404 to user: Hypervisor with ID 'cb53da09-6a7b-495a-a62b-13852409a720' could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:23.538341 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23cdc166-cd73-4b55-873f-dec2e909a0d3 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/cb53da09-6a7b-495a-a62b-13852409a720/uptime" status: 404 len: 123 microversion: 2.1 time: 0.034044 Oct 31 15:16:23.539440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 315/576] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/os-hypervisors/cb53da09-6a7b-495a-a62b-13852409a720/uptime => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:23.550058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Calling method '.version_select at 0x7f5ca2a76040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.552083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.552659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.553330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.578938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.579516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.580030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.599664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:23.608721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.609672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.610563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.625249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dca965c2-b8c1-4783-bf56-ae4ee8306735 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.079116 Oct 31 15:16:23.629251 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 316/577] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:23.647849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.650937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:23.670350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.671082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:23.675234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.676952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.677691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.678864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.695742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.695866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.695866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.696026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.696026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.696178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.696178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.696178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.923348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.931567 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36267980-262d-4e52-8b30-f8f2b703c315 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 0.300489 Oct 31 15:16:23.932371 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 317/578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.938002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab6d1a11-057b-4482-afc3-bf43e3ab744d tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Calling method '.version_select at 0x7f5ca2945550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.940131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab6d1a11-057b-4482-afc3-bf43e3ab744d tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '0ef114a5c0ea4b8c89f344e3c15c2a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a8ece32a69a4986b1427aa5b4a92d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab6d1a11-057b-4482-afc3-bf43e3ab744d tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Request method failure captured: Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-a98gsgS29__s4y-wDKvsI-UnBTYWv_zF8xnhLoJpGfl_BiwdEvMGyQUylskkjHsuhSr1-PFzjZR0ZD-_psy8CTCsWsXbW9IfGm3wRq-vUGS-X7eEJmo7in3LJBU1E1wwNXsRVxtPxlWgEdCLSN0hmfcHMOYcilHTO-SLhXpLtZyLs Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:16:23.941708 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a8ece32a69a4986b1427aa5b4a92d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9a8ece32a69a4986b1427aa5b4a92d80 Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-90770499 Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0ef114a5c0ea4b8c89f344e3c15c2a0a Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-90770499-project Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '1'} Oct 31 15:16:23.943090 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:23.943946 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 15:16:23.945990 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:23.948964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab6d1a11-057b-4482-afc3-bf43e3ab744d tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:23.948964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab6d1a11-057b-4482-afc3-bf43e3ab744d tempest-HypervisorAdminNegativeTestJSON-90770499 tempest-HypervisorAdminNegativeTestJSON-90770499-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009475 Oct 31 15:16:23.948964 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 318/579] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:23.949516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87917ea7-06d2-4091-9c3f-bdebf5ccfe2a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2921b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.037463 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87917ea7-06d2-4091-9c3f-bdebf5ccfe2a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.092396 Oct 31 15:16:24.038795 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 319/580] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:24.054598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.062170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.066669 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2e0ef447-21a1-453f-821b-95a64f6715b0 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1616 microversion: 2.1 time: 0.619535 Oct 31 15:16:24.073270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.073999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.074497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.075340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.075898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.076497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.086328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 262/581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1616 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:24.097985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6499008a-ea6c-4a33-891a-c68975b9b5c0 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Calling method '.version_select at 0x7f5ca2b40ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.099893 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-6499008a-ea6c-4a33-891a-c68975b9b5c0 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] HTTP exception thrown: Hypervisor with ID 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783' could not be found. Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6499008a-ea6c-4a33-891a-c68975b9b5c0 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Request method failure captured: Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-hypervisors/a1e0c3b6-d6fd-429b-894f-3f68ce3eb783 HTTP/1.1 Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-a-Y6JFSMjpKjJOs419X47nBdAFwcusDzjk1w08VO7TcWR5z5MR0RyCPMYUFOqgSput3J0MFB9xS568bdpieuHme2pf4N68WyNoGuigh2L0BibwCNv9Tsx00h3WuVgsz8u7epAnthEioaDiAdTBOBlrKzN_3sWgorfnlBAAnur4uBc Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e1a0b5ac380643708f619e4d1a84733c Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-394567945 Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:16:24.102336 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e1a0b5ac380643708f619e4d1a84733c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-394567945 Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e1a0b5ac380643708f619e4d1a84733c Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-394567945 Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8737dd94d29d4e3ba0db40435689d52b Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: exception: Hypervisor with ID 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783' could not be found. Oct 31 15:16:24.104139 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783'} Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783' Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 31 15:16:24.105016 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:16:24.106313 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783' could not be found. Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783' could not be found. Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6499008a-ea6c-4a33-891a-c68975b9b5c0 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] Returning 404 to user: Hypervisor with ID 'a1e0c3b6-d6fd-429b-894f-3f68ce3eb783' could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:24.107452 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6499008a-ea6c-4a33-891a-c68975b9b5c0 tempest-HypervisorAdminNegativeTestJSON-394567945 tempest-HypervisorAdminNegativeTestJSON-394567945-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/a1e0c3b6-d6fd-429b-894f-3f68ce3eb783" status: 404 len: 123 microversion: 2.1 time: 0.013674 Oct 31 15:16:24.108749 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 263/582] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/os-hypervisors/a1e0c3b6-d6fd-429b-894f-3f68ce3eb783 => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:24.112972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:24.113532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.124566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.125379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.125975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.127689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.128501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.130296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.243335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0b21e2d662b64de892cf15cccac1dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b64ffb3dc84f819d343d483cae6d9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.244719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] flavor_id is None. Assuming migration. {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:16:24.245252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:16:24.299318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.313338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.315358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.317949 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74706a49-5b66-45fe-b618-533564b25f7d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 0.275712 Oct 31 15:16:24.320233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 320/583] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:24.327674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.332502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.349242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.350343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.351012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.356060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.358316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.359017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.477806 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1a39a7a2-5da5-4b39-b040-c3c9f6ea21b7 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10/action" status: 202 len: 0 microversion: 2.1 time: 0.368495 Oct 31 15:16:24.479390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 264/584] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:16:24 2022] POST /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:24.484790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.485648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.493406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.494750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.495364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.496472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.497372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.497951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.588145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.608302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.614596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.622494 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ffe75f19-c186-4801-b774-664d93ca05cc tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.141679 Oct 31 15:16:24.623643 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 265/585] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:24.628670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.629504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.650000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:24.660962 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb6bc73b-b2a0-4203-a4e9-c4c2b874c768 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1322 microversion: 2.1 time: 0.339470 Oct 31 15:16:24.662493 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 321/586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:24.668779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.672419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.673013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.674015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.674899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.675513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.676096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.678727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.691440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.699302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.700206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.701168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.701792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.702412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.346135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:25.369333 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4c03634-a88c-43ab-b016-57dcc17d9dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1472 microversion: 2.1 time: 0.742525 Oct 31 15:16:25.371001 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 266/587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1472 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:25.378353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-58bb16d4-0396-4ba4-905c-9e5f0aeaa0ed req-8a4912ac-957a-45c5-8e40-3793beab30fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d59103-18f0-4bb0-ba16-2907d512fa5d", "tag": "760b9d1b-32f9-4a30-9a04-e9579ea03436"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:25.395096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:25.429255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-58bb16d4-0396-4ba4-905c-9e5f0aeaa0ed req-8a4912ac-957a-45c5-8e40-3793beab30fa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.429748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-58bb16d4-0396-4ba4-905c-9e5f0aeaa0ed req-8a4912ac-957a-45c5-8e40-3793beab30fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.430362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-58bb16d4-0396-4ba4-905c-9e5f0aeaa0ed req-8a4912ac-957a-45c5-8e40-3793beab30fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.440258 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05c7d670-0f58-4929-881d-902449e781bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 0.771382 Oct 31 15:16:25.443396 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 322/588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:25.447240 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-58bb16d4-0396-4ba4-905c-9e5f0aeaa0ed req-8a4912ac-957a-45c5-8e40-3793beab30fa service nova] Creating event network-changed:760b9d1b-32f9-4a30-9a04-e9579ea03436 for instance 48d59103-18f0-4bb0-ba16-2907d512fa5d on n-h2-858383-17 Oct 31 15:16:25.460038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-58bb16d4-0396-4ba4-905c-9e5f0aeaa0ed req-8a4912ac-957a-45c5-8e40-3793beab30fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082832 Oct 31 15:16:25.460901 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 267/589] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:25.465254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:25.466545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:25.473034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.474752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.475697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.476880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.477570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.478912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.481387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-520fd163-c602-45a4-b622-41f0ebf09898 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2b3f940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:25.507961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:25.593057 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-520fd163-c602-45a4-b622-41f0ebf09898 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.129340 Oct 31 15:16:25.601179 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 268/590] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:25 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:25.611023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:25.611793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:25.622976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.623479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.623916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.625032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:25.625205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:25.625827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.319664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=21 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:26.343971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:26.569090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:26.586854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:26.611913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:26.636014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:26.646701 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa1b05c1-3192-41d7-a0bc-e67ba7251c56 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 1.046293 Oct 31 15:16:26.653292 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b6fea56-b1f7-403a-ad33-d7792665c027 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 1.191692 Oct 31 15:16:26.654949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 269/591] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:25 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:26.656077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 323/592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:25 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:26.662150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:26.663011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:26.673499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7fc66d50-3f0c-409c-875a-82a64ee0db40 req-91ee08d5-ab5f-4224-9818-3e8e2a61c3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d916d41e-cdb8-41c4-9491-b4ab391d1ca7", "name": "network-vif-plugged", "status": "completed", "tag": "9e8bd758-ca0a-4f0c-b03b-dc89859f27ed"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:26.714775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.722484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.729523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.731778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7fc66d50-3f0c-409c-875a-82a64ee0db40 req-91ee08d5-ab5f-4224-9818-3e8e2a61c3f7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.734173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.736636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.739801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7fc66d50-3f0c-409c-875a-82a64ee0db40 req-91ee08d5-ab5f-4224-9818-3e8e2a61c3f7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.745908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.746285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7fc66d50-3f0c-409c-875a-82a64ee0db40 req-91ee08d5-ab5f-4224-9818-3e8e2a61c3f7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.815070 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7fc66d50-3f0c-409c-875a-82a64ee0db40 req-91ee08d5-ab5f-4224-9818-3e8e2a61c3f7 service nova] Creating event network-vif-plugged:9e8bd758-ca0a-4f0c-b03b-dc89859f27ed for instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 on n-h1-858383-17 Oct 31 15:16:26.828649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7fc66d50-3f0c-409c-875a-82a64ee0db40 req-91ee08d5-ab5f-4224-9818-3e8e2a61c3f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171171 Oct 31 15:16:26.830384 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 270/593] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:26.839791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:26.841256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:26.865991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.866719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.867340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.868751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.869371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.869953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.159841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.173513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.176289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.190014 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdb18b77-1012-45b9-a739-c77558ecef62 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.531349 Oct 31 15:16:27.192764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 324/594] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:26 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:27.208648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.209329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:27.219902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.223220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.225095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.225867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.227213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.229659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.356540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.384181 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-423aa273-7369-44db-821f-99a08a82adab tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1472 microversion: 2.1 time: 0.551059 Oct 31 15:16:27.385952 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 271/595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:26 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1472 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:27.417421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.419376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:27.437382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.438110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.438725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.439679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.440295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.440911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.726350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.732243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.740436 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66b511b0-1e62-4e51-b289-fe30e441acfa tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1472 microversion: 2.1 time: 0.545333 Oct 31 15:16:27.741722 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 325/596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:27.752636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a0e2726-2e0e-4d59-aedd-8a6a886764a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2bb1d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.763196 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-682cc319-5b0a-46b6-ad0f-1a422f871463 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 0.357230 Oct 31 15:16:27.780766 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 272/597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:27.791731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.792986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:27.800327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.801281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.802166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.804135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.815061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.816960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.856803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Request method failure captured: Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db/diagnostics HTTP/1.1 Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-a0VVlRtC7UWMYt_zdCVAlCO4b2EDijyJMuZrRpPWt9SvFLsWjXT_y47_kCW7Xyx4Ig6UNRyXvbXvmXZCyIZOLvfjyjh_Ysf88x3VqjkZ0kHf0Z765aRmRTHPT5ZJgewtsbg3njFshxFYsWflCqI357SIJAdwIhLhY8wdv8afNnYpI Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 7da73ebe589d4f5491a4f4c6fe01fc67 Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-713976220 Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:16:27.859210 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-713976220 Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 7da73ebe589d4f5491a4f4c6fe01fc67 Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-713976220 Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerDiagnosticsNegativeTest-713976220-project Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d1de4076f673437bb1e71a5f84afa452 Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-713976220-project Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:16:27.860490 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': 'e8162776-f600-4766-a801-4af50feda6db'} Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:27.861209 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 15:16:27.862392 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:16:27.863448 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a0e2726-2e0e-4d59-aedd-8a6a886764a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.118850 Oct 31 15:16:27.863448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 326/598] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:27.865470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:27.866664 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbf7d90f-5186-4971-911d-e049f592d320 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.084224 Oct 31 15:16:27.867702 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 273/599] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db/diagnostics => generated 117 bytes in 86 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:27.877321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.878333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:27.878469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.884104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:27.886390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.887361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.888500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.889559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.890239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.891074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.897953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.898471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.899218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.901212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.901699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.904512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.122621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.145546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.148400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.150453 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f94ed17-d5dd-4f4c-91f0-837a143efdd5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 0.280342 Oct 31 15:16:28.165833 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 274/600] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:28.165833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.165833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:28.177233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.181536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.182274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.183299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.185265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.186164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.224682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:16:28.229147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.240868 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1808e7db-48b3-42e2-8425-ca70bc65849d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 0.376943 Oct 31 15:16:28.242444 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 327/601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:28.249051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.249859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:28.257544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.258235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.258967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.260346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.260984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.261630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.339178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:28.348919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.358283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.360179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.360879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cdeb6957-e88e-4da1-b104-ef715724cf56 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 204 len: 0 microversion: 2.1 time: 0.205276 Oct 31 15:16:28.365768 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 275/602] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:28 2022] DELETE /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:28.376744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.377956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:28.379395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-662c724f-e859-447d-9675-53ad85042222 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.127964 Oct 31 15:16:28.385825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.386374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.386604 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 328/603] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:28 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:28.387176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.388114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.388750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.389414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.769115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.770335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:28.781480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.782229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.782852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.784553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.786329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.788894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.879983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.895781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:28.912051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f93ad3e-e6eb-4861-a233-e77878771f98 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1478 microversion: 2.1 time: 0.544596 Oct 31 15:16:28.913788 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 276/604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:28 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1478 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:28.926470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.929900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:28.940929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.942118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.942778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:28.943765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:28.944493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:28.945318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.166868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.184363 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81d19201-3b5e-4828-80df-37b2b61d9de6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 0.266545 Oct 31 15:16:29.189271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 277/605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:28 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:29.194539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-18ac2e26-3845-4c56-9401-975107cc6942 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca29db040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.210226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.218319 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aeb8e985-d1b7-44da-8abd-a4e9d11779d6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1472 microversion: 2.1 time: 0.453218 Oct 31 15:16:29.229647 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 329/606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:28 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1472 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:29.240729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8acbd6ee-d991-4cca-9e3c-f74791f272d8 req-a911c2eb-4b84-4be9-ad73-cb41ee327098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1da379-7eab-4e0e-a269-1b980bcd964e", "name": "network-vif-plugged", "status": "completed", "tag": "8f534018-dae0-4a5a-8e50-e009f54ec704"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:29.251834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8acbd6ee-d991-4cca-9e3c-f74791f272d8 req-a911c2eb-4b84-4be9-ad73-cb41ee327098 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.252550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8acbd6ee-d991-4cca-9e3c-f74791f272d8 req-a911c2eb-4b84-4be9-ad73-cb41ee327098 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.253162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8acbd6ee-d991-4cca-9e3c-f74791f272d8 req-a911c2eb-4b84-4be9-ad73-cb41ee327098 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.255395 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-18ac2e26-3845-4c56-9401-975107cc6942 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.064561 Oct 31 15:16:29.256230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 278/607] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:29.266228 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8acbd6ee-d991-4cca-9e3c-f74791f272d8 req-a911c2eb-4b84-4be9-ad73-cb41ee327098 service nova] Creating event network-vif-plugged:8f534018-dae0-4a5a-8e50-e009f54ec704 for instance 0e1da379-7eab-4e0e-a269-1b980bcd964e on n-h2-858383-17 Oct 31 15:16:29.267620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.268346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:29.271725 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8acbd6ee-d991-4cca-9e3c-f74791f272d8 req-a911c2eb-4b84-4be9-ad73-cb41ee327098 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040825 Oct 31 15:16:29.276446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 330/608] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:29.281769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.282564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.282810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.283266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.283868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:29.284179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.285428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.287471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.292098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.292901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.293497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.294399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.294862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.295413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.616726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.631986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.633807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.635433 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-857d8500-160b-4877-8ce4-fabb76f03bf6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 0.377813 Oct 31 15:16:29.646950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.665063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 279/609] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:29.670859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.671341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:29.671462 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb320a30-c463-445d-9d78-22a269974480 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1319 microversion: 2.1 time: 0.391100 Oct 31 15:16:29.673018 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 331/610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:29.698177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.698698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.699148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.699934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.700393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.700940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.877696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.909703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.917355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.934822 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4eb4279-6331-4806-9c3f-e8840fd78fe3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.267003 Oct 31 15:16:29.937900 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 280/611] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:29.952762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.952762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:29.967280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.976732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.976732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.976732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.976732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.977199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.209897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:30.210951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:30.223328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.224196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.224649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.225407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.226966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.227874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.358229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:30.368004 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a73b1ba8-2940-4e4c-b4da-eef9f11e1932 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1478 microversion: 2.1 time: 0.429599 Oct 31 15:16:30.369388 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 332/612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1478 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:30.374612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:30.375609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:30.382360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.383141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.383735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.385939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.386775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.387497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.514061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:30.522703 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d682509-b052-4d14-ae95-c7948eeb5fe1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 0.316651 Oct 31 15:16:30.533878 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 281/613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:30 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:30.547364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c049afee-a0c2-4adb-8c4c-a4aa4a233e11 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2a26ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:30.596498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c049afee-a0c2-4adb-8c4c-a4aa4a233e11 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1429 microversion: 2.1 time: 0.054226 Oct 31 15:16:30.606333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 282/614] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:30 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:30.734338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:30.742601 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89a4e98d-22cb-4e7c-ae34-d769c26a0b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1472 microversion: 2.1 time: 0.371813 Oct 31 15:16:30.743216 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 333/615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:30 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:30.749826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:30.750445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:30.777114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.777883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.778656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.779563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.780441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.781083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.842794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1472078235", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:30.925635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:31.171625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.181859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.184212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.186124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11120e7e-e805-4802-88dc-1720be9b6eb8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1362 microversion: 2.25 time: 0.438971 Oct 31 15:16:31.187269 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 334/616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:30 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:31.193502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.194935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.202429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.203225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.203871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.205335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.205904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.206453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.288272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:31.288824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:31.289372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:31.290015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:31.291101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:31.300792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.301360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.301873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.302692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.303262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.303880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.323586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Getting quotas for project b7381b2cd1c646298a9bbedccf3defde. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:31.330049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Getting quotas for user 74a559020cbd4b0b85e0831c1ea92a63 and project b7381b2cd1c646298a9bbedccf3defde. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:31.347180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:31.349727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:31.381600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.390966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a1ba9f84-9312-4969-90e5-e50d02ad2842 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1469 microversion: 2.1 time: 0.201758 Oct 31 15:16:31.391535 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 335/617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:31.404905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5d9b5567-b95c-4b6d-9fdf-2df1f28b15df req-e93ea8f0-757b-4c2f-aab3-b25901426908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8162776-f600-4766-a801-4af50feda6db", "name": "network-vif-deleted", "tag": "c86f2068-480a-462e-bdd3-11f993e633b0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:31.409025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-267bab95-ce6a-4b6f-b223-c4310333f2c1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801030 Oct 31 15:16:31.409845 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 283/618] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:31.414778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.415110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5d9b5567-b95c-4b6d-9fdf-2df1f28b15df req-e93ea8f0-757b-4c2f-aab3-b25901426908 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.416236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5d9b5567-b95c-4b6d-9fdf-2df1f28b15df req-e93ea8f0-757b-4c2f-aab3-b25901426908 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.416952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5d9b5567-b95c-4b6d-9fdf-2df1f28b15df req-e93ea8f0-757b-4c2f-aab3-b25901426908 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.417107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.423748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.424104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.424707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.425656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.426434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.426962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.428570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5d9b5567-b95c-4b6d-9fdf-2df1f28b15df req-e93ea8f0-757b-4c2f-aab3-b25901426908 service nova] Creating event network-vif-deleted:c86f2068-480a-462e-bdd3-11f993e633b0 for instance e8162776-f600-4766-a801-4af50feda6db on n-h2-858383-17 Oct 31 15:16:31.434190 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5d9b5567-b95c-4b6d-9fdf-2df1f28b15df req-e93ea8f0-757b-4c2f-aab3-b25901426908 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032782 Oct 31 15:16:31.434818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 336/619] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:31.440709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d59103-18f0-4bb0-ba16-2907d512fa5d", "name": "network-vif-plugged", "status": "completed", "tag": "760b9d1b-32f9-4a30-9a04-e9579ea03436"}, {"server_uuid": "2e2557bf-9d54-4682-8964-1fd936d0d706", "name": "network-vif-plugged", "status": "completed", "tag": "337e551d-0dda-4efa-b391-e4efad616e8c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:31.451708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.452177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.452600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.466646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] Creating event network-vif-plugged:760b9d1b-32f9-4a30-9a04-e9579ea03436 for instance 48d59103-18f0-4bb0-ba16-2907d512fa5d on n-h2-858383-17 Oct 31 15:16:31.467164 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] Creating event network-vif-plugged:337e551d-0dda-4efa-b391-e4efad616e8c for instance 2e2557bf-9d54-4682-8964-1fd936d0d706 on n-h1-858383-17 Oct 31 15:16:31.475183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f93e1e7c-b2a5-4af3-9603-5af8006a8382 req-966d3bf3-c8c5-480b-b2fc-d6b1f361ecd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038903 Oct 31 15:16:31.475785 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 337/620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:31.483675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.484468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.493099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.494245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.494682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.495385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.495842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.496288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.500532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.509150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.511406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.518732 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da34ce11-0f29-41c5-8699-f758a6d74e28 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.107726 Oct 31 15:16:31.519737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 284/621] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:31.524821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.526091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.542327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.542327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.542546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.546355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.547140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.547756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.548278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.548971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.549568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.550178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lazy-loading 'fault' on Instance uuid e8162776-f600-4766-a801-4af50feda6db {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:31.629211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1de4076f673437bb1e71a5f84afa452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da73ebe589d4f5491a4f4c6fe01fc67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.640445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19600dbc-eacd-446c-af8c-274bdc8d9445 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 200 len: 1312 microversion: 2.1 time: 0.162482 Oct 31 15:16:31.657678 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 338/622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:31.662787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e730725e-5282-4ff1-8ce7-d8d9ee5e0472 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.663543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e730725e-5282-4ff1-8ce7-d8d9ee5e0472 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.735767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e730725e-5282-4ff1-8ce7-d8d9ee5e0472 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.743553 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e730725e-5282-4ff1-8ce7-d8d9ee5e0472 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1219 microversion: 2.1 time: 0.084341 Oct 31 15:16:31.744142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 339/623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:31.759399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.760097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.768993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.769465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.769914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.770732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.772424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.773103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.804918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:31.814639 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c3571a2-2620-4313-99bf-fbb96b9f37da tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1319 microversion: 2.1 time: 0.293827 Oct 31 15:16:31.821415 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 285/624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:31.830573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4cc23369-255c-4f68-b866-8c72529aa428 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2a26b80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.901771 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4cc23369-255c-4f68-b866-8c72529aa428 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1438 microversion: 2.1 time: 0.079210 Oct 31 15:16:31.903308 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 286/625] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:31.908452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:31.909151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:31.916417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.917360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.918209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:31.919620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:31.920441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:31.921107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.012020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.025186 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0eae8ae5-86f3-43e9-bf40-260f4075b479 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1388 microversion: 2.1 time: 0.277578 Oct 31 15:16:32.025930 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 340/626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1388 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:32.048721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7626b24c-54d7-4a59-8c38-2ede160a8443 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2945820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.084690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.094980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-edf7f586-bbe2-4c9a-b342-19dd1799c7e2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1472 microversion: 2.1 time: 0.190341 Oct 31 15:16:32.095580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 287/627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:32.104771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7626b24c-54d7-4a59-8c38-2ede160a8443 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 200 len: 1438 microversion: 2.1 time: 0.065572 Oct 31 15:16:32.105334 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 341/628] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:32.119439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.120511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.127292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.127787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.128211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.128922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.129378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.129800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.212817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.213439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.219725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.220222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.220651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.221371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.221827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.222253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.289366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.297707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27da82eb-9b55-45d9-83e8-401698d82bf1 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1466 microversion: 2.1 time: 0.182617 Oct 31 15:16:32.298375 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 288/629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1466 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:32.323849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a888431-8aa9-4ffd-9a5c-52702f593391 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2a260d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.362455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.370918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.372362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.373587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9c11dbb-3441-43ce-b44b-61c4a1cf66d1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1558 microversion: 2.25 time: 0.164993 Oct 31 15:16:32.374150 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 342/630] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:16:32.399992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.400986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.406966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.407441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.407872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.408557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.409028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.409452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.538534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:32.552647 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3fb0651-4047-433d-ab9d-b3d5ffe0d738 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 2053 microversion: 2.25 time: 0.158062 Oct 31 15:16:32.553151 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 343/631] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 2053 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:16:32.563172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.563172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.564469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.564915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.565533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.566360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.566821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.567239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.571860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:32.639291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.648340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.650295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.656018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0529b840-6a7a-471a-a96a-1c96812fb848 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.101735 Oct 31 15:16:32.656478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 344/632] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:32.670139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.670781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.678443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.678924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.679352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.680041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.680494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.681192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.819427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:32.845883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6801f533-4ec1-4304-a409-8c7b4c8b159b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 2053 microversion: 2.25 time: 0.188093 Oct 31 15:16:32.856767 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 345/633] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 2053 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:32.856767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.856767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] [instance: e8162776-f600-4766-a801-4af50feda6db] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.866700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.866700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.866700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.866700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.867750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.867750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.877153 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] HTTP exception thrown: Instance e8162776-f600-4766-a801-4af50feda6db could not be found. Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Request method failure captured: Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db HTTP/1.1 Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-a0VVlRtC7UWMYt_zdCVAlCO4b2EDijyJMuZrRpPWt9SvFLsWjXT_y47_kCW7Xyx4Ig6UNRyXvbXvmXZCyIZOLvfjyjh_Ysf88x3VqjkZ0kHf0Z765aRmRTHPT5ZJgewtsbg3njFshxFYsWflCqI357SIJAdwIhLhY8wdv8afNnYpI Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 7da73ebe589d4f5491a4f4c6fe01fc67 Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-713976220 Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:16:32.878785 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7da73ebe589d4f5491a4f4c6fe01fc67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-713976220 Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 7da73ebe589d4f5491a4f4c6fe01fc67 Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-713976220 Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiagnosticsNegativeTest-713976220-project Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d1de4076f673437bb1e71a5f84afa452 Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-713976220-project Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e8162776-f600-4766-a801-4af50feda6db could not be found. Oct 31 15:16:32.880232 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e8162776-f600-4766-a801-4af50feda6db'} Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8162776-f600-4766-a801-4af50feda6db could not be found. Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:32.880971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8162776-f600-4766-a801-4af50feda6db could not be found. Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8162776-f600-4766-a801-4af50feda6db could not be found. Oct 31 15:16:32.883443 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:32.885441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] Returning 404 to user: Instance e8162776-f600-4766-a801-4af50feda6db could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:32.885441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3767d32d-92d5-492e-971f-80af4a0ba008 tempest-ServerDiagnosticsNegativeTest-713976220 tempest-ServerDiagnosticsNegativeTest-713976220-project] 10.222.0.48 "GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db" status: 404 len: 111 microversion: 2.1 time: 0.032612 Oct 31 15:16:32.885441 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 346/634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/e8162776-f600-4766-a801-4af50feda6db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:32.885441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.886130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.892354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.892720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.893323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.894018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.894476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.895761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.948039 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a888431-8aa9-4ffd-9a5c-52702f593391 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "DELETE /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1" status: 204 len: 0 microversion: 2.1 time: 0.628933 Oct 31 15:16:32.951804 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 289/635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:32 2022] DELETE /compute/v2.1/images/b37f0368-ef8b-412d-9749-8c5e76b618f1 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:32.957100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.957748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.966734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.967236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.967676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.969301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.969904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.970342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.991685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.001545 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a309cfef-fab4-4426-8c5f-e6b0565207cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1271 microversion: 2.1 time: 0.119758 Oct 31 15:16:33.002541 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 347/636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:33.007265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.011688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.012347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.013102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.014064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.014522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.014945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.039801 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30eeb685-1055-4174-9917-e32484100b64 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.036015 Oct 31 15:16:33.041377 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 348/637] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:33.046942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a958497f-759e-4f3a-8bda-cdb621722ee9 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '.version_select at 0x7f5ca2a760d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.095689 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a958497f-759e-4f3a-8bda-cdb621722ee9 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] HTTP exception thrown: Image not found. Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a958497f-759e-4f3a-8bda-cdb621722ee9 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Request method failure captured: Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e HTTP/1.1 Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Z2SSLbqIL43MZq4-WoxYC_WNecvteE7XnLRoHAh6_pn6jus3WOwHtLtv_mGaqOVpZrieaAimDTNinyy6uNWCVyBJWgi62S5AjBWgWC-sLuNpf2f-bJ174o_IE1zrcmt-_jqMUoc6PyGnih6do3v-qEbhB4fnTiQqIh7IaMKH1f9kY Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8bac2d5104974de8961402403f40e257 Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:16:33.100078 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bac2d5104974de8961402403f40e257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bac2d5104974de8961402403f40e257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bac2d5104974de8961402403f40e257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bac2d5104974de8961402403f40e257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8bac2d5104974de8961402403f40e257 Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerTestJSON-1821284362-project Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 4fdcccbb6840445290ea2e578488e759 Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerTestJSON-1821284362-project Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '024df0ec-f5a1-417b-903f-b9a1a366a01e'} Oct 31 15:16:33.101470 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 024df0ec-f5a1-417b-903f-b9a1a366a01e to delete Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:33.102225 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 024df0ec-f5a1-417b-903f-b9a1a366a01e could not be found. Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:33.104498 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a958497f-759e-4f3a-8bda-cdb621722ee9 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:33.106773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a958497f-759e-4f3a-8bda-cdb621722ee9 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "DELETE /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e" status: 404 len: 62 microversion: 2.1 time: 0.058999 Oct 31 15:16:33.108922 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 349/638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:33 2022] DELETE /compute/v2.1/images/024df0ec-f5a1-417b-903f-b9a1a366a01e => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:33.109808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.110071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.119739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.120860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.121659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.122501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.123328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.124031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.149129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.158175 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb0d4afa-85c3-4398-ae53-c6b0b40607b0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1319 microversion: 2.1 time: 0.205219 Oct 31 15:16:33.162045 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 290/639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:33.168365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:33.169225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.175754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.177230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.178107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.179967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.181213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.181874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.252266 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-803a2e63-7f08-402e-adcf-a732d3b6a10b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e/action" status: 202 len: 0 microversion: 2.25 time: 0.088613 Oct 31 15:16:33.256368 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 291/640] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:16:33 2022] POST /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:33.259907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.260481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.266690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.267170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.267662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.269114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.269565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.270050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.282087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.292092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9aaa96a1-2b8d-4402-bb3e-68b93a2b7cec tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1587 microversion: 2.1 time: 0.187782 Oct 31 15:16:33.293711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 350/641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1587 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:33.301060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.302277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.310347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.311142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.311800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.311932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:16:33.312677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.313254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.313789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.425275 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c2652fb9-5f83-4d20-8bb5-343ea9a6ee0c tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 204 len: 0 microversion: 2.1 time: 0.170504 Oct 31 15:16:33.426072 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 292/642] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:33 2022] DELETE /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:33.435510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.436313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.444520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.447388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.448488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.449451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.450154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.454213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.518134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.526385 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5e54080-e9e9-49dc-9d13-82f8346b66b8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.231194 Oct 31 15:16:33.529055 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 351/643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:33.540884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.542155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.551272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.552063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.552508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.553244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.553705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.554136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.639777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:33.646822 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7578e50d-1268-4373-8fad-d6c9550e0e7b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115539 Oct 31 15:16:33.647826 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 352/644] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:33.653408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.654103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.667160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.669151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.671180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.671880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.673264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.675528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.691277 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc7f2c6d-7ea1-4149-8b9d-5f1276210bca tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 2058 microversion: 2.25 time: 0.263603 Oct 31 15:16:33.706181 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 293/645] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 2058 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:33.706181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.706181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.730711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.731915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.732438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.733249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.733895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.734659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.903384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.912618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.914076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.921366 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c33c777b-8b73-4834-859d-f45a03975eb3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1447 microversion: 2.75 time: 0.224442 Oct 31 15:16:33.922243 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 294/646] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1447 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:34.027966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.029528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:34.039301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.039934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.040747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.042011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.042526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.043466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.052620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:34.061994 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32ebea90-424c-4e1d-be46-75a6a9027156 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1472 microversion: 2.1 time: 0.412923 Oct 31 15:16:34.062470 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 353/647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:34.075215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:34.148826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:34.158436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b410e6f9-d70f-45e3-aa71-6613e64103af tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1277 microversion: 2.1 time: 0.136108 Oct 31 15:16:34.159132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 295/648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:34.188338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.189280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:34.197118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.197810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.198256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.199044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.199550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.200019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.551767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.552663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:34.559254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.559874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.560489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.561380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.566210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.566729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.788030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:34.819320 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2c06475-d30d-4b70-a27a-62d0cf5831cd tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1319 microversion: 2.1 time: 0.635084 Oct 31 15:16:34.843755 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 354/649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:34.849007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.849629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:34.875639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.876613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.878355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.881604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.882467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.883101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.194411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.206917 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-31e7b51a-a6a5-407f-ae7a-3ad1899ce261 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.658733 Oct 31 15:16:35.209150 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 296/650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:35.216843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.219034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:35.226242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.227148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.228499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.229518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.229998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.230378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.273260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:35.295305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f57ff8ea-b556-4920-859b-0f2ccd0aaf59 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 2038 microversion: 2.25 time: 0.449421 Oct 31 15:16:35.296225 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 355/651] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 2038 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:35.304375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.306627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:35.315116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.315812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.316487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.318106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.318748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.319444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.380495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.391518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.393258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.398456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e3d1def1-1e49-4a2d-a29f-cbd01a720ab0 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1465 microversion: 2.75 time: 0.186543 Oct 31 15:16:35.399595 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 297/652] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1465 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:35.404738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.405531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:35.419719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.420209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.420646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.421368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.421836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.422257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.653003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.670529 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cc62c61-9a88-47b6-96d2-6b91c9f0564f tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1472 microversion: 2.1 time: 0.372394 Oct 31 15:16:35.690176 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 356/653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:35.697407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": "auto"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.700176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:35.707495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.708175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.709004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.710270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.711059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.711556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.755274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.765410 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98e0dde3-4af9-44dd-a949-89d40428d548 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1319 microversion: 2.1 time: 0.364593 Oct 31 15:16:35.768966 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 298/654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:35.780381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a3094e96-110b-4544-94dc-23fe49240ec8 req-18b00ff2-7413-498d-a664-f8963e79b752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "name": "network-vif-unplugged", "status": "completed", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.808982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3094e96-110b-4544-94dc-23fe49240ec8 req-18b00ff2-7413-498d-a664-f8963e79b752 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.812028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3094e96-110b-4544-94dc-23fe49240ec8 req-18b00ff2-7413-498d-a664-f8963e79b752 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.812510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3094e96-110b-4544-94dc-23fe49240ec8 req-18b00ff2-7413-498d-a664-f8963e79b752 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.839095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a3094e96-110b-4544-94dc-23fe49240ec8 req-18b00ff2-7413-498d-a664-f8963e79b752 service nova] Creating event network-vif-unplugged:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:16:35.864553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a3094e96-110b-4544-94dc-23fe49240ec8 req-18b00ff2-7413-498d-a664-f8963e79b752 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091499 Oct 31 15:16:35.868157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 299/655] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:35.878046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.879172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:35.895970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.901114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.901593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.902409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.917056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.920094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.094245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'flavor' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:36.151845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Going to try to live migrate instance to n-h1-858383-17 {{(pid=120625) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:16:36.203419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:36.211179 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-70577e64-632b-4c97-ac32-479062ad3b9f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1469 microversion: 2.1 time: 0.339925 Oct 31 15:16:36.211814 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 300/656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:36.234534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-13ba2c3d-bf8c-42cc-9c93-2419d67d2c2c req-4b6a5af5-d692-46f7-8029-d54f1c3e5dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5fcbce4-ac3d-423c-b3c2-4743f2cfe638", "tag": "033d70b6-6542-4609-a87a-f7d09fc98263"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:36.244622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-13ba2c3d-bf8c-42cc-9c93-2419d67d2c2c req-4b6a5af5-d692-46f7-8029-d54f1c3e5dfa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.245388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-13ba2c3d-bf8c-42cc-9c93-2419d67d2c2c req-4b6a5af5-d692-46f7-8029-d54f1c3e5dfa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.245973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-13ba2c3d-bf8c-42cc-9c93-2419d67d2c2c req-4b6a5af5-d692-46f7-8029-d54f1c3e5dfa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.258288 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-13ba2c3d-bf8c-42cc-9c93-2419d67d2c2c req-4b6a5af5-d692-46f7-8029-d54f1c3e5dfa service nova] Creating event network-changed:033d70b6-6542-4609-a87a-f7d09fc98263 for instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 on n-h2-858383-17 Oct 31 15:16:36.264519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-13ba2c3d-bf8c-42cc-9c93-2419d67d2c2c req-4b6a5af5-d692-46f7-8029-d54f1c3e5dfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037914 Oct 31 15:16:36.265579 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 301/657] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:36.271162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:36.272173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:36.281744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.282491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.284416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.285474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.287511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.288179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.549947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:36.560922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f91e7909-ece4-4fea-ba6b-397ee0d05abe tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1587 microversion: 2.1 time: 0.293877 Oct 31 15:16:36.562180 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 302/658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:36 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1587 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:36.586655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ee66ce4d-155c-40d4-99a2-9ae40b5b99a8 req-cc53a480-6cac-45fa-a591-0df2d36660c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d59103-18f0-4bb0-ba16-2907d512fa5d", "tag": "760b9d1b-32f9-4a30-9a04-e9579ea03436"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:36.615102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ee66ce4d-155c-40d4-99a2-9ae40b5b99a8 req-cc53a480-6cac-45fa-a591-0df2d36660c0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.616000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ee66ce4d-155c-40d4-99a2-9ae40b5b99a8 req-cc53a480-6cac-45fa-a591-0df2d36660c0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.617895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ee66ce4d-155c-40d4-99a2-9ae40b5b99a8 req-cc53a480-6cac-45fa-a591-0df2d36660c0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.632829 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ee66ce4d-155c-40d4-99a2-9ae40b5b99a8 req-cc53a480-6cac-45fa-a591-0df2d36660c0 service nova] Creating event network-changed:760b9d1b-32f9-4a30-9a04-e9579ea03436 for instance 48d59103-18f0-4bb0-ba16-2907d512fa5d on n-h2-858383-17 Oct 31 15:16:36.641881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ee66ce4d-155c-40d4-99a2-9ae40b5b99a8 req-cc53a480-6cac-45fa-a591-0df2d36660c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066764 Oct 31 15:16:36.643096 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 303/659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:36.649970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:36.656510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:36.671087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.671799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.672569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.673463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.674066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.674771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.132839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.144597 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0c318e27-bbec-4299-a663-4fb01346a24d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.500085 Oct 31 15:16:37.151339 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 304/660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:36 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:37.156497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.174306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.175217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Searching by: {'reservation_id': 'r-wt8j70md', 'deleted': False, 'project_id': '4366c148cab043bc8a653080ba52e8c6'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:16:37.185354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.185954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.186491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.187316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.187968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.188527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.329649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:16:37.444417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.452135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.452625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.453090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.580732 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d56a1861-b58b-4237-b0ed-350d50951d75 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-wt8j70md" status: 200 len: 2931 microversion: 2.1 time: 0.427988 Oct 31 15:16:37.581333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 305/661] 10.222.0.48 () {58 vars in 1197 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wt8j70md => generated 2931 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:37.592883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.592883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:37.593964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.594448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.594879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.595955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.596414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.596865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.828175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.836218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.838409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.843451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f4f7aba2-0e2e-4d68-9e1a-ed44b82d2ac3 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1453 microversion: 2.75 time: 0.260882 Oct 31 15:16:37.844013 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 306/662] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:37.848387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.849275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:37.855383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.855873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.856306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.857018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.857475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.857896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.988523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.996352 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60a95131-8285-4114-8101-368c2d92e409 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1472 microversion: 2.1 time: 0.151398 Oct 31 15:16:37.996955 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 307/663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1472 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:38.001375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:38.001978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:38.007435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.007915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.008349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.009745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.010205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.010630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.219632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:38.227988 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e66dc9a-3cb1-4f65-9915-b34d16f71e30 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1319 microversion: 2.1 time: 0.229449 Oct 31 15:16:38.228603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 308/664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:38.354717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1857948554", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:38.436900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:38.864796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:38.865245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:38.865713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:38.866111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:38.866514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:38.875973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.876449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.876952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.877666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.878118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.878535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.889658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:38.896582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Getting quotas for project a8467f5801594eba9c27b4eb124c8325. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:38.901380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Getting quotas for user 319cd9ded5c2410392868fb3cb039342 and project a8467f5801594eba9c27b4eb124c8325. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:38.912499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:38.915587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:38.959022 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76ffbb60-890b-432c-8702-b6e1857c586f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729060 Oct 31 15:16:38.959583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 309/665] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:38.964239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac307010-543b-40d2-afcd-d3bff2c1b37f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:38.991554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.compute.server_groups [None req-ac307010-543b-40d2-afcd-d3bff2c1b37f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Querying cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) for 2 instances {{(pid=120626) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:16:38.992397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac307010-543b-40d2-afcd-d3bff2c1b37f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.993522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac307010-543b-40d2-afcd-d3bff2c1b37f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.993959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac307010-543b-40d2-afcd-d3bff2c1b37f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.029574 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac307010-543b-40d2-afcd-d3bff2c1b37f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/02de2e26-4114-4a63-b2f0-1fd858bafc1f" status: 200 len: 265 microversion: 2.1 time: 0.068857 Oct 31 15:16:39.036533 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 310/666] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:16:38 2022] GET /compute/v2.1/os-server-groups/02de2e26-4114-4a63-b2f0-1fd858bafc1f => generated 265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:39.042876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.043733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:39.053914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.054406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.056134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.056349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.056839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.057459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.317849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:39.331428 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9c77cec5-76ed-483f-9b72-fc17a320899f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.291829 Oct 31 15:16:39.345281 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 311/667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:39 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:39.353047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.353911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:39.361539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.362154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.362496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.363149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.363783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.364411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.440906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:39.452805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:39.454665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:39.469116 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-720a6f0f-1610-4922-86ac-3e660a044aed tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1453 microversion: 2.75 time: 0.121964 Oct 31 15:16:39.470327 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 312/668] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:39 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:39.475985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.476823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:39.495870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.496623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.497370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.498099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.498559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.498988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.576024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:39.588526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d432804b-7ff8-4a32-9096-88db427520a6 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1430 microversion: 2.1 time: 0.116410 Oct 31 15:16:39.589631 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 313/669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:39 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1430 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:39.597613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.598506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:39.607136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.607969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.608477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.609228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.609678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.610108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.614599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:39.853150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6c1680b-fb19-407b-8c1c-3e888fd239b5 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1622 microversion: 2.1 time: 0.260967 Oct 31 15:16:39.853846 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 314/670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:39 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1622 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:39.858904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-474317493", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:39.931061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:40.181997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:40.182424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:40.182908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:40.183317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:40.183728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:40.193698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.194187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.194675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.195416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.195915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.196975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.215147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Getting quotas for project a8467f5801594eba9c27b4eb124c8325. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:40.220653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Getting quotas for user 319cd9ded5c2410392868fb3cb039342 and project a8467f5801594eba9c27b4eb124c8325. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:40.235721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:40.237875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:40.283285 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1aa1178b-ce44-4ceb-bd54-c1c356aa7841 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428217 Oct 31 15:16:40.290483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 315/671] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:40.290483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.290483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.296685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.297235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.297643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.298603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.299078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.299522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.381631 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27c4362d-6b01-4501-aaf0-32389c4ac551 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e/action" status: 202 len: 0 microversion: 2.25 time: 4.690208 Oct 31 15:16:40.382936 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 357/672] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e/action => generated 0 bytes in 4692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:40.393569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d7d1d18f-0338-4227-94e9-38a5fb6ffa40 req-382dc716-3ea1-43d5-b8ab-bfcd708f0251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0edea8-e591-45c2-abe5-4f639f5c5e94", "name": "network-vif-deleted", "tag": "b8da8d60-ac61-4729-9f87-dc7691e57110"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:40.417476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d7d1d18f-0338-4227-94e9-38a5fb6ffa40 req-382dc716-3ea1-43d5-b8ab-bfcd708f0251 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.426745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d7d1d18f-0338-4227-94e9-38a5fb6ffa40 req-382dc716-3ea1-43d5-b8ab-bfcd708f0251 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.429222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d7d1d18f-0338-4227-94e9-38a5fb6ffa40 req-382dc716-3ea1-43d5-b8ab-bfcd708f0251 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.466459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d7d1d18f-0338-4227-94e9-38a5fb6ffa40 req-382dc716-3ea1-43d5-b8ab-bfcd708f0251 service nova] Creating event network-vif-deleted:b8da8d60-ac61-4729-9f87-dc7691e57110 for instance df0edea8-e591-45c2-abe5-4f639f5c5e94 on n-h1-858383-17 Oct 31 15:16:40.472660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d7d1d18f-0338-4227-94e9-38a5fb6ffa40 req-382dc716-3ea1-43d5-b8ab-bfcd708f0251 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084502 Oct 31 15:16:40.473768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 358/673] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:40.480319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.481373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.488436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.488989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.489649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.490724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.494202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.495040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.528324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:40.550912 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ebf3af86-e426-4545-8686-93b28192ba51 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1319 microversion: 2.1 time: 0.265869 Oct 31 15:16:40.554953 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 316/674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:40.561672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9b53553-8e06-498f-8385-02e7b331c411 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.562613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9b53553-8e06-498f-8385-02e7b331c411 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.673283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9b53553-8e06-498f-8385-02e7b331c411 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:40.681215 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9b53553-8e06-498f-8385-02e7b331c411 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1213 microversion: 2.1 time: 0.123604 Oct 31 15:16:40.681802 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 317/675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:40.702231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.702855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.710020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.710511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.714360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.715595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.716263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.716925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.918441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-112c43cc-16e0-4f49-a0da-bdb298647777 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 200 len: 1622 microversion: 2.1 time: 0.443450 Oct 31 15:16:40.923135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 359/676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 1622 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:40.934325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.935446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.953210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.953716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.954150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.954858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.955313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.955743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.012559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.025254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89ef9baf-bec8-4336-a188-7e769e04f286 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.331265 Oct 31 15:16:41.053542 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 318/677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:41.074318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:41.075212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:41.085418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.085928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.086378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.087225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.087865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.088977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.234453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.246551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.248749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.255119 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dea89a0d-364d-437e-9319-4f04b071994f tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1438 microversion: 2.75 time: 0.196063 Oct 31 15:16:41.256126 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 319/678] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:41 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1438 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:41.269986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:41.270932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:41.288235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.289153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.290600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.291830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.292740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.293427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.335197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.335935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.336460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.337650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.338337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lazy-loading 'fault' on Instance uuid df0edea8-e591-45c2-abe5-4f639f5c5e94 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:41.345976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.347774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.349262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da96a07a-f930-4e3a-940f-9636f0dab58e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.424052 Oct 31 15:16:41.350056 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 360/679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:41.355405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd8ae68a-9bf7-43e6-b7c9-ff0205f06eda tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: .version_select at 0x7f5ca2f854c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1164698837", "policies": ["anti-affinity"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:41.374138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cd8ae68a-9bf7-43e6-b7c9-ff0205f06eda tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:41.378266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:41.379943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cd8ae68a-9bf7-43e6-b7c9-ff0205f06eda tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:41.418381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdcccbb6840445290ea2e578488e759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bac2d5104974de8961402403f40e257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.427139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cd8ae68a-9bf7-43e6-b7c9-ff0205f06eda tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:41.430010 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b9e4863-944f-4a34-a355-c4cb2fe66af3 tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 200 len: 1307 microversion: 2.1 time: 0.171372 Oct 31 15:16:41.432588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cd8ae68a-9bf7-43e6-b7c9-ff0205f06eda tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:41.433153 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 320/680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:41 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:41.455585 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd8ae68a-9bf7-43e6-b7c9-ff0205f06eda tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.104267 Oct 31 15:16:41.456275 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 361/681] 10.222.0.48 () {60 vars in 1174 bytes} [Mon Oct 31 15:16:41 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:41.578881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1900287637", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5365e837-d31b-41cc-ac46-c840c3c58481"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:41.579095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:41.583534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:41.592145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.592922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.593883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.594706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.595295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.595832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.649592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:41.697842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:41.698447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:41.699068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:41.699558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:41.700077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:41.794072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:41.802088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.802954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.803584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.804581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.806690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.807302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.967882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:41.987227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b396c7f-77a0-467b-bfa5-4264aa9ec9f2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4/action" status: 202 len: 1944 microversion: 2.75 time: 0.547968 Oct 31 15:16:41.988237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 321/682] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:16:41 2022] POST /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4/action => generated 1944 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:16:41.993635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:41.994321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.000117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.000611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.001080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.001775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.002233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.002785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.139161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:42.139586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:42.140059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:42.140468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:42.140920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:42.157855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.158346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.158781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.159703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.160360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.161196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.184574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:42.189119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:42.204734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Going to run 2 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:42.207518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:42.282575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:42.286531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:42.291112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:42.307941 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f13ffc9-9002-4d59-a44b-b60ad9b3f268 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1319 microversion: 2.1 time: 0.318376 Oct 31 15:16:42.309627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 322/683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:41 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:42.318354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:42.319301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.326396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.327011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.327854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.328369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.328875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.329333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.343482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:42.348359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:42.362687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=93c9c446-931d-406c-beef-3f71283a244b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:42.424480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:42.429469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:42.462780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:42.472826 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9968538f-26ed-40f0-99b8-c346cd44ce4b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1265 microversion: 2.1 time: 0.161674 Oct 31 15:16:42.474695 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 323/684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:42 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:42.484082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:42.484974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.488318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:42.494511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.495311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.495932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.496616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'server_group_members'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:42.497189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.497821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.499017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.563830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e88c0d46-58b8-48aa-8571-3933ca6f9a55 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.998440 Oct 31 15:16:42.566740 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 362/685] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:16:42.581194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:42.581823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.592624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.593499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.594174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.595107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.595837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.596495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.601738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:42.722223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:42.775444 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f96aa29-cafe-4f7e-8b56-0b48a2e993dc tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.299448 Oct 31 15:16:42.776260 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 324/686] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:42 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:42.787035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:42.787950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.799687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.800123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.804465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.805849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.806332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.806945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.302326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:43.311071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63d7b4d1-eeac-4f72-a668-00e75d7e4eaf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.741319 Oct 31 15:16:43.314502 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 363/687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:42 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:43.321837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.326768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] [instance: df0edea8-e591-45c2-abe5-4f639f5c5e94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:43.341002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.341757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.353461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.354273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.354922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.355509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.380749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] HTTP exception thrown: Instance df0edea8-e591-45c2-abe5-4f639f5c5e94 could not be found. Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Request method failure captured: Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 HTTP/1.1 Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Z2SSLbqIL43MZq4-WoxYC_WNecvteE7XnLRoHAh6_pn6jus3WOwHtLtv_mGaqOVpZrieaAimDTNinyy6uNWCVyBJWgi62S5AjBWgWC-sLuNpf2f-bJ174o_IE1zrcmt-_jqMUoc6PyGnih6do3v-qEbhB4fnTiQqIh7IaMKH1f9kY Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8bac2d5104974de8961402403f40e257 Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:16:43.382606 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bac2d5104974de8961402403f40e257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bac2d5104974de8961402403f40e257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bac2d5104974de8961402403f40e257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bac2d5104974de8961402403f40e257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8bac2d5104974de8961402403f40e257 Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1821284362 Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerTestJSON-1821284362-project Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 4fdcccbb6840445290ea2e578488e759 Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerTestJSON-1821284362-project Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance df0edea8-e591-45c2-abe5-4f639f5c5e94 could not be found. Oct 31 15:16:43.385237 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'df0edea8-e591-45c2-abe5-4f639f5c5e94'} Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0edea8-e591-45c2-abe5-4f639f5c5e94 could not be found. Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:43.386109 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0edea8-e591-45c2-abe5-4f639f5c5e94 could not be found. Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0edea8-e591-45c2-abe5-4f639f5c5e94 could not be found. Oct 31 15:16:43.389157 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:43.390900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] Returning 404 to user: Instance df0edea8-e591-45c2-abe5-4f639f5c5e94 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:43.391959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cbed06e-7fd5-41d8-b819-84d9ceac793a tempest-ImagesOneServerTestJSON-1821284362 tempest-ImagesOneServerTestJSON-1821284362-project] 10.222.0.48 "GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94" status: 404 len: 111 microversion: 2.1 time: 0.072678 Oct 31 15:16:43.392083 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 364/688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers/df0edea8-e591-45c2-abe5-4f639f5c5e94 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:43.411139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.420372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:43.422202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Searching by: {'deleted': False, 'project_id': '4366c148cab043bc8a653080ba52e8c6'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:16:43.435665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.436815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.437430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.438474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.439100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.439679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.477113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Listed batch of 5 results from cell out of 999 limit. Returned 5 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:16:43.516365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:43.529337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:43.531249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:43.538809 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aecf2ed1-d6fc-4770-9fac-b4e42d51a8b2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.761088 Oct 31 15:16:43.540032 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 325/689] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:42 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:43.547073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9275098e-6480-4154-9ec8-340a6f6083f5 req-d204da50-20f2-4618-91ae-78e84495ce57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fcbce4-ac3d-423c-b3c2-4743f2cfe638", "name": "network-vif-plugged", "status": "completed", "tag": "033d70b6-6542-4609-a87a-f7d09fc98263"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:43.566644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa65c028-3e8c-4c75-926b-094ab287aa6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.156643 Oct 31 15:16:43.578887 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 365/690] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:43.584261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9275098e-6480-4154-9ec8-340a6f6083f5 req-d204da50-20f2-4618-91ae-78e84495ce57 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.585662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9275098e-6480-4154-9ec8-340a6f6083f5 req-d204da50-20f2-4618-91ae-78e84495ce57 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.587998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.588639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:43.588937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9275098e-6480-4154-9ec8-340a6f6083f5 req-d204da50-20f2-4618-91ae-78e84495ce57 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.600533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.601069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.601507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.606181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.606869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.610892 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9275098e-6480-4154-9ec8-340a6f6083f5 req-d204da50-20f2-4618-91ae-78e84495ce57 service nova] Creating event network-vif-plugged:033d70b6-6542-4609-a87a-f7d09fc98263 for instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 on n-h2-858383-17 Oct 31 15:16:43.611629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.623248 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9275098e-6480-4154-9ec8-340a6f6083f5 req-d204da50-20f2-4618-91ae-78e84495ce57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081086 Oct 31 15:16:43.629670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 326/691] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:43.636279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.641561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:43.654505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.657242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.657732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.658488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.658955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.665366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.914962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:43.929642 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f6962547-dd98-4eee-88d8-ad96d2f7393a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1271 microversion: 2.1 time: 0.298497 Oct 31 15:16:43.933833 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 327/692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:43.957619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.958480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:43.966979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.967775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.968371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.969942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.970730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.971313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.117839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:44.126477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae06ed56-4f91-458a-9e06-88814a8bc51a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1215 microversion: 2.1 time: 0.173320 Oct 31 15:16:44.127513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 328/693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:44.135000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.138675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:44.148165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.149070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.150946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.151878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.153110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.153711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.283968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:44.290410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:44.294444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:44.297819 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6d6a998-9131-4e52-a15f-4a74400106f1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1319 microversion: 2.1 time: 0.723155 Oct 31 15:16:44.302876 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 366/694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:44.339027 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-48339122-b831-47f3-85fb-5f733e934377 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.210102 Oct 31 15:16:44.340027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.341039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:44.350377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:44.353205 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 329/695] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:44 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:44.357704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.358531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.359767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.360440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.361105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.361544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.553747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ade5bfd4-90af-4c27-ab96-2bc212335e64 req-2c27983a-8d9b-4f70-a9b4-28c5a2efb8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1da379-7eab-4e0e-a269-1b980bcd964e", "name": "network-vif-unplugged", "status": "completed", "tag": "8f534018-dae0-4a5a-8e50-e009f54ec704"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:44.568872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ade5bfd4-90af-4c27-ab96-2bc212335e64 req-2c27983a-8d9b-4f70-a9b4-28c5a2efb8e3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.574324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ade5bfd4-90af-4c27-ab96-2bc212335e64 req-2c27983a-8d9b-4f70-a9b4-28c5a2efb8e3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.575173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ade5bfd4-90af-4c27-ab96-2bc212335e64 req-2c27983a-8d9b-4f70-a9b4-28c5a2efb8e3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.591760 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ade5bfd4-90af-4c27-ab96-2bc212335e64 req-2c27983a-8d9b-4f70-a9b4-28c5a2efb8e3 service nova] Creating event network-vif-unplugged:8f534018-dae0-4a5a-8e50-e009f54ec704 for instance 0e1da379-7eab-4e0e-a269-1b980bcd964e on n-h2-858383-17 Oct 31 15:16:44.597335 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ade5bfd4-90af-4c27-ab96-2bc212335e64 req-2c27983a-8d9b-4f70-a9b4-28c5a2efb8e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048977 Oct 31 15:16:44.598168 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 330/696] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:44.603206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.604008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:44.612134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.612616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.613470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.614403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.615200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.616306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.838206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:44.846622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21622a08-04f5-47f4-b0c2-a0739d72b845 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.511016 Oct 31 15:16:44.853096 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 367/697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:44 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:44.960986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.962609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:44.974996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.977972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.978640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.981667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.983679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.984187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.038198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.057542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.059106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.060248 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3fe228d0-3f99-4614-9711-a4ae6bbbe325 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.461010 Oct 31 15:16:45.088724 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 331/698] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:44 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:45.151615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.152231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.169343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.170253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.170864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.171748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.172360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.172965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.395357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.406354 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b302461f-5375-4997-95f6-145939c8d58b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1271 microversion: 2.1 time: 0.259062 Oct 31 15:16:45.410392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 332/699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:45.420227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.423949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.433923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.434420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.434860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.435568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.436026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.436452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.490601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.511226 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b31cdc60-183f-44d1-aa65-ee569fbfc5ae tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.555746 Oct 31 15:16:45.511827 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 368/700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:44 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:45.516431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.517468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.537807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.541391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.542136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.542886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.546671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.547121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.711625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:45.733789 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d31d10b2-881f-4335-8c09-2d3f9301d239 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.220573 Oct 31 15:16:45.735343 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 369/701] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:45.882566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.894464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e991552c-9916-455d-9e0a-ede72d964973 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1468 microversion: 2.1 time: 0.482209 Oct 31 15:16:45.898235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Calling method '.version_select at 0x7f5ca2f39c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.910265 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 333/702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1468 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:45.919888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.921098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.931145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.932273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.933506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.934968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.935798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.936411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.936737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.937563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.938273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.939518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.940509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.944574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.975877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05068194-092d-475f-b39b-10cecf92e5ef tempest-AbsoluteLimitsTestJSON-851431948 tempest-AbsoluteLimitsTestJSON-851431948-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.238728 Oct 31 15:16:45.977726 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 370/703] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:46.287880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-818957097", "block_migration": true, "disk_over_commit": false}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:46.297034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.306094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.306938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.307739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.308684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.310185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.310830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.343184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lazy-loading 'flavor' on Instance uuid e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:46.358537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Going to try to live migrate instance to tempest-host-818957097 {{(pid=120625) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:16:46.367617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] HTTP exception thrown: Compute host tempest-host-818957097 could not be found. Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Request method failure captured: Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638/action HTTP/1.1 Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 106 Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-bNHe2RbFCg9I-cBSenx8j2fmQgr-lQRKM_zJEjFCgwakXNSMt5GW2mZktUoZ0_s-0sdmGPm5nr1lZ_nQZXK1W9GKAOluFaIM7pdXOK6Z2RBQrdCDrLSI7xUC5tg7iTdR_rdL-PTqKY5qxb3-5yge5NkMV6ZNJOrC5MRRmTAB6UcMU Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: fde6c8de9c894032a27776e24af48e80 Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveMigrationNegativeTest-1988081640 Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:16:46.373605 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fde6c8de9c894032a27776e24af48e80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fde6c8de9c894032a27776e24af48e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fde6c8de9c894032a27776e24af48e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fde6c8de9c894032a27776e24af48e80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveMigrationNegativeTest-1988081640 Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: fde6c8de9c894032a27776e24af48e80 Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1988081640 Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveMigrationNegativeTest-1988081640-project-admin Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6c1eefaa4dec4364a1a143a1d2efc527 Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveMigrationNegativeTest-1988081640-project-admin Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: {"os-migrateLive": {"host": "tempest-host-818957097", "block_migration": true, "disk_over_commit": false}} Oct 31 15:16:46.374923 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: exception: Compute host tempest-host-818957097 could not be found. Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e5fcbce4-ac3d-423c-b3c2-4743f2cfe638', 'body': {'os-migrateLive': {'host': 'tempest-host-818957097', 'block_migration': True, 'disk_over_commit': False}}} Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:16:46.375641 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5489, in live_migrate Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-818957097 could not be found. Oct 31 15:16:46.377967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-818957097 could not be found. Oct 31 15:16:46.379159 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-818957097 could not be found. Oct 31 15:16:46.380268 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.382225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Returning 400 to user: Compute host tempest-host-818957097 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:46.383892 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49d9ac5e-dad6-4f15-8e26-70d0d195331e tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638/action" status: 400 len: 99 microversion: 2.1 time: 0.404341 Oct 31 15:16:46.385023 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 371/704] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Oct 31 15:16:45 2022] POST /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638/action => generated 99 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:46.391563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.392632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.401566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.402449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.403695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.404683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.405387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.406056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.448040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:46.457279 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-919ba3d4-1573-4556-98bc-8fdda8acf0ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.546721 Oct 31 15:16:46.458128 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 334/705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:46.464267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-14ccbac6-0a2d-4128-bf29-4c5821c20aad req-c372f962-9e8a-474e-9724-893cad3683a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee43b08d-f9f4-45c0-bfac-b60dde48261d", "tag": "f1a06634-992a-4099-b9cb-3af51ba7ed45"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:46.474504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-14ccbac6-0a2d-4128-bf29-4c5821c20aad req-c372f962-9e8a-474e-9724-893cad3683a5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.475296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-14ccbac6-0a2d-4128-bf29-4c5821c20aad req-c372f962-9e8a-474e-9724-893cad3683a5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.476008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-14ccbac6-0a2d-4128-bf29-4c5821c20aad req-c372f962-9e8a-474e-9724-893cad3683a5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.491460 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-14ccbac6-0a2d-4128-bf29-4c5821c20aad req-c372f962-9e8a-474e-9724-893cad3683a5 service nova] Creating event network-changed:f1a06634-992a-4099-b9cb-3af51ba7ed45 for instance ee43b08d-f9f4-45c0-bfac-b60dde48261d on n-h1-858383-17 Oct 31 15:16:46.498910 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-14ccbac6-0a2d-4128-bf29-4c5821c20aad req-c372f962-9e8a-474e-9724-893cad3683a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038485 Oct 31 15:16:46.500023 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 335/706] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:46.505689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.506764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.514129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.514937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.515599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.516858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.517434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.518021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.811225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:46.817400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:46.825820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:46.830501 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a304d906-c13e-4285-80bd-7d8f43e3c574 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1468 microversion: 2.1 time: 0.328912 Oct 31 15:16:46.831086 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 336/707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:46 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:46.834321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:46.835607 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad11d194-1911-4686-90a3-b83c3452ea77 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.449398 Oct 31 15:16:46.858361 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 372/708] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:46 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:46.861277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.865746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.869298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.872742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.875733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:46.878956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.881649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.882356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.883598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.885818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.886653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.887289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.887992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.892888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.894434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.895041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.895741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.051553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:47.059696 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-955bc8c2-52a8-4fc2-b316-fd29ad92dc8f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1277 microversion: 2.1 time: 0.226258 Oct 31 15:16:47.064856 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 337/709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:46 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:47.068355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}, {"name": "network-changed", "server_uuid": "0e1da379-7eab-4e0e-a269-1b980bcd964e", "tag": "8f534018-dae0-4a5a-8e50-e009f54ec704"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.080499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.081142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.081643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.101617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] Creating event network-changed:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:16:47.102765 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] Creating event network-changed:8f534018-dae0-4a5a-8e50-e009f54ec704 for instance 0e1da379-7eab-4e0e-a269-1b980bcd964e on n-h2-858383-17 Oct 31 15:16:47.109987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4c1122d4-5fff-4a34-83a3-e0ca55db02eb req-2fcaaf72-fbf4-42ec-8ae0-b74615dc51e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048036 Oct 31 15:16:47.111745 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 338/710] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:47.118772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.120023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:47.126918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.127418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.128469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.129364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.129829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.130259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.195146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:47.203894 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd0c73f6-f0c3-4dcc-801d-02f90c0d6d10 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.344077 Oct 31 15:16:47.204752 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 373/711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:46 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:47.222558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-184614773", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.225082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:47.244451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-173bff27-238f-4c6b-bb0d-73a9c6952bd8 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.130931 Oct 31 15:16:47.246206 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 339/712] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:47 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:47.280379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:47.490211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.491466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:47.508891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.509390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.510079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.511019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.511689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.512356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.140002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:48.140558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:48.141231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:48.141804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:48.142220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:48.154381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.155156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.155825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.156819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.157504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.158016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.186632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Getting quotas for project b7381b2cd1c646298a9bbedccf3defde. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:48.191579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Getting quotas for user 74a559020cbd4b0b85e0831c1ea92a63 and project b7381b2cd1c646298a9bbedccf3defde. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:48.206536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:48.210849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:48.220094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.230456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c627e71f-8698-4d6d-b8f3-924138f602d3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.745788 Oct 31 15:16:48.232064 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 340/713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:47 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:48.237674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.238751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.246333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.246894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.247582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.248360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.248942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.249592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.278333 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6fec2dc-5a4f-403a-8bc8-e31ea41343cf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059494 Oct 31 15:16:48.286276 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 374/714] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:48.291665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.292476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.301852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.302798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.303236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.303937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.304393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.305463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.716935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.727143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.732950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.736816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.737448 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0403eed8-f033-43eb-9c50-a0d78c8aa5f5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.450035 Oct 31 15:16:48.738038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-06c24468-4a4e-4087-b2b6-1afd02b79d09 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.504639 Oct 31 15:16:48.738594 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 341/715] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:48.738931 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 375/716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:48.761408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.762047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.762288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.763935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.769678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.770435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.771028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.771309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.771809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.772228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.772362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.773008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.773532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.774412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.774532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.774951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.937811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:48.967822 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-14751e40-8625-4462-b563-46b9c5cc094b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.217849 Oct 31 15:16:48.968820 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 342/717] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:48.975695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.977320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.993857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.995027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.996466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.997730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.998867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.999326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.144284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:49.153844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1abb2b0a-50db-42bf-b6ee-ec2b88d66948 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.413767 Oct 31 15:16:49.154806 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 376/718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:49.211489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:49.230112 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e1a8233f-bd45-4ada-9494-774086cdaedf tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1222 microversion: 2.1 time: 0.259359 Oct 31 15:16:49.230527 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 343/719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:49.256519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.258413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:49.272224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1ff02c3c-3949-48c5-a5ca-5485d4de8ea4 req-c9820e7a-7216-4694-acc4-f5d12459ed7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c9c446-931d-406c-beef-3f71283a244b", "tag": "927144ed-dd76-45fd-8f86-82482fd63ede"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.276078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.278371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.279206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.281961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.282903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1ff02c3c-3949-48c5-a5ca-5485d4de8ea4 req-c9820e7a-7216-4694-acc4-f5d12459ed7d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.283515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.283802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1ff02c3c-3949-48c5-a5ca-5485d4de8ea4 req-c9820e7a-7216-4694-acc4-f5d12459ed7d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.284300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.284613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1ff02c3c-3949-48c5-a5ca-5485d4de8ea4 req-c9820e7a-7216-4694-acc4-f5d12459ed7d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.299290 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1ff02c3c-3949-48c5-a5ca-5485d4de8ea4 req-c9820e7a-7216-4694-acc4-f5d12459ed7d service nova] Creating event network-changed:927144ed-dd76-45fd-8f86-82482fd63ede for instance 93c9c446-931d-406c-beef-3f71283a244b on n-h2-858383-17 Oct 31 15:16:49.306134 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1ff02c3c-3949-48c5-a5ca-5485d4de8ea4 req-c9820e7a-7216-4694-acc4-f5d12459ed7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041019 Oct 31 15:16:49.307348 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 344/720] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.650648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:49.663041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ef28a75-3ec1-41b9-9c76-07914b32dc54 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.411187 Oct 31 15:16:49.674688 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 377/721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:49.767191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.768153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.769359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:49.769489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:49.778446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.784531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.785349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.786124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.786688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.787187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.787799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.788319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.788552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.790752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.792519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.793407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.136302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.143205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.145254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-499bef6c-cb67-4002-83d4-1d133baaaff3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.385189 Oct 31 15:16:50.146084 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 345/722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:50.152582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.153236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.154063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.155515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.157279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-472a2c87-80b2-4ea7-be0b-d1b8bf0ce537 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.393846 Oct 31 15:16:50.158132 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 378/723] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:50.160247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.160772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.161339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.162047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.163545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.163545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.193930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.197343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.207067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.212639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.213702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.214711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.216035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.216859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.217853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.357335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:50.395713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42fc0da7-0523-468a-bc7b-29d02d49bc2d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.247683 Oct 31 15:16:50.397086 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 346/724] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:50.403228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.404041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.410093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.410830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.411606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.412516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.413213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.414055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.582087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.592899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.593624 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-651d227d-f419-4871-af2c-5eaac5654ec5 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.409174 Oct 31 15:16:50.605495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.605495 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a4fb9e4-0da9-43d0-ba65-330358d53ff3 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1288 microversion: 2.1 time: 0.202412 Oct 31 15:16:50.605495 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 347/725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1288 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:50.613672 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 379/726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:50.691926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.692804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.694626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=22 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.701102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.701506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.701940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.702635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.703266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.703692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.177611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.184076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:51.194907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.196608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.197481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.198398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.199030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.199619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.365425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.374959 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e6ec227-8838-4dd5-a75a-55bda8ef5af5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.687168 Oct 31 15:16:51.376181 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 348/727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:51.381921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.383400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:51.400988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.401689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.402205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.403063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.403583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.404081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.771017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.781246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:51.802562 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fde01c45-1674-4ce3-b167-bd2b3ec0e5c3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.633067 Oct 31 15:16:51.818276 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 380/728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:51.834160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.837965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:51.846101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.847080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.848235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.849817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.850499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.852118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.906790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.915477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.922738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.927469 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33a64fb0-2b37-4c12-a963-50abcc447132 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.546870 Oct 31 15:16:51.931959 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 349/729] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:51.936971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.937584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:51.955264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.956187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.956817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.959384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.959862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.961778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.092560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:52.110894 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1c4002f-bb16-4f23-9ffa-1015dba2ebd4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.283657 Oct 31 15:16:52.111492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 381/730] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:52.136364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.137024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:52.142972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.143460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.144368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.144646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.145134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.145562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.318590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.326454 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e524fc11-2bb9-48f2-9bbd-5d8ec9d5a458 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1276 microversion: 2.1 time: 0.200529 Oct 31 15:16:52.327053 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 382/731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:52 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:52.399600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.400908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:52.408279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.409079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.409519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.410252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.410930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.411513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.659728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.672267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e453167-b276-4bed-b916-fb5bb960a4a0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.738893 Oct 31 15:16:52.673540 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 350/732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:52.830562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.831320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:52.839621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.840674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.841530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.842398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.843215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.843949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.037542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.050110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0f77dc9-12c8-45d2-b118-5f1326455122 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1477 microversion: 2.1 time: 0.654079 Oct 31 15:16:53.051323 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 383/733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:52 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1477 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:53.058875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.060555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:53.068930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.071004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.071670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.074314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.075598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.076858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.582548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.593228 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f9658d2-9bbe-41e9-841b-156e7a3ace30 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.766549 Oct 31 15:16:53.595467 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 351/734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:52 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:53.601983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.603315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:53.613433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.614085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.615000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.616609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.617519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.619047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.834675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.835105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:53.856258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.858017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.860338 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2daf6b2b-7d19-4da5-bd9e-391751de3362 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.807139 Oct 31 15:16:53.872178 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb920a25-e178-4d66-a330-444cd2240af7 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.275458 Oct 31 15:16:53.873487 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 352/735] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:53.879428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.880726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:53.883794 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 384/736] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:53.888644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.888886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3b7cc673-270e-4db1-9c4b-5c1c868170ca req-2d2ca8af-a661-41a5-8aba-e365722d94b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "name": "network-vif-plugged", "status": "completed", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:53.889509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.890080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.890891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.891456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.892587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.902705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b7cc673-270e-4db1-9c4b-5c1c868170ca req-2d2ca8af-a661-41a5-8aba-e365722d94b6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.903903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b7cc673-270e-4db1-9c4b-5c1c868170ca req-2d2ca8af-a661-41a5-8aba-e365722d94b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.904341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b7cc673-270e-4db1-9c4b-5c1c868170ca req-2d2ca8af-a661-41a5-8aba-e365722d94b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.927866 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3b7cc673-270e-4db1-9c4b-5c1c868170ca req-2d2ca8af-a661-41a5-8aba-e365722d94b6 service nova] Creating event network-vif-plugged:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:16:53.935931 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3b7cc673-270e-4db1-9c4b-5c1c868170ca req-2d2ca8af-a661-41a5-8aba-e365722d94b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050541 Oct 31 15:16:53.937059 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 385/737] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:53.965887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.967943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:53.975497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.976121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.977551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.978283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.978920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.979358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.649190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:54.658956 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-366f7d2e-8d83-4fe8-a0cd-cbfeafc1e9a0 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.784059 Oct 31 15:16:54.660581 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 353/738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:54.678693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:54.679314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:54.686174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.686689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.687124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.687973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.688436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.688892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.798423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:54.807905 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44d2cb4e-490b-4aea-8f8b-233a0afced35 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.868491 Oct 31 15:16:54.808399 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 386/739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:54.813303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a9fdaecc-a9c6-4673-80d7-2d1a0a3dc742 req-d997e4e2-330d-461f-b91d-ac36dfb192df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52000d3-30d6-4c22-8751-b1623197edab", "tag": "0810769b-07b9-4f0e-8058-ccb8b44d5d89"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:54.825057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9fdaecc-a9c6-4673-80d7-2d1a0a3dc742 req-d997e4e2-330d-461f-b91d-ac36dfb192df service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.825595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9fdaecc-a9c6-4673-80d7-2d1a0a3dc742 req-d997e4e2-330d-461f-b91d-ac36dfb192df service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.826240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9fdaecc-a9c6-4673-80d7-2d1a0a3dc742 req-d997e4e2-330d-461f-b91d-ac36dfb192df service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.842893 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a9fdaecc-a9c6-4673-80d7-2d1a0a3dc742 req-d997e4e2-330d-461f-b91d-ac36dfb192df service nova] Creating event network-changed:0810769b-07b9-4f0e-8058-ccb8b44d5d89 for instance a52000d3-30d6-4c22-8751-b1623197edab on n-h1-858383-17 Oct 31 15:16:54.848896 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a9fdaecc-a9c6-4673-80d7-2d1a0a3dc742 req-d997e4e2-330d-461f-b91d-ac36dfb192df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038926 Oct 31 15:16:54.850060 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 387/740] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:54.857864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:54.859034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:54.867756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.868513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.869524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.870709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.871337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.872223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.311013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:55.330330 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd1263ba-6dc2-4d77-9678-630f6f89777c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1476 microversion: 2.1 time: 0.668540 Oct 31 15:16:55.331637 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 354/741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:54 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:55.347508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:55.348618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:55.356943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.357898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.359191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.360132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.360948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.361531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.754962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:55.764368 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69742299-8306-44ec-82b7-1bce04ba6bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.911827 Oct 31 15:16:55.764987 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 388/742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:54 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:55.769512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:55.770311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:55.776553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.777302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.777904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.778784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:55.779383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:55.779943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:55.955771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:55.978544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1275a1a5-8941-4541-b44c-badfd4770b8b tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.212482 Oct 31 15:16:55.979146 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 389/743] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:55 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:55.993127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "name": "network-vif-unplugged", "status": "completed", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:56.005334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.005978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.006727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.021899 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] Creating event network-vif-unplugged:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h1-858383-17 Oct 31 15:16:56.031376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] Instance 96718579-8de0-4966-8f19-05cc9cc4da10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:16:56.045193 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-614fa005-c2c2-4fc5-ab7e-1a4b533b5c8f req-1570b94d-8b53-4595-b9ff-cbe37e6f161e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057654 Oct 31 15:16:56.045835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 390/744] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:56.051286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:56.052244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:56.059462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.059952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.060380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.061339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.061959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.062390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.307935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:56.316085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:56.318197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:56.319384 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-644d9a49-70c5-4b03-a15d-515badc367a6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1568 microversion: 2.25 time: 0.984607 Oct 31 15:16:56.319967 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 355/745] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:55 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1568 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:56.332898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:56.332898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:56.332898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.332898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.333297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.333975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.334440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.334869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.577223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:56.585342 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74c15f72-bb3d-46a8-ae9a-d8ccb038390c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.537919 Oct 31 15:16:56.585902 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 391/746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:56 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:56.590970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee43b08d-f9f4-45c0-bfac-b60dde48261d", "name": "network-vif-plugged", "status": "completed", "tag": "f1a06634-992a-4099-b9cb-3af51ba7ed45"}, {"server_uuid": "93c9c446-931d-406c-beef-3f71283a244b", "name": "network-vif-plugged", "status": "completed", "tag": "927144ed-dd76-45fd-8f86-82482fd63ede"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:56.601181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.601646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.602156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.614566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] Creating event network-vif-plugged:f1a06634-992a-4099-b9cb-3af51ba7ed45 for instance ee43b08d-f9f4-45c0-bfac-b60dde48261d on n-h1-858383-17 Oct 31 15:16:56.615066 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] Creating event network-vif-plugged:927144ed-dd76-45fd-8f86-82482fd63ede for instance 93c9c446-931d-406c-beef-3f71283a244b on n-h2-858383-17 Oct 31 15:16:56.623912 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e1932005-d53f-4545-b8db-f79b943405c7 req-7a47c104-3884-45fd-a523-21d45588e9db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036823 Oct 31 15:16:56.624579 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 392/747] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:56.629805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:56.630490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:56.637253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.637916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.638597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.639959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.640496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.641162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.782604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:56.792127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f488f4e9-ce3c-4af9-ad69-c063590e1601 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.470059 Oct 31 15:16:56.792941 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 356/748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:56 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:56.814942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:56.815876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:56.823441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.823943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.824384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:56.825258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:56.825586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:56.826017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.086804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.094812 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b50b3d36-ec3c-4390-b861-52d5e99f8fcb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1476 microversion: 2.1 time: 0.468920 Oct 31 15:16:57.095399 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 393/749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:56 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:57.099761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.102301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:57.111982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.112685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.113159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.114112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.114322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.114763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.150952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.163724 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-edf57172-8feb-4549-9b3d-0520bf492b52 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.352709 Oct 31 15:16:57.165891 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 357/750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:56 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:57.226848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:57.250803 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b18d4f66-964c-4cc2-9553-c4dab64dfa7d tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.153968 Oct 31 15:16:57.252627 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 394/751] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:57.311852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f48bdc73-cb93-4081-870e-ba18c6736e9f req-d0434c52-d5b8-4f3a-89ed-4a3f5154b570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee1a094-22bc-4438-8411-f0e582aaa1f2", "tag": "9e521ffb-e253-4c7a-addf-b43a007d28ee"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:57.339181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f48bdc73-cb93-4081-870e-ba18c6736e9f req-d0434c52-d5b8-4f3a-89ed-4a3f5154b570 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.341484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f48bdc73-cb93-4081-870e-ba18c6736e9f req-d0434c52-d5b8-4f3a-89ed-4a3f5154b570 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.342649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f48bdc73-cb93-4081-870e-ba18c6736e9f req-d0434c52-d5b8-4f3a-89ed-4a3f5154b570 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.347436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.348324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:57.358288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.359209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f48bdc73-cb93-4081-870e-ba18c6736e9f req-d0434c52-d5b8-4f3a-89ed-4a3f5154b570 service nova] Creating event network-changed:9e521ffb-e253-4c7a-addf-b43a007d28ee for instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 on n-h2-858383-17 Oct 31 15:16:57.364762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.365224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.366273 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f48bdc73-cb93-4081-870e-ba18c6736e9f req-d0434c52-d5b8-4f3a-89ed-4a3f5154b570 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058453 Oct 31 15:16:57.366389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.367318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.367758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.369227 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 358/752] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:57.544567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.554044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.555886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.557371 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee2a07a0-5e28-4e1b-9e4b-61238a3594aa tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1543 microversion: 2.25 time: 0.213863 Oct 31 15:16:57.558020 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 395/753] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:57.582234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e65f2fb-c300-472b-91da-aea51e954a02 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '.version_select at 0x7f5ca2c97550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.586259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65f2fb-c300-472b-91da-aea51e954a02 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.586789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65f2fb-c300-472b-91da-aea51e954a02 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.587230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65f2fb-c300-472b-91da-aea51e954a02 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.608414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.609060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:57.611690 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e65f2fb-c300-472b-91da-aea51e954a02 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1541 microversion: 2.25 time: 0.025095 Oct 31 15:16:57.614893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.615763 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 359/754] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/os-migrations => generated 1541 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:57.621466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.622099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.623432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.624945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.625868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.630758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.631575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:57.638860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.639576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.640012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.640743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.641357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.641939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.848517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.867310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e1aa840-30c5-4f08-8fa8-554649f99163 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.261934 Oct 31 15:16:57.871292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:57.891961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 396/755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:57.904838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.905464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:57.919667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ed665d60-b25f-4eda-968c-cefbdda8a8f3 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 2038 microversion: 2.25 time: 0.292205 Oct 31 15:16:57.921167 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 360/756] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 2038 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:57.921832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.922332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.922778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.923490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.923948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.924369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.955612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a553009d-69aa-421e-a363-b392a5f674d5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Action: 'create', calling method: .version_select at 0x7f5ca2acc280>, body: {"keypair": {"name": "tempest-keypair-464716875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVwfb8b/FGi8CLFJvLt2wlQXUr20B9vYaJP5FPWcNk1k9pXvWfYKT9gCYLKbPzX2fNea7h2TplwoyF4XwYlrSHvejsUOKk+xmay0IcGPROiTpcEGiyR0yntZwV4Lqs9XA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:57.975496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a553009d-69aa-421e-a363-b392a5f674d5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for project d09369d806ba4afe911914e3272a59e4. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:57.981617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a553009d-69aa-421e-a363-b392a5f674d5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for user 8c9c59f229134e1ab069e18a116ebdf2 and project d09369d806ba4afe911914e3272a59e4. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:58.008219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a553009d-69aa-421e-a363-b392a5f674d5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.055773 Oct 31 15:16:58.017256 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 361/757] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:16:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:16:58.120977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:58.121612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:58.138657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.139174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.140274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.142267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.144343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.144849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.177175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:58.200224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=40 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:58.716440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:58.733102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-826d3a0f-7003-4469-92f3-dbd988a3e448 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.838398 Oct 31 15:16:58.734295 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 397/758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:58.748085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:58.767567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.768051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.768478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.786428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:58.793744 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] Creating event network-changed:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h1-858383-17 Oct 31 15:16:58.798397 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b5abfd1-7398-48d4-9a60-44261f3b67d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1476 microversion: 2.1 time: 0.682728 Oct 31 15:16:58.814461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 362/759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:58 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1476 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:58.814461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:58.814461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:58.823902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] Instance 96718579-8de0-4966-8f19-05cc9cc4da10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:16:58.837265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.838018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.838621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.840971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.843020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.849058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.860531 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3419830d-3ffd-4dcf-aa70-0a5981a1082c req-cbf1cc1f-2947-46a1-a29d-eea3a66286e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121899 Oct 31 15:16:58.861638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 398/760] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:58.874797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:58.907596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:58.923206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.923969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.924875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.925959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:58.926571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:58.927147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:58.982544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:59.108941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:59.141678 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3032155a-6054-42d2-a46b-c7e78df165a3 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.278891 Oct 31 15:16:59.145881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 399/761] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:16:58 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:59.170312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:59.172032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:59.196581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.197242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.197644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:59.203102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.203591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.204135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:59.238323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:59.248463 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a1b29bb9-521f-4b2f-952c-7e07d7c2a79d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.446728 Oct 31 15:16:59.254119 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 363/762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:58 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:59.449973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-387bbb3e-390c-4d8a-83da-98a55a164065 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Action: 'create', calling method: .version_select at 0x7f5ca2c974c0>, body: {"keypair": {"name": "tempest-keypair-472865569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOiZXapyzA6nnftH6jbQAndfSYNLcQLVT7zek+hxxU6bGNWHupUYH10knA/P4bQcLF633mS3VB0hKe9MPp8JjvMzz+xk1BDd1uOMs+X3j3fuX6mSsX+i5q9SljRhuf0YQ=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:59.469118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-387bbb3e-390c-4d8a-83da-98a55a164065 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Getting quotas for project 0d2e676a7b344a9fbb96b88fbb4fd69b. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:59.473548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-387bbb3e-390c-4d8a-83da-98a55a164065 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Getting quotas for user 849ee26672704efe849789e080eb9038 and project 0d2e676a7b344a9fbb96b88fbb4fd69b. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:59.499980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-387bbb3e-390c-4d8a-83da-98a55a164065 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.244685 Oct 31 15:16:59.501358 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 364/763] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:16:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:59.768246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:59.769780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:59.787625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.790945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.792719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:59.794510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.795142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.795790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:59.853434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:59.865012 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99a6d01f-b8f5-42e0-b9f2-6beaba48294b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.717206 Oct 31 15:16:59.865987 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 400/764] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:59 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:59.892779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:59.894967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:59.908751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.909733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.910410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:59.911350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.912324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.912954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:00.468355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:00.480400 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84999442-8108-432e-9ff6-d7ba8b568778 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.721942 Oct 31 15:17:00.494425 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 365/765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:59 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:00.504833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:00.506288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:00.508617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:00.515248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:00.516054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:00.516664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:00.517831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:00.518572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:00.519710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:00.525898 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf9f7add-068c-4a00-9af2-69ee445afd23 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1476 microversion: 2.1 time: 0.651178 Oct 31 15:17:00.527381 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 401/766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:59 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1476 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:00.540572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:00.542824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:00.568464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:00.575390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:00.577977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:00.579171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:00.580176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:00.581054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:00.756480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:00.762082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:00.782598 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7b30947-8ee6-4c88-8081-36cc8d6e5851 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.286979 Oct 31 15:17:00.784142 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 366/767] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:00 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:00.870577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:00.881679 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55c335fc-4137-452c-ac83-7c24c8c957b3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.351412 Oct 31 15:17:00.882329 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 402/768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:00 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:00.890535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:00.893717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:00.904355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:00.905185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:00.905776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:00.906651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:00.907204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:00.907871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:01.511217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:01.514192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:01.527326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:01.544421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:01.546356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:01.548728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:01.551005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:01.551742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:01.553915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:01.811127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:01.823176 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-217ef7b4-e0cf-4659-b4b6-f4d44f0ff52c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.936571 Oct 31 15:17:01.823803 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 367/769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:00 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:01.838014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:01.838014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:01.852331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:01.852861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:01.853300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:01.857121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:01.857640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:01.858078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.099206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:02.114290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ffcc8a8-2572-480f-9d93-ffbc2149bed0 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.610212 Oct 31 15:17:02.129320 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 403/770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:01 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:02.144122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:02.144809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:02.153263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.154002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:02.154624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.155510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.156141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:02.156794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.184611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:02.195048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13d837fc-b694-4445-9fb4-02ccf5569e26 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1474 microversion: 2.1 time: 0.369860 Oct 31 15:17:02.196642 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 368/771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:01 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:02.203395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:02.204283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:02.212635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.213848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:02.214406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.215491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.216142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:02.216578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.256267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:02.279036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71b83d42-ea3a-4b65-a74c-f3fa7d0d4546 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.146832 Oct 31 15:17:02.293828 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 404/772] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:02 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:02.307047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1813076279", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "635e1e0a-6ae3-43b6-936a-df7141d79dfa"}], "security_groups": [{"name": "tempest-securitygroup--552984805"}], "key_name": "tempest-keypair-464716875", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:02.388308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:02.402625 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cda54a3e-0b21-4414-ae4d-43b2b4cfc671 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.203658 Oct 31 15:17:02.403457 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 369/773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:02 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:02.463216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] validate_networks() for [('635e1e0a-6ae3-43b6-936a-df7141d79dfa', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:02.849323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:02.849903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:02.862353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.863656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:02.864287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.865707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.868991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:02.872943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:02.979975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:02.980459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:02.980886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:02.981453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:02.981861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:02.999097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:02.999836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.001448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.002453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.003475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.004602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.028586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:03.033184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for user 8c9c59f229134e1ab069e18a116ebdf2 and project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:03.059511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:03.061906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:03.077605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.090869 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1afff16-7b3c-4933-9240-dfc24b9714d8 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.245674 Oct 31 15:17:03.092807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 370/774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:02 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:03.114124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d48bf57e-2b4a-4f65-8ac8-f7864ee92003 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.818891 Oct 31 15:17:03.114765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 405/775] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:17:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:17:03.131824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c675181a-1360-4844-ba61-5d082ca46c6c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.135816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c675181a-1360-4844-ba61-5d082ca46c6c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:03.139343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.140885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:03.152682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.153708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.155619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.162242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.165666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.173797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.201577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c675181a-1360-4844-ba61-5d082ca46c6c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.213776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c675181a-1360-4844-ba61-5d082ca46c6c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.216120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c675181a-1360-4844-ba61-5d082ca46c6c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.217792 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c675181a-1360-4844-ba61-5d082ca46c6c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1285 microversion: 2.25 time: 0.095160 Oct 31 15:17:03.218832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 371/776] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:17:03.224582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.225698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:03.231679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:03.233896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.234750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.235448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.236435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.237162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.237881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.561748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.573389 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a705d3f6-67e7-40c8-bc81-dfaebc0a5014 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.437730 Oct 31 15:17:03.579579 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 406/777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:03.585997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.586622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:03.593489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.594256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.594906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.595840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.596519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.597273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.608454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.622467 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01464510-c906-4813-b8dc-7c185384e572 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1474 microversion: 2.1 time: 0.401445 Oct 31 15:17:03.623747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 372/778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:03.632217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.633314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:03.648103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.649085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.650088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.651037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.651951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.652576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.745283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:03.800146 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b385ddd-132f-4b90-aeca-e82ae189bdf5 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.217781 Oct 31 15:17:03.809629 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 407/779] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:03.859311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:03.870221 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8516dc2c-8cdb-4912-b40c-7357c5dfcd11 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.245055 Oct 31 15:17:03.874405 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 373/780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:04.117429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.118442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:04.125605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.126216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.126859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.127779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.128545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.129073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.249003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.249806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:04.261502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.269468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.270057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.270892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.271437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.271860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.314994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:04.324623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65957d89-c491-4320-ab3a-038b3a23001c tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.212854 Oct 31 15:17:04.325639 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 408/781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:04.359385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:04.369021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:04.370661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:04.372051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-075955e2-8968-435b-bd4c-7a734a5d7dd7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1337 microversion: 2.25 time: 0.128584 Oct 31 15:17:04.373132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 374/782] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1337 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:04.605221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.605848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:04.613923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.614564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.615008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.615711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.616164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.616621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.651546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.652521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:04.659911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.662423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.663866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.665069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.665731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.666555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.973135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:05.001288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14c8423d-e348-4eaa-843f-54ec16f65ed4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1313 microversion: 2.1 time: 0.401350 Oct 31 15:17:05.002828 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 409/783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:05.030478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:05.032512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:05.044810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:05.047496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5cb6385a-5e07-4f8f-9ce7-7ce141d6a6b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1474 microversion: 2.1 time: 0.398176 Oct 31 15:17:05.048775 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 375/784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1474 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:05.064069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.065954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.066960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.070485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.078551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:05.080987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:05.091494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.092043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.095995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.098847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.100115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.103058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.104867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.106242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.354715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:05.387451 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eaf52e91-2ba9-4045-8a16-59174cc5b616 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.383354 Oct 31 15:17:05.394577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 410/785] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:05 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:05.403807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-515d5bed-d2b7-451d-aa17-23111cf767fc req-7788d4be-0916-47b5-b7e9-21494a4915db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52000d3-30d6-4c22-8751-b1623197edab", "name": "network-vif-plugged", "status": "completed", "tag": "0810769b-07b9-4f0e-8058-ccb8b44d5d89"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:05.450279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-515d5bed-d2b7-451d-aa17-23111cf767fc req-7788d4be-0916-47b5-b7e9-21494a4915db service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.450855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-515d5bed-d2b7-451d-aa17-23111cf767fc req-7788d4be-0916-47b5-b7e9-21494a4915db service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.451295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-515d5bed-d2b7-451d-aa17-23111cf767fc req-7788d4be-0916-47b5-b7e9-21494a4915db service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.470978 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-515d5bed-d2b7-451d-aa17-23111cf767fc req-7788d4be-0916-47b5-b7e9-21494a4915db service nova] Creating event network-vif-plugged:0810769b-07b9-4f0e-8058-ccb8b44d5d89 for instance a52000d3-30d6-4c22-8751-b1623197edab on n-h1-858383-17 Oct 31 15:17:05.484287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-515d5bed-d2b7-451d-aa17-23111cf767fc req-7788d4be-0916-47b5-b7e9-21494a4915db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086558 Oct 31 15:17:05.486617 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 411/786] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:05.519099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:05.520134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:05.528224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.529053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.529734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.530656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.531312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.531933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.553201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:05.575289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73760bec-2087-4223-bbac-1f4b7901d8b2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.511796 Oct 31 15:17:05.576261 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 376/787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:05 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:05.591419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:05.592072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:05.598676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.599092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.599527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.600231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:05.600955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:05.601269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:05.757390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:05.769293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:05.772976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:05.775204 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-608a4374-75c7-4239-ac32-d1092bf1eaf8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1343 microversion: 2.25 time: 0.197840 Oct 31 15:17:05.777822 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 377/788] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:05 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:06.026667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:06.027270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:06.033458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.034180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.034788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.035490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.036111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.036539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.115087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:06.126144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5c34826-6100-48c2-8729-3d945c5511e5 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.635944 Oct 31 15:17:06.126825 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 412/789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:05 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:06.131605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:06.132951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:06.140148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.140635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.141422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.142757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.143501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.144141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.820726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:06.825125 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1a84f64-3abb-4f0e-ad44-ae3701956e9f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1463 microversion: 2.1 time: 0.802871 Oct 31 15:17:06.825884 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 378/790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:06 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1463 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:06.834822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:06.835927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:06.840506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:06.844472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.846401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.846848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.847566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.848028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.848629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.866003 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f163b4b0-8fb7-4842-b964-de9177e2449b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1471 microversion: 2.1 time: 0.737906 Oct 31 15:17:06.867165 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 413/791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:06 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1471 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:06.885559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:06.885559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:06.885559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.885559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.887744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.890111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:06.890688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:06.891499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:06.976579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:07.001235 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ca78c31-1480-416f-b60c-e6e4c43e265e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.171992 Oct 31 15:17:07.014056 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 379/792] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:06 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:07.023454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:07.024083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:07.030482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.030982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.031427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.032136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.032599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.033087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.146922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:07.156679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:07.158452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:07.159827 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cea0fe86-d38b-47a7-a6cd-94cb8181f643 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1343 microversion: 2.25 time: 0.144250 Oct 31 15:17:07.160989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 380/793] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:07 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1343 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:07.187270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:07.188343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:07.192744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:07.196983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.200441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.201132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.202779 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb7e4df2-20fa-4f53-bcdd-724d546fd53c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1319 microversion: 2.1 time: 0.334547 Oct 31 15:17:07.203378 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 414/794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:06 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:07.203513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.209353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:07.209793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.210772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.213307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:07.221010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.221585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.222103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.222884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.224154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.227315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.290579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:07.335674 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-949dde8d-b115-424f-929c-514efec5ee98 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10/action" status: 204 len: 0 microversion: 2.1 time: 0.129236 Oct 31 15:17:07.336794 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 415/795] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:07 2022] POST /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10/action => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:07.344659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:07.345416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:07.353372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.354014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.354462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.355173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.355638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.356651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.608311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:07.623720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-31c0021b-74d9-42db-aaf7-606f18adfabd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1463 microversion: 2.1 time: 0.444615 Oct 31 15:17:07.640331 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 381/796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:07 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1463 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:07.645177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:07.649719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:07.660979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.661591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.662131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.663766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:07.664356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:07.668737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:07.955296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:07.978922 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-437ffa1d-a117-49da-85cd-e2c1c2a6af06 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.640793 Oct 31 15:17:08.000606 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 416/797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:07 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:08.012970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c2c4f3df-6dcd-4ef2-a8f9-c35a4300f7de req-72e8fb63-a000-45ac-83ba-533cb38faeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee1a094-22bc-4438-8411-f0e582aaa1f2", "name": "network-vif-plugged", "status": "completed", "tag": "9e521ffb-e253-4c7a-addf-b43a007d28ee"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:08.031911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c2c4f3df-6dcd-4ef2-a8f9-c35a4300f7de req-72e8fb63-a000-45ac-83ba-533cb38faeb3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.032391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c2c4f3df-6dcd-4ef2-a8f9-c35a4300f7de req-72e8fb63-a000-45ac-83ba-533cb38faeb3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.034480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c2c4f3df-6dcd-4ef2-a8f9-c35a4300f7de req-72e8fb63-a000-45ac-83ba-533cb38faeb3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.059175 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c2c4f3df-6dcd-4ef2-a8f9-c35a4300f7de req-72e8fb63-a000-45ac-83ba-533cb38faeb3 service nova] Creating event network-vif-plugged:9e521ffb-e253-4c7a-addf-b43a007d28ee for instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 on n-h2-858383-17 Oct 31 15:17:08.075130 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c2c4f3df-6dcd-4ef2-a8f9-c35a4300f7de req-72e8fb63-a000-45ac-83ba-533cb38faeb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072876 Oct 31 15:17:08.075745 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 417/798] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:08.083299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1999018440", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e0f76ff1-0ab5-4867-bd70-298e5c669e14"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:08.178423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:08.180754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.194472 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bfc5ea0-efb8-45e4-90c8-6455645cb296 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1471 microversion: 2.1 time: 0.557188 Oct 31 15:17:08.195989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 382/799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:07 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1471 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:08.203073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:08.204254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:08.212180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.212956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.214073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.215224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.216014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.217124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.350365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:08.354803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:08.371689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c98a34bf-807e-4fcd-830a-809686a50d75 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.174468 Oct 31 15:17:08.372423 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 383/800] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:08 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:08.378916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:08.378916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:08.387007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.387573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.388151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.392751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.392751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.392751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.761429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.770608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.772229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.773522 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4cd240f-3bfe-4d52-b480-dc4a6e453d53 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.400084 Oct 31 15:17:08.774336 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 384/801] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:08 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:08.778696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:08.779314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:08.787083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.787708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.788648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.789953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.789953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.790339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.830110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:08.830662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:08.831138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:08.831546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:08.831953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:08.841990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.842479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.842909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.843868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.844328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.844775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.863683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Getting quotas for project a8467f5801594eba9c27b4eb124c8325. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:08.867747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Getting quotas for user 319cd9ded5c2410392868fb3cb039342 and project a8467f5801594eba9c27b4eb124c8325. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:08.879249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:08.882515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:08.929927 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93f36258-2220-4fe6-8649-9b293c15b43d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851101 Oct 31 15:17:08.931762 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 418/802] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:08.946400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ee9eefe-fa51-4502-b4a7-94c63195c8fc tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:08.947402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ee9eefe-fa51-4502-b4a7-94c63195c8fc tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:09.033943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ee9eefe-fa51-4502-b4a7-94c63195c8fc tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:09.042509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:09.044729 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ee9eefe-fa51-4502-b4a7-94c63195c8fc tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1214 microversion: 2.1 time: 0.105067 Oct 31 15:17:09.046665 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 419/803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:08 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:09.050262 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9db3e556-2927-418c-8e66-e39102c0e521 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1469 microversion: 2.1 time: 0.275182 Oct 31 15:17:09.052979 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 385/804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:08 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:09.072600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:09.073485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:09.074005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:09.074823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:09.087243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.088024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.088170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.088626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.089518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.090621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.090923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.091774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.092360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.093100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.093945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.095159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.516207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:09.544571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95807fde-cdf8-44d4-a2b6-aff916638f4b tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1318 microversion: 2.1 time: 0.496483 Oct 31 15:17:09.560777 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 420/805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:09 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:09.561139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:09.561612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:09.561612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:09.567656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81ac7e8e-6b64-45b8-afbb-1c1b25fd0416 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1469 microversion: 2.1 time: 0.498884 Oct 31 15:17:09.576731 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 386/806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:09 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1469 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:09.589072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:09.589072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:09.589387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.589387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.589387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.589387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.590884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.591714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.593320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.593953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.594258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.594971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.595432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.595860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.834122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:09.871317 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0032dde0-4d8d-4d88-8efb-4e8836d370d2 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.294316 Oct 31 15:17:09.872977 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 387/807] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:09 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:09.878152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-255c694e-1396-406e-a3f2-f711937b0023 req-67f4dae2-a43f-4219-8dc4-6bef113745d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86ca09a-927f-4b27-89b2-db9834d10c3c", "tag": "d47e8eda-2de0-4bec-8ab5-ac3c4682b94c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:09.897543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-255c694e-1396-406e-a3f2-f711937b0023 req-67f4dae2-a43f-4219-8dc4-6bef113745d2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.898133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-255c694e-1396-406e-a3f2-f711937b0023 req-67f4dae2-a43f-4219-8dc4-6bef113745d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.898581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-255c694e-1396-406e-a3f2-f711937b0023 req-67f4dae2-a43f-4219-8dc4-6bef113745d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.912727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-255c694e-1396-406e-a3f2-f711937b0023 req-67f4dae2-a43f-4219-8dc4-6bef113745d2 service nova] Creating event network-changed:d47e8eda-2de0-4bec-8ab5-ac3c4682b94c for instance e86ca09a-927f-4b27-89b2-db9834d10c3c on n-h2-858383-17 Oct 31 15:17:09.917446 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-255c694e-1396-406e-a3f2-f711937b0023 req-67f4dae2-a43f-4219-8dc4-6bef113745d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043215 Oct 31 15:17:09.918647 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 388/808] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:09.924289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:09.937997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:09.938918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Searching by: {'reservation_id': 'r-mn8jfhcq', 'deleted': False, 'project_id': '4366c148cab043bc8a653080ba52e8c6'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:09.950469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.950956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.952406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:09.953240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:09.953716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:09.954291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.011871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:10.023296 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95536c9a-e04c-499e-b2d2-a414dc61abbe tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1471 microversion: 2.1 time: 0.472236 Oct 31 15:17:10.024226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 421/809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:09 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:10.040450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:10.041181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:10.049209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.050256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.051171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.052270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.053074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.054364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.075463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:17:10.185509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:10.197678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.198584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.199192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.603130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:10.611210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:10.612625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:10.613751 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-73b7a10b-46a2-47fe-95d5-641d4a8d98e7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.588492 Oct 31 15:17:10.614304 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 422/810] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:10 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:10.617750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ec78739c-e607-4453-98d2-c416a66a51cb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-mn8jfhcq" status: 200 len: 2931 microversion: 2.1 time: 0.698507 Oct 31 15:17:10.618353 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 389/811] 10.222.0.48 () {58 vars in 1197 bytes} [Mon Oct 31 15:17:09 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mn8jfhcq => generated 2931 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:10.632941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "name": "network-vif-plugged", "status": "completed", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:10.643395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:10.644256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:10.650950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.651443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.651874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.652942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.653398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.654333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.665320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.665917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.666375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.689715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] Creating event network-vif-plugged:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h1-858383-17 Oct 31 15:17:10.704903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] Instance 96718579-8de0-4966-8f19-05cc9cc4da10 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:17:10.720629 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-84ee2da4-b0cf-4ae8-a1c7-3a98fc01712a req-9597a563-57a4-4d90-8b69-cc93e99f4a10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100764 Oct 31 15:17:10.721279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 390/812] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:10.729771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:10.730489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:10.737063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.737694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.738235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.739455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.740004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.740808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.784929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:10.797961 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d43178a-728c-49a6-9e56-c2fc1c1be6db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1266 microversion: 2.1 time: 0.182098 Oct 31 15:17:10.799189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 423/813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:10 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:10.817645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e33fcf2c-c51f-48ce-aafc-3ac32fc55f40 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:10.851312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_groups [None req-e33fcf2c-c51f-48ce-aafc-3ac32fc55f40 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Querying cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) for 2 instances {{(pid=120625) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:17:10.853160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e33fcf2c-c51f-48ce-aafc-3ac32fc55f40 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.856723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e33fcf2c-c51f-48ce-aafc-3ac32fc55f40 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.856723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e33fcf2c-c51f-48ce-aafc-3ac32fc55f40 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.917120 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e33fcf2c-c51f-48ce-aafc-3ac32fc55f40 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/5365e837-d31b-41cc-ac46-c840c3c58481" status: 200 len: 271 microversion: 2.1 time: 0.116535 Oct 31 15:17:10.919019 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 424/814] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:17:10 2022] GET /compute/v2.1/os-server-groups/5365e837-d31b-41cc-ac46-c840c3c58481 => generated 271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:10.924001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:10.925740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:10.933428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.933932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.934442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.935156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.936130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.936507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.067803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:11.085885 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ce02337-5d92-4349-8f01-9877bddd4daa tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.165708 Oct 31 15:17:11.093437 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 425/815] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:10 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:11.098672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.099328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.108752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.109256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.111908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.111908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.111908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.112271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.126431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.136310 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a91e8ba3-9480-4b47-b04d-89911e37bfee tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1468 microversion: 2.1 time: 0.410885 Oct 31 15:17:11.137362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 391/816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:10 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1468 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:11.143832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.144725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.152240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.153060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.153501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.154205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.154913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.155342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.488155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-04c5d4e6-695c-458a-9002-dab7cd4b7e31 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1622 microversion: 2.1 time: 0.393276 Oct 31 15:17:11.489207 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 426/817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1622 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:11.491428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.494786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:11.495317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.500107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea7d9eef-de27-42a0-9cfc-ce9b7ca8806e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1471 microversion: 2.1 time: 0.361542 Oct 31 15:17:11.500912 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 392/818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:11.501629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.502116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.502550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.503245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.503723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.504142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.535014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lazy-loading 'flavor' on Instance uuid 3ee1a094-22bc-4438-8411-f0e582aaa1f2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:11.536531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.538185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.551856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.554424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.555644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.559005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.559576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.560796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.627662 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7614842-2a65-41b8-bd9a-91fd70e27cb3 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.136368 Oct 31 15:17:11.628359 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 427/819] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:11 2022] POST /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:11.640050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.641503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.649987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.650828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.651092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.651803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.652270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.652723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.837155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ed71427-865d-4918-bf7a-72a2bd3abc8a tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 200 len: 1622 microversion: 2.1 time: 0.304883 Oct 31 15:17:11.853383 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 393/820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 1622 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:11.853383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.853383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.853383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.853855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.853855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.853855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.853855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.854182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.888142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.895701 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-583feecb-b574-42d5-ac91-b8fd0e5c4e70 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1476 microversion: 2.1 time: 0.260330 Oct 31 15:17:11.896501 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 428/821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:11.916921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.917534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.927734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.927734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.931733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.932525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.933017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.933439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.028009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.035983 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-389909d3-8bcb-4c80-8d7c-2e4e5f68d131 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1272 microversion: 2.1 time: 0.123661 Oct 31 15:17:12.036552 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 429/822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:12.041740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-703359399", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:12.097766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:12.138472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.149331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.151118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.152336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a993f39b-6397-4039-a8ce-d0816090c631 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.313366 Oct 31 15:17:12.153187 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 394/823] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:12.158090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.158950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.184521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.185767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.186733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.188124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.189155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.189800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.381193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:12.405436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e81024c-9998-46e8-bb8c-d859c1b09a43 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.250970 Oct 31 15:17:12.406649 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 395/824] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:12.493984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:12.494793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:12.495496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:12.496119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:12.496794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:12.510279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.510844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.511370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.512172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.513008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.513506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.530215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:12.537299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:12.541784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.542505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:12.542955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.555810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.556221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.556459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:12.556653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.557403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.559226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:12.561797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.563280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.621883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7ef75f1-e9fd-41ed-9b39-8fb904b39880 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584172 Oct 31 15:17:12.622892 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 430/825] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:12.639918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52e6e8ae-8619-4cea-8b7d-b8a82d12f487 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.640584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52e6e8ae-8619-4cea-8b7d-b8a82d12f487 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.784509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52e6e8ae-8619-4cea-8b7d-b8a82d12f487 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.797217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52e6e8ae-8619-4cea-8b7d-b8a82d12f487 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1216 microversion: 2.1 time: 0.166725 Oct 31 15:17:12.799067 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 431/826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:12.891200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.903786 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8cfb2f3-6e16-4d65-8d23-f4209cb3ee62 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1471 microversion: 2.1 time: 0.367231 Oct 31 15:17:12.906038 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 396/827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:12.930941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.931625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.939896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.940991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.941592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.943233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.944053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.945131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.065674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:13.070096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:13.097294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.098210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.099478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.101566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.102261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.102905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.665725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:13.674598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a6270e8-69f1-4cae-aa99-0f8144e3ee15 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1476 microversion: 2.1 time: 0.752424 Oct 31 15:17:13.676215 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 432/828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1476 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:13.682105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:13.682710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:13.689041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.689763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.690401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.691302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.691935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.692528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.844161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:13.853017 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69bceb01-da48-4301-81a2-94a80008977b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.795139 Oct 31 15:17:13.869333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 397/829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:13 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:13.874544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:13.880510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:13.888596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.889589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.890014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.890733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.891198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.891622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.075819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:14.094889 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-34f8cb77-561f-4bb1-9316-7c073648442e tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.223981 Oct 31 15:17:14.095757 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 398/830] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:13 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:14.101711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:14.102501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.108532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.109229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.109823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.110680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.111294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.111874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.169787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.173286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:14.185522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.189914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.191892 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-807a0b73-0a27-46dd-8fde-3fb12048ac48 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.514226 Oct 31 15:17:14.192658 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 433/831] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:13 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:14.203407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:14.204033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.221108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.221426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.222076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.223250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.224294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.224925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.226139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.226887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:14.235289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92528cb1-9c26-43ed-a774-551d906b28bb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1268 microversion: 2.1 time: 0.138312 Oct 31 15:17:14.235883 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 399/832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:14 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1268 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:14.700356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.701940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:14.702818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.712617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.717739 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83ebb6cf-8c99-4922-8601-dd2285b6854e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1463 microversion: 2.1 time: 0.521250 Oct 31 15:17:14.719193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.719336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 434/833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:14 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1463 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:14.720307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.722324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.723745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.726099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.744612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:14.746955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.759188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.759996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.761144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.762138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.763023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.800791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.338011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.366852 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d92683dc-cd07-4742-8f9c-1b8ea8422994 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1459 microversion: 2.1 time: 0.668933 Oct 31 15:17:15.368756 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 400/834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:14 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1459 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:15.378871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4ae3eac4-b5a1-4aed-bf26-2257a9e5b31a req-8a257233-ff13-4912-a3b2-6d6760da832d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5", "tag": "0e86172e-2093-44ee-9850-5faa0eb12535"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:15.410592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4ae3eac4-b5a1-4aed-bf26-2257a9e5b31a req-8a257233-ff13-4912-a3b2-6d6760da832d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.414477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4ae3eac4-b5a1-4aed-bf26-2257a9e5b31a req-8a257233-ff13-4912-a3b2-6d6760da832d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.415324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4ae3eac4-b5a1-4aed-bf26-2257a9e5b31a req-8a257233-ff13-4912-a3b2-6d6760da832d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.456644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4ae3eac4-b5a1-4aed-bf26-2257a9e5b31a req-8a257233-ff13-4912-a3b2-6d6760da832d service nova] Creating event network-changed:0e86172e-2093-44ee-9850-5faa0eb12535 for instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 on n-h2-858383-17 Oct 31 15:17:15.472796 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4ae3eac4-b5a1-4aed-bf26-2257a9e5b31a req-8a257233-ff13-4912-a3b2-6d6760da832d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100607 Oct 31 15:17:15.475825 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 401/835] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:15.489553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.490747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:15.506023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.507554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.509562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.512750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.513467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.514758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.567598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8070df8-a53e-4b8e-b775-fea83e6ab3a9 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1616 microversion: 2.1 time: 0.828222 Oct 31 15:17:15.570310 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 435/836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:14 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1616 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:15.616475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.619610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:15.633648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.634936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.635726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.641437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.642267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.643428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.845381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:15.889845 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-427bcb90-aa72-4ba5-9181-d429fea1f818 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1931 microversion: 2.75 time: 0.315913 Oct 31 15:17:15.890766 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 436/837] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1931 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:15.900868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.905606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:15.929601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.930115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.930562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.931487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.932279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.933774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.064043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.074046 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fc0cd65-9d56-4c1a-b557-0805e5996f32 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.596758 Oct 31 15:17:16.081028 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 402/838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.108750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.109620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:16.118801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.120885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.125299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.126248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.126879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.127466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.304214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.321459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.323154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.324646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34b5c95d-d773-4a23-aba0-3bafb52972cc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.432638 Oct 31 15:17:16.337572 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 437/839] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:16.356460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.357110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:16.364026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.364521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.364979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.365714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.366175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.366592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.416240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.425185 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-363129e3-551b-414b-b0a8-16e699f4cc26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.342787 Oct 31 15:17:16.441836 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 403/840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.450669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa6e321a-7460-4160-abe8-d99d804bbd7d tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '.version_select at 0x7f5ca2c08040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.454639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6e321a-7460-4160-abe8-d99d804bbd7d tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.455263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6e321a-7460-4160-abe8-d99d804bbd7d tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.455817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6e321a-7460-4160-abe8-d99d804bbd7d tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.465997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa6e321a-7460-4160-abe8-d99d804bbd7d tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.022908 Oct 31 15:17:16.480823 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 404/841] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.658252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-31958003", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:16.780868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:16.792939 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97e8677b-9ccd-4a6a-a1f3-26ae0bbb6eba tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1612 microversion: 2.1 time: 0.453969 Oct 31 15:17:16.797611 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 438/842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1612 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.813606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-54e55e69-2a46-4fdc-ae8b-cf4f89fb42c6 req-4e364436-870c-4108-b8d9-2ea7b40259e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62a28f2-d478-4b10-bc35-f88f048ad1ee", "tag": "31606774-a4a6-43cb-843b-2abb9b050e72"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:16.833888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-54e55e69-2a46-4fdc-ae8b-cf4f89fb42c6 req-4e364436-870c-4108-b8d9-2ea7b40259e0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.834908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-54e55e69-2a46-4fdc-ae8b-cf4f89fb42c6 req-4e364436-870c-4108-b8d9-2ea7b40259e0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.838589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-54e55e69-2a46-4fdc-ae8b-cf4f89fb42c6 req-4e364436-870c-4108-b8d9-2ea7b40259e0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.861109 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-54e55e69-2a46-4fdc-ae8b-cf4f89fb42c6 req-4e364436-870c-4108-b8d9-2ea7b40259e0 service nova] Creating event network-changed:31606774-a4a6-43cb-843b-2abb9b050e72 for instance c62a28f2-d478-4b10-bc35-f88f048ad1ee on n-h2-858383-17 Oct 31 15:17:16.870742 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-54e55e69-2a46-4fdc-ae8b-cf4f89fb42c6 req-4e364436-870c-4108-b8d9-2ea7b40259e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069272 Oct 31 15:17:16.871638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 439/843] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:16.884981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.891752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.892473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.893091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.894533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.895103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.895705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.929879 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3240363-0217-4709-b708-5706dfd44d40 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056869 Oct 31 15:17:16.932865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 440/844] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:16.938211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.939130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:16.947111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.947585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.948310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.949121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.949677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.950256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.042048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:17.060752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc81ab05-4d95-4e96-bc0b-8fe4d7fbb8c4 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1937 microversion: 2.75 time: 0.126456 Oct 31 15:17:17.061625 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 441/845] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1937 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:17.067781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:17.072488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.079560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.080215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.080847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.081723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.082316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.082877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.110697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Lazy-loading 'flavor' on Instance uuid 3ee1a094-22bc-4438-8411-f0e582aaa1f2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:17.112395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:17.112957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:17.113569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:17.114257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:17.114750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:17.128157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.128659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.129012 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 while it is in vm_state suspended Oct 31 15:17:17.129174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.129843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.130306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.130787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Request method failure captured: Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2/action HTTP/1.1 Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 98 Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-bNHe2RbFCg9I-cBSenx8j2fmQgr-lQRKM_zJEjFCgwakXNSMt5GW2mZktUoZ0_s-0sdmGPm5nr1lZ_nQZXK1W9GKAOluFaIM7pdXOK6Z2RBQrdCDrLSI7xUC5tg7iTdR_rdL-PTqKY5qxb3-5yge5NkMV6ZNJOrC5MRRmTAB6UcMU Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: fde6c8de9c894032a27776e24af48e80 Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveMigrationNegativeTest-1988081640 Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:17:17.131847 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fde6c8de9c894032a27776e24af48e80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fde6c8de9c894032a27776e24af48e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fde6c8de9c894032a27776e24af48e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fde6c8de9c894032a27776e24af48e80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveMigrationNegativeTest-1988081640 Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: fde6c8de9c894032a27776e24af48e80 Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1988081640 Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveMigrationNegativeTest-1988081640-project-admin Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6c1eefaa4dec4364a1a143a1d2efc527 Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveMigrationNegativeTest-1988081640-project-admin Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": true, "disk_over_commit": false}} Oct 31 15:17:17.133501 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot 'os-migrateLive' instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 while it is in vm_state suspended Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3ee1a094-22bc-4438-8411-f0e582aaa1f2', 'body': {'os-migrateLive': {'host': 'n-h1-858383-17', 'block_migration': True, 'disk_over_commit': False}}} Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 15:17:17.134387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:17.141025 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 while it is in vm_state suspended Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 while it is in vm_state suspended Oct 31 15:17:17.142546 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.143603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 while it is in vm_state suspended {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:17.143603 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-569b76e8-f1ee-4444-8525-309b60faae20 tempest-LiveMigrationNegativeTest-1988081640 tempest-LiveMigrationNegativeTest-1988081640-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2/action" status: 409 len: 155 microversion: 2.1 time: 0.070424 Oct 31 15:17:17.143603 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 442/846] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:17 2022] POST /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2/action => generated 155 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:17.143603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.143603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.148592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.149121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.149621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.150334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.150793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.151224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.156071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:17.160614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for user 8184a0251b8e4cb882556b458bbc4de7 and project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:17.173258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:17.175577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:17.226567 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d148de98-a79a-444a-b639-f2e66808ec5b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572589 Oct 31 15:17:17.228870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 405/847] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:17:17.234435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.235395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.249941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.250604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.251322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.252053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.252959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.253398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.289939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:17.387564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.400893 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc968789-8d71-4ab9-bde9-92c489c1588e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 204 len: 0 microversion: 2.1 time: 0.170243 Oct 31 15:17:17.402565 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 406/848] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:17 2022] DELETE /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:17.410818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-651f4714-44d5-4d9b-94c6-d8e2c277c2cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.411781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1a75e4c-4f76-4eeb-96f6-0ca6b16b8a81 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.275235 Oct 31 15:17:17.411936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-651f4714-44d5-4d9b-94c6-d8e2c277c2cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.413923 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 443/849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.421016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-bf9eb04b-94d8-4741-8aa0-8d64a72499f4 req-9434e830-8775-41d6-8fed-3ba79505de40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86ca09a-927f-4b27-89b2-db9834d10c3c", "name": "network-vif-plugged", "status": "completed", "tag": "d47e8eda-2de0-4bec-8ab5-ac3c4682b94c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:17.421935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:17.436088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bf9eb04b-94d8-4741-8aa0-8d64a72499f4 req-9434e830-8775-41d6-8fed-3ba79505de40 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.437604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bf9eb04b-94d8-4741-8aa0-8d64a72499f4 req-9434e830-8775-41d6-8fed-3ba79505de40 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.438184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bf9eb04b-94d8-4741-8aa0-8d64a72499f4 req-9434e830-8775-41d6-8fed-3ba79505de40 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.451391 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-bf9eb04b-94d8-4741-8aa0-8d64a72499f4 req-9434e830-8775-41d6-8fed-3ba79505de40 service nova] Creating event network-vif-plugged:d47e8eda-2de0-4bec-8ab5-ac3c4682b94c for instance e86ca09a-927f-4b27-89b2-db9834d10c3c on n-h2-858383-17 Oct 31 15:17:17.457192 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-bf9eb04b-94d8-4741-8aa0-8d64a72499f4 req-9434e830-8775-41d6-8fed-3ba79505de40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041781 Oct 31 15:17:17.460345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 444/850] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:17.467064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.467957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.477788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.477788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.478519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.479326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.480272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.480272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.516402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-651f4714-44d5-4d9b-94c6-d8e2c277c2cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.525458 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-651f4714-44d5-4d9b-94c6-d8e2c277c2cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1211 microversion: 2.1 time: 0.120450 Oct 31 15:17:17.526204 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 407/851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.531068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.532081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.539972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.540686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.541309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.542436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.543065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.543643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.721749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.739686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.739686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.739686 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54aa2723-feb6-4510-adae-11be07ebecd2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.273113 Oct 31 15:17:17.741833 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 445/852] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:17.747077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.747812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.755810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.757099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.757776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.760355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.761046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.761666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.784336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.793546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e6e1d19f-5350-4aa8-b931-9f03101f7608 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1465 microversion: 2.1 time: 0.266002 Oct 31 15:17:17.794448 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 408/853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1465 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.855821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.856325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.863153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.863642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.864073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.864822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.865303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.865772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.894272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:17.932651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.943022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6b9cf18-16ec-4ee9-b086-35e50fae7646 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.206102 Oct 31 15:17:17.944929 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 446/854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.989448 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1889dc87-4e4a-450b-bcc6-60e1ed1e2b7a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 204 len: 0 microversion: 2.1 time: 0.138393 Oct 31 15:17:17.990028 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 409/855] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:17 2022] DELETE /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:17.999173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.999891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.005929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.006570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.007006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.007706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.008163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.008586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.094544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.095246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.101522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.102055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.102483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.103223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.103671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.104242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.145589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:18.157444 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97bab47d-b751-4e90-878c-7a053f5754bc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1711 microversion: 2.1 time: 0.161944 Oct 31 15:17:18.158054 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 447/856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:18.184389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:18.202151 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-107849cd-a09c-4040-ad2f-a035da43c918 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1937 microversion: 2.75 time: 0.112127 Oct 31 15:17:18.202991 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 410/857] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1937 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:17:18.438096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.438813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.445927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.446414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.446842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.447536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.447990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.448415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.554015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.554963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.561163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.561657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.562093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.562793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.563256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.563729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.577084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:18.585274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8156499-2955-4563-979b-b95b36e3c481 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.150956 Oct 31 15:17:18.585861 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 448/858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:18.628400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:18.636411 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5671d2c4-40de-4228-9ebe-052d905b0bd0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1215 microversion: 2.1 time: 0.087322 Oct 31 15:17:18.637016 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 411/859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:18.761559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.762335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.769380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.769870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.770308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.771014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.771654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.772150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.819067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.819304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.829021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.829525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.829967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.830673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.831133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.831554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.032956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.042438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.043549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.044953 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2717f63c-57e3-437b-9083-0094a323e3a7 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.287404 Oct 31 15:17:19.045617 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 449/860] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:17:19.059878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:19.061059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:19.066600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.078017 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64a9b662-e494-4242-9d52-e42776aebc90 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1465 microversion: 2.1 time: 0.263617 Oct 31 15:17:19.079443 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 412/861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1465 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:19.083595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.084092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.085217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.086107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.086569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.086996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.183467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:19.184382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:19.191463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.192232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.192956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.194488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.195574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.196959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.236883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.246293 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f0f769a-3e41-49fe-ae1c-3d58644e66d5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.199314 Oct 31 15:17:19.247781 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 450/862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:19 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:19.264471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:19.265519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:19.271992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.273153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.273839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.274793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.275494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.276024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.371870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:19.379394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:19.398028 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91efbb20-ed87-4524-92f5-caccf1177816 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1937 microversion: 2.75 time: 0.148942 Oct 31 15:17:19.399371 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 451/863] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:19 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1937 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:19.419834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.433079 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ee29c17-df2e-44eb-a42f-c0656b984936 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1711 microversion: 2.1 time: 0.253381 Oct 31 15:17:19.433895 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 413/864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:19 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1711 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:19.608893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:19.609502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:19.615728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.615934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.616375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.617099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.617549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.617972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.661783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:19.661783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:19.666879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.667371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.667804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.668528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.669014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.669441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.737158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.749601 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73c2a857-fbe2-457f-b7d2-717a0b07c864 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1215 microversion: 2.1 time: 0.094063 Oct 31 15:17:19.750725 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 414/865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:19 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:19.794592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.803915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30e79b0b-4f28-414c-827b-bb35db4fa923 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.198264 Oct 31 15:17:19.804507 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 452/866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:19 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:20.074636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:20.075246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:20.081994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.082485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.082922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.083613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.084072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.085283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.106576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:20.107321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:20.113321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.113811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.114240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.114934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.115386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.115978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.268687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.273534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:20.279578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.281136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.282634 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac6e9974-18c9-4b6c-af84-b524c49c528d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.211924 Oct 31 15:17:20.297212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 415/867] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:20 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:20.308056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:20.308977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:20.315893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.316734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.317542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.319021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.319690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.320321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.321398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.344026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f335a737-2fdf-4c59-b381-4f7a03bda59e tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1465 microversion: 2.1 time: 0.241418 Oct 31 15:17:20.345064 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 453/868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:20 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:20.433219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:20.434322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:20.451881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.452962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.453797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.456029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.456596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.458524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.023870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:21.042889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d557e005-ca61-4a20-bbf1-bd39cf5d7f11 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1937 microversion: 2.75 time: 0.615067 Oct 31 15:17:21.059615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 454/869] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:20 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1937 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:21.071867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.072646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.080502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.081143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.081855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.082670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.083241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.083766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.267576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:21.283795 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-05d028e7-b893-4b32-9eb8-2dcb1abb8ca5 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.981016 Oct 31 15:17:21.285254 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 416/870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:20 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:21.305434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.306789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.321965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.322644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.330585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.331647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.332242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.332810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.473542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:21.486620 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9091219-99c6-4622-8d5d-dd7d81b4e9d2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1263 microversion: 2.1 time: 0.199822 Oct 31 15:17:21.487698 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 417/871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:21.495279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.495896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.510904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.511953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.512835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.513760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.514420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.515441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.543330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:21.552216 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52e3c787-7551-4ebf-b38f-31fe358d4c9e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1711 microversion: 2.1 time: 0.491332 Oct 31 15:17:21.552859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 455/872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1711 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:21.566946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.567501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.581617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.582122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.582565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.583293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.583762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.584877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.870016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:21.886930 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d7c55172-6ccb-47fd-865e-36e1b4a3e32c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.397746 Oct 31 15:17:21.890984 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 418/873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:21.910093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-76896861-8ed8-4e0e-99ac-2a9de4814b84 req-85ce9402-e07b-46a5-aca0-e9e97712319a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee1a094-22bc-4438-8411-f0e582aaa1f2", "name": "network-vif-deleted", "tag": "9e521ffb-e253-4c7a-addf-b43a007d28ee"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:21.936630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-76896861-8ed8-4e0e-99ac-2a9de4814b84 req-85ce9402-e07b-46a5-aca0-e9e97712319a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.938440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-76896861-8ed8-4e0e-99ac-2a9de4814b84 req-85ce9402-e07b-46a5-aca0-e9e97712319a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.938983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-76896861-8ed8-4e0e-99ac-2a9de4814b84 req-85ce9402-e07b-46a5-aca0-e9e97712319a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.965741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-76896861-8ed8-4e0e-99ac-2a9de4814b84 req-85ce9402-e07b-46a5-aca0-e9e97712319a service nova] Creating event network-vif-deleted:9e521ffb-e253-4c7a-addf-b43a007d28ee for instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 on n-h2-858383-17 Oct 31 15:17:21.977887 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-76896861-8ed8-4e0e-99ac-2a9de4814b84 req-85ce9402-e07b-46a5-aca0-e9e97712319a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085049 Oct 31 15:17:21.978609 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 419/874] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:21.990126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.991144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.006608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.006608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.007741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.008598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.009405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.009946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.054665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.055201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.055748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.056299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lazy-loading 'fault' on Instance uuid 3ee1a094-22bc-4438-8411-f0e582aaa1f2 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:22.081839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.091003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.092456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.093606 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8399768f-f406-4a96-955e-a3f2fa2e1968 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1410 microversion: 2.25 time: 0.539806 Oct 31 15:17:22.094168 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 456/875] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1410 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:22.129510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a79bd281-f8d4-4482-9a03-9040eb795697 req-d29b3431-c83c-43ab-91e6-fd3b4f963fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5", "name": "network-vif-plugged", "status": "completed", "tag": "0e86172e-2093-44ee-9850-5faa0eb12535"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:22.147300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a79bd281-f8d4-4482-9a03-9040eb795697 req-d29b3431-c83c-43ab-91e6-fd3b4f963fb9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.147793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a79bd281-f8d4-4482-9a03-9040eb795697 req-d29b3431-c83c-43ab-91e6-fd3b4f963fb9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.148231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a79bd281-f8d4-4482-9a03-9040eb795697 req-d29b3431-c83c-43ab-91e6-fd3b4f963fb9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.183246 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a79bd281-f8d4-4482-9a03-9040eb795697 req-d29b3431-c83c-43ab-91e6-fd3b4f963fb9 service nova] Creating event network-vif-plugged:0e86172e-2093-44ee-9850-5faa0eb12535 for instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 on n-h2-858383-17 Oct 31 15:17:22.188518 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a79bd281-f8d4-4482-9a03-9040eb795697 req-d29b3431-c83c-43ab-91e6-fd3b4f963fb9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062559 Oct 31 15:17:22.189387 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 457/876] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:22.194527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.205759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.213254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.213754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.214193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.215163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.215803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.216434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.247622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.256963 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4ac3aa4-4553-49d2-8e68-5447383c75ec tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1308 microversion: 2.1 time: 0.276321 Oct 31 15:17:22.257894 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 420/877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:22.313790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.315135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.333108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.336872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.337595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.340499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.343738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.345014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.377564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:22.423796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f200c5d2-3523-423b-adc8-6ce6ffa6a6ee tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1937 microversion: 2.75 time: 0.233051 Oct 31 15:17:22.424717 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 458/878] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1937 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:22.516762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.517711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.535549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.536636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.539064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.540803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.542984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.543680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.748952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.770001 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31354c37-4316-4a89-b583-d2bcc4388a5a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1263 microversion: 2.1 time: 0.257083 Oct 31 15:17:22.783921 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 459/879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1263 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:22.803861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.804577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.816295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=22 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:22.821150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.827154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.827882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.828480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.829087 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a9f51fe-38a2-480b-bc50-87f3ca4a8bfc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.519427 Oct 31 15:17:22.829671 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 421/880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:22.830207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.830886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.831471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.915298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.916222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.922854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.923620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.924476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.925411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.926058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.926672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.157935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.174899 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8f537ab-7fcf-428a-8799-639ae8a53856 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1711 microversion: 2.1 time: 0.388788 Oct 31 15:17:23.185655 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 460/881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1711 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:23.198718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:23.199838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:23.213756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.214355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.215112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.215849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.216340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.216769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.368422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.378942 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4e67b7a-348c-43eb-8952-2660b95ba621 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1314 microversion: 2.1 time: 0.470149 Oct 31 15:17:23.393244 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 422/882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:23.405287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:23.406262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:23.422118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.422835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.423622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.424527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.425221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.428210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.465331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.466075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.466694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.467436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lazy-loading 'fault' on Instance uuid 3ee1a094-22bc-4438-8411-f0e582aaa1f2 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:23.566923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.576382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00734896-839b-446c-8d5c-c6c628ca8725 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1308 microversion: 2.1 time: 0.176840 Oct 31 15:17:23.577024 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 423/883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:23 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:23.593050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:23.593939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:23.600886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.607934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.608389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.609189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.609854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.610456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.643152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.660048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.665093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.666525 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c977d899-b19c-4d8e-8261-54c6cafa45fc tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1606 microversion: 2.25 time: 0.484870 Oct 31 15:17:23.670370 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 461/884] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:23 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1606 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:23.694885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:23.695382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:23.701643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.702414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.703036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.703895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.704526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.705128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.053672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] Lazy-loading 'services' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:24.078145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-efd87d2b-94a2-41a8-87a6-afc38452fb05 tempest-ServersAdmin275Test-333161528 tempest-ServersAdmin275Test-333161528-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1922 microversion: 2.75 time: 0.499883 Oct 31 15:17:24.092887 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 424/885] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:23 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1922 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:24.129830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.132135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.145594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.146077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.146612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.147481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.148120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.148955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.183515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae85b427-d842-435c-9c90-9e92c29cf10f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.492982 Oct 31 15:17:24.195695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 462/886] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:17:23 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-interface => generated 284 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:17:24.201681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.202381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.214134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.215266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.215721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.216851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.217848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.218297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.386701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.404337 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63007f1e-d012-4b38-a2d2-fc331abe4389 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1269 microversion: 2.1 time: 0.298821 Oct 31 15:17:24.409211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 425/887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:24.425579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.427141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.447323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.450426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.451461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.453902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.454666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.457785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.500123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:24.505515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.528104 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3692deea-de13-4b42-9cda-933afd707db9 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.330371 Oct 31 15:17:24.528739 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 463/888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:24.546590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.547573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.568543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.571125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.573312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.579484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.582459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.584264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.661698 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a681ee4-832c-43af-ac8c-503d5fd3b4a8 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "DELETE /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 204 len: 0 microversion: 2.75 time: 0.250569 Oct 31 15:17:24.663370 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 426/889] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:24 2022] DELETE /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:17:24.679694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-dcb0cf19-58c5-460a-b928-312b017e23c1 req-72d4c48d-0506-48b4-811d-f667d7df953c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d59103-18f0-4bb0-ba16-2907d512fa5d", "name": "network-vif-deleted", "tag": "760b9d1b-32f9-4a30-9a04-e9579ea03436"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:24.702740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dcb0cf19-58c5-460a-b928-312b017e23c1 req-72d4c48d-0506-48b4-811d-f667d7df953c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.705178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dcb0cf19-58c5-460a-b928-312b017e23c1 req-72d4c48d-0506-48b4-811d-f667d7df953c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.707467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dcb0cf19-58c5-460a-b928-312b017e23c1 req-72d4c48d-0506-48b4-811d-f667d7df953c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.722294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-dcb0cf19-58c5-460a-b928-312b017e23c1 req-72d4c48d-0506-48b4-811d-f667d7df953c service nova] Creating event network-vif-deleted:760b9d1b-32f9-4a30-9a04-e9579ea03436 for instance 48d59103-18f0-4bb0-ba16-2907d512fa5d on n-h2-858383-17 Oct 31 15:17:24.729658 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-dcb0cf19-58c5-460a-b928-312b017e23c1 req-72d4c48d-0506-48b4-811d-f667d7df953c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064015 Oct 31 15:17:24.730627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 427/890] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:24.739064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.740927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.765572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.777941 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e61ca34e-6752-43da-901c-a006c39e66e1 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1643 microversion: 2.1 time: 0.247127 Oct 31 15:17:24.783719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.784975 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 464/891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1643 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:24.796754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.797194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.797993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.798393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.798822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.802528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.803706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.821947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.822438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.822874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.823585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.824044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.824466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.894155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.894646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.895084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.895538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lazy-loading 'fault' on Instance uuid 3ee1a094-22bc-4438-8411-f0e582aaa1f2 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:25.111006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.121786 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6c7814c-4c17-49d6-87be-9176d362ac19 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 200 len: 1308 microversion: 2.1 time: 0.328172 Oct 31 15:17:25.133068 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 465/892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:25.138803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.139922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.154666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.155344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.155976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.156952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.157574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.175740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.366107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.374987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.386749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.389940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.391865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:25.393734 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d48ebe03-a150-4bc7-9427-553f6ee07bcf tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1444 microversion: 2.75 time: 0.258855 Oct 31 15:17:25.399704 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4630446c-3f2a-47dc-8cc2-2d90583af74b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1462 microversion: 2.1 time: 0.667561 Oct 31 15:17:25.404339 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 466/893] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1444 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:25.424891 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 428/894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1462 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:25.434864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.435776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.445362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.457517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.458227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.459924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.460724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.461359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.636931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.649209 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac5d0c6a-ba5a-47db-93c8-2a606042d074 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1269 microversion: 2.1 time: 0.218230 Oct 31 15:17:25.650656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 467/895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:25.658207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.659435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.671294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.675912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.680776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.681839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.683535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.684196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.700459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:25.702476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.717366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'deleted': False, 'project_id': '6e8808f1726342dcb4e881fc28aa668b'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:25.738163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.740800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.742550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.745129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.750151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.752632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.903495 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-82e9c6ff-99ea-4473-bd4e-695b2714bdea tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.466388 Oct 31 15:17:25.904433 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 429/896] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:25.911783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.915888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.930215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.934720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.935462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.937414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.938549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.939482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.025014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.025784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.026463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.027124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lazy-loading 'fault' on Instance uuid 48d59103-18f0-4bb0-ba16-2907d512fa5d {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:26.126039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:26.148864 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-74401540-1d16-48d9-b3f7-d3c1da18549e tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1352 microversion: 2.1 time: 0.242964 Oct 31 15:17:26.149776 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 430/897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:26.154325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.174928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'deleted': False} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:26.187247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.187741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.188178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.188940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.189397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.189820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.214801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:26.237389 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ce636f7-55f1-466b-854d-16bb2c43b858 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.585258 Oct 31 15:17:26.238799 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 468/898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:26.243619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.244458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: 3ee1a094-22bc-4438-8411-f0e582aaa1f2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:26.259528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.260312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.261047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.262057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.262802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.263414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.282225 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] HTTP exception thrown: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 could not be found. Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Request method failure captured: Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 HTTP/1.1 Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-bMIZ4_RjnWEdKChwL_pUwMfNSer83Rn8ZTuppRA2MlbDZFBBfvcSG4HcJXufti34BAFJuHR9QfU72HnlUiYnz3B_HY6_lct1W8NnupgnPUVFKPrxhb33Svd2xdZDiIrGT6u736B6Qr4DHxed_7l6wgYivX9Nx38099mt0riEvOnac Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b7381b2cd1c646298a9bbedccf3defde Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveMigrationNegativeTest-1513436076 Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:17:26.284274 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveMigrationNegativeTest-1513436076 Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b7381b2cd1c646298a9bbedccf3defde Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1513436076 Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveMigrationNegativeTest-1513436076-project Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 74a559020cbd4b0b85e0831c1ea92a63 Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveMigrationNegativeTest-1513436076-project Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 could not be found. Oct 31 15:17:26.285888 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3ee1a094-22bc-4438-8411-f0e582aaa1f2'} Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 could not be found. Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:26.286638 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 could not be found. Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 could not be found. Oct 31 15:17:26.288857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:26.291822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Returning 404 to user: Instance 3ee1a094-22bc-4438-8411-f0e582aaa1f2 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:26.293053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b65e1a2d-fd0d-4c3a-b823-e102c4185198 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2" status: 404 len: 111 microversion: 2.1 time: 0.053133 Oct 31 15:17:26.296997 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 469/899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:26 2022] GET /compute/v2.1/servers/3ee1a094-22bc-4438-8411-f0e582aaa1f2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:26.305174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.306018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:26.315359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.315858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.316766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.318796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.319692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.320537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.354676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:26.364742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:17:26.386429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:26.486379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=21 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:26.510031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.510535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.511126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.545843 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad40e671-6472-4b62-99fd-b5f3c1f7b2be tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 204 len: 0 microversion: 2.1 time: 0.245958 Oct 31 15:17:26.546897 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 470/900] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:26 2022] DELETE /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:17:26.554232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.555155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:26.561123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.561609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.562043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.562764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.563198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.563624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.647978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:26.663876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:26.665375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:26.670911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6d27005-7bdb-461f-a30f-5a26778f07c1 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1444 microversion: 2.75 time: 0.122740 Oct 31 15:17:26.671503 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 471/901] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:26 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:26.691511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.692776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:26.700462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.701608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.701608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.702745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.703108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.703847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.907885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:26.926130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:26.936957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4085e342-209e-44d3-8d3c-24377d92dff1 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1474 microversion: 2.1 time: 0.249108 Oct 31 15:17:26.937543 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 472/902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:26 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1474 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:26.942568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-dce40167-2a13-4bad-9349-349de65cec8e req-28a40058-8883-46d3-8077-b95fd020a1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86ca09a-927f-4b27-89b2-db9834d10c3c", "tag": "d47e8eda-2de0-4bec-8ab5-ac3c4682b94c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:26.953014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dce40167-2a13-4bad-9349-349de65cec8e req-28a40058-8883-46d3-8077-b95fd020a1ab service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.953558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dce40167-2a13-4bad-9349-349de65cec8e req-28a40058-8883-46d3-8077-b95fd020a1ab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.954081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dce40167-2a13-4bad-9349-349de65cec8e req-28a40058-8883-46d3-8077-b95fd020a1ab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.982941 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-dce40167-2a13-4bad-9349-349de65cec8e req-28a40058-8883-46d3-8077-b95fd020a1ab service nova] Creating event network-changed:d47e8eda-2de0-4bec-8ab5-ac3c4682b94c for instance e86ca09a-927f-4b27-89b2-db9834d10c3c on n-h2-858383-17 Oct 31 15:17:26.988685 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-dce40167-2a13-4bad-9349-349de65cec8e req-28a40058-8883-46d3-8077-b95fd020a1ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049974 Oct 31 15:17:26.993651 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 473/903] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:26.999977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-265334853", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "55287c8b-ed4f-4dd0-9590-28fb99e0d8fc"}], "security_groups": [{"name": "tempest-securitygroup--1796328786"}], "key_name": "tempest-keypair-472865569", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "86fdb488-26c3-411f-85bd-c33099c082c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:27.066899 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d367563d-9f0a-4281-bf1b-b1b2e96e3866 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 26977 microversion: 2.1 time: 0.915964 Oct 31 15:17:27.081571 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 431/904] 10.222.0.48 () {58 vars in 1171 bytes} [Mon Oct 31 15:17:26 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 26977 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:27.098156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.098803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.126763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.127320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.127762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.128865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.129455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.129893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.395662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] validate_networks() for [('55287c8b-ed4f-4dd0-9590-28fb99e0d8fc', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:27.438271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.458404 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4fbe783-af34-4df8-8b9d-e9e6c44a37c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.375569 Oct 31 15:17:27.459652 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 432/905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:27.473600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.484977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'deleted': False, 'project_id': '6e8808f1726342dcb4e881fc28aa668b'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:27.490178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.490844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.491078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.491829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.492282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.492720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.527770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-259f3fd2-185b-4349-80a9-b2901ca178e2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?tenant_id=a8467f5801594eba9c27b4eb124c8325" status: 200 len: 15 microversion: 2.1 time: 0.066304 Oct 31 15:17:27.528344 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 433/906] 10.222.0.48 () {58 vars in 1231 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/detail?tenant_id=a8467f5801594eba9c27b4eb124c8325 => generated 15 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:27.533223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.533828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.540450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.541015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.541461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.542308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.542596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.543019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.580097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.580592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.581283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.581735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lazy-loading 'fault' on Instance uuid 48d59103-18f0-4bb0-ba16-2907d512fa5d {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:27.651220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b24aa0edeef4cf58c624bee5f7478fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b5e7bae2ce41279db848f24326b3ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.665135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-932cff20-c798-41cd-8397-3290cf4ef897 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 200 len: 1352 microversion: 2.1 time: 0.132235 Oct 31 15:17:27.666214 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 434/907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 1352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:27.680174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.681117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.687688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.688529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.689222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.689951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.691616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.692059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.153249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.162852 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3fb3d935-db69-4ccf-bcf6-7151b98c5246 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.493039 Oct 31 15:17:28.162852 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 435/908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:28.186877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.192826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'tenant_id': 'a8467f5801594eba9c27b4eb124c8325', 'deleted': False} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:28.199734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.200611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.200611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.201311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.201766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.202189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.234959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:17:28.315480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.315969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.316403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.456246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Getting quotas for project 0d2e676a7b344a9fbb96b88fbb4fd69b. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:28.466218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Getting quotas for user 849ee26672704efe849789e080eb9038 and project 0d2e676a7b344a9fbb96b88fbb4fd69b. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:28.478612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:28.479022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:28.479666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:28.480257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:28.480844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:28.489620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.490749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.491432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.492168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.492636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.493208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.528136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Getting quotas for project 0d2e676a7b344a9fbb96b88fbb4fd69b. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:28.533629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Getting quotas for user 849ee26672704efe849789e080eb9038 and project 0d2e676a7b344a9fbb96b88fbb4fd69b. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:28.601111 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63aa8fc8-ff07-4a24-b871-e941eef18921 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a8467f5801594eba9c27b4eb124c8325" status: 200 len: 4830 microversion: 2.1 time: 0.436853 Oct 31 15:17:28.602942 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 436/909] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a8467f5801594eba9c27b4eb124c8325 => generated 4830 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:28.608746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.609600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:28.612966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:28.615899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86fdb488-26c3-411f-85bd-c33099c082c9',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:28.634829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.635352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.636383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.637185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.637714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.638077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.734494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.735023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.735465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.735913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lazy-loading 'fault' on Instance uuid 54b05807-5fdb-4943-9cc6-5736a85a3cd4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:28.866497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f9063f6-0de0-461a-8620-89d7576cb4b0 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.871081 Oct 31 15:17:28.867223 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 474/910] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:28.874231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.874852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:28.883181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.883802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.884251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.885361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.885893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.886505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.937260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.937608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.938730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.939199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lazy-loading 'fault' on Instance uuid e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:29.281715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.294521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.296818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57e01cb3ed2f49778623932a0732b158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fbb8ccf45644c14a3bd483416186461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.304996 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d8142c81-7b2d-4ff1-b252-6493497cb242 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 200 len: 1449 microversion: 2.75 time: 0.700593 Oct 31 15:17:29.314120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a559020cbd4b0b85e0831c1ea92a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7381b2cd1c646298a9bbedccf3defde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.317367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 437/911] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 1449 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:29.321898 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f31fc1a4-aa2e-424f-aa8c-09331a632be4 tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 200 len: 1309 microversion: 2.1 time: 0.453638 Oct 31 15:17:29.325024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 475/912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:29.331951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.338556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'tenant_id': '6e8808f1726342dcb4e881fc28aa668b', 'deleted': False} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:29.338753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.339599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.346933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:29.349124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.350787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.351408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.352730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.353594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.354240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.366231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.366605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.367051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.367784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.368244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.368671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.487140 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f936494f-4e34-4ad8-b512-01d48e1e9dab tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e8808f1726342dcb4e881fc28aa668b" status: 200 len: 15 microversion: 2.1 time: 0.158540 Oct 31 15:17:29.488994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 476/913] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e8808f1726342dcb4e881fc28aa668b => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:29.494919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a9da3277-e32c-44bb-ab59-2f21c873db27 req-68086f85-76e8-4736-84a2-31e050f3e721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09142860-c91f-4a33-b580-e1288ecae4bd", "tag": "02a04c3f-55f1-45d0-9693-0d91bb15b3fd"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.506269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9da3277-e32c-44bb-ab59-2f21c873db27 req-68086f85-76e8-4736-84a2-31e050f3e721 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.507337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9da3277-e32c-44bb-ab59-2f21c873db27 req-68086f85-76e8-4736-84a2-31e050f3e721 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.508223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9da3277-e32c-44bb-ab59-2f21c873db27 req-68086f85-76e8-4736-84a2-31e050f3e721 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.523488 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a9da3277-e32c-44bb-ab59-2f21c873db27 req-68086f85-76e8-4736-84a2-31e050f3e721 service nova] Creating event network-changed:02a04c3f-55f1-45d0-9693-0d91bb15b3fd for instance 09142860-c91f-4a33-b580-e1288ecae4bd on n-h1-858383-17 Oct 31 15:17:29.539016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a9da3277-e32c-44bb-ab59-2f21c873db27 req-68086f85-76e8-4736-84a2-31e050f3e721 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047431 Oct 31 15:17:29.541179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 477/914] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:29.549999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.551427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.570705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.571518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.573338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.574261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.574862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.575385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.596018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d HTTP/1.1 Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:17:29.597701 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:29.598961 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '48d59103-18f0-4bb0-ba16-2907d512fa5d'} Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:29.599813 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:29.601423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.602711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:29.604264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e4b3998-ee7e-4030-84fa-3008fab05477 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 404 len: 111 microversion: 2.1 time: 0.056032 Oct 31 15:17:29.607287 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 478/915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:29.616471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.622551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.643469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.644130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.644644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.646011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.647565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.648179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.747765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.756401 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-23166f05-cbcf-417e-9bab-5070cb3a5a91 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.437538 Oct 31 15:17:29.757215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 438/916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:29.762420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f2a944b8-48b5-408e-83c7-e2f2d3ecfc22 req-f9d39683-d079-432d-8e4f-6fa203fd0b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fcbce4-ac3d-423c-b3c2-4743f2cfe638", "name": "network-vif-deleted", "tag": "033d70b6-6542-4609-a87a-f7d09fc98263"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.775835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.776580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2a944b8-48b5-408e-83c7-e2f2d3ecfc22 req-f9d39683-d079-432d-8e4f-6fa203fd0b92 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.777497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2a944b8-48b5-408e-83c7-e2f2d3ecfc22 req-f9d39683-d079-432d-8e4f-6fa203fd0b92 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.778808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2a944b8-48b5-408e-83c7-e2f2d3ecfc22 req-f9d39683-d079-432d-8e4f-6fa203fd0b92 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.785032 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e2bbe5f-93e4-4073-8400-50029e560ad6 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1162 microversion: 2.1 time: 0.175113 Oct 31 15:17:29.785608 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 479/917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1162 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:29.790783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.791576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.806797 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f2a944b8-48b5-408e-83c7-e2f2d3ecfc22 req-f9d39683-d079-432d-8e4f-6fa203fd0b92 service nova] Creating event network-vif-deleted:033d70b6-6542-4609-a87a-f7d09fc98263 for instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 on n-h2-858383-17 Oct 31 15:17:29.810663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.811389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.812048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.813180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.813793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.814110 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f2a944b8-48b5-408e-83c7-e2f2d3ecfc22 req-f9d39683-d079-432d-8e4f-6fa203fd0b92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055412 Oct 31 15:17:29.814599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.815132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 439/918] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:29.821722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c87315a9-ccc4-4588-a8fe-2e2933f8222e req-460c4b63-31df-42e8-a282-b36c0830b88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62a28f2-d478-4b10-bc35-f88f048ad1ee", "name": "network-vif-plugged", "status": "completed", "tag": "31606774-a4a6-43cb-843b-2abb9b050e72"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.835759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c87315a9-ccc4-4588-a8fe-2e2933f8222e req-460c4b63-31df-42e8-a282-b36c0830b88c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.836270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c87315a9-ccc4-4588-a8fe-2e2933f8222e req-460c4b63-31df-42e8-a282-b36c0830b88c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.836719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c87315a9-ccc4-4588-a8fe-2e2933f8222e req-460c4b63-31df-42e8-a282-b36c0830b88c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.855383 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c87315a9-ccc4-4588-a8fe-2e2933f8222e req-460c4b63-31df-42e8-a282-b36c0830b88c service nova] Creating event network-vif-plugged:31606774-a4a6-43cb-843b-2abb9b050e72 for instance c62a28f2-d478-4b10-bc35-f88f048ad1ee on n-h2-858383-17 Oct 31 15:17:29.862120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c87315a9-ccc4-4588-a8fe-2e2933f8222e req-460c4b63-31df-42e8-a282-b36c0830b88c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045614 Oct 31 15:17:29.862955 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 440/919] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:29.868937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa3f87b7-3d6e-41f8-8795-829a1f0365dd tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.874877 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa3f87b7-3d6e-41f8-8795-829a1f0365dd tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010864 Oct 31 15:17:29.875910 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 441/920] 10.222.0.48 () {58 vars in 1189 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:29.897765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.898381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.905592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.906083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.907842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.908814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.909427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.910011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.925052 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd HTTP/1.1 Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:29.926727 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:29.928811 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '493610b0-1112-44d9-9df3-ad5800017cbd'} Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:29.929575 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:29.930817 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.933923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:29.933923 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b094408-b578-41ff-9e9a-7a81067684f6 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 404 len: 111 microversion: 2.1 time: 0.051608 Oct 31 15:17:29.933923 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 442/921] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:29 2022] DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:29.936454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.944998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.958277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.959210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.959719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.960437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.961607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.962042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.046324 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f544c9c-200c-4840-bb5d-b690d980a00a tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 0 microversion: 2.1 time: 0.116031 Oct 31 15:17:30.047287 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 443/922] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:29 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:30.053467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.054387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.060767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.061492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.062037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.062938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.063921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.063921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.079586 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd HTTP/1.1 Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:30.080944 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:30.082543 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '493610b0-1112-44d9-9df3-ad5800017cbd'} Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:30.083391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:30.086191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.088604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:30.090173 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4052ee15-6e47-4bed-b7a6-6586cd406dfc tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 404 len: 111 microversion: 2.1 time: 0.041586 Oct 31 15:17:30.094183 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 444/923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:30.098834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.104781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.105603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a8467f5801594eba9c27b4eb124c8325'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:30.108438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.111359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.111930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.112252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.113286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.113785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.114158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.118487 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2669177b-236b-4954-b5ef-a1b568e90cdf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.331843 Oct 31 15:17:30.119709 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 480/924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:30.124576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eec1ae52-941d-4c34-8c65-5a7a85d86c54 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '.version_select at 0x7f5ca2638c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.144608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eec1ae52-941d-4c34-8c65-5a7a85d86c54 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785399804" status: 202 len: 0 microversion: 2.1 time: 0.023226 Oct 31 15:17:30.145118 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 481/925] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785399804 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:30.205494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:17:30.266211 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd28aeaa-09cf-4c0e-b75a-171cb0b3a6a6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.172270 Oct 31 15:17:30.266984 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 445/926] 10.222.0.48 () {58 vars in 1150 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:30.279071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:30.281294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.287834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.288515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.289140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.289839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.290303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.290727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.336814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.337395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] [instance: 54b05807-5fdb-4943-9cc6-5736a85a3cd4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.346835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.347391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.347833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.348567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.349115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.350547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.364977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] HTTP exception thrown: Instance 54b05807-5fdb-4943-9cc6-5736a85a3cd4 could not be found. Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Request method failure captured: Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 HTTP/1.1 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-aenaZ8wNKUlSFRHKB7Kl-6Z4d4JEPOnWojYJzfW7Lz17cpXlel8uOYiS2owUjOB-q2Y1V1FP07lA1H9aXAd5zkM9Ay8Lpd-GzLjchEOR_K5ZGF9Hh0ShRYqjR6esui5V2CxyLOMF4kXKFMZpIweT5TYfNKv-KPYEcQltWe4AgSA9o Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.75 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 6fbb8ccf45644c14a3bd483416186461 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdmin275Test-585770220 Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:30.366970 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6fbb8ccf45644c14a3bd483416186461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6fbb8ccf45644c14a3bd483416186461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6fbb8ccf45644c14a3bd483416186461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6fbb8ccf45644c14a3bd483416186461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdmin275Test-585770220 Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 6fbb8ccf45644c14a3bd483416186461 Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdmin275Test-585770220 Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdmin275Test-585770220-project Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 57e01cb3ed2f49778623932a0732b158 Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdmin275Test-585770220-project Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 54b05807-5fdb-4943-9cc6-5736a85a3cd4 could not be found. Oct 31 15:17:30.368608 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '54b05807-5fdb-4943-9cc6-5736a85a3cd4'} Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b05807-5fdb-4943-9cc6-5736a85a3cd4 could not be found. Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:30.369520 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b05807-5fdb-4943-9cc6-5736a85a3cd4 could not be found. Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b05807-5fdb-4943-9cc6-5736a85a3cd4 could not be found. Oct 31 15:17:30.370906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.372216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] Returning 404 to user: Instance 54b05807-5fdb-4943-9cc6-5736a85a3cd4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:30.373133 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d458c18d-d46c-421d-9caa-0cd8d9ff0943 tempest-ServersAdmin275Test-585770220 tempest-ServersAdmin275Test-585770220-project] 10.222.0.48 "GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4" status: 404 len: 111 microversion: 2.75 time: 0.040968 Oct 31 15:17:30.374039 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 446/927] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/54b05807-5fdb-4943-9cc6-5736a85a3cd4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:17:30.378954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.379827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] [instance: e5fcbce4-ac3d-423c-b3c2-4743f2cfe638] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.386809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.387284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.388788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.389651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.390353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.391017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.411425 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] HTTP exception thrown: Instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 could not be found. Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Request method failure captured: Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 HTTP/1.1 Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-bMIZ4_RjnWEdKChwL_pUwMfNSer83Rn8ZTuppRA2MlbDZFBBfvcSG4HcJXufti34BAFJuHR9QfU72HnlUiYnz3B_HY6_lct1W8NnupgnPUVFKPrxhb33Svd2xdZDiIrGT6u736B6Qr4DHxed_7l6wgYivX9Nx38099mt0riEvOnac Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b7381b2cd1c646298a9bbedccf3defde Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-LiveMigrationNegativeTest-1513436076 Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:30.414495 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7381b2cd1c646298a9bbedccf3defde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-LiveMigrationNegativeTest-1513436076 Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b7381b2cd1c646298a9bbedccf3defde Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1513436076 Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-LiveMigrationNegativeTest-1513436076-project Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 74a559020cbd4b0b85e0831c1ea92a63 Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-LiveMigrationNegativeTest-1513436076-project Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 could not be found. Oct 31 15:17:30.416257 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e5fcbce4-ac3d-423c-b3c2-4743f2cfe638'} Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 could not be found. Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:30.417118 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 could not be found. Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 could not be found. Oct 31 15:17:30.418604 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:30.419848 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eac226a1-0ed0-4169-a5d5-54842d0c3d9e tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 0 microversion: 2.1 time: 0.142014 Oct 31 15:17:30.419848 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 482/928] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:30 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:30.421136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] Returning 404 to user: Instance e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:30.422166 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e1e114a9-fcb9-4d45-b146-df67e8fcdf9a tempest-LiveMigrationNegativeTest-1513436076 tempest-LiveMigrationNegativeTest-1513436076-project] 10.222.0.48 "GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638" status: 404 len: 111 microversion: 2.1 time: 0.046909 Oct 31 15:17:30.426619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 447/929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/e5fcbce4-ac3d-423c-b3c2-4743f2cfe638 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:30.431284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.434397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.445983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.446483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.446922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.447654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.448114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.451545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.677187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c32a062b-dae5-415e-b036-628ed5b46d3c tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1616 microversion: 2.1 time: 0.254133 Oct 31 15:17:30.680290 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 483/930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1616 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:30.706968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.707621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.724493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.726610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.727541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.728318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.728806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.729235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.783472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.784352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.794727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.796101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.799831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.806042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.807959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.808684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.047725 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6389dd3b-5f0a-41a3-b7b9-952309fc105d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1616 microversion: 2.1 time: 0.345023 Oct 31 15:17:31.048876 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 448/931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1616 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.065397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.066330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.080055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.080755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.083571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.084667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.085232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.085726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.161954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.177236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ecad3d20-1078-4346-974a-1293b707ec52 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.398849 Oct 31 15:17:31.178964 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 484/932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.186642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.195184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'host': 'n-h2-858383-17', 'deleted': False} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:31.200514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.201892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.202523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.203422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.203844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.205152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.205582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.215296 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0cbcb526-e2dc-4007-9488-31b4d2186741 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1236 microversion: 2.1 time: 0.165049 Oct 31 15:17:31.230247 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 449/933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1236 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.241531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.242468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.249545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.250522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.251314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.252274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.252915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.253553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.259426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:31.330526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:17:31.399064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:31.420148 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b237b9e-c4f6-4635-9b07-b7148f9484a2 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=n-h2-858383-17&all_tenants=1" status: 200 len: 1990 microversion: 2.1 time: 0.239877 Oct 31 15:17:31.421206 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 485/934] 10.222.0.48 () {58 vars in 1192 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers?host=n-h2-858383-17&all_tenants=1 => generated 1990 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.429431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9590a02-6009-446b-a554-ebe3c9159db8 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.452384 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9590a02-6009-446b-a554-ebe3c9159db8 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/298499287" status: 202 len: 0 microversion: 2.1 time: 0.029724 Oct 31 15:17:31.453764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 486/935] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:17:31 2022] DELETE /compute/v2.1/flavors/298499287 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:31.460271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.468186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:31.474496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.475421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.476006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.476944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.478140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.478750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.503516 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0454490-edd7-42c5-ab0c-138f1f97a4cc tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.048187 Oct 31 15:17:31.513697 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 487/936] 10.222.0.48 () {58 vars in 1196 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:31.513697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b8938ac-a979-43fb-82c4-3fa5c8b697e6 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.538073 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b8938ac-a979-43fb-82c4-3fa5c8b697e6 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.031506 Oct 31 15:17:31.552720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 488/937] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.552720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:31.552720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.558712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.559844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.560450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.561481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.561942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.562361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.563213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.572269 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0d80848-ece2-4e4f-b012-bdc96b10d0d7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1316 microversion: 2.1 time: 0.340462 Oct 31 15:17:31.572872 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 450/938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.588675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ac36a4c-6cc9-4c5f-a15b-3ea6c88e2780 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.622800 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2ac36a4c-6cc9-4c5f-a15b-3ea6c88e2780 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/686017506" status: 202 len: 0 microversion: 2.1 time: 0.048407 Oct 31 15:17:31.626843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 451/939] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:17:31 2022] DELETE /compute/v2.1/flavors/686017506 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:31.633108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5e1ece9-07d0-4f20-87a4-3e8df8717223 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.655059 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5e1ece9-07d0-4f20-87a4-3e8df8717223 tempest-ServersWithSpecificFlavorTestJSON-1486352093 tempest-ServersWithSpecificFlavorTestJSON-1486352093-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026903 Oct 31 15:17:31.656063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 452/940] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:31.693729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.694077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.701253 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19956ea4-ba79-44c4-bcf9-d931a5e58269 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 0 microversion: 2.1 time: 0.160350 Oct 31 15:17:31.705095 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 489/941] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:31 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:31.714868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.718695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:31.719791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.720265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.721222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.721913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.722805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.723157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.734944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.735446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.735891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.736724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.737212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.737639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.752647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d HTTP/1.1 Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:31.769691 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.771887 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '48d59103-18f0-4bb0-ba16-2907d512fa5d'} Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:31.772965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.775262 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.778381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:31.778381 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0285252-8694-44ac-81a5-7acb4b35c28b tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 404 len: 111 microversion: 2.1 time: 0.092865 Oct 31 15:17:31.780713 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 453/942] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:31 2022] DELETE /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:17:31.789260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.791921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 48d59103-18f0-4bb0-ba16-2907d512fa5d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.798457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.799155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.799758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.820208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.825303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.826203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.854318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d HTTP/1.1 Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:31.856190 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.857740 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '48d59103-18f0-4bb0-ba16-2907d512fa5d'} Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:31.858574 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. Oct 31 15:17:31.859927 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.861210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 48d59103-18f0-4bb0-ba16-2907d512fa5d could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:31.861210 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67698949-3714-4d07-a991-6cd009fd303a tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d" status: 404 len: 111 microversion: 2.1 time: 0.075686 Oct 31 15:17:31.861819 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 454/943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers/48d59103-18f0-4bb0-ba16-2907d512fa5d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:31.866889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.867380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.874047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.874775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.875351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.876068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.876520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.877530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.893680 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd HTTP/1.1 Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:31.895249 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.897302 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '493610b0-1112-44d9-9df3-ad5800017cbd'} Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:31.898166 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.899551 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.900950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:31.900950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:31.900950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:31.900950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:31.901681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:31.902741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-787f97cb-241e-42bf-906e-9f660e7d5d98 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 404 len: 111 microversion: 2.1 time: 0.039949 Oct 31 15:17:31.903648 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 455/944] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:31 2022] DELETE /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:31.905245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:31.912963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.913579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] [instance: 493610b0-1112-44d9-9df3-ad5800017cbd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.929510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.930086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.930523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.934836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.935413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.935853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.955347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] HTTP exception thrown: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Request method failure captured: Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd HTTP/1.1 Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z2JXizJGhuRFbBB07_Bqo43gg5Eku6AvVXDmPxThLodhuX1QosgSyX99oYC9HkkmDaAjgL0qavwW1ES0I88ep4LOxSq0EGIDpuGuxfHm9LXtRNy3ZENB6NfP8l1eNmz7ikYLtrCG8HoZl8vGLssUYdLamdm1W5mKZof2U5qr8dlf4 Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:31.957418 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7b5e7bae2ce41279db848f24326b3ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e7b5e7bae2ce41279db848f24326b3ee Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583 Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9b24aa0edeef4cf58c624bee5f7478fb Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-116048583-project Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.959801 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '493610b0-1112-44d9-9df3-ad5800017cbd'} Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:31.960594 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. Oct 31 15:17:31.961871 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:31.962900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] Returning 404 to user: Instance 493610b0-1112-44d9-9df3-ad5800017cbd could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:31.962900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae27d3d8-a154-4245-aef0-57d2c1ce3242 tempest-ServersWithSpecificFlavorTestJSON-116048583 tempest-ServersWithSpecificFlavorTestJSON-116048583-project] 10.222.0.48 "GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd" status: 404 len: 111 microversion: 2.1 time: 0.051413 Oct 31 15:17:31.962900 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 456/945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers/493610b0-1112-44d9-9df3-ad5800017cbd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:17:32.050605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.059199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.059775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.060279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.061113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.061646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.062187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.096516 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ceb6e08-919f-4fc5-941b-a3d4a8de521f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 1067 microversion: 2.1 time: 0.384327 Oct 31 15:17:32.097780 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 490/946] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:31 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 1067 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 31 15:17:32.123559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.125383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.136321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.137264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.138002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.138940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.139648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.140353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.205637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.206435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.245435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.246266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.249723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.252250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.256034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.257147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.502309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.512488 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-debd4645-6933-4afe-ae48-612843786b96 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.394588 Oct 31 15:17:32.518441 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 457/947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:32.532308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.533322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.547154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.557298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.557928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.558869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.559355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.559964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.625662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.640393 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8f14ea5-86ac-4209-9d30-78b860c89c61 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.439860 Oct 31 15:17:32.657984 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 491/948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:32.666269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.668142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.675522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.676304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.676953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.678445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.679259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.680620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.074686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:33.116257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd1a97f0-dc1e-4a2f-879d-28dcac32f0ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1466 microversion: 2.1 time: 0.454483 Oct 31 15:17:33.118208 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 492/949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1466 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:33.142115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:33.143657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:33.146446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:33.153707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.154595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.155329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.156255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.156959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.157792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.258216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:33.274667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb407f81-9f70-4d18-92c5-a0626f45a871 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1304 microversion: 2.1 time: 0.754835 Oct 31 15:17:33.276092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 458/950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1304 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:33.543230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:33.544130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:33.555156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.556988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.561828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.562899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.563757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.564530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.156094 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d446ed90-9598-4055-b5bf-da1928ad2b69 tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1619 microversion: 2.1 time: 1.014400 Oct 31 15:17:34.188627 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 493/951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:33 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1619 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:34.206891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:34.212811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:34.220613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.221172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.221654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.222684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.223312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.224732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.411213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:34.436977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9d2aefd-018d-44b2-aa8e-b1891547d45a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.895125 Oct 31 15:17:34.437604 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 459/952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:33 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:34.458645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:34.466997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:34.487750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.488242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.490640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.498341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.498341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.498341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.701858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:34.710889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd3ca51a-daec-47ec-8c22-680789156744 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.520927 Oct 31 15:17:34.724948 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 494/953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:34 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:34.732583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1910897395", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:34.852383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:35.315553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:35.325317 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4b63a43-363a-4b71-976b-f44716598672 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1304 microversion: 2.1 time: 0.886532 Oct 31 15:17:35.337588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 460/954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:34 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1304 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:35.734475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:35.735042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:35.735695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:35.736000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:35.736526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:35.767425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.772045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.772499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.778682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.779431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.784309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.855256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:35.870756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:35.916355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:35.921697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:35.959100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eeb27c0f-f8b9-48db-b73f-0a716a7f31d6 tempest-NetworksTest-1507161614 tempest-NetworksTest-1507161614-project-admin] Calling method '.version_select at 0x7f5ca240d430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:36.086360 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a500a803-66e1-40fa-8996-ed840b054473 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365630 Oct 31 15:17:36.097400 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 495/955] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:36.105838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:36.112528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:36.131735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.133261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.135811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.138995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.140873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.141304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.712686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:36.762787 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a2d2c4e-5ac3-4696-ac8f-f4849a94a515 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.669631 Oct 31 15:17:36.764343 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 496/956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:36 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:36.781080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:36.781993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:36.795794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.796601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.797674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.798601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.799365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.800270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.896161 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eeb27c0f-f8b9-48db-b73f-0a716a7f31d6 tempest-NetworksTest-1507161614 tempest-NetworksTest-1507161614-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 5397 microversion: 2.1 time: 1.556406 Oct 31 15:17:36.896780 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 461/957] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:35 2022] GET /compute/v2.1/os-networks => generated 5397 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:36.901692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-752e0bdd-3e3f-477b-967c-df03464772df tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:36.902503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-752e0bdd-3e3f-477b-967c-df03464772df tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:37.210155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-752e0bdd-3e3f-477b-967c-df03464772df tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:37.221477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-752e0bdd-3e3f-477b-967c-df03464772df tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1217 microversion: 2.1 time: 0.322471 Oct 31 15:17:37.224623 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 462/958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:36 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1217 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:37.235749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.237885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:37.263403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.266611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.267387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.268482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.272255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.273191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.927015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:37.940273 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f41dc62-50b0-44cb-8d3e-b8314d29dffb tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 1.166527 Oct 31 15:17:37.941230 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 497/959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:36 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:37.951036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b0f25706-1a03-4578-ab94-cb78b7d3a5d9 req-f2cc4e29-b6d7-4d15-9991-ad6807d3d1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968b5ef7-db40-4099-ab2e-f20a844049d7", "tag": "b09d4455-f914-4d85-9b6e-c4fd93ebeafe"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:37.974685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0f25706-1a03-4578-ab94-cb78b7d3a5d9 req-f2cc4e29-b6d7-4d15-9991-ad6807d3d1ca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.975549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0f25706-1a03-4578-ab94-cb78b7d3a5d9 req-f2cc4e29-b6d7-4d15-9991-ad6807d3d1ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.976223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0f25706-1a03-4578-ab94-cb78b7d3a5d9 req-f2cc4e29-b6d7-4d15-9991-ad6807d3d1ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.997876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.013690 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-65147aaf-3073-4345-bd43-804fd5dd865a tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1304 microversion: 2.1 time: 0.787478 Oct 31 15:17:38.014486 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 463/960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:37 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1304 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:38.017666 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b0f25706-1a03-4578-ab94-cb78b7d3a5d9 req-f2cc4e29-b6d7-4d15-9991-ad6807d3d1ca service nova] Creating event network-changed:b09d4455-f914-4d85-9b6e-c4fd93ebeafe for instance 968b5ef7-db40-4099-ab2e-f20a844049d7 on n-h2-858383-17 Oct 31 15:17:38.041273 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b0f25706-1a03-4578-ab94-cb78b7d3a5d9 req-f2cc4e29-b6d7-4d15-9991-ad6807d3d1ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098650 Oct 31 15:17:38.043467 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 498/961] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:38.057554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68bb6871-dae6-4131-a23b-72044a8307a2 tempest-NetworksTest-1507161614 tempest-NetworksTest-1507161614-project-admin] Calling method '.version_select at 0x7f5ca25e1820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.269801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.280618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.286416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.287129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.288429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.289152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.289793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.303321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=15 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:38.368894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5cb74daf-f83b-4606-be7e-5b438fac0a0d tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.353511 Oct 31 15:17:38.372471 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 464/962] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:38.380872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.382552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:38.401150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.401939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.402717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.403765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.404436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.405045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.422590 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68bb6871-dae6-4131-a23b-72044a8307a2 tempest-NetworksTest-1507161614 tempest-NetworksTest-1507161614-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks/ca869cd7-f8cf-416b-b96d-ecb055e8c307" status: 200 len: 652 microversion: 2.1 time: 0.375365 Oct 31 15:17:38.425446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 499/963] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/os-networks/ca869cd7-f8cf-416b-b96d-ecb055e8c307 => generated 652 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:38.442042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.446197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:38.455518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.456832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.457431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.458809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.460007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.460668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.702492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.715481 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcfdadb5-8a6f-490d-af2f-f943878b3ef4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1277 microversion: 2.1 time: 0.288670 Oct 31 15:17:38.722108 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 500/964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1277 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:38.730847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.734426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.734918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.735360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.736107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.736570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.737023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.799896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.805213 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47560fb0-1074-4511-ae01-f8d2ab8efef3 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.082065 Oct 31 15:17:38.806447 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 501/965] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:38.808551 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d8988755-263b-4f93-b525-886fce8b9e65 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.434129 Oct 31 15:17:38.813623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8760f43-e0ae-4aa4-bb44-3764629876db tempest-NetworksTest-1507161614 tempest-NetworksTest-1507161614-project-admin] Calling method '.version_select at 0x7f5ca2457e50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.816038 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 465/966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:38.821201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.824735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.825205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.825635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.826351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.826797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.827212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.875614 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fb595cab-af06-45e3-b51b-472e6f778bff tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.058428 Oct 31 15:17:38.877671 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 466/967] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/os-services => generated 949 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:38.892590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.914645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.915701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.917533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.923647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.924517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.925179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.969464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ac034e7-8fa7-416a-9a57-f4af0d03d9bc tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-858383-17&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.082178 Oct 31 15:17:38.972514 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 467/968] 10.222.0.48 () {58 vars in 1196 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/os-services?host=n-d-858383-17&binary=xxx => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:38.978657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.979916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:38.987818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.988869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.989981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.992447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.992447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.993051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.077596 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8760f43-e0ae-4aa4-bb44-3764629876db tempest-NetworksTest-1507161614 tempest-NetworksTest-1507161614-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 4702 microversion: 2.1 time: 0.269871 Oct 31 15:17:39.078807 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 502/969] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/os-networks => generated 4702 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:39.084191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.087873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.088356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.101065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.102328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.102820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.103323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.170672 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05a13139-c160-47a6-a892-33a10843b88a tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.089790 Oct 31 15:17:39.172065 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 503/970] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:39.185431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.187607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:39.203094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.205500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.206188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.210209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.211464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.212095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.812409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:39.845049 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df798d77-cd98-48bd-9b9c-da2658301ac8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.869283 Oct 31 15:17:39.847498 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 468/971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:39.867993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d60cef5a-1e20-403f-8f1c-d03a6ffca2d8 req-e41de96a-c68d-4ce8-bcd5-e9790de26da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09142860-c91f-4a33-b580-e1288ecae4bd", "name": "network-vif-plugged", "status": "completed", "tag": "02a04c3f-55f1-45d0-9693-0d91bb15b3fd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:39.886630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d60cef5a-1e20-403f-8f1c-d03a6ffca2d8 req-e41de96a-c68d-4ce8-bcd5-e9790de26da8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.888125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d60cef5a-1e20-403f-8f1c-d03a6ffca2d8 req-e41de96a-c68d-4ce8-bcd5-e9790de26da8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.889020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d60cef5a-1e20-403f-8f1c-d03a6ffca2d8 req-e41de96a-c68d-4ce8-bcd5-e9790de26da8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.907302 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d60cef5a-1e20-403f-8f1c-d03a6ffca2d8 req-e41de96a-c68d-4ce8-bcd5-e9790de26da8 service nova] Creating event network-vif-plugged:02a04c3f-55f1-45d0-9693-0d91bb15b3fd for instance 09142860-c91f-4a33-b580-e1288ecae4bd on n-h1-858383-17 Oct 31 15:17:39.914606 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d60cef5a-1e20-403f-8f1c-d03a6ffca2d8 req-e41de96a-c68d-4ce8-bcd5-e9790de26da8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062216 Oct 31 15:17:39.919807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 469/972] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:39.925876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.931228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.932618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.933713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.935279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.935969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.936824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.939578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:39.951403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3535e94-3cf4-4406-be15-dcefb43514ae tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1304 microversion: 2.1 time: 0.777719 Oct 31 15:17:39.952565 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 504/973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1304 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:39.957500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.959081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:39.965855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.966695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.967289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.968290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.969272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.969857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.055252 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0bf8623a-4c6c-4ffb-ae9b-24e8ceb84c19 tempest-ServicesAdminNegativeTestJSON-611865176 tempest-ServicesAdminNegativeTestJSON-611865176-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.129242 Oct 31 15:17:40.057599 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 470/974] 10.222.0.48 () {58 vars in 1198 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:40.075344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:40.076013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:40.086241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:40.088622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:40.089661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.090704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:40.091594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:40.092422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.100008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:40.108955 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84a5b97b-8f27-4913-9179-c43802fe47ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1275 microversion: 2.1 time: 0.155128 Oct 31 15:17:40.109531 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 505/975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:40.319826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:40.328569 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d9c32c8-723f-41ee-86be-85ae016a210a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.260647 Oct 31 15:17:40.333921 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 471/976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:40 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:40.411451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fd47c87-f32b-43dd-b099-31cf3199cb5b tempest-ServicesAdminNegativeTestJSON-704182456 tempest-ServicesAdminNegativeTestJSON-704182456-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:40.417770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3fd47c87-f32b-43dd-b099-31cf3199cb5b tempest-ServicesAdminNegativeTestJSON-704182456 tempest-ServicesAdminNegativeTestJSON-704182456-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0112820303dc4f7eac2782405143c98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7407f953cb774fafa85b5b89faef2b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fd47c87-f32b-43dd-b099-31cf3199cb5b tempest-ServicesAdminNegativeTestJSON-704182456 tempest-ServicesAdminNegativeTestJSON-704182456-project] Request method failure captured: Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cPsGHwVusKp2V1X74yHCof0P2VRtFSmc_5wp56yKm3UscNnqFXIp_smDBFRNO4DUGt3YbJzfj4qvKdAa0Mh2Kn7LT3FGVXJax_MUT-Sm1Jpr2S6x7zofXXy-c5R0L6sD8uLjUlLhjkkJ7Lk3CwZQRFYbPeVgFwzhxZ0E7FNhPJLOk Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 7407f953cb774fafa85b5b89faef2b2e Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-704182456 Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:17:40.423562 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7407f953cb774fafa85b5b89faef2b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7407f953cb774fafa85b5b89faef2b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7407f953cb774fafa85b5b89faef2b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7407f953cb774fafa85b5b89faef2b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-704182456 Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 7407f953cb774fafa85b5b89faef2b2e Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-704182456 Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServicesAdminNegativeTestJSON-704182456-project Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0112820303dc4f7eac2782405143c98a Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-704182456-project Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:17:40.426314 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:40.428026 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:17:40.431863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:40.433414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fd47c87-f32b-43dd-b099-31cf3199cb5b tempest-ServicesAdminNegativeTestJSON-704182456 tempest-ServicesAdminNegativeTestJSON-704182456-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:40.433414 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3fd47c87-f32b-43dd-b099-31cf3199cb5b tempest-ServicesAdminNegativeTestJSON-704182456 tempest-ServicesAdminNegativeTestJSON-704182456-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.316211 Oct 31 15:17:40.450286 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 506/977] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 338 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:40.876758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:40.877555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:40.897502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:40.899765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:40.901693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.905817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:40.908838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:40.909992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.983557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:40.984658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:41.017903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.018652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.019420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.022182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.022963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.023406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.064411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:41.316996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:41.346219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98b2aa96-12f8-4f17-9b84-9e32d58936f1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1311 microversion: 2.1 time: 0.474218 Oct 31 15:17:41.354939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 472/978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:40 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1311 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:41.377588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:41.383259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:41.415847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.416405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.416872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.429059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.430364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.431388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.657258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:41.680522 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea812f46-78e9-40b4-b9e8-6c82b587cd27 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1304 microversion: 2.1 time: 0.703969 Oct 31 15:17:41.681420 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 507/979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:40 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1304 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:41.696791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:41.698780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:41.707962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.709814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.710255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.711695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.712359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.712981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.920771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:41.942146 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab0efd7c-0faf-4618-9dae-15bfafb99ae0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.584111 Oct 31 15:17:41.944300 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 473/980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:41 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:42.070778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:42.085175 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-428a11eb-4208-46ff-aabd-da2447e8b3f9 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.402188 Oct 31 15:17:42.086742 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 508/981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:41 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:42.378814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:42.379439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:42.389457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.391247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.392923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.393918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.395009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.396406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.703535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:42.704865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:42.716077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.717398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.718087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.721335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.722746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.723135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:42.725039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.736828 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3e7201c-8f24-4182-b196-2a4904c923c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1460 microversion: 2.1 time: 0.362502 Oct 31 15:17:42.740719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 474/982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:42 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1460 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:42.763907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:42.766892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:42.774494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.776089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.776791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.777723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.778676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.779324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.973282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:42.980556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Old instance type m1.heat2, new instance type m1.heat {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:17:42.981336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:42.996844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4effada9-eaa8-4bf7-a360-b184df9a70cd tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.297023 Oct 31 15:17:42.997920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 509/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:42 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:43.003035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:43.003650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:43.004046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:43.004639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:43.008606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:43.009140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:43.009644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:43.012996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.013753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.014381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.015926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.016598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.017231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.225204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.239053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75aab163-f9b5-4b03-9a49-0d19947070e6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.239823 Oct 31 15:17:43.241368 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 510/984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:42 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:43.246780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:43.247591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:43.253157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:43.256287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.257080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.257798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.258735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.259623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.260231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.322637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38eb0322-2362-4650-b343-9a00d2f748db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd/action" status: 202 len: 0 microversion: 2.1 time: 0.561344 Oct 31 15:17:43.323279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 475/985] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:42 2022] POST /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:17:43.331651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:43.332547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:43.358671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.359171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.359603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.360378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.360876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.361296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.662791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.676074 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1736be72-a28d-46b2-9663-8a9006b3d04f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1469 microversion: 2.1 time: 0.346170 Oct 31 15:17:43.680595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.688230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 476/986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:43 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:43.691050 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52e27798-b6c8-4caf-95a8-1496c7269652 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.448461 Oct 31 15:17:43.694091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 511/987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:43 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:43.696105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6c8112db-b40a-4ef1-9993-af6c189b9b81 req-21cecc70-4ca7-4a09-9580-3aee81d3225c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab331d4-e68d-40dc-9638-67a4dae2bd42", "tag": "1f86272c-f4b9-4f4d-a7c7-d7dbea179058"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:43.706316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c8112db-b40a-4ef1-9993-af6c189b9b81 req-21cecc70-4ca7-4a09-9580-3aee81d3225c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.706996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c8112db-b40a-4ef1-9993-af6c189b9b81 req-21cecc70-4ca7-4a09-9580-3aee81d3225c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.707574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c8112db-b40a-4ef1-9993-af6c189b9b81 req-21cecc70-4ca7-4a09-9580-3aee81d3225c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.731829 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6c8112db-b40a-4ef1-9993-af6c189b9b81 req-21cecc70-4ca7-4a09-9580-3aee81d3225c service nova] Creating event network-changed:1f86272c-f4b9-4f4d-a7c7-d7dbea179058 for instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 on n-h2-858383-17 Oct 31 15:17:43.737575 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6c8112db-b40a-4ef1-9993-af6c189b9b81 req-21cecc70-4ca7-4a09-9580-3aee81d3225c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047945 Oct 31 15:17:43.738768 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 477/988] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:44.028331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.029002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:44.045564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.046117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.046808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.047888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.048400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.048923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.287715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.290467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:44.311636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.315408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.316088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.329602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.334038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.335482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.344862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:44.354946 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e68bfb90-875d-43e1-9c3a-37eb3f075e34 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.333216 Oct 31 15:17:44.356331 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 512/989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:44 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:44.569049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:44.578971 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6205b80d-381d-48c6-8b98-d4d8ae87671c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.315204 Oct 31 15:17:44.592735 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 478/990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:44 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:44.719059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.720028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.720825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:44.722856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:44.736181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.737819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.738789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.740414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.741237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.741679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.742415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.744755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.744755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.745437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.746501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.746885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.022208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:45.036747 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7402ca1f-2636-4a58-b7c8-732990031930 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1469 microversion: 2.1 time: 0.329175 Oct 31 15:17:45.040915 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 513/991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:44 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:45.137644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:45.146057 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d05db92-cbda-40dc-b1a4-218c6fee3084 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.432339 Oct 31 15:17:45.149362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 479/992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:44 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:45.383808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:45.384463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:45.402317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:45.410602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:45.414251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:45.416348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.417362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:45.417905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:45.419841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.447348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e783361-9b27-41a9-9ad7-01c8ffa86a29 tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] Calling method '.version_select at 0x7f5ca2461a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:45.482224 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e783361-9b27-41a9-9ad7-01c8ffa86a29 tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.438256 Oct 31 15:17:45.490874 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 514/993] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:17:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:45.500786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ce23843-1b41-4f35-a65a-403aa662834d tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2461d30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:45.837372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:45.847244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-202bd711-cf10-4557-8509-e9adec7254ef tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.471820 Oct 31 15:17:45.861053 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 480/994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:45 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:45.861053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:45.861053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:45.862099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:45.862953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:45.863627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.865497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:45.866228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:45.866874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.944777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=12,nova_api:UPDATE=9 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:46.063034 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ce23843-1b41-4f35-a65a-403aa662834d tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.567156 Oct 31 15:17:46.063991 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 515/995] 10.222.0.48 () {60 vars in 1206 bytes} [Mon Oct 31 15:17:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:46.070007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.071114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:46.078155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.079239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.079947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.081844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.082787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.083880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.256644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.265136 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f033886-6cbb-4d0b-a48a-f8e9ba9bbe34 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.414130 Oct 31 15:17:46.266274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 481/996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:45 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:46.271159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-30750041-48d6-4ff3-8c9e-9dc095bae563 tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] Calling method '.version_select at 0x7f5ca2425940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.292165 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-30750041-48d6-4ff3-8c9e-9dc095bae563 tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.024562 Oct 31 15:17:46.299889 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 482/997] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:46.299889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.299889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:46.306239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.306738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.307179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.307890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.308356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.308931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.564880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.587712 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ad739ce-f26d-407f-9e15-f391ddb60d6e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1469 microversion: 2.1 time: 0.522588 Oct 31 15:17:46.590681 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 516/998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:46.595356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14a515b8-7c6b-4dba-9db6-68220cbc21b9 tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2461550>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:46.670847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.684833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ccfa0d4-cc64-4642-942f-0dc9a0c07fef tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.390984 Oct 31 15:17:46.686255 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 483/999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:46.753126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14a515b8-7c6b-4dba-9db6-68220cbc21b9 tempest-QuotaClassesAdminTestJSON-1825824214 tempest-QuotaClassesAdminTestJSON-1825824214-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.160939 Oct 31 15:17:46.763064 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 517/1000] 10.222.0.48 () {60 vars in 1206 bytes} [Mon Oct 31 15:17:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:46.875849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.876956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:46.885861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.886696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.887346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.888280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.889105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.889769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.289066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:47.291032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:47.300484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.306093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.307235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.308278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.312053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.312834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.370087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:47.378220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc0f0565-22c6-42fc-8737-0b6f8727f76b tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.507478 Oct 31 15:17:47.378797 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 484/1001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:47.616962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:47.617687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:47.628454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.628965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.629421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.630825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.631278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.633015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.951912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:47.970749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f09c1a00-3786-4515-95d3-7b383007b785 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.686801 Oct 31 15:17:47.975007 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 518/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:47 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:47.985467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:47.986902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:48.000739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.001631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.002313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.004992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.006929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.008549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.178545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:48.196232 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-efcf67a4-4bd8-43a2-a61c-13d8dfbd5e76 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1469 microversion: 2.1 time: 0.586698 Oct 31 15:17:48.197403 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 485/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:47 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1469 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:48.289561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:48.314175 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ebdc165-857b-4e6d-97e5-391f5eb92279 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.336378 Oct 31 15:17:48.315933 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 519/1004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:47 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:48.403751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:48.404560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:48.415667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.416354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.419155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.420081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.421255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.429354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.681223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:48.709001 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-019883a8-e60d-4f17-9def-f1ce0cf53d6d tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.304068 Oct 31 15:17:48.711206 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 486/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:48 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:49.001010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.002327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:49.018271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.019094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.019543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.020819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.021448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.022250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.127120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=14 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:49.220019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.221252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:49.231007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.231539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.231943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.232651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.233135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.233556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.298950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:49.307343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37c94340-87bc-4562-813e-da857cf86d5c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.311764 Oct 31 15:17:49.307942 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 520/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:48 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:49.338518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.339451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:49.345781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.346262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.346914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.347955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.349413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.350058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.727858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:49.739227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcf8ae44-7608-47ea-b5fd-6f71438a173c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.521213 Oct 31 15:17:49.761925 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 487/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:49 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:49.764065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d79f81cb-bb42-4041-aad6-7cfd3d413663 req-aef7dbbd-379e-4678-9eb5-41cf11d17c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab331d4-e68d-40dc-9638-67a4dae2bd42", "name": "network-vif-plugged", "status": "completed", "tag": "1f86272c-f4b9-4f4d-a7c7-d7dbea179058"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:49.787942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d79f81cb-bb42-4041-aad6-7cfd3d413663 req-aef7dbbd-379e-4678-9eb5-41cf11d17c07 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.788475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d79f81cb-bb42-4041-aad6-7cfd3d413663 req-aef7dbbd-379e-4678-9eb5-41cf11d17c07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.788938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d79f81cb-bb42-4041-aad6-7cfd3d413663 req-aef7dbbd-379e-4678-9eb5-41cf11d17c07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.802809 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d79f81cb-bb42-4041-aad6-7cfd3d413663 req-aef7dbbd-379e-4678-9eb5-41cf11d17c07 service nova] Creating event network-vif-plugged:1f86272c-f4b9-4f4d-a7c7-d7dbea179058 for instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 on n-h2-858383-17 Oct 31 15:17:49.818013 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d79f81cb-bb42-4041-aad6-7cfd3d413663 req-aef7dbbd-379e-4678-9eb5-41cf11d17c07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058049 Oct 31 15:17:49.818648 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 488/1008] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:49.831159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:49.835108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.836076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:49.840118 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f321695d-67e2-4eca-8b39-a087bd757063 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1471 microversion: 2.1 time: 0.506145 Oct 31 15:17:49.852816 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 521/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:49 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1471 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:49.861262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.861915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.862412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.863255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.864245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.864752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.952186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:50.076413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:50.084846 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-74ba0ec8-8a65-4e3e-bf9a-c96c27b03e48 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.254433 Oct 31 15:17:50.085431 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 489/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:49 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:50.331123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.333531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.340679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.341438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.342086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.343039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.343626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.344163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.545198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:50.553440 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-234e8a55-19e7-459b-bc35-85db9eb01634 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.225994 Oct 31 15:17:50.554048 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 522/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:50.773765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.775215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.789525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.790630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.793958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.795012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.798565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.799240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.869667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.870673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.888847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.889463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.889984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.891959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.896686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.897508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.438020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:51.450713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3f92cc27-1b61-459e-9407-9b95b9af8f07 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.681928 Oct 31 15:17:51.474880 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 490/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.480291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:51.490770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:51.497580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.498195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.499938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.500850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.503149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.503836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.563904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:51.573026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5308be45-35c9-4758-ab75-1e2802b3c286 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1489 microversion: 2.1 time: 0.709452 Oct 31 15:17:51.588724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 523/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1489 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.588724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ca73be6-128c-4817-b0cf-b174dff5f975 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca247aee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:51.662265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ca73be6-128c-4817-b0cf-b174dff5f975 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb" status: 200 len: 635 microversion: 2.1 time: 0.085435 Oct 31 15:17:51.663433 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 524/1014] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:51 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb => generated 635 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:51.677608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:51.678226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:51.686141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.686632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.689469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.690526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.691273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.694605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.876685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:51.887405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5bee1eaf-b25b-4232-be56-471df2b843fb tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.411261 Oct 31 15:17:51.901915 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 491/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:51 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.913591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08055e6c-c53c-479e-9eec-6ef1f4ba0af0 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca22e3280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:51.972494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:51.979881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-08055e6c-c53c-479e-9eec-6ef1f4ba0af0 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:51.982624 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-854ac017-d08b-4b9f-87db-b274dd20a122 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1317 microversion: 2.1 time: 0.317998 Oct 31 15:17:51.983214 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 525/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:51 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.987176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-08055e6c-c53c-479e-9eec-6ef1f4ba0af0 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:52.202143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce93c1c4-7561-4375-9d60-e45b14035f28 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1433940167", "id": 1675928617, "os-flavor-access:is_public": "False"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:52.237146 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce93c1c4-7561-4375-9d60-e45b14035f28 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.252838 Oct 31 15:17:52.239453 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 526/1017] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:51 2022] POST /compute/v2.1/flavors => generated 439 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:52.251834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af8b0f6b-60de-426a-9fda-e0bf3324ace5 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:52.395856 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af8b0f6b-60de-426a-9fda-e0bf3324ace5 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1675928617/action" status: 200 len: 97 microversion: 2.1 time: 0.147300 Oct 31 15:17:52.401681 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 527/1018] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Oct 31 15:17:52 2022] POST /compute/v2.1/flavors/1675928617/action => generated 97 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:17:52.406451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e408dac-0716-48ad-94bb-4c298ad62489 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:52.424390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08055e6c-c53c-479e-9eec-6ef1f4ba0af0 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.520091 Oct 31 15:17:52.425431 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 492/1019] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:51 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:52.435482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a38f5bfc-1694-4e0b-8fd9-493819c455b3 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca24258b0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.506295 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0e408dac-0716-48ad-94bb-4c298ad62489 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 02a0f829ac8e4cd3907ba37f6a3ec45f combination. Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e408dac-0716-48ad-94bb-4c298ad62489 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Request method failure captured: Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/flavors/1675928617/action HTTP/1.1 Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 67 Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ceumiTj_7eKolbkL9LoGvOyBKQbTskzlCtlPT0IWzdgAYNxfRV_E3kMG26H2oN-pvvrR3z13EmKqlIv0oeOEDETyJK3YwO-0xieXNjrznMmXn7vuop_WRhb0MHXTKbqlWfQjZr6OJLFQj20-0Mhp_RoxthonQIwprIrkgcvYdSbzw Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 92648d3624ec4ab5868ff76ca4029fc1 Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:17:52.509405 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 92648d3624ec4ab5868ff76ca4029fc1 Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bc21124698334cde9b507d47bc3f33f3 Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: {"addTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} Oct 31 15:17:52.511022 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor access already exists for flavor 34 and project 02a0f829ac8e4cd3907ba37f6a3ec45f combination. Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '1675928617', 'body': {'addTenantAccess': {'tenant': '02a0f829ac8e4cd3907ba37f6a3ec45f'}}} Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:17:52.511928 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-02a0f829ac8e4cd3907ba37f6a3ec45f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:17:52.513253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:17:52.514621 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:17:52.515955 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-02a0f829ac8e4cd3907ba37f6a3ec45f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 15, 17, 52, 497984), 'updated_at': None, 'flavor_id': 34, 'project_id': '02a0f829ac8e4cd3907ba37f6a3ec45f'}] Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:52.517633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 02a0f829ac8e4cd3907ba37f6a3ec45f combination. Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:52.523128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 02a0f829ac8e4cd3907ba37f6a3ec45f combination. Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:52.524586 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:52.525908 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 02a0f829ac8e4cd3907ba37f6a3ec45f combination. Oct 31 15:17:52.525908 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:52.525908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e408dac-0716-48ad-94bb-4c298ad62489 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 02a0f829ac8e4cd3907ba37f6a3ec45f combination. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:52.525908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e408dac-0716-48ad-94bb-4c298ad62489 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1675928617/action" status: 409 len: 152 microversion: 2.1 time: 0.108160 Oct 31 15:17:52.525908 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 528/1020] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Oct 31 15:17:52 2022] POST /compute/v2.1/flavors/1675928617/action => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:17:52.525908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.526731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:52.529935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.530705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.531380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.532083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.532538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.533140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.789025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:52.798549 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3972f808-8d7e-4bf3-9437-753980bbaf70 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.282415 Oct 31 15:17:52.802416 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 529/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:52.807113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ee3c118-1b9f-4895-abe0-1d1f9c872d8c tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:52.823637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a38f5bfc-1694-4e0b-8fd9-493819c455b3 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "DELETE /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.391813 Oct 31 15:17:52.826239 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 493/1022] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Oct 31 15:17:52 2022] DELETE /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata/os_version => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:17:52.834561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.838134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:52.859350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.859908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.860348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.861303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.861770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.862245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.913993 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ee3c118-1b9f-4895-abe0-1d1f9c872d8c tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1675928617/action" status: 200 len: 21 microversion: 2.1 time: 0.110348 Oct 31 15:17:52.919783 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 530/1023] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Oct 31 15:17:52 2022] POST /compute/v2.1/flavors/1675928617/action => generated 21 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:52.925683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-afe0388d-347a-40ca-812a-cb7cd29c64e4 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca24bcb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.971379 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-afe0388d-347a-40ca-812a-cb7cd29c64e4 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 37 microversion: 2.1 time: 0.050092 Oct 31 15:17:52.972235 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 531/1024] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 37 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:52.983342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.984272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:52.991249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.991959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.992500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.993338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.993905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.994438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.153996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:53.168922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67e43370-814a-4b37-b0be-c2772ff707e1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1477 microversion: 2.1 time: 0.341422 Oct 31 15:17:53.169893 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 494/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:53.176874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90689659-990e-4cde-a27e-0a7e406fca69 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:53.202713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90689659-990e-4cde-a27e-0a7e406fca69 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1675928617" status: 202 len: 0 microversion: 2.1 time: 0.031475 Oct 31 15:17:53.203604 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 495/1026] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:17:53 2022] DELETE /compute/v2.1/flavors/1675928617 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:53.209960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d02db0cf-b5f4-4c70-a359-483799144d53 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca2318040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:53.291011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d02db0cf-b5f4-4c70-a359-483799144d53 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:53.301699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:53.308514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d02db0cf-b5f4-4c70-a359-483799144d53 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:53.313980 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec8f1180-1599-4ecd-817e-6f3af5ba5092 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.338939 Oct 31 15:17:53.314901 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 532/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:53.334486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:53.335096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:53.346835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.349504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.350137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.352006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.353881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.354557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.362672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:53.662219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:53.679312 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93d9d0d2-019c-4684-aced-4bdd5d143f2b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1465 microversion: 2.1 time: 0.363132 Oct 31 15:17:53.679914 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 533/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:53 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1465 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:53.687987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d02db0cf-b5f4-4c70-a359-483799144d53 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.482591 Oct 31 15:17:53.689307 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 496/1029] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:53 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:53.691396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56d62a00-97d9-496f-bd56-b0b5ab488ad5 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:53.706712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:53.708470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:53.721000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.721947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.722622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.724220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.724965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.725493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.741098 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56d62a00-97d9-496f-bd56-b0b5ab488ad5 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055861 Oct 31 15:17:53.745046 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 534/1030] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:53.762369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d83702d2-4588-4781-9468-0fedca4fa2ac tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca24a91f0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:53.809848 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d83702d2-4588-4781-9468-0fedca4fa2ac tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.063250 Oct 31 15:17:53.810459 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 535/1031] 10.222.0.48 () {58 vars in 1290 bytes} [Mon Oct 31 15:17:53 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata/os_distro => generated 33 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:53.815067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f6d47ac8-9fcc-4f1f-8aec-b4953c08efa2 req-21eef8c8-cf3f-4530-9e72-063c4ed4002f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968b5ef7-db40-4099-ab2e-f20a844049d7", "name": "network-vif-plugged", "status": "completed", "tag": "b09d4455-f914-4d85-9b6e-c4fd93ebeafe"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:53.839694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f6d47ac8-9fcc-4f1f-8aec-b4953c08efa2 req-21eef8c8-cf3f-4530-9e72-063c4ed4002f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.840355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f6d47ac8-9fcc-4f1f-8aec-b4953c08efa2 req-21eef8c8-cf3f-4530-9e72-063c4ed4002f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.840923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f6d47ac8-9fcc-4f1f-8aec-b4953c08efa2 req-21eef8c8-cf3f-4530-9e72-063c4ed4002f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.859327 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f6d47ac8-9fcc-4f1f-8aec-b4953c08efa2 req-21eef8c8-cf3f-4530-9e72-063c4ed4002f service nova] Creating event network-vif-plugged:b09d4455-f914-4d85-9b6e-c4fd93ebeafe for instance 968b5ef7-db40-4099-ab2e-f20a844049d7 on n-h2-858383-17 Oct 31 15:17:53.865124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f6d47ac8-9fcc-4f1f-8aec-b4953c08efa2 req-21eef8c8-cf3f-4530-9e72-063c4ed4002f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053488 Oct 31 15:17:53.866177 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 536/1032] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:53.872580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-beeb091c-f1a9-4c2c-b31c-3117b4cb36e3 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-266461995", "id": 601933992, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:53.922588 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-beeb091c-f1a9-4c2c-b31c-3117b4cb36e3 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.054908 Oct 31 15:17:53.924359 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 537/1033] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:53 2022] POST /compute/v2.1/flavors => generated 434 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:53.930761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5cabd15-3024-498f-b6ce-2e8c301e3bbd tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca2479160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:53.997712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:54.001633 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f2a8e60-e791-40ea-91fe-f9eb7e894f0f tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1618 microversion: 2.1 time: 0.296853 Oct 31 15:17:54.002867 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 497/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:53 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1618 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.018128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e5cabd15-3024-498f-b6ce-2e8c301e3bbd tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:54.029196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e5cabd15-3024-498f-b6ce-2e8c301e3bbd tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:54.030487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.034720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:54.055684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.055962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=15,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:54.063472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.064362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.065373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.070314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.070876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.107749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:54.267798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5cabd15-3024-498f-b6ce-2e8c301e3bbd tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.341799 Oct 31 15:17:54.268615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 538/1035] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:53 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:54.277341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9ba2245-09a0-4075-968c-2b2d6af72783 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.287425 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a9ba2245-09a0-4075-968c-2b2d6af72783 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9ba2245-09a0-4075-968c-2b2d6af72783 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Request method failure captured: Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/flavors/601933992/os-flavor-access HTTP/1.1 Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ceumiTj_7eKolbkL9LoGvOyBKQbTskzlCtlPT0IWzdgAYNxfRV_E3kMG26H2oN-pvvrR3z13EmKqlIv0oeOEDETyJK3YwO-0xieXNjrznMmXn7vuop_WRhb0MHXTKbqlWfQjZr6OJLFQj20-0Mhp_RoxthonQIwprIrkgcvYdSbzw Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 92648d3624ec4ab5868ff76ca4029fc1 Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:17:54.289468 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 92648d3624ec4ab5868ff76ca4029fc1 Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bc21124698334cde9b507d47bc3f33f3 Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: exception: Access list not available for public flavors. Oct 31 15:17:54.290988 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'flavor_id': '601933992'} Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 31 15:17:54.291849 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:54.293555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9ba2245-09a0-4075-968c-2b2d6af72783 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:54.293555 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9ba2245-09a0-4075-968c-2b2d6af72783 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/601933992/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020986 Oct 31 15:17:54.293555 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 539/1036] 10.222.0.48 () {58 vars in 1206 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/flavors/601933992/os-flavor-access => generated 91 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:54.297345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.297659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:54.304084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.304567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.305075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.305777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.306236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.306663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.446376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:54.454234 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-06f89048-45a5-4f49-9a75-80d15b6e8f0d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.450141 Oct 31 15:17:54.454817 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 498/1037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.462915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-981162969", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:54.522302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:54.530766 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14858328-945c-4dab-bbc2-00e83ffc8a3b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1477 microversion: 2.1 time: 0.238338 Oct 31 15:17:54.531348 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 540/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1477 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.537894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7f603768-c25e-4229-b032-5ecc4193c185 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca2479d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.590646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7f603768-c25e-4229-b032-5ecc4193c185 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.057875 Oct 31 15:17:54.591942 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 541/1039] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:54.601862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d094934-5eb7-4f6d-99d5-429a170b9c94 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.623494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d094934-5eb7-4f6d-99d5-429a170b9c94 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/601933992" status: 202 len: 0 microversion: 2.1 time: 0.030190 Oct 31 15:17:54.625000 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 542/1040] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:17:54 2022] DELETE /compute/v2.1/flavors/601933992 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:54.632506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.633596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:54.640746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.648824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.649487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.650262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.650730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.651156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.720933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:54.878135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:54.888055 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a3eb667-72ee-4645-bf3a-5f46c0ad47c9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1292 microversion: 2.1 time: 0.261648 Oct 31 15:17:54.888972 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 543/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.897530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e45f11c8-5178-490a-a7b0-46304027f302 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca24790d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:54.945512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e45f11c8-5178-490a-a7b0-46304027f302 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:54.950617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e45f11c8-5178-490a-a7b0-46304027f302 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.010253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:55.010671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:55.011139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:55.011542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:55.011947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:55.022652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.023069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.023451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.024256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.024826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.025329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.044641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.050345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Getting quotas for user 08345a85f1cb46f080b0268f151384dc and project 4366c148cab043bc8a653080ba52e8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.064438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:55.067924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:55.130833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67160279-da2a-40ee-b36c-ae1061098511 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668247 Oct 31 15:17:55.131509 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 499/1042] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:55.142198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fa08865-88a0-4ee4-a8c4-0545d8a0625c tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:55.169185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e45f11c8-5178-490a-a7b0-46304027f302 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.278939 Oct 31 15:17:55.169764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 544/1043] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:54 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:55.183869 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fa08865-88a0-4ee4-a8c4-0545d8a0625c tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050941 Oct 31 15:17:55.188852 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 500/1044] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:55.194908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9072698-d633-4e0f-af98-5b0ff8e2cfba tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:55.195794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9072698-d633-4e0f-af98-5b0ff8e2cfba tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:55.263901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9072698-d633-4e0f-af98-5b0ff8e2cfba tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:55.273778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9072698-d633-4e0f-af98-5b0ff8e2cfba tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1216 microversion: 2.1 time: 0.083257 Oct 31 15:17:55.274213 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 501/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:55 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:55.276605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1071638724", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "f0d5b929-e8f8-4875-990d-aaf4f4a8247a"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:55.295265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-007eaf9e-7490-45cb-81c2-124b79b39c97 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca2332ca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:55.354795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] validate_networks() for [('f0d5b929-e8f8-4875-990d-aaf4f4a8247a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:55.361126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-007eaf9e-7490-45cb-81c2-124b79b39c97 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.368371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-007eaf9e-7490-45cb-81c2-124b79b39c97 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.751707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-007eaf9e-7490-45cb-81c2-124b79b39c97 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 64 microversion: 2.1 time: 0.463240 Oct 31 15:17:55.752522 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 502/1046] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:55 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 64 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:55.762988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b27ddd8e-f368-4184-8d03-efdc7d9e0542 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1435421916", "id": 1318481389, "os-flavor-access:is_public": "False"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:55.790572 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b27ddd8e-f368-4184-8d03-efdc7d9e0542 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036852 Oct 31 15:17:55.792029 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 503/1047] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:55 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:55.797385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:55.798579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:55.808845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.809803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.810657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.811385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.812009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.812460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.937585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:55.938083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:55.938478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:55.938940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:55.939365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:55.950190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.950665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.951738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.952482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.953138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.953568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.974349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.980413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:55.980633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for user 9315a4916cfa47da9904d8bfbc775e0a and project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.995529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:55.997552 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2fa77eb9-cc94-4777-ab0f-82d634ab4f39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.203925 Oct 31 15:17:55.998227 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 504/1048] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:55 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.013037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:56.017288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.017643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.028441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.028987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.029421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.030466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.031264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.031851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.090237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7aa09c80-9d7a-47ee-b0b4-e80fff41242f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919026 Oct 31 15:17:56.090806 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 545/1049] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:56.102561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32bbf22b-4822-4a92-bfdf-f1f4c61103de tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca247ae50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.183820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32bbf22b-4822-4a92-bfdf-f1f4c61103de tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 64 microversion: 2.1 time: 0.091858 Oct 31 15:17:56.189573 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 546/1050] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 64 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:56.245655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.257968 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4802aed-c25a-4ba2-938b-dcae5e684426 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1477 microversion: 2.1 time: 0.258391 Oct 31 15:17:56.283347 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 505/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:55 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1477 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.306041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.306788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.320141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.320685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.321159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.322126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.322593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.323021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.375995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f3a181e-a39f-4d94-bc1f-dbe415339277 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:56.382068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f3a181e-a39f-4d94-bc1f-dbe415339277 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '75bc7e21d23b408685b6e8f5ab212d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a0f829ac8e4cd3907ba37f6a3ec45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f3a181e-a39f-4d94-bc1f-dbe415339277 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Request method failure captured: Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/flavors/1318481389/action HTTP/1.1 Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 67 Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ceNyKjbz_w_tRySIpKVGab1vZ7RgBRTtEucyUi3DhXrZctKF8RUkUmTPZ9E945tNjT-w_oo3VS6npgx2fJ1CPKXtykoJe1gF7emDE8vwoocGRpFXpCyVHUmwpe5L6RuUuCIO_WASbgTJEU5uNTOdxLDrkw2tZlxXyLHFVdaQ0kWUg Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 02a0f829ac8e4cd3907ba37f6a3ec45f Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1574094013 Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:17:56.384783 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1574094013 Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 02a0f829ac8e4cd3907ba37f6a3ec45f Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1574094013 Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsAccessNegativeTestJSON-1574094013-project Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 75bc7e21d23b408685b6e8f5ab212d2d Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1574094013-project Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: {"addTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} Oct 31 15:17:56.386358 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '1318481389', 'body': {'addTenantAccess': {'tenant': '02a0f829ac8e4cd3907ba37f6a3ec45f'}}} Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:56.387604 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 15:17:56.389556 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:17:56.391340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f3a181e-a39f-4d94-bc1f-dbe415339277 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:56.391340 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f3a181e-a39f-4d94-bc1f-dbe415339277 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] 10.222.0.48 "POST /compute/v2.1/flavors/1318481389/action" status: 403 len: 130 microversion: 2.1 time: 0.195818 Oct 31 15:17:56.393071 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 547/1052] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Oct 31 15:17:56 2022] POST /compute/v2.1/flavors/1318481389/action => generated 130 bytes in 201 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:56.398415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-872cc4c4-f7a2-4cf4-a932-9e687e4b8b4d req-f81631da-6955-4911-8559-a3a121e4c7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "name": "network-vif-unplugged", "status": "completed", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:56.409239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-872cc4c4-f7a2-4cf4-a932-9e687e4b8b4d req-f81631da-6955-4911-8559-a3a121e4c7d5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.409694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-872cc4c4-f7a2-4cf4-a932-9e687e4b8b4d req-f81631da-6955-4911-8559-a3a121e4c7d5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.410336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-872cc4c4-f7a2-4cf4-a932-9e687e4b8b4d req-f81631da-6955-4911-8559-a3a121e4c7d5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.423090 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-872cc4c4-f7a2-4cf4-a932-9e687e4b8b4d req-f81631da-6955-4911-8559-a3a121e4c7d5 service nova] Creating event network-vif-unplugged:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:17:56.429326 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-872cc4c4-f7a2-4cf4-a932-9e687e4b8b4d req-f81631da-6955-4911-8559-a3a121e4c7d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036442 Oct 31 15:17:56.430158 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 548/1053] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:56.436356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2aee6db-0884-4a8a-9d06-88ed08e7f6e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.437843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c2aee6db-0884-4a8a-9d06-88ed08e7f6e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.509310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c2aee6db-0884-4a8a-9d06-88ed08e7f6e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.517724 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2aee6db-0884-4a8a-9d06-88ed08e7f6e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1225 microversion: 2.1 time: 0.086237 Oct 31 15:17:56.519277 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 549/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.528305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c72bba4d-06f8-4ce0-bd85-57a7a7779d44 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca24351f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:56.597405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.620945 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76d9876b-cfcd-40c6-b3d2-91e1ce000945 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1481 microversion: 2.1 time: 0.332139 Oct 31 15:17:56.621846 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 506/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1481 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.627338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.627962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.638973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-c72bba4d-06f8-4ce0-bd85-57a7a7779d44 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:56.641894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.642704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.643177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.644020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.646406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.646936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.649545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-c72bba4d-06f8-4ce0-bd85-57a7a7779d44 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:56.725015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.735717 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0be5b49b-e836-4c19-ad7f-7df39c0180e4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1268 microversion: 2.1 time: 0.111790 Oct 31 15:17:56.736501 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 507/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1268 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.741982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6286f3e-fd01-487a-8066-87c13f5092e9 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.755613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:56.764374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6286f3e-fd01-487a-8066-87c13f5092e9 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1318481389" status: 202 len: 0 microversion: 2.1 time: 0.026626 Oct 31 15:17:56.767799 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 508/1057] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:17:56 2022] DELETE /compute/v2.1/flavors/1318481389 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:56.776248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.776775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.783944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.784519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.785720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.787038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.788010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.788597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.901947 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fccc2f94-4dec-4e77-b104-b9c5a6007778 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129224 Oct 31 15:17:56.911246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 509/1058] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:56.916864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41feebcc-2d37-4a46-9463-edc978a744b6 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.938364 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41feebcc-2d37-4a46-9463-edc978a744b6 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025099 Oct 31 15:17:56.939222 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 510/1059] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.964237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc3c2713-1dd2-4385-86d4-b17606088b99 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1165390422", "id": 830778974, "os-flavor-access:is_public": "False"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:57.004709 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc3c2713-1dd2-4385-86d4-b17606088b99 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.044573 Oct 31 15:17:57.015296 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 511/1060] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:56 2022] POST /compute/v2.1/flavors => generated 436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:57.036789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.039656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.059993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.060507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.060974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.062611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.063247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.064631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.084796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c72bba4d-06f8-4ce0-bd85-57a7a7779d44 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.563630 Oct 31 15:17:57.090138 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 550/1061] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:56 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:57.093896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdea88b8-e54b-41de-bccd-448b279c1927 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:57.271154 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdea88b8-e54b-41de-bccd-448b279c1927 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/830778974/action" status: 200 len: 96 microversion: 2.1 time: 0.184268 Oct 31 15:17:57.272016 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 551/1062] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Oct 31 15:17:57 2022] POST /compute/v2.1/flavors/830778974/action => generated 96 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:57.277180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-380437ff-512c-4604-a39a-e2fe62cf593a tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update', calling method: .version_select at 0x7f5ca25e1550>, body: {"meta": {"os_version": "alt"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:57.364834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-380437ff-512c-4604-a39a-e2fe62cf593a tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:57.390481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-380437ff-512c-4604-a39a-e2fe62cf593a tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:57.449785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:57.460831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27b84f81-4d1c-4e64-8617-bd1c177c3cde tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.442312 Oct 31 15:17:57.464077 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 512/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:57.492576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c28d909-f8d7-4065-abbe-ba857e233925 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:57.496036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c28d909-f8d7-4065-abbe-ba857e233925 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '75bc7e21d23b408685b6e8f5ab212d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a0f829ac8e4cd3907ba37f6a3ec45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c28d909-f8d7-4065-abbe-ba857e233925 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Request method failure captured: Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/flavors/830778974/action HTTP/1.1 Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 70 Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ceNyKjbz_w_tRySIpKVGab1vZ7RgBRTtEucyUi3DhXrZctKF8RUkUmTPZ9E945tNjT-w_oo3VS6npgx2fJ1CPKXtykoJe1gF7emDE8vwoocGRpFXpCyVHUmwpe5L6RuUuCIO_WASbgTJEU5uNTOdxLDrkw2tZlxXyLHFVdaQ0kWUg Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 02a0f829ac8e4cd3907ba37f6a3ec45f Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1574094013 Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:17:57.501636 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02a0f829ac8e4cd3907ba37f6a3ec45f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1574094013 Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 02a0f829ac8e4cd3907ba37f6a3ec45f Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1574094013 Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FlavorsAccessNegativeTestJSON-1574094013-project Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 75bc7e21d23b408685b6e8f5ab212d2d Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1574094013-project Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: {"removeTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} Oct 31 15:17:57.503223 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '830778974', 'body': {'removeTenantAccess': {'tenant': '02a0f829ac8e4cd3907ba37f6a3ec45f'}}} Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can( Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:57.504614 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 15:17:57.506140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:57.510335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c28d909-f8d7-4065-abbe-ba857e233925 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:57.513154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c28d909-f8d7-4065-abbe-ba857e233925 tempest-FlavorsAccessNegativeTestJSON-1574094013 tempest-FlavorsAccessNegativeTestJSON-1574094013-project] 10.222.0.48 "POST /compute/v2.1/flavors/830778974/action" status: 403 len: 133 microversion: 2.1 time: 0.046957 Oct 31 15:17:57.519132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 513/1064] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Oct 31 15:17:57 2022] POST /compute/v2.1/flavors/830778974/action => generated 133 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:57.526320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.527172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.543530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.544083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.544388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.546485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.548579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.549424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.774012 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-380437ff-512c-4604-a39a-e2fe62cf593a tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.500649 Oct 31 15:17:57.774917 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 552/1065] 10.222.0.48 () {60 vars in 1313 bytes} [Mon Oct 31 15:17:57 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata/os_version => generated 31 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:57.785735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d2e9c4f-0c7d-4761-972c-e9d83f0fa891 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02a0f829ac8e4cd3907ba37f6a3ec45f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:57.920106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d2e9c4f-0c7d-4761-972c-e9d83f0fa891 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/830778974/action" status: 200 len: 21 microversion: 2.1 time: 0.138275 Oct 31 15:17:57.921748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 553/1066] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Oct 31 15:17:57 2022] POST /compute/v2.1/flavors/830778974/action => generated 21 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:57.930674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.931725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.945543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.946462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.947245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.949088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.950443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.951721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.095420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.103566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02479585-cece-4b7d-a49f-312f16f117c7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1277 microversion: 2.1 time: 0.180581 Oct 31 15:17:58.104156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 554/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.109063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.109895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:58.116934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.117635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.118386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.119244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.119871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.120448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.250401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.259993 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28b9a1cd-0f6d-4315-928f-37357b5d9b26 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1274 microversion: 2.1 time: 0.154581 Oct 31 15:17:58.280721 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 555/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.290187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4bcd0914-dd0b-429f-b2cd-e84ce5c0982d tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca24355e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.303723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.323757 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e38f1c5-b24a-44f8-b5a0-f07f631cbda6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1477 microversion: 2.1 time: 0.802110 Oct 31 15:17:58.333906 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 514/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1477 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.349818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9263bd60-4614-4a75-ae2b-89bd7cf93d9f tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.350360 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4bcd0914-dd0b-429f-b2cd-e84ce5c0982d tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 58 microversion: 2.1 time: 0.078399 Oct 31 15:17:58.357471 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 556/1070] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 58 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:58.362792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54df20cc-5823-4a4a-972e-0aeb1d10b505 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'update_all', calling method: .version_select at 0x7f5ca2461d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:58.382919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9263bd60-4614-4a75-ae2b-89bd7cf93d9f tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/830778974" status: 202 len: 0 microversion: 2.1 time: 0.047716 Oct 31 15:17:58.384286 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 515/1071] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:17:58 2022] DELETE /compute/v2.1/flavors/830778974 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:58.393907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c708660-64d6-482e-979f-ceb1208b2f3d tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.422107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c708660-64d6-482e-979f-ceb1208b2f3d tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032298 Oct 31 15:17:58.424428 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 516/1072] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.444666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9fd1bf05-8e9e-4e03-ab90-321a87bcde59 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-356060876", "id": 444228017, "os-flavor-access:is_public": "False"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:58.445182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-54df20cc-5823-4a4a-972e-0aeb1d10b505 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:58.459371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-54df20cc-5823-4a4a-972e-0aeb1d10b505 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:58.464867 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9fd1bf05-8e9e-4e03-ab90-321a87bcde59 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024877 Oct 31 15:17:58.465469 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 517/1073] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:58 2022] POST /compute/v2.1/flavors => generated 435 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:58.475158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-24674b16-441b-48a0-806c-d2ba683907b9 req-3cd47f9b-62ca-4ffb-8fbb-c9520e228079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "name": "network-vif-plugged", "status": "completed", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:58.487449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-24674b16-441b-48a0-806c-d2ba683907b9 req-3cd47f9b-62ca-4ffb-8fbb-c9520e228079 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.488239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-24674b16-441b-48a0-806c-d2ba683907b9 req-3cd47f9b-62ca-4ffb-8fbb-c9520e228079 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.488882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-24674b16-441b-48a0-806c-d2ba683907b9 req-3cd47f9b-62ca-4ffb-8fbb-c9520e228079 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.510428 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-24674b16-441b-48a0-806c-d2ba683907b9 req-3cd47f9b-62ca-4ffb-8fbb-c9520e228079 service nova] Creating event network-vif-plugged:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:17:58.516281 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-24674b16-441b-48a0-806c-d2ba683907b9 req-3cd47f9b-62ca-4ffb-8fbb-c9520e228079 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049261 Oct 31 15:17:58.516939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 518/1074] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:58.526902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ac87aac-f535-4782-8b79-f8d87b532322 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "353ec5748e26426da99281562ac3b30e"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:58.650170 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-8ac87aac-f535-4782-8b79-f8d87b532322 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] HTTP exception thrown: Flavor access not found for 38 / 353ec5748e26426da99281562ac3b30e combination. Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ac87aac-f535-4782-8b79-f8d87b532322 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Request method failure captured: Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/flavors/444228017/action HTTP/1.1 Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 70 Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ceumiTj_7eKolbkL9LoGvOyBKQbTskzlCtlPT0IWzdgAYNxfRV_E3kMG26H2oN-pvvrR3z13EmKqlIv0oeOEDETyJK3YwO-0xieXNjrznMmXn7vuop_WRhb0MHXTKbqlWfQjZr6OJLFQj20-0Mhp_RoxthonQIwprIrkgcvYdSbzw Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 92648d3624ec4ab5868ff76ca4029fc1 Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:17:58.654630 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92648d3624ec4ab5868ff76ca4029fc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 92648d3624ec4ab5868ff76ca4029fc1 Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-156751755 Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bc21124698334cde9b507d47bc3f33f3 Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: {"removeTenantAccess": {"tenant": "353ec5748e26426da99281562ac3b30e"}} Oct 31 15:17:58.656007 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: exception: Flavor access not found for 38 / 353ec5748e26426da99281562ac3b30e combination. Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '444228017', 'body': {'removeTenantAccess': {'tenant': '353ec5748e26426da99281562ac3b30e'}}} Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 31 15:17:58.656770 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / 353ec5748e26426da99281562ac3b30e combination. Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / 353ec5748e26426da99281562ac3b30e combination. Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:58.657841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:58.660210 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:58.660210 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:58.660210 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:58.660210 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:58.660210 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / 353ec5748e26426da99281562ac3b30e combination. Oct 31 15:17:58.660210 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:17:58.661989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ac87aac-f535-4782-8b79-f8d87b532322 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Returning 404 to user: Flavor access not found for 38 / 353ec5748e26426da99281562ac3b30e combination. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:58.663267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ac87aac-f535-4782-8b79-f8d87b532322 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/444228017/action" status: 404 len: 124 microversion: 2.1 time: 0.140418 Oct 31 15:17:58.668537 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 519/1075] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Oct 31 15:17:58 2022] POST /compute/v2.1/flavors/444228017/action => generated 124 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:58.686419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.687574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:58.696341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.697113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.697855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.699064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.699811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.700451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.893777 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54df20cc-5823-4a4a-972e-0aeb1d10b505 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 61 microversion: 2.1 time: 0.534735 Oct 31 15:17:58.895591 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 557/1076] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:17:58 2022] PUT /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 61 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:58.903788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be92c722-1ad9-4e09-a08e-cd081fa102b6 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.930505 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be92c722-1ad9-4e09-a08e-cd081fa102b6 tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/444228017" status: 202 len: 0 microversion: 2.1 time: 0.032897 Oct 31 15:17:58.931183 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 558/1077] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:17:58 2022] DELETE /compute/v2.1/flavors/444228017 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:58.937329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6fcf2ec-dbc5-4dee-98d3-4174d3bfd9c3 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Action: 'create', calling method: .version_select at 0x7f5ca25ea700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:58.996868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a6fcf2ec-dbc5-4dee-98d3-4174d3bfd9c3 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:59.003343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a6fcf2ec-dbc5-4dee-98d3-4174d3bfd9c3 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Getting quotas for user 07c5f623316841f1bbaea280c4528a3f and project ae84bb9d5a3d499687425244e213f97c. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:59.084980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:59.096539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-703b3322-d745-4cf6-87e7-1c295e098f42 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.423940 Oct 31 15:17:59.099566 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 520/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:59.121429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d222183b-a215-474c-91fb-1dc5d621297c tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.182422 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d222183b-a215-474c-91fb-1dc5d621297c tempest-FlavorsAccessNegativeTestJSON-156751755 tempest-FlavorsAccessNegativeTestJSON-156751755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081728 Oct 31 15:17:59.182700 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 521/1079] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:59.214220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.214842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:59.236125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.241920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.244231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.245243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.249465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.250130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.737610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6fcf2ec-dbc5-4dee-98d3-4174d3bfd9c3 tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "POST /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 85 microversion: 2.1 time: 0.804952 Oct 31 15:17:59.738356 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 559/1080] 10.222.0.48 () {60 vars in 1281 bytes} [Mon Oct 31 15:17:58 2022] POST /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 85 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:59.748440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e93f45ab-7993-4cbf-9c8f-1a1d32ae4511 req-7a2b171c-9e3e-4ac6-beb6-e783e672ed1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "968b5ef7-db40-4099-ab2e-f20a844049d7", "tag": "b09d4455-f914-4d85-9b6e-c4fd93ebeafe"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:59.765566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:59.787076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e93f45ab-7993-4cbf-9c8f-1a1d32ae4511 req-7a2b171c-9e3e-4ac6-beb6-e783e672ed1a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.787666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:59.791318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e93f45ab-7993-4cbf-9c8f-1a1d32ae4511 req-7a2b171c-9e3e-4ac6-beb6-e783e672ed1a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.791982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e93f45ab-7993-4cbf-9c8f-1a1d32ae4511 req-7a2b171c-9e3e-4ac6-beb6-e783e672ed1a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.798368 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e371937-dddc-4de3-acae-93618262fd92 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1481 microversion: 2.1 time: 0.600502 Oct 31 15:17:59.800820 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 522/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1481 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:59.806620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.817270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:59.840486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.842886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.845929 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e93f45ab-7993-4cbf-9c8f-1a1d32ae4511 req-7a2b171c-9e3e-4ac6-beb6-e783e672ed1a service nova] Creating event network-changed:b09d4455-f914-4d85-9b6e-c4fd93ebeafe for instance 968b5ef7-db40-4099-ab2e-f20a844049d7 on n-h2-858383-17 Oct 31 15:17:59.849311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.850584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.851889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.858377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e93f45ab-7993-4cbf-9c8f-1a1d32ae4511 req-7a2b171c-9e3e-4ac6-beb6-e783e672ed1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118261 Oct 31 15:17:59.859267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.861247 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 560/1082] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:59.870726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.871447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:59.890626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.890939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.891380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.892099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.892556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.899276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.681739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:00.697874 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eed5618f-924a-4086-be33-73920bc84446 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.835265 Oct 31 15:18:00.698490 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 561/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:00.718557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.719169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:00.742667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.743319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.743761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.744481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.744979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.745406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.854401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:00.866019 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce9063c4-1d70-4de4-ac4e-f5bb56322c8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 1.063164 Oct 31 15:18:00.866732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 523/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:00.873586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e118a9f-845d-4f18-ace1-6133efdbecca tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] Calling method '.version_select at 0x7f5ca25a2b80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.930708 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e118a9f-845d-4f18-ace1-6133efdbecca tempest-ImagesMetadataTestJSON-669664559 tempest-ImagesMetadataTestJSON-669664559-project] 10.222.0.48 "GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata" status: 200 len: 85 microversion: 2.1 time: 0.062624 Oct 31 15:18:00.931922 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 524/1085] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/images/ce5cbc73-5f86-4e92-b0f8-c955f6b0cbbb/metadata => generated 85 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:00.936612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.946264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:00.964966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.965841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.968040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.969136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.971518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.974725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.288447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:01.302583 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3d8ac4b-bdb1-4b26-a8e2-d8a1c25a1f36 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1463 microversion: 2.1 time: 0.588054 Oct 31 15:18:01.303164 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 562/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1463 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:01.326792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:01.327397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:01.338532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.341267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.341668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.342424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.342737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.343162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.434723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:01.450725 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d39d513-13db-4dd3-bd6a-974b3ada2634 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.516224 Oct 31 15:18:01.454109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 525/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:01.720974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:01.722720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:01.731741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.732542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.734499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.735700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.737043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.738475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.866179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:01.876557 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b647caa-45d1-489b-822d-623f9ac3a5e6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1463 microversion: 2.1 time: 0.553543 Oct 31 15:18:01.880216 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 563/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:01 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1463 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:01.901020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:01.902032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:01.913532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.915104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.915560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.917693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.918576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.919795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.137460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:02.145498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-faf2fa9c-fecb-40bf-8260-06835790a761 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.428501 Oct 31 15:18:02.157351 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 526/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:01 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:02.167483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:02.170627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:02.177637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.178395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.178999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.179864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.180470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.181079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.213986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:02.226267 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c1cf6a7-bfb4-4a7c-b3d8-f4be3d91f0cf tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 0.329365 Oct 31 15:18:02.237712 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 564/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:01 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:02.247901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-eb435501-5e32-41f0-85d1-38f11d01b17c req-01abc405-c927-4531-8b91-0d0fb2d843b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49d2d14-1dea-4aeb-8b9c-e947eb21f939", "tag": "027ef5c6-722e-486b-aed2-211ee9a6f939"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:02.271481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eb435501-5e32-41f0-85d1-38f11d01b17c req-01abc405-c927-4531-8b91-0d0fb2d843b4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.272429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eb435501-5e32-41f0-85d1-38f11d01b17c req-01abc405-c927-4531-8b91-0d0fb2d843b4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.273007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eb435501-5e32-41f0-85d1-38f11d01b17c req-01abc405-c927-4531-8b91-0d0fb2d843b4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.296677 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-eb435501-5e32-41f0-85d1-38f11d01b17c req-01abc405-c927-4531-8b91-0d0fb2d843b4 service nova] Creating event network-changed:027ef5c6-722e-486b-aed2-211ee9a6f939 for instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 on n-h2-858383-17 Oct 31 15:18:02.310081 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-eb435501-5e32-41f0-85d1-38f11d01b17c req-01abc405-c927-4531-8b91-0d0fb2d843b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072614 Oct 31 15:18:02.310717 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 565/1091] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:02.311212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:02.311786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:02.312461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:02.313024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:02.313392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:02.367567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-7ae9bf63-76f6-4c3b-8fa6-369c2b64559b req-d6d0d9f2-eec8-49c2-ab04-847b4b026540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d96293d-930b-49d3-b6bc-126ea18f36da", "tag": "48f520c8-387a-4e52-97f2-313b60a8d7fc"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:02.379251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7ae9bf63-76f6-4c3b-8fa6-369c2b64559b req-d6d0d9f2-eec8-49c2-ab04-847b4b026540 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.380035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7ae9bf63-76f6-4c3b-8fa6-369c2b64559b req-d6d0d9f2-eec8-49c2-ab04-847b4b026540 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.380542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7ae9bf63-76f6-4c3b-8fa6-369c2b64559b req-d6d0d9f2-eec8-49c2-ab04-847b4b026540 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.394323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:02.404999 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-7ae9bf63-76f6-4c3b-8fa6-369c2b64559b req-d6d0d9f2-eec8-49c2-ab04-847b4b026540 service nova] Creating event network-changed:48f520c8-387a-4e52-97f2-313b60a8d7fc for instance 0d96293d-930b-49d3-b6bc-126ea18f36da on n-h1-858383-17 Oct 31 15:18:02.408615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.409149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.409591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.410346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.410898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.411338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.416833 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-7ae9bf63-76f6-4c3b-8fa6-369c2b64559b req-d6d0d9f2-eec8-49c2-ab04-847b4b026540 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055488 Oct 31 15:18:02.419053 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 566/1092] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:02.476268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:02.477005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:02.481264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5689340b-946c-4332-8e67-b5c8b69d02b3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 1067 microversion: 2.1 time: 0.322553 Oct 31 15:18:02.481923 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 527/1093] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:02 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 1067 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:18:02.488498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.489568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.490183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.491138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.491797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.492450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.511211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:02.512363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:02.521743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.522505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.522781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.523921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.524791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.526111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.121018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:03.123308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:03.134831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:03.138374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-26da85a0-52b1-407f-a307-8c8712b5b89f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.634612 Oct 31 15:18:03.139271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 528/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:02 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:03.157068 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ba8cb6c-60c5-4769-a4ac-2fad05e48518 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.684884 Oct 31 15:18:03.158088 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 567/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:02 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:03.179811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:03.180645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:03.195444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.196560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.197595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.198872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.199542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.200655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.251499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:03.252118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:03.265419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.266323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.267085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.268852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.269437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.269946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.648441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:03.700037 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9adf06cd-b872-4f50-972b-8ae29b75f939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.525381 Oct 31 15:18:03.704357 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 529/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:03 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:03.718520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:03.729895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43c1a30f-a49d-4f2e-b42e-35f15a010952 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 0.482778 Oct 31 15:18:03.732757 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 568/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:03 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:04.164542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.166049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.177448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.189776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.191527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.197516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.198410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.199291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.200257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.200869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.201324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.201830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.202238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.202632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.203428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.203964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.501042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:04.506836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:04.516932 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ee0543f-1261-4574-bf40-44cf47ad98db tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.356734 Oct 31 15:18:04.521223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 530/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:04.524238 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-145a17c7-4161-4f48-a6dd-65a277317873 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.343863 Oct 31 15:18:04.525143 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 569/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:04.731213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.731930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.755208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.755559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.756300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.756745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.757195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.757631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.761071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.761787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.770120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.771707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.773417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.775056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.775883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.778817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.035548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:05.199711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.214562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.218707 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e9409e6-3541-44a1-918c-96b9706110a0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 0.469769 Oct 31 15:18:05.223899 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 570/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:05.235610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3012aed4-4dc0-49e8-ad64-438e6b194509 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.508180 Oct 31 15:18:05.242714 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 531/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:05.367790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26a365ac-5e63-44f5-ad3a-af0649e3de6f tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1403608619", "ram": 512, "vcpus": 1, "disk": 10, "id": 1484476341, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:05.386413 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26a365ac-5e63-44f5-ad3a-af0649e3de6f tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.161058 Oct 31 15:18:05.387669 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 571/1102] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:05 2022] POST /compute/v2.1/flavors => generated 416 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:05.402746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=27 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:05.532606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7fbc5e3-6aaf-4c69-a3cc-447915d56816 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:05.544785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:05.545700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:05.551573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e7fbc5e3-6aaf-4c69-a3cc-447915d56816 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] HTTP exception thrown: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:05.555082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7fbc5e3-6aaf-4c69-a3cc-447915d56816 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Request method failure captured: Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/flavors/1484476341/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-cstr9wC3vg7piFW7v_Qm78T1SIBGlkguWxaqlwuQMWSmCzd50uahDc4_afD3jqO0xO6oVHzRLXitqmORwMnkYkpDYUBrLSATXpykoaWKCsz91M2OpnOjMTG48iWQ6-SxQieAC_mNWgLPJE1gOz4n77lFK1HEEtEhMKxQjcRES787g Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:05.555475 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: be768b64e525430bbf1488234e17277f Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:05.556776 n-d-858383-17 devstack@n-api.service[120626]: exception: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'flavor_id': '1484476341', 'id': 'hw:cpu_thread_policy'} Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:05.557495 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7fbc5e3-6aaf-4c69-a3cc-447915d56816 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Returning 404 to user: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7fbc5e3-6aaf-4c69-a3cc-447915d56816 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] 10.222.0.48 "GET /compute/v2.1/flavors/1484476341/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.159696 Oct 31 15:18:05.565325 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 532/1103] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:18:05 2022] GET /compute/v2.1/flavors/1484476341/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:05.571462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:05.571462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:05.577428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.578203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.578858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.579829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.580162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.580633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.581441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.581791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.582084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.582516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.582940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.885409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.896351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-592fa651-c334-4f92-9565-72a5d42dbd72 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.354845 Oct 31 15:18:05.914865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 572/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:05 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:05.921752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7158d4c5-4361-4a13-89ab-0c8801228bd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:05.926985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7158d4c5-4361-4a13-89ab-0c8801228bd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'be768b64e525430bbf1488234e17277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ef6beb1649559a82e2faf407cd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7158d4c5-4361-4a13-89ab-0c8801228bd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Request method failure captured: Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/flavors/1484476341/os-extra_specs HTTP/1.1 Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 66 Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cstr9wC3vg7piFW7v_Qm78T1SIBGlkguWxaqlwuQMWSmCzd50uahDc4_afD3jqO0xO6oVHzRLXitqmORwMnkYkpDYUBrLSATXpykoaWKCsz91M2OpnOjMTG48iWQ6-SxQieAC_mNWgLPJE1gOz4n77lFK1HEEtEhMKxQjcRES787g Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:05.929661 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: be768b64e525430bbf1488234e17277f Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 31 15:18:05.931028 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'flavor_id': '1484476341', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:18:05.931756 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 15:18:05.932947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:05.938749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7158d4c5-4361-4a13-89ab-0c8801228bd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:05.939052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.939620 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7158d4c5-4361-4a13-89ab-0c8801228bd8 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] 10.222.0.48 "POST /compute/v2.1/flavors/1484476341/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.023452 Oct 31 15:18:05.942484 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 573/1105] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Oct 31 15:18:05 2022] POST /compute/v2.1/flavors/1484476341/os-extra_specs => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:05.948926 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-975d34bb-c276-4a45-9f72-b7f2928307d5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.388804 Oct 31 15:18:05.960775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f571b9d-9d52-4474-bdda-77830c0eeb96 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:05.961430 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 533/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:05 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:05.977167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:06.014432 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f571b9d-9d52-4474-bdda-77830c0eeb96 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1484476341/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065021 Oct 31 15:18:06.015275 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 574/1107] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Oct 31 15:18:05 2022] POST /compute/v2.1/flavors/1484476341/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:06.025842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84263e3f-6868-4e6d-bbcf-84d57a4fdea6 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.027383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-84263e3f-6868-4e6d-bbcf-84d57a4fdea6 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'be768b64e525430bbf1488234e17277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ef6beb1649559a82e2faf407cd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84263e3f-6868-4e6d-bbcf-84d57a4fdea6 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Request method failure captured: Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-cstr9wC3vg7piFW7v_Qm78T1SIBGlkguWxaqlwuQMWSmCzd50uahDc4_afD3jqO0xO6oVHzRLXitqmORwMnkYkpDYUBrLSATXpykoaWKCsz91M2OpnOjMTG48iWQ6-SxQieAC_mNWgLPJE1gOz4n77lFK1HEEtEhMKxQjcRES787g Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:06.029059 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: be768b64e525430bbf1488234e17277f Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:06.030657 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'flavor_id': '1484476341', 'id': 'hw:numa_nodes'} Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:18:06.031340 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 15:18:06.032595 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.035466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84263e3f-6868-4e6d-bbcf-84d57a4fdea6 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:06.036581 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84263e3f-6868-4e6d-bbcf-84d57a4fdea6 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] 10.222.0.48 "DELETE /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015092 Oct 31 15:18:06.037659 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 534/1108] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:18:06 2022] DELETE /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:06.047023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b532644c-f5ec-4287-b66b-fb37f0cbf6ba tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:06.070975 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b532644c-f5ec-4287-b66b-fb37f0cbf6ba tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1484476341/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027854 Oct 31 15:18:06.071489 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 575/1109] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Oct 31 15:18:06 2022] POST /compute/v2.1/flavors/1484476341/os-extra_specs => generated 66 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:06.082285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9fbd0b0d-bc8d-4a24-8b8b-8c438704b4b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:06.085818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9fbd0b0d-bc8d-4a24-8b8b-8c438704b4b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'be768b64e525430bbf1488234e17277f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3132ef6beb1649559a82e2faf407cd00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9fbd0b0d-bc8d-4a24-8b8b-8c438704b4b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Request method failure captured: Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 22 Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-cstr9wC3vg7piFW7v_Qm78T1SIBGlkguWxaqlwuQMWSmCzd50uahDc4_afD3jqO0xO6oVHzRLXitqmORwMnkYkpDYUBrLSATXpykoaWKCsz91M2OpnOjMTG48iWQ6-SxQieAC_mNWgLPJE1gOz4n77lFK1HEEtEhMKxQjcRES787g Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:06.087404 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3132ef6beb1649559a82e2faf407cd00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3132ef6beb1649559a82e2faf407cd00 Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: be768b64e525430bbf1488234e17277f Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: {"hw:numa_nodes": "1"} Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:06.089282 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'flavor_id': '1484476341', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:18:06.090127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 15:18:06.091218 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.092312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9fbd0b0d-bc8d-4a24-8b8b-8c438704b4b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:06.092312 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9fbd0b0d-bc8d-4a24-8b8b-8c438704b4b2 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168 tempest-FlavorsExtraSpecsNegativeTestJSON-1863010168-project] 10.222.0.48 "PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011147 Oct 31 15:18:06.092312 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 535/1110] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Oct 31 15:18:06 2022] PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:06.099279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c4ed4c6-a421-41b5-bd21-c631070aa253 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.110112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-5c4ed4c6-a421-41b5-bd21-c631070aa253 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] HTTP exception thrown: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c4ed4c6-a421-41b5-bd21-c631070aa253 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Request method failure captured: Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/flavors/1484476341/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ctnyFEsK1eDl4hhe2zaP2cu81ej4U2LCyK6oqIs6n0jk91Ojm-szshZxdIUUmfn6bLW3ziZwrR-_m_IHNsMQvtMfE6nW5r5n6SLxg01MSVUz_DAE8ktx1yBMcObm4714lDJko5gBnm8ziVvi4kiDYKTF-elO1QmK6d3OMwH59ZmQo Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 761face9ad014d408822a3a5af310f10 Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:18:06.111607 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/761face9ad014d408822a3a5af310f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/761face9ad014d408822a3a5af310f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_761face9ad014d408822a3a5af310f10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/761face9ad014d408822a3a5af310f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 761face9ad014d408822a3a5af310f10 Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: fccbc06c18244c948dcbcb139b301a07 Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:06.113383 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'flavor_id': '1484476341', 'id': 'hw:cpu_thread_policy'} Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.114282 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c4ed4c6-a421-41b5-bd21-c631070aa253 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Returning 404 to user: Flavor 1484476341 has no extra specs with key hw:cpu_thread_policy. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:06.116029 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c4ed4c6-a421-41b5-bd21-c631070aa253 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1484476341/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019049 Oct 31 15:18:06.116815 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 576/1111] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:18:06 2022] DELETE /compute/v2.1/flavors/1484476341/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:06.126697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0165ae51-9843-4764-8340-4d4954b99bc6 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:06.130056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0165ae51-9843-4764-8340-4d4954b99bc6 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0165ae51-9843-4764-8340-4d4954b99bc6 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Request method failure captured: Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 27 Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ctnyFEsK1eDl4hhe2zaP2cu81ej4U2LCyK6oqIs6n0jk91Ojm-szshZxdIUUmfn6bLW3ziZwrR-_m_IHNsMQvtMfE6nW5r5n6SLxg01MSVUz_DAE8ktx1yBMcObm4714lDJko5gBnm8ziVvi4kiDYKTF-elO1QmK6d3OMwH59ZmQo Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 761face9ad014d408822a3a5af310f10 Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:18:06.131377 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/761face9ad014d408822a3a5af310f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/761face9ad014d408822a3a5af310f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_761face9ad014d408822a3a5af310f10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/761face9ad014d408822a3a5af310f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 761face9ad014d408822a3a5af310f10 Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: fccbc06c18244c948dcbcb139b301a07 Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: {"hw:cpu_policy": "shared"} Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:06.132819 n-d-858383-17 devstack@n-api.service[120626]: exception: Request body and URI mismatch Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'flavor_id': '1484476341', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.133753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0165ae51-9843-4764-8340-4d4954b99bc6 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0165ae51-9843-4764-8340-4d4954b99bc6 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010929 Oct 31 15:18:06.136844 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 536/1112] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Oct 31 15:18:06 2022] PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes => generated 73 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:06.142439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-624b63ac-562e-450c-978e-639bd327f77c tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-624b63ac-562e-450c-978e-639bd327f77c tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Request method failure captured: Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 49 Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ctnyFEsK1eDl4hhe2zaP2cu81ej4U2LCyK6oqIs6n0jk91Ojm-szshZxdIUUmfn6bLW3ziZwrR-_m_IHNsMQvtMfE6nW5r5n6SLxg01MSVUz_DAE8ktx1yBMcObm4714lDJko5gBnm8ziVvi4kiDYKTF-elO1QmK6d3OMwH59ZmQo Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 761face9ad014d408822a3a5af310f10 Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:18:06.147248 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/761face9ad014d408822a3a5af310f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/761face9ad014d408822a3a5af310f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_761face9ad014d408822a3a5af310f10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/761face9ad014d408822a3a5af310f10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 761face9ad014d408822a3a5af310f10 Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: fccbc06c18244c948dcbcb139b301a07 Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 31 15:18:06.148853 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'flavor_id': '1484476341', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 31 15:18:06.149696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.151048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-624b63ac-562e-450c-978e-639bd327f77c tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-624b63ac-562e-450c-978e-639bd327f77c tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012080 Oct 31 15:18:06.152233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 577/1113] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Oct 31 15:18:06 2022] PUT /compute/v2.1/flavors/1484476341/os-extra_specs/hw:numa_nodes => generated 117 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:06.160032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0576406a-7711-4fef-b098-2cfcfd1c92a0 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.189767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0576406a-7711-4fef-b098-2cfcfd1c92a0 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1484476341" status: 202 len: 0 microversion: 2.1 time: 0.033426 Oct 31 15:18:06.190406 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 537/1114] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:18:06 2022] DELETE /compute/v2.1/flavors/1484476341 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:06.198884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ed1d3ed-ed98-4f01-af70-717ab2e7b9b3 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.219343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ed1d3ed-ed98-4f01-af70-717ab2e7b9b3 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839 tempest-FlavorsExtraSpecsNegativeTestJSON-438481839-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024092 Oct 31 15:18:06.219962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 578/1115] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:06.245701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.246944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.253262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.253852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.254301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.255009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.255471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.255962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.264879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.266162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.277401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.278391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.279591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.281515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.282244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.282888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.880925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.889447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e9c3f92-54fa-4927-bfc9-b4d0ebe7dcce tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 0.648265 Oct 31 15:18:06.890356 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 538/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:06.920188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.920957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.931463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.932562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.933105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.933553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.934274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.934739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.935167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.935819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:06.945071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d3ecfea-7d3c-49ec-b8ea-419a2daf9bbf tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.684913 Oct 31 15:18:06.958177 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 579/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:06.983049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.983982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.992671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.993541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.994207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.995146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.995829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.997162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.388275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:07.403220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c94bc076-002d-4348-b5b4-d6ea257bf3a1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.487587 Oct 31 15:18:07.403801 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 539/1118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:07.416183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:07.438164 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-999bb14a-0fe7-4493-bc95-96cc3ca2a34d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.466527 Oct 31 15:18:07.451781 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 580/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:07.914539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7c6a3e7a-7b31-4dfc-95c8-cf328b0721e1 req-e47ca6c6-4090-47d3-b592-219e5e0772aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49d2d14-1dea-4aeb-8b9c-e947eb21f939", "name": "network-vif-plugged", "status": "completed", "tag": "027ef5c6-722e-486b-aed2-211ee9a6f939"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:07.914898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.916473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:07.924425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.925760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.926557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.927946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.928618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.929266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.937587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7c6a3e7a-7b31-4dfc-95c8-cf328b0721e1 req-e47ca6c6-4090-47d3-b592-219e5e0772aa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.938323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7c6a3e7a-7b31-4dfc-95c8-cf328b0721e1 req-e47ca6c6-4090-47d3-b592-219e5e0772aa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.938854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7c6a3e7a-7b31-4dfc-95c8-cf328b0721e1 req-e47ca6c6-4090-47d3-b592-219e5e0772aa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.968166 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7c6a3e7a-7b31-4dfc-95c8-cf328b0721e1 req-e47ca6c6-4090-47d3-b592-219e5e0772aa service nova] Creating event network-vif-plugged:027ef5c6-722e-486b-aed2-211ee9a6f939 for instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 on n-h2-858383-17 Oct 31 15:18:07.985597 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7c6a3e7a-7b31-4dfc-95c8-cf328b0721e1 req-e47ca6c6-4090-47d3-b592-219e5e0772aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076314 Oct 31 15:18:07.989093 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 540/1120] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:08.016261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:08.017360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:08.039393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.039878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.040529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.042991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.043640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.045625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.346468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:08.359288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-893ac8b9-1611-4eb9-b32c-3a88a6691045 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 0.449830 Oct 31 15:18:08.360399 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 581/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:08.439431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:08.441660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:08.449843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:08.465879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.466863 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b77ed09d-18d2-4f0e-9c3d-acf49c8aa10c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.476213 Oct 31 15:18:08.467486 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 541/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:08.478452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.479030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.489172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.489722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.490175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.497476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:08.498107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:08.519386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.519987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.520437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.521214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.521683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.522125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.818814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:08.856124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed0a5c46-fdea-4a8c-b325-498d87d6899f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.425293 Oct 31 15:18:08.870296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:08.872767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3301e126-b6c0-4cbe-8432-55e44f5685b6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.385589 Oct 31 15:18:08.874451 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 542/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:08 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:08.892729 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 582/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:08 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:09.385005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.385815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.399438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.400211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.400996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.407475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.408370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.409398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.501242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.501972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.513770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=31 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:09.518609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.526015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.531136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.532050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.535605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.536132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.215876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.220652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.225461 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7570b546-5f6b-49c3-b9bf-f10ae7bc2a8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1325 microversion: 2.1 time: 0.846040 Oct 31 15:18:10.226097 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 543/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:09 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1325 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:10.229782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d7b0895-784d-4a06-abbf-a2d944fb53b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.733360 Oct 31 15:18:10.232835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 583/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:09 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:10.239481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.240564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:10.255053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.255841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.256667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.257583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.258407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.258996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.391234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Calling method '.version_select at 0x7f5ca2332c10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.395283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.395773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.396491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.412169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.412662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.413174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.449953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.450622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.451069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.462563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.462971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.463404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.504966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.505432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.506051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.512659 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce8593aa-fcd2-4c7d-9fe6-9fee13129c12 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 3027 microversion: 2.53 time: 0.285319 Oct 31 15:18:10.513282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 544/1127] 10.222.0.48 () {60 vars in 1243 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 3027 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:10.518232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.519004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:10.525481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.526174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.526609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.527694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.527824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.528463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.530640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.540753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d1706e29-1519-4900-8c2f-3cf54b14b3da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.308775 Oct 31 15:18:10.542116 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 584/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:10.551961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Calling method '.version_select at 0x7f5ca24bc550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.556095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.556588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.557407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.577101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.579010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.579924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.625884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.626444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.626877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.641343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.641868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.642346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.691116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.691614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.692106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.699142 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ed480f5-9fab-4ee4-879a-2f0fa8e42928 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1715 microversion: 2.53 time: 0.151842 Oct 31 15:18:10.699793 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 585/1129] 10.222.0.48 () {60 vars in 1222 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:10.715279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Calling method '.version_select at 0x7f5ca24bca60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.719738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.720315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.720779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.739083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.739670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.740111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.747395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5aa508f2-1d19-4093-b5f1-bf6c00248e00 tempest-HypervisorAdminV253TestBase-1592384301 tempest-HypervisorAdminV253TestBase-1592384301-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/898b1a5f-8f65-4146-88e0-5ed080c010d2" status: 200 len: 793 microversion: 2.53 time: 0.036315 Oct 31 15:18:10.748381 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 586/1130] 10.222.0.48 () {60 vars in 1298 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/os-hypervisors/898b1a5f-8f65-4146-88e0-5ed080c010d2 => generated 793 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:18:10.798876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.809147 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab77cc25-ef11-48a3-a230-946f2f332dfc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.294776 Oct 31 15:18:10.809740 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 545/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:11.254000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.254851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.265791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.266272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.267622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.268344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.269944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.270347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.359075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1794821648", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bc2357ef-c687-4bf5-80c5-a090c70bef3f"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:11.417751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] validate_networks() for [('bc2357ef-c687-4bf5-80c5-a090c70bef3f', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:11.579833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.591918 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f90891d-cd09-4cc2-9a24-93f8947db7f3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.344178 Oct 31 15:18:11.592753 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 546/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:11.601205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.602138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.616353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.618266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.618890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.620088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.621407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.622043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.933490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.964370 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8bb45e0-5cde-46da-9a54-03465184c400 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.368601 Oct 31 15:18:11.965298 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 547/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:11.970573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-45f65e4a-31b8-42e3-8493-b9c5af4913ab req-5b98f823-a20e-4f20-9b4d-8450415158aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d96293d-930b-49d3-b6bc-126ea18f36da", "name": "network-vif-plugged", "status": "completed", "tag": "48f520c8-387a-4e52-97f2-313b60a8d7fc"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:11.985431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-45f65e4a-31b8-42e3-8493-b9c5af4913ab req-5b98f823-a20e-4f20-9b4d-8450415158aa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.986624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-45f65e4a-31b8-42e3-8493-b9c5af4913ab req-5b98f823-a20e-4f20-9b4d-8450415158aa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.987205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-45f65e4a-31b8-42e3-8493-b9c5af4913ab req-5b98f823-a20e-4f20-9b4d-8450415158aa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.001645 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-45f65e4a-31b8-42e3-8493-b9c5af4913ab req-5b98f823-a20e-4f20-9b4d-8450415158aa service nova] Creating event network-vif-plugged:48f520c8-387a-4e52-97f2-313b60a8d7fc for instance 0d96293d-930b-49d3-b6bc-126ea18f36da on n-h1-858383-17 Oct 31 15:18:12.009229 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-45f65e4a-31b8-42e3-8493-b9c5af4913ab req-5b98f823-a20e-4f20-9b4d-8450415158aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042321 Oct 31 15:18:12.010109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 548/1134] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:12.016179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.018395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.026659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.028478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.029114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.030177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.031790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.032467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.087921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:12.088932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:12.089844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:12.090471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:12.091077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:12.105404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.106223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.107084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.108047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.108738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.109377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.135338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:12.149879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for user 857b0f5f4fdc4b1faeae0e0770d65125 and project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:12.180966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:12.183950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:12.246148 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77fe5084-50b3-45ca-9c34-2370083636e1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103487 Oct 31 15:18:12.253905 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 587/1135] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:12.258937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.259715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.281484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.282179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.284465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.285318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.285787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.287252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.288562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.311917 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e76b3709-05e3-45b7-9c3c-03783822f033 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.297708 Oct 31 15:18:12.321496 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 549/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.321496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.321496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.335340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:12.339774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.340274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.340830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.341537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.346996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.349112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.375028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:12.523945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.537436 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c619c8cd-0d86-4a2b-a8e8-219c5c487881 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.287085 Oct 31 15:18:12.539066 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 588/1137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.549295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f133b43-c873-40f8-94cc-518d141364b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.551593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f133b43-c873-40f8-94cc-518d141364b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.611282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.620106 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe43f1ee-efa8-4dfd-b130-26be002b413b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.304216 Oct 31 15:18:12.639972 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 550/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.651488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-346e4e40-88a5-4b8d-a97f-56d3ccabfe0e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1553271125", "metadata": {"": ""}}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-346e4e40-88a5-4b8d-a97f-56d3ccabfe0e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action HTTP/1.1 Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 107 Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:12.659762 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1553271125", "metadata": {"": ""}}} Oct 31 15:18:12.661444 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1553271125', 'metadata': {'': ''}}}} Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'': ''} Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:12.662349 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.663648 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:12.665071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:12.665071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:12.665071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:12.665071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:12.665071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:12.665071 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:12.670893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-346e4e40-88a5-4b8d-a97f-56d3ccabfe0e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:12.672167 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-346e4e40-88a5-4b8d-a97f-56d3ccabfe0e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action" status: 400 len: 170 microversion: 2.1 time: 0.031003 Oct 31 15:18:12.673267 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 551/1139] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Oct 31 15:18:12 2022] POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action => generated 170 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:12.693540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f133b43-c873-40f8-94cc-518d141364b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.696016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.696784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.705420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f133b43-c873-40f8-94cc-518d141364b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1208 microversion: 2.1 time: 0.164747 Oct 31 15:18:12.706183 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 589/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1208 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.707508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.708852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.709314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.710411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.711324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.711776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.895193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.906550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60fa59aa-c232-402d-ba44-728dd4a4624a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.228152 Oct 31 15:18:12.907937 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 552/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.935987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.937119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.944245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.944922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.945451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.946223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.946798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.947326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.994452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.995207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.006835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.010525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.010977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.011701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.012161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.012586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.138638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.151388 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8ba9aa1-194d-4fba-9d31-a7cf946a4528 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.220163 Oct 31 15:18:13.151967 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 590/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:13.177036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac72508-683d-4f95-bd24-060eddcc7286 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1066196617", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac72508-683d-4f95-bd24-060eddcc7286 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action HTTP/1.1 Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 619 Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:13.181529 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:13.182865 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:18:13.183474 n-d-858383-17 devstack@n-api.service[120625]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1066196617", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 31 15:18:13.183474 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:13.183474 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1066196617', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 31 15:18:13.183693 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:13.184375 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.185403 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:13.186626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:13.186626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:13.186626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:13.186626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:13.186626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:13.186626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:13.189101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac72508-683d-4f95-bd24-060eddcc7286 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:13.191241 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ac72508-683d-4f95-bd24-060eddcc7286 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action" status: 400 len: 938 microversion: 2.1 time: 0.019679 Oct 31 15:18:13.192336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 591/1143] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Oct 31 15:18:13 2022] POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:13.208342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.209509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.216198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:13.218423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.219173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.219985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.220925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.221545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.222789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.342732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.356388 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-91f9a06a-0820-439d-acf4-bb419f80272e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1316 microversion: 2.1 time: 0.365996 Oct 31 15:18:13.357510 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 553/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:13.379802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.381264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.393468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.396650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.397131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.397877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.398339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.400017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.489152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.499270 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1439a0fc-3799-4743-841f-f2c5f9ca3573 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.302896 Oct 31 15:18:13.515369 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 592/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:13.526579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.527824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.536480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.537383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.538010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.539287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.539914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.540506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.610710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.621571 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d6ba581-9479-48b7-9f62-600a5fd32c05 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.259462 Oct 31 15:18:13.622646 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 554/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:13.627596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.628629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.636361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.637158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.637839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.638712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.639430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.639931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.849241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:13.866327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.871542 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9d3e91b-a01f-4978-8bac-2ff1c67cf493 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 2346 microversion: 2.25 time: 0.354593 Oct 31 15:18:13.884749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 593/1147] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 2346 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:13.884749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.884749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.885533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.886198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.886792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.887639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.888227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.888828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.898125 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-498aaa59-eefb-4fd2-8ecd-b5aa21969d7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.274412 Oct 31 15:18:13.899711 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 555/1148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:13.906315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.906933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.921165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.921868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.922636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.923538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.924000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.924431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.023856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.039727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e01861ed-8141-4321-91bc-69e8ff144d06 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1260 microversion: 2.1 time: 0.137430 Oct 31 15:18:14.040652 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 556/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.045145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.060585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.061742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.062391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.063327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.063976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.064608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.104144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.113126 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-56c4709c-6ef5-4361-a309-e9cc5c228196 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.070660 Oct 31 15:18:14.113669 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 557/1150] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:14.119806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-590d7039-0b0d-4f81-8960-316939d5bd7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:14.125046 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42bcf9fe-403f-4940-ab15-df716bee2a90 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.251814 Oct 31 15:18:14.125774 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 594/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-590d7039-0b0d-4f81-8960-316939d5bd7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action HTTP/1.1 Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 285 Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:14.129973 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:18:14.131563 n-d-858383-17 devstack@n-api.service[120626]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:14.132394 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:14.133131 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:14.134357 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:14.135174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:14.135174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:14.135174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-590d7039-0b0d-4f81-8960-316939d5bd7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:14.135174 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-590d7039-0b0d-4f81-8960-316939d5bd7e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action" status: 400 len: 619 microversion: 2.1 time: 0.016743 Oct 31 15:18:14.140002 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 558/1152] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Oct 31 15:18:14 2022] POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:14.153560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.154184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.163069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.164062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.164675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.165754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.166390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.167582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.383584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.384215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.399766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.400580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.401259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.402216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.402973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.403593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.646424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.656041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-500ef45a-46a2-404c-bd55-4b848b28c915 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.514528 Oct 31 15:18:14.673058 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 595/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.679936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.681026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.707652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.713835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.714255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.714996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.715455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.715879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.819396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.827519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f69d096-0af5-4cca-aa38-7c8eff4fb089 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1465 microversion: 2.1 time: 0.447891 Oct 31 15:18:14.839107 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 559/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1465 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.848601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.849623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.860869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.861566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.863017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.864384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.869892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.870508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.224621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.247018 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-25fbe893-a86a-4aff-8f53-a228baede959 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.400578 Oct 31 15:18:15.248211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 560/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.253517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.254123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.276388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.276971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.279982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.280740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.281417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.281844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.381996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.395711 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a24a818f-c831-4563-b52c-dd16e62ee473 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.721328 Oct 31 15:18:15.396333 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 596/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.414413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.415044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.441424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.443508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.443992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.446934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.449682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.450308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.586305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.589180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:15.607208 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7f5074ff-4a28-439d-8c5e-d718e16e093e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1266 microversion: 2.1 time: 0.209666 Oct 31 15:18:15.608838 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 597/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.609611 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45fb4838-a2bd-48c7-aab6-1e50dbee975c tempest-ServersOnMultiNodesTest-847371614 tempest-ServersOnMultiNodesTest-847371614-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1618 microversion: 2.1 time: 0.359654 Oct 31 15:18:15.610325 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 561/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1618 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.619020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.619638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.638407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.639774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.641242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.642693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.643409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.644584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.848976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-862681aa-c7f2-4598-b501-06a133032af1 tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] Calling method '.version_select at 0x7f5ca2698040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.864192 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-862681aa-c7f2-4598-b501-06a133032af1 tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.252185 Oct 31 15:18:15.871600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 562/1159] 10.222.0.48 () {60 vars in 1226 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:15.874498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.877347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1784866311"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:15.880898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.886168 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8fbc204-83d9-460a-96f8-06dc8991d7b1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.273619 Oct 31 15:18:15.886719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 598/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.902848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.903675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.904367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.905040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.906341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.906972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.907114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.907700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.922920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.925683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.926317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.928363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.930159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.931284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.975474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:16.085110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47eb3f53-f89a-456d-ae00-5333607e4d10 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 204 len: 0 microversion: 2.1 time: 0.192231 Oct 31 15:18:16.085738 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 599/1161] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:15 2022] DELETE /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:16.096307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7048e6c5-f2a2-43ed-860b-3dc6f1bcad33 tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2645c10>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:16.187445 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce4599c0-622a-4b2a-9f7e-b64c8f0c6dd3 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action" status: 202 len: 0 microversion: 2.1 time: 0.314277 Oct 31 15:18:16.188100 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 563/1162] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:15 2022] POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:18:16.195000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.195000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.201584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.202077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.202516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.203215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.203851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.204434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.295667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7048e6c5-f2a2-43ed-860b-3dc6f1bcad33 tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.203060 Oct 31 15:18:16.296283 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 600/1163] 10.222.0.48 () {62 vars in 1247 bytes} [Mon Oct 31 15:18:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:16.302802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-224354166"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:16.305682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.316438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.316994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.321694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.323150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.324030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.325847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.373248 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Cannot 'createImage' instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 while it is in task_state image_snapshot Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action HTTP/1.1 Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 84 Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:16.374916 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-224354166"}} Oct 31 15:18:16.376230 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot 'createImage' instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 while it is in task_state image_snapshot Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-224354166'}}} Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:16.377050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 while it is in task_state image_snapshot Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 while it is in task_state image_snapshot Oct 31 15:18:16.378263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:16.379472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 409 to user: Cannot 'createImage' instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 while it is in task_state image_snapshot {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:16.379472 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e27410f-a1cd-4aa4-9e1d-a2c7e6ab2cfc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action" status: 409 len: 159 microversion: 2.1 time: 0.078387 Oct 31 15:18:16.379472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 601/1164] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:16 2022] POST /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939/action => generated 159 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:18:16.383959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e452f9be-1e97-4bec-ae7f-d9e0bbb3076c tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] Calling method '.version_select at 0x7f5ca2448700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.397582 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e452f9be-1e97-4bec-ae7f-d9e0bbb3076c tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019364 Oct 31 15:18:16.398141 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 602/1165] 10.222.0.48 () {60 vars in 1226 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:16.403161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84e264a2-6b54-4ddc-bdd7-0959fbda80d1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '.version_select at 0x7f5ca2448790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.540094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:16.553759 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4b9c206-8db5-403a-a674-817d130a6c36 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1471 microversion: 2.1 time: 0.363954 Oct 31 15:18:16.571550 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84e264a2-6b54-4ddc-bdd7-0959fbda80d1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/images/7bcd3cab-3a75-4274-af37-8c01d528bb71" status: 204 len: 0 microversion: 2.1 time: 0.171626 Oct 31 15:18:16.572886 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 603/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] DELETE /compute/v2.1/images/7bcd3cab-3a75-4274-af37-8c01d528bb71 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:16.573103 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 564/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:16.579082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23951f06-a36a-41a8-bd5f-351fabb12e4f tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca247a310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:16.583285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.584268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.595099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.595983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.597274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.598258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.599128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.599647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.672438 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23951f06-a36a-41a8-bd5f-351fabb12e4f tempest-QuotaClassesAdmin257Test-91778036 tempest-QuotaClassesAdmin257Test-91778036-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.097905 Oct 31 15:18:16.673097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 604/1168] 10.222.0.48 () {62 vars in 1247 bytes} [Mon Oct 31 15:18:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:16.684237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.684997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.693931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.694422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.694853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.695558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.696014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.696440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.156377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.187568 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-696a65dc-b2b7-4b3b-860e-4a53ee166706 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.612837 Oct 31 15:18:17.189848 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 565/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.197890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.198819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.225444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.229030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.235694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.236458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.237509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.238135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.238563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.241970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dea99e66-33f5-43cf-8164-8a7dd8dbfc5e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1534 microversion: 2.1 time: 0.567635 Oct 31 15:18:17.242782 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 605/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1534 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.268394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0aeb4ec-0164-4640-8f37-5a9bc59f0837", "device": "/dev/xvdb"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:17.273879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.281653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.282149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.282583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.284450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.284623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.284984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.493191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.504102 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b027f122-6a2b-4c3e-b468-571120dd12fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.312324 Oct 31 15:18:17.509506 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 566/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.514422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.515304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.521783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.522267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.522698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.523396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.523854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.524275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.720095 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9d651a9-d04c-45a7-8422-48fb3c1f7250 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "POST /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.459102 Oct 31 15:18:17.724893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 606/1172] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Oct 31 15:18:17 2022] POST /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:18:17.733794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.735115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.742880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.743518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.744487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.745105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.745670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.746631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.858576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.868900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c35584ed-b1d7-4cbd-966b-f1bce25256e6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.358073 Oct 31 15:18:17.869698 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 567/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.125112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:18.134332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76d25a73-6617-4701-a180-3d8cf42aeefb tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1471 microversion: 2.1 time: 0.412204 Oct 31 15:18:18.135406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f79220f6-e5ad-411c-a986-1873bc6f3f97 req-b48168fb-4d14-4b8d-9027-7790210a8c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802119d0-f33f-421a-910a-9a78e05406a6", "tag": "cc06bcb0-9110-476e-a705-7dfb05841e2e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:18.145826 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 607/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.151514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f79220f6-e5ad-411c-a986-1873bc6f3f97 req-b48168fb-4d14-4b8d-9027-7790210a8c2d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.152004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f79220f6-e5ad-411c-a986-1873bc6f3f97 req-b48168fb-4d14-4b8d-9027-7790210a8c2d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.152441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f79220f6-e5ad-411c-a986-1873bc6f3f97 req-b48168fb-4d14-4b8d-9027-7790210a8c2d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.199168 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f79220f6-e5ad-411c-a986-1873bc6f3f97 req-b48168fb-4d14-4b8d-9027-7790210a8c2d service nova] Creating event network-changed:cc06bcb0-9110-476e-a705-7dfb05841e2e for instance 802119d0-f33f-421a-910a-9a78e05406a6 on n-h2-858383-17 Oct 31 15:18:18.206618 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f79220f6-e5ad-411c-a986-1873bc6f3f97 req-b48168fb-4d14-4b8d-9027-7790210a8c2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075314 Oct 31 15:18:18.209447 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 568/1175] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:18.214133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.214790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.221081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.221980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.222574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.223445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.224662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.225260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.274158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.274870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.286105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.288967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.290758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.291977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.292960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.294470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.649120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:18.657196 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d410600c-10f8-4894-99e6-cfe85d92fa98 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.448087 Oct 31 15:18:18.658553 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 608/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:18.673462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.675327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.683208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.684136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.684901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.685604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.686217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.686981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.767608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:18.780483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8c9c7eb2-2fbe-40af-8a01-8901d6d810d2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1540 microversion: 2.1 time: 0.512500 Oct 31 15:18:18.792721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 569/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1540 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.896225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.897171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.917137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.917635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.918074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.918781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.919236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.919708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.925993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:19.209365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:19.219088 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e2ee62b-7eb1-46c7-bcb6-63aa358aeab9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.558393 Oct 31 15:18:19.219787 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 609/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:19.232881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.233497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:19.247643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.248435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.249274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.250218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.250886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.251462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.441745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:19.466422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:19.480631 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-348c4813-1b8f-408c-bd5a-0711f87b09ba tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.591381 Oct 31 15:18:19.481185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-17069879-7398-45ec-9472-d4743eb4b609 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1429 microversion: 2.1 time: 0.259625 Oct 31 15:18:19.481584 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 570/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:19.493920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 610/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1429 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:19.683178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.684230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:19.695553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.696547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.697600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.698619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.699905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.702536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.807042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.807666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:19.828323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.829172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.829792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.831631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.832602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.833253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.029779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.038685 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d5dd369-5cfc-4f36-859f-8ca9173b91ad tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.360512 Oct 31 15:18:20.039268 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 571/1181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:20.107413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.117938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da100367-efe1-4b3b-bcfe-55d2c77a1d34 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1540 microversion: 2.1 time: 0.314805 Oct 31 15:18:20.118930 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 611/1182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1540 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:20.248745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:20.249361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:20.264055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.264554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.265032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.265733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.266188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.266607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.314804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-12b4bcac-6887-4029-8d10-9c5d15869c8a req-39d94eb8-fde3-4cb6-a648-c5be681bf05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d96293d-930b-49d3-b6bc-126ea18f36da", "name": "network-vif-deleted", "tag": "48f520c8-387a-4e52-97f2-313b60a8d7fc"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:20.348550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-12b4bcac-6887-4029-8d10-9c5d15869c8a req-39d94eb8-fde3-4cb6-a648-c5be681bf05a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.351372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-12b4bcac-6887-4029-8d10-9c5d15869c8a req-39d94eb8-fde3-4cb6-a648-c5be681bf05a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.352106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-12b4bcac-6887-4029-8d10-9c5d15869c8a req-39d94eb8-fde3-4cb6-a648-c5be681bf05a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.399293 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-12b4bcac-6887-4029-8d10-9c5d15869c8a req-39d94eb8-fde3-4cb6-a648-c5be681bf05a service nova] Creating event network-vif-deleted:48f520c8-387a-4e52-97f2-313b60a8d7fc for instance 0d96293d-930b-49d3-b6bc-126ea18f36da on n-h1-858383-17 Oct 31 15:18:20.406728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-12b4bcac-6887-4029-8d10-9c5d15869c8a req-39d94eb8-fde3-4cb6-a648-c5be681bf05a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097391 Oct 31 15:18:20.408189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 612/1183] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:20.512116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:20.514411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:20.530381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.532058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.533105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.535758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.537489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.538306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.685459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.696581 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f400be6-929c-4c6c-a337-e2a5dd330c46 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.451659 Oct 31 15:18:20.697454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 572/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:20 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:20.702637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:20.705119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:20.733043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.734826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.736521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.739049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.739528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.739962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.803652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.804517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.805446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.806166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lazy-loading 'fault' on Instance uuid 0d96293d-930b-49d3-b6bc-126ea18f36da {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:20.872040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.885117 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6fc4093-853e-4da9-8603-ab228608dfb3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1474 microversion: 2.1 time: 0.378621 Oct 31 15:18:20.886314 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 613/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:20 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:20.958448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.970050 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c21cfdf5-ae7c-4bc1-9985-6747cd75652e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 200 len: 1306 microversion: 2.1 time: 0.271328 Oct 31 15:18:20.973212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 573/1186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:20 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 1306 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:21.069596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:21.070334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:21.082384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.084733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.087248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.088956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.090909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.091681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.147950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:21.148872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:21.176132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.176132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.176132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.177507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.178364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.178994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.633303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:21.652071 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9758b99b-01ec-467e-b312-cc196555ba45 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1535 microversion: 2.1 time: 0.508443 Oct 31 15:18:21.666282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 574/1187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:21 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1535 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:21.725822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:21.727036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:21.744020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.744571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.745035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.747268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.751165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.751814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.874015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:21.884709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c93f417-72fd-47d3-af13-626fd0146a97 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.822510 Oct 31 15:18:21.889424 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 614/1188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:21 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:21.908834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:21.909811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:21.922218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.923130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.923754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.926016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.927458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.928645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.120333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:22.660598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:22.681346 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a727ee39-e776-42e4-8abe-e93b0caff8a2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.949391 Oct 31 15:18:22.682873 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 575/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:21 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:22.718930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:22.719942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 0d96293d-930b-49d3-b6bc-126ea18f36da] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:22.737373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.741919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:22.742556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.743298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.743759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:22.744185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.779638 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance 0d96293d-930b-49d3-b6bc-126ea18f36da could not be found. Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da HTTP/1.1 Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:22.781669 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 0d96293d-930b-49d3-b6bc-126ea18f36da could not be found. Oct 31 15:18:22.783090 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0d96293d-930b-49d3-b6bc-126ea18f36da'} Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d96293d-930b-49d3-b6bc-126ea18f36da could not be found. Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:22.784485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d96293d-930b-49d3-b6bc-126ea18f36da could not be found. Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d96293d-930b-49d3-b6bc-126ea18f36da could not be found. Oct 31 15:18:22.787407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:22.789297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance 0d96293d-930b-49d3-b6bc-126ea18f36da could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:22.789297 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01bf8bd2-f631-4b0a-8374-39ceba766621 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da" status: 404 len: 111 microversion: 2.1 time: 0.099545 Oct 31 15:18:22.789297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 576/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:22 2022] GET /compute/v2.1/servers/0d96293d-930b-49d3-b6bc-126ea18f36da => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:22.794942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:22.809446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:22.819763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.820468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:22.821205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.822465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.823160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:22.823836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.906362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:22.929050 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-803279ef-e2bb-49f4-8e0f-50d28533a8c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1473 microversion: 2.1 time: 1.024274 Oct 31 15:18:22.930626 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 615/1191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:21 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1473 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:22.950067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:22.951073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:22.996321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.999367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.000238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.004557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.007060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.007771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.016632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:23.073949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:23.124206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.137877 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a3999e2e-6c54-4f7d-8fb6-a4f16fbad189 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1522 microversion: 2.1 time: 0.348306 Oct 31 15:18:23.138494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 577/1192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:22 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.156077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.156738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.169789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.170957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.171819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.172823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.173679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.175151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.214858 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff7fc60b-6fba-4e9f-be9a-476caa3689f4 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 204 len: 0 microversion: 2.1 time: 0.282383 Oct 31 15:18:23.215558 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 616/1193] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:22 2022] DELETE /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:23.224302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.225926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.233735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.234314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.235224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.240874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.240874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.240874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.298056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:23.482365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=17,nova_api:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:23.506158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95a90d79-5170-4487-883e-9754ee1bbbbd tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 204 len: 0 microversion: 2.1 time: 0.288724 Oct 31 15:18:23.513775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 617/1194] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:23 2022] DELETE /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:23.528087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.528991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.545310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.546007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.546555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.547381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.548058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.548780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.550189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.571689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ccea09cd-5483-44b9-9549-ca342d9de808 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.432043 Oct 31 15:18:23.572559 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 578/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.581577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.584509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.592138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.592996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.593747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.594735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.595383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.596023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.830566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.840478 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-363a0dd5-b26a-4bc4-a5dc-31ad57043624 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1471 microversion: 2.1 time: 0.323488 Oct 31 15:18:23.841304 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 618/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.848638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.849690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.858786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.859693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.860508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.861438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.863187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.882758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.918371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.931115 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69219c09-06e4-4ce0-8fc8-06fbb5c1d598 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1528 microversion: 2.1 time: 0.355836 Oct 31 15:18:23.936155 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 579/1197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1528 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.960234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.960520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.973644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.978280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.979430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.980176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.980711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.981163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.077382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:24.223794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.237859 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be8ef6b0-0323-4efd-8c41-02d6e47bf7e5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.392001 Oct 31 15:18:24.238814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 619/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:24.317825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.326325 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92282f07-acb9-44c5-b330-9a135ea8c90d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1471 microversion: 2.1 time: 0.371315 Oct 31 15:18:24.341607 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 580/1199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:24.615793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.620041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:24.640014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.643632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.644358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.647622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.651483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.652159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.702358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f4f69401-cd9b-4cc6-8dbe-34b4e65d426f req-15659c3d-3a57-40ba-9719-53357477aee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49d2d14-1dea-4aeb-8b9c-e947eb21f939", "name": "network-vif-plugged", "status": "completed", "tag": "027ef5c6-722e-486b-aed2-211ee9a6f939"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:24.729208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4f69401-cd9b-4cc6-8dbe-34b4e65d426f req-15659c3d-3a57-40ba-9719-53357477aee9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.732113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4f69401-cd9b-4cc6-8dbe-34b4e65d426f req-15659c3d-3a57-40ba-9719-53357477aee9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.733721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4f69401-cd9b-4cc6-8dbe-34b4e65d426f req-15659c3d-3a57-40ba-9719-53357477aee9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.769749 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f4f69401-cd9b-4cc6-8dbe-34b4e65d426f req-15659c3d-3a57-40ba-9719-53357477aee9 service nova] Creating event network-vif-plugged:027ef5c6-722e-486b-aed2-211ee9a6f939 for instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 on n-h2-858383-17 Oct 31 15:18:24.776765 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f4f69401-cd9b-4cc6-8dbe-34b4e65d426f req-15659c3d-3a57-40ba-9719-53357477aee9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080593 Oct 31 15:18:24.778484 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 581/1200] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:24.886913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.888437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:24.908231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.908849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.910607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.911508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.913057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.918547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.133696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.142759 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7559925d-88a9-483d-a869-9d8be1050e38 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.546075 Oct 31 15:18:25.147624 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 620/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.152620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.179001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.198886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.199395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.199842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.200569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.201750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.202210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.217639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.227147 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1df19119-ea08-4f03-9ae6-68b92ed9a1b7 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1471 microversion: 2.1 time: 0.360426 Oct 31 15:18:25.230128 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 582/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.281744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.282558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.292311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.296805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.300596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.302027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.302734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.303479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.557086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.574128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a8f98fe-8e41-4957-aedb-3ff62bc8549a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1528 microversion: 2.1 time: 0.425307 Oct 31 15:18:25.578591 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 621/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.590123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.599849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.614525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.615154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.617038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.617898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.620588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.621289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.809282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.811119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.821573 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a31854e-6109-4b80-a93f-f57aad33ff92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1471 microversion: 2.1 time: 0.241545 Oct 31 15:18:25.822170 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 622/1204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.832932 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75398210-6d9d-425b-92a1-37c21109b7ae tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.555117 Oct 31 15:18:25.832932 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 583/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.169292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:26.182014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.182656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.233813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.234614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.244803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.247924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.249737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.250306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.251204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.252010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.259690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.260184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.260622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.261365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.261829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.262255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.596849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:26.599576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:26.609002 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eef2d7d1-84c7-4d75-828e-947e498e0e58 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.442336 Oct 31 15:18:26.609501 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1be68ac5-cb78-45a1-9562-6a575ee346ea tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1471 microversion: 2.1 time: 0.362105 Oct 31 15:18:26.610094 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 623/1206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.610661 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 584/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.633767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.634778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.641708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.642261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.643437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.644711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.645469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.646178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.677378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:26.793081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1846965611", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "619fc2a7-48a2-488f-822e-32ff25c82360"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:26.905285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] validate_networks() for [('619fc2a7-48a2-488f-822e-32ff25c82360', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:26.972283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:26.986445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1953b4eb-0de8-4554-bed4-7cf08bfd37fa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1528 microversion: 2.1 time: 0.363691 Oct 31 15:18:26.998167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 624/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:27.011066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:27.012824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:27.023873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.024792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.025557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.026525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.027250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.028005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.586392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:27.600303 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f660eac0-79d1-4176-92fb-819cfe954344 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1471 microversion: 2.1 time: 0.593736 Oct 31 15:18:27.602607 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 625/1209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:27 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1471 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:27.607931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:27.609281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:27.619422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.620402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.621033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.623092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.623744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.628454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.864829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:27.865437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:27.865617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:27.866032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:27.866458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:27.884479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.885244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.886026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.887069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.887631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.888126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.910270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Getting quotas for project 9affbb7cbc954cd8b44bf8f30767a1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:27.923241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Getting quotas for user e69c6e6309854c1288ad1a19631704d8 and project 9affbb7cbc954cd8b44bf8f30767a1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:27.943699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:27.946017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:28.023566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.026255 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-709d1675-c425-45f2-8dc9-596c9aeda058 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413077 Oct 31 15:18:28.030890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 585/1210] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:28.036060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09142860-c91f-4a33-b580-e1288ecae4bd", "name": "network-vif-unplugged", "status": "completed", "tag": "02a04c3f-55f1-45d0-9693-0d91bb15b3fd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:28.037608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b848381-f4ed-45cc-b705-abf9625350f1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.433723 Oct 31 15:18:28.040747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 626/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:27 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.045835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5684451e-5318-4a8a-90c5-26921bdce551 req-9400128e-aa4f-4a50-9c6d-b04535af6d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49d2d14-1dea-4aeb-8b9c-e947eb21f939", "name": "network-vif-deleted", "tag": "027ef5c6-722e-486b-aed2-211ee9a6f939"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:28.071074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5684451e-5318-4a8a-90c5-26921bdce551 req-9400128e-aa4f-4a50-9c6d-b04535af6d4f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.071576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5684451e-5318-4a8a-90c5-26921bdce551 req-9400128e-aa4f-4a50-9c6d-b04535af6d4f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.073023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5684451e-5318-4a8a-90c5-26921bdce551 req-9400128e-aa4f-4a50-9c6d-b04535af6d4f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.101171 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5684451e-5318-4a8a-90c5-26921bdce551 req-9400128e-aa4f-4a50-9c6d-b04535af6d4f service nova] Creating event network-vif-deleted:027ef5c6-722e-486b-aed2-211ee9a6f939 for instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 on n-h2-858383-17 Oct 31 15:18:28.113976 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5684451e-5318-4a8a-90c5-26921bdce551 req-9400128e-aa4f-4a50-9c6d-b04535af6d4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071792 Oct 31 15:18:28.114877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.115199 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 627/1212] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:28.117426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.120683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.131496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.132220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.144912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.145738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.146519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.147435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.148055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.148646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.170907 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] Creating event network-vif-unplugged:02a04c3f-55f1-45d0-9693-0d91bb15b3fd for instance 09142860-c91f-4a33-b580-e1288ecae4bd on n-h1-858383-17 Oct 31 15:18:28.222024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] Instance 09142860-c91f-4a33-b580-e1288ecae4bd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:18:28.244927 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-86768302-c0bb-4569-a008-a33238f30e8d req-2a86c4dd-f228-4e94-bcf4-cb392864d3c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.212646 Oct 31 15:18:28.245552 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 586/1213] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:28.249528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.263318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0259a43-290d-4c09-a8cc-0a672bc1bd51 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1302 microversion: 2.1 time: 0.145780 Oct 31 15:18:28.264438 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 628/1214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.269251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.270163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.271768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3f38dbf2-0b6e-4575-9f0b-70571aa3989b req-3ca7813d-70a6-4cca-8183-e17e8d0c084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab331d4-e68d-40dc-9638-67a4dae2bd42", "name": "network-vif-deleted", "tag": "1f86272c-f4b9-4f4d-a7c7-d7dbea179058"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:28.280429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.280981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.281548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.291121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.291981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.292652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.294356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3f38dbf2-0b6e-4575-9f0b-70571aa3989b req-3ca7813d-70a6-4cca-8183-e17e8d0c084b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.295205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3f38dbf2-0b6e-4575-9f0b-70571aa3989b req-3ca7813d-70a6-4cca-8183-e17e8d0c084b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.295659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3f38dbf2-0b6e-4575-9f0b-70571aa3989b req-3ca7813d-70a6-4cca-8183-e17e8d0c084b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.309595 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3f38dbf2-0b6e-4575-9f0b-70571aa3989b req-3ca7813d-70a6-4cca-8183-e17e8d0c084b service nova] Creating event network-vif-deleted:1f86272c-f4b9-4f4d-a7c7-d7dbea179058 for instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 on n-h2-858383-17 Oct 31 15:18:28.315990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3f38dbf2-0b6e-4575-9f0b-70571aa3989b req-3ca7813d-70a6-4cca-8183-e17e8d0c084b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049759 Oct 31 15:18:28.317062 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 629/1215] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:28.327663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.329078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.339855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.340441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.340987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.342190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.343898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.345048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.391610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.392447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.393302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.394228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lazy-loading 'fault' on Instance uuid e49d2d14-1dea-4aeb-8b9c-e947eb21f939 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:28.398356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:28.475054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.489776 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5fe8fe2-2cb4-47d1-bd76-456ef3310891 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 200 len: 1315 microversion: 2.1 time: 0.170748 Oct 31 15:18:28.491184 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 630/1216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.513629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.522373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-96aff240-ab23-42fe-9b17-5efb4f57147d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.522770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a68096f0-9578-427c-80f3-ca1f67457e7c tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.276028 Oct 31 15:18:28.523591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-96aff240-ab23-42fe-9b17-5efb4f57147d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.532469 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 587/1217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.588427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-96aff240-ab23-42fe-9b17-5efb4f57147d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.600420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-96aff240-ab23-42fe-9b17-5efb4f57147d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1224 microversion: 2.1 time: 0.093414 Oct 31 15:18:28.603175 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 631/1218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.630455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.631332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.639457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.640111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.640734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.641418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.642077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.642548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.842886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.849656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:28.861591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a745a589-c554-4caa-8a7b-bb87468fac6b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1468 microversion: 2.1 time: 0.235675 Oct 31 15:18:28.863134 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 588/1219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1468 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.885497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:28.886303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.907596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.912995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.914206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.915278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.916689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.917489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.000011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c35dc0f-6ceb-4fa0-a8be-0422a6ffde16 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd/action" status: 204 len: 0 microversion: 2.1 time: 0.118170 Oct 31 15:18:29.004402 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 632/1220] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:28 2022] POST /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd/action => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:29.009827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.010444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.016940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.017436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.018246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.019128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.019753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.020612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.069785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.071214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.078897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.079918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.081317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.082347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.083427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.084217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.302106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.320059 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e61536c3-4d49-48c3-9632-2957a50ca28c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1468 microversion: 2.1 time: 0.313763 Oct 31 15:18:29.322272 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 589/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:29.329261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.330898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.342567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.343409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.344015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.344594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.345107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.345563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.368535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.378369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d92bb74-ab0c-4b57-8082-efbbe1324931 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.314977 Oct 31 15:18:29.378899 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 633/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.387591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.388653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.389129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.390114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lazy-loading 'fault' on Instance uuid 9ab331d4-e68d-40dc-9638-67a4dae2bd42 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:29.449363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.462011 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5542e046-5fbb-4010-82be-5e68d2ce88e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 200 len: 1307 microversion: 2.1 time: 0.138247 Oct 31 15:18:29.483093 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 590/1223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.523435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.524714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.533273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.533941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.534468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.535439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.536295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.536881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.549321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.550017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.571482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.572582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.573542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.574453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.575076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.575664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.599618 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 HTTP/1.1 Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:29.601795 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:18:29.603653 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939'} Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:29.604432 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:18:29.605681 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:29.606794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:29.606794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42f71521-94f2-416e-b268-c7ed07475b17 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 404 len: 111 microversion: 2.1 time: 0.088037 Oct 31 15:18:29.614204 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 634/1224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:29.622506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f260820-46b4-447b-b6e0-9e89ab7123bc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'create', calling method: .version_select at 0x7f5ca235c3a0>, body: {"keypair": {"name": "tempest-keypair-1683871846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyR0zTmwLJ067cInfO1KVGDJ+qfXpwCoKwBOr0e5MyQARX/vzUEqbFIDsTPVWgHSDwoeE6MFasftcJrA1z/cAxyg4IpjnQbu2v17UP7kXXZQ82J/s+hR1EDhplTez012A=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:29.650031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4f260820-46b4-447b-b6e0-9e89ab7123bc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:29.656533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4f260820-46b4-447b-b6e0-9e89ab7123bc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for user 9315a4916cfa47da9904d8bfbc775e0a and project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:29.691369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f260820-46b4-447b-b6e0-9e89ab7123bc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075549 Oct 31 15:18:29.692525 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 635/1225] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:18:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:29.698467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.699091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.706326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.706817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.707456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.708173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.708686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.709199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.814687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.838664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32777a2f-5826-444f-b84a-7a4bc5d458e5 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1276 microversion: 2.1 time: 0.144626 Oct 31 15:18:29.839266 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 636/1226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.853846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.867715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fef2b80d-5cf2-4bd3-8155-07e1f5fbb23f tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.324293 Oct 31 15:18:29.872667 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 591/1227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:30.296252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6b8ba6d3-f73d-4269-8502-f02171cc9b8e req-bcdfd00c-33f3-484b-9ed0-e46e8187ce26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802119d0-f33f-421a-910a-9a78e05406a6", "name": "network-vif-plugged", "status": "completed", "tag": "cc06bcb0-9110-476e-a705-7dfb05841e2e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:30.320981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6b8ba6d3-f73d-4269-8502-f02171cc9b8e req-bcdfd00c-33f3-484b-9ed0-e46e8187ce26 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.321510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6b8ba6d3-f73d-4269-8502-f02171cc9b8e req-bcdfd00c-33f3-484b-9ed0-e46e8187ce26 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.321941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6b8ba6d3-f73d-4269-8502-f02171cc9b8e req-bcdfd00c-33f3-484b-9ed0-e46e8187ce26 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.345205 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6b8ba6d3-f73d-4269-8502-f02171cc9b8e req-bcdfd00c-33f3-484b-9ed0-e46e8187ce26 service nova] Creating event network-vif-plugged:cc06bcb0-9110-476e-a705-7dfb05841e2e for instance 802119d0-f33f-421a-910a-9a78e05406a6 on n-h2-858383-17 Oct 31 15:18:30.348810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:30.349793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:30.363446 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6b8ba6d3-f73d-4269-8502-f02171cc9b8e req-bcdfd00c-33f3-484b-9ed0-e46e8187ce26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071409 Oct 31 15:18:30.364152 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 637/1228] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:30.378550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:30.387847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.388916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.392517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.396042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.399852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.401722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:30.401867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.402506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:30.414791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.415287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.415768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.416477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.416961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.417451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.265525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.268727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.282772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e51f246-fa52-4536-87ee-0f5d52f4c3ed tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1468 microversion: 2.1 time: 0.939819 Oct 31 15:18:31.285105 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 592/1229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:30 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1468 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:31.293387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-06c4ff8c-cc9d-40f0-82c7-68c646303f10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.896102 Oct 31 15:18:31.322550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.323357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 9ab331d4-e68d-40dc-9638-67a4dae2bd42] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.331996 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 638/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:30 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:31.337969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.339892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.342780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.343897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.344032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.344549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.344966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.346161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.353800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.354291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.354727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.355435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.355891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.356338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.364300 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 could not be found. Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 HTTP/1.1 Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:31.370265 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 could not be found. Oct 31 15:18:31.371906 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9ab331d4-e68d-40dc-9638-67a4dae2bd42'} Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 could not be found. Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:31.372813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 could not be found. Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 could not be found. Oct 31 15:18:31.374236 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:31.377631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance 9ab331d4-e68d-40dc-9638-67a4dae2bd42 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:31.379758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1aa527f5-0181-483f-8ade-6e05ce79c43e tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42" status: 404 len: 111 microversion: 2.1 time: 0.093287 Oct 31 15:18:31.380762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 593/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/9ab331d4-e68d-40dc-9638-67a4dae2bd42 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:31.386464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.387390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.397083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.398102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.398845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.399724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.400380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.401697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.542747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.553709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fceacd70-4b65-4029-b490-5218f8449e61 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1282 microversion: 2.1 time: 0.219165 Oct 31 15:18:31.555033 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 639/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:31.577750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.578576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.585404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.586373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.587012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.588282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.588975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.589600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.621353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:31.719793 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ebf82d80-92ea-4d37-a901-e288ceee8627 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 204 len: 0 microversion: 2.1 time: 0.152370 Oct 31 15:18:31.720394 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 640/1233] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:31 2022] DELETE /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:31.730248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-584578908", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:31.757995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.766289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-564fd8ec-5ca5-4e4d-a89f-ad7929b116cd tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.384223 Oct 31 15:18:31.767061 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 594/1234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:31.789470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.790288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.798041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.799442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.800609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.804525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] validate_networks() for [('f0d5b929-e8f8-4875-990d-aaf4f4a8247a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:31.816857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.817754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.818229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.136054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:32.154361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d2e24ee-66be-4004-9120-c315f845c5a2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1472 microversion: 2.1 time: 0.371341 Oct 31 15:18:32.155178 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 595/1235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:32.321328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:32.322251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:32.330854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.331811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.332430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.333357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.333999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.334708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.683132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:32.692368 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a0f4a3d-cb16-4e50-9a6e-c1ac81ba9a78 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1468 microversion: 2.1 time: 0.376514 Oct 31 15:18:32.693345 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 596/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:32 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:32.699116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:32.699724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:32.708041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.708531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.709627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.710758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.711182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:32.711659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.711659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.712306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:32.712975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:32.713793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:32.714352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:32.726003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.726490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.726922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.727639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.728091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.728511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.747287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:32.752843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for user 9315a4916cfa47da9904d8bfbc775e0a and project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:32.765332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:32.767881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:32.815618 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-027db069-06bf-4823-8c1c-ea2bf68bdd1e tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.093594 Oct 31 15:18:32.817239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 641/1237] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:32.826137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:32.826751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:32.833955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.834648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.835283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.835981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.836583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.837255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.030483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.038961 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a1ddcb51-127f-4ddd-9706-9781c88d88a8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1308 microversion: 2.1 time: 0.344338 Oct 31 15:18:33.039820 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 597/1238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:32 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.044487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.045200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.051846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.052415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.052946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.053715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.054232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.054716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.089101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.100392 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-966ef102-54ee-45d7-a9d5-fd6877faab63 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.281720 Oct 31 15:18:33.101148 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 642/1239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:32 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.105968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e4e5dcf-8a35-4e75-8b1e-9f5703e28586 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.106747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e4e5dcf-8a35-4e75-8b1e-9f5703e28586 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.241152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e4e5dcf-8a35-4e75-8b1e-9f5703e28586 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.250614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e4e5dcf-8a35-4e75-8b1e-9f5703e28586 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1224 microversion: 2.1 time: 0.148254 Oct 31 15:18:33.251571 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 643/1240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.264548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.265321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.272345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.273217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.274126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.274728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.275339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.275772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.341423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.350320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98091f49-7d3d-4710-9ce5-af12b4d2bf5b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.309335 Oct 31 15:18:33.350899 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 598/1241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.520589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.528491 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35eb9d7a-2504-4fa1-a0fb-199d2aec39ce tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1472 microversion: 2.1 time: 0.275535 Oct 31 15:18:33.529199 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 644/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.715703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.716329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.724017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.724514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.724981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.725688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.726153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.726577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.728523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ec2824cf-3e18-4431-89c9-5a4c104a0b58 req-758599c4-3147-4c4f-ae9f-ac48c6b0ede4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:33.739888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec2824cf-3e18-4431-89c9-5a4c104a0b58 req-758599c4-3147-4c4f-ae9f-ac48c6b0ede4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.740432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec2824cf-3e18-4431-89c9-5a4c104a0b58 req-758599c4-3147-4c4f-ae9f-ac48c6b0ede4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.740968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec2824cf-3e18-4431-89c9-5a4c104a0b58 req-758599c4-3147-4c4f-ae9f-ac48c6b0ede4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.760034 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ec2824cf-3e18-4431-89c9-5a4c104a0b58 req-758599c4-3147-4c4f-ae9f-ac48c6b0ede4 service nova] Creating event network-changed:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:18:33.765341 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ec2824cf-3e18-4431-89c9-5a4c104a0b58 req-758599c4-3147-4c4f-ae9f-ac48c6b0ede4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042542 Oct 31 15:18:33.766239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 645/1243] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:33.936214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.945375 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b81fa801-31f2-4839-bbaf-713d5beea03c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1460 microversion: 2.1 time: 0.233779 Oct 31 15:18:33.946032 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 599/1244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1460 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.979766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.980992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.990997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.993191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.994021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.994665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.996267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.998148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.064000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.065326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.077213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.078097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.078993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.080806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.081589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.082362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.500052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.514758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.527884 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-160cab6e-dfe2-43eb-9b63-f288d82cee7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1460 microversion: 2.1 time: 0.554452 Oct 31 15:18:34.529023 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76a462a8-9092-4c1f-bc87-88d38c61fac2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1489 microversion: 2.1 time: 0.469565 Oct 31 15:18:34.529167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 646/1245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1460 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.530203 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 600/1246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1489 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:34.557399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.558071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.559945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.563749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.570732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.571222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.571872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.572841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.574001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.574819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.575034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.575785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.576847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.577911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.578453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.579186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.725790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.736306 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-35ddbd13-a850-4122-8341-2d4f08672e4c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1276 microversion: 2.1 time: 0.204100 Oct 31 15:18:34.737657 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 601/1247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.742528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.743133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.749645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.750485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.751168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.752332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.753024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.753604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.887039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.897543 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f762676-e103-465d-8840-c9a844bfe0b4 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.362718 Oct 31 15:18:34.910474 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 647/1248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.913079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.913079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.921557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.922406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.923151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.924028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.924809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.925682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.036207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:35.045116 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20c090d7-8aae-4a38-8da6-eeceedaf87ff tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.306084 Oct 31 15:18:35.045890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 602/1249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:35.061551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b9dfb65e-93a7-43e0-ac33-8700b705a1dc req-d2cf1f26-6dec-4323-85c3-2e31626c3ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09142860-c91f-4a33-b580-e1288ecae4bd", "name": "network-vif-plugged", "status": "completed", "tag": "02a04c3f-55f1-45d0-9693-0d91bb15b3fd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:35.073236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b9dfb65e-93a7-43e0-ac33-8700b705a1dc req-d2cf1f26-6dec-4323-85c3-2e31626c3ee1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.073839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b9dfb65e-93a7-43e0-ac33-8700b705a1dc req-d2cf1f26-6dec-4323-85c3-2e31626c3ee1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.074336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b9dfb65e-93a7-43e0-ac33-8700b705a1dc req-d2cf1f26-6dec-4323-85c3-2e31626c3ee1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.089227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b9dfb65e-93a7-43e0-ac33-8700b705a1dc req-d2cf1f26-6dec-4323-85c3-2e31626c3ee1 service nova] Creating event network-vif-plugged:02a04c3f-55f1-45d0-9693-0d91bb15b3fd for instance 09142860-c91f-4a33-b580-e1288ecae4bd on n-h1-858383-17 Oct 31 15:18:35.095142 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b9dfb65e-93a7-43e0-ac33-8700b705a1dc req-d2cf1f26-6dec-4323-85c3-2e31626c3ee1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047403 Oct 31 15:18:35.096827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 603/1250] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:35.102458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:35.103169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.110251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.110780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.112171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.113129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.113770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.114211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.172796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:35.212112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:35.220051 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6271b891-9176-41d9-9754-bcbe22625912 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 2424 microversion: 2.25 time: 0.312836 Oct 31 15:18:35.228527 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 648/1251] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 2424 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:35.235046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:35.235576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.238911 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fb625f64-ee4d-4c9b-a4f3-1adf7a3d3b21 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 200 len: 1430 microversion: 2.1 time: 0.140667 Oct 31 15:18:35.252646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:35.253326 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 604/1252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:35 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 1430 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:35.260063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.260565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.261013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.261724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.262176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.262315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8dfcc2bd-52a3-4e6b-949d-68e16b7f1b92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'create', calling method: .version_select at 0x7f5ca2424280>, body: {"keypair": {"name": "tempest-keypair-2111067039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANqIvso0XFdbxWSMCXI47TKV3d4Ais08Iv9IBWcM7TIWHnsQN4CrcUIntscUVOJgLVvR0Fw3I7RcBKZ11QReUZ6KBr9Lq2a/rXlaGRlvUwQjQJQYlc59zI4b1MonukotA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:35.262598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.301966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:35.308975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-8dfcc2bd-52a3-4e6b-949d-68e16b7f1b92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:35.325863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-8dfcc2bd-52a3-4e6b-949d-68e16b7f1b92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for user 8184a0251b8e4cb882556b458bbc4de7 and project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:35.375826 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8dfcc2bd-52a3-4e6b-949d-68e16b7f1b92 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120902 Oct 31 15:18:35.376775 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 605/1253] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:18:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:35.382967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": "auto"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:35.394689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.401852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9fcce53-ad81-43d7-a8f1-7de0db8da901 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6/action" status: 202 len: 0 microversion: 2.1 time: 0.171505 Oct 31 15:18:35.404128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.405094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.405679 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 649/1254] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:35 2022] POST /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:35.406059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.407660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.410690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.411623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.421070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:35.424992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.445065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.450680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.451979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.454471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.457090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.458440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.479702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'flavor' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:35.506223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Going to try to live migrate instance to n-h1-858383-17 {{(pid=120626) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:18:35.559684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:36.270352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:36.282250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a24d365-0b70-4637-baa2-19aced7e3de2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1494 microversion: 2.1 time: 0.872751 Oct 31 15:18:36.283494 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 650/1255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:35 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1494 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:36.291218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:36.291705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:36.307584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.308083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.308594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.309332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.310076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.310199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.407631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:36.417971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f023251-0e16-4c4b-8ad1-977188840627 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1282 microversion: 2.1 time: 0.130640 Oct 31 15:18:36.419044 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 651/1256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:36 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:36.423821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:36.424434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:36.430315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.430820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.431238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.432036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.432745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.433188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.758313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:36.769851 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61bdd3cd-5175-479b-bed0-9c36ee1d6438 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.349615 Oct 31 15:18:36.770685 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 652/1257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:36 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:36.775667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:36.777098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:36.784436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.785052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.785507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.786309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.786827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.787402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.039458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:37.051589 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ce53542-65ae-493d-be34-4d49352c3702 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.279635 Oct 31 15:18:37.052398 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 653/1258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:36 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.073845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-24e19761-9706-4812-8a46-a51bc24c8faa req-6571b753-2348-4153-a85b-c1e1cd59e86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62a28f2-d478-4b10-bc35-f88f048ad1ee", "name": "network-vif-deleted", "tag": "31606774-a4a6-43cb-843b-2abb9b050e72"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:37.085552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-24e19761-9706-4812-8a46-a51bc24c8faa req-6571b753-2348-4153-a85b-c1e1cd59e86c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.086114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-24e19761-9706-4812-8a46-a51bc24c8faa req-6571b753-2348-4153-a85b-c1e1cd59e86c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.086625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-24e19761-9706-4812-8a46-a51bc24c8faa req-6571b753-2348-4153-a85b-c1e1cd59e86c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.100833 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-24e19761-9706-4812-8a46-a51bc24c8faa req-6571b753-2348-4153-a85b-c1e1cd59e86c service nova] Creating event network-vif-deleted:31606774-a4a6-43cb-843b-2abb9b050e72 for instance c62a28f2-d478-4b10-bc35-f88f048ad1ee on n-h2-858383-17 Oct 31 15:18:37.107121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-24e19761-9706-4812-8a46-a51bc24c8faa req-6571b753-2348-4153-a85b-c1e1cd59e86c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040465 Oct 31 15:18:37.108038 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 654/1259] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:37.114539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.115364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: c62a28f2-d478-4b10-bc35-f88f048ad1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.122856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.123489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.124019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.125007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.126070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.126070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.152570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance c62a28f2-d478-4b10-bc35-f88f048ad1ee could not be found. Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee HTTP/1.1 Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:37.156099 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance c62a28f2-d478-4b10-bc35-f88f048ad1ee could not be found. Oct 31 15:18:37.157842 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'c62a28f2-d478-4b10-bc35-f88f048ad1ee'} Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62a28f2-d478-4b10-bc35-f88f048ad1ee could not be found. Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:37.158817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62a28f2-d478-4b10-bc35-f88f048ad1ee could not be found. Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62a28f2-d478-4b10-bc35-f88f048ad1ee could not be found. Oct 31 15:18:37.160526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:37.162664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance c62a28f2-d478-4b10-bc35-f88f048ad1ee could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:37.162664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9cc5e4ff-9033-4884-b80e-d139ee12c939 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee" status: 404 len: 111 microversion: 2.1 time: 0.049217 Oct 31 15:18:37.162821 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 655/1260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/c62a28f2-d478-4b10-bc35-f88f048ad1ee => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:37.168243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.168814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.177269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.177760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.178255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.178977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.179436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.179861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.213629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:37.319121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8254706-9689-47b9-82f1-c765d2e3c958 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 204 len: 0 microversion: 2.1 time: 0.154383 Oct 31 15:18:37.319936 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 656/1261] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:37 2022] DELETE /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:37.325138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.325854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.334807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.335325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.335760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.336471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.336972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.337398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.675516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:37.683924 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53d491f0-db63-475b-a2fb-a9e544f7e055 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 200 len: 1474 microversion: 2.1 time: 0.363005 Oct 31 15:18:37.684576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 657/1262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.690026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.690657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.696684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.697554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.697927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.698585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.699357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.702416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.750614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:37.853831 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61901095-ad6d-4aaa-a9c8-e65b8dadfa98 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 204 len: 0 microversion: 2.1 time: 0.167918 Oct 31 15:18:37.858378 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 658/1263] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:37 2022] DELETE /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:37.864912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.865622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.872927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.873536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.873975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.876058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.877460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.878093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.899867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:38.100062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.107893 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-801873a2-835a-4eae-b748-8aa3cdef6d23 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1324 microversion: 2.1 time: 0.248641 Oct 31 15:18:38.108474 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 659/1264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.112922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a503e74-972a-4109-b01d-7ba9b4548807 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '.version_select at 0x7f5ca235c670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.116357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a503e74-972a-4109-b01d-7ba9b4548807 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.116876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a503e74-972a-4109-b01d-7ba9b4548807 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.117311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a503e74-972a-4109-b01d-7ba9b4548807 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.127181 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a503e74-972a-4109-b01d-7ba9b4548807 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1925 microversion: 2.1 time: 0.016951 Oct 31 15:18:38.127564 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 660/1265] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/os-migrations => generated 1925 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.141498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1695119687"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:38.144797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.150902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.151466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.151998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.152717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.153190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.153616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.357811 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa1c4a14-9e46-4917-8a52-0a936f4b6f63 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6/action" status: 202 len: 0 microversion: 2.1 time: 0.220315 Oct 31 15:18:38.358947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 661/1266] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:38 2022] POST /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:18:38.364130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.364856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.371440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.371926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.372359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.373080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.373537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.373962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.394037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:38.525326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.534492 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a92d44f-9f42-40b7-9ff7-e2923a794b0c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.174580 Oct 31 15:18:38.535646 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 662/1267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.541518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.542803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.551159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.551769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.552205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.552951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.553411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.553888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.690547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.698056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5177d3ec-996a-41cd-a62b-58c673724f7f tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1475 microversion: 2.1 time: 0.161214 Oct 31 15:18:38.698818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 663/1268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1475 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.714296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.714838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.731170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.731867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.732419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.733382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.734462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.734462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.934304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.943794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9325ab0d-2955-4409-9112-39eb5fd37362 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.233599 Oct 31 15:18:38.944473 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 664/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.949175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d8c2712-dc60-4837-bc6b-36dd498284d3 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.955785 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d8c2712-dc60-4837-bc6b-36dd498284d3 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.009963 Oct 31 15:18:38.956801 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 665/1270] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:38.961438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15b258b0-3d9b-42b6-9ff8-c6bb2d17869f tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca233f4c0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.012835 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15b258b0-3d9b-42b6-9ff8-c6bb2d17869f tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.054676 Oct 31 15:18:39.013495 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 666/1271] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.018364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9cd045a-1daa-4327-8397-82c193fa3fc1 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1765189475", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:39.038765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9cd045a-1daa-4327-8397-82c193fa3fc1 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.024139 Oct 31 15:18:39.039568 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 667/1272] 10.222.0.48 () {60 vars in 1146 bytes} [Mon Oct 31 15:18:39 2022] POST /compute/v2.1/flavors => generated 499 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:39.051980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12049de3-715c-4e5a-85da-2908ab86aeae tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.064906 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12049de3-715c-4e5a-85da-2908ab86aeae tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016629 Oct 31 15:18:39.066227 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 668/1273] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:18:39.131468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.132327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.139521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.140204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.140854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.141750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.142930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.143757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.370863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.380217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba07062a-a0a7-4765-bb19-6b05ded0e918 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1324 microversion: 2.1 time: 0.252514 Oct 31 15:18:39.380818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 669/1274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.385539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5ec336e4-deac-4f16-a745-6041f43a0eb5 req-368793df-6803-41bb-84d1-03071b9f359d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c96a089-868a-48e6-8687-f117e429833b", "tag": "3c7edc45-0684-4f16-a7d3-e245bdb94392"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:39.396206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5ec336e4-deac-4f16-a745-6041f43a0eb5 req-368793df-6803-41bb-84d1-03071b9f359d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.396675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5ec336e4-deac-4f16-a745-6041f43a0eb5 req-368793df-6803-41bb-84d1-03071b9f359d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.397125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5ec336e4-deac-4f16-a745-6041f43a0eb5 req-368793df-6803-41bb-84d1-03071b9f359d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.408774 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5ec336e4-deac-4f16-a745-6041f43a0eb5 req-368793df-6803-41bb-84d1-03071b9f359d service nova] Creating event network-changed:3c7edc45-0684-4f16-a7d3-e245bdb94392 for instance 3c96a089-868a-48e6-8687-f117e429833b on n-h2-858383-17 Oct 31 15:18:39.414054 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5ec336e4-deac-4f16-a745-6041f43a0eb5 req-368793df-6803-41bb-84d1-03071b9f359d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031856 Oct 31 15:18:39.414661 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 670/1275] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:39.419635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1909159312", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "443d3397-f4b8-4acd-98e8-b3a37dfb3f9b"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:39.479100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:39.804630 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94b6483b-db45-41e8-9de0-2d4a4b36cb6c tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/action" status: 202 len: 0 microversion: 2.25 time: 4.426508 Oct 31 15:18:39.806238 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 606/1276] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:18:35 2022] POST /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/action => generated 0 bytes in 4429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:39.813322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.815318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.822937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.823717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.824635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.825655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.826558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.827244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.427406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:40.427888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:40.428349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:40.428796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:40.429211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:40.437955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.438440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.439034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.439911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.440372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.440826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.458470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:40.464215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for user 8184a0251b8e4cb882556b458bbc4de7 and project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:40.479145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:40.481623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:40.539240 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cbf9347e-4871-4daa-98fb-69a932c5e5d4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123268 Oct 31 15:18:40.540331 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 671/1277] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:40.545440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-455a98dd-cdc2-481c-a2f3-1c7e5337d903 req-1d1a242b-c8e9-4d7e-bf18-2dc38b2681b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c9c446-931d-406c-beef-3f71283a244b", "name": "network-vif-deleted", "tag": "927144ed-dd76-45fd-8f86-82482fd63ede"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:40.556630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-455a98dd-cdc2-481c-a2f3-1c7e5337d903 req-1d1a242b-c8e9-4d7e-bf18-2dc38b2681b6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.557132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-455a98dd-cdc2-481c-a2f3-1c7e5337d903 req-1d1a242b-c8e9-4d7e-bf18-2dc38b2681b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.557557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-455a98dd-cdc2-481c-a2f3-1c7e5337d903 req-1d1a242b-c8e9-4d7e-bf18-2dc38b2681b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.570206 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-455a98dd-cdc2-481c-a2f3-1c7e5337d903 req-1d1a242b-c8e9-4d7e-bf18-2dc38b2681b6 service nova] Creating event network-vif-deleted:927144ed-dd76-45fd-8f86-82482fd63ede for instance 93c9c446-931d-406c-beef-3f71283a244b on n-h2-858383-17 Oct 31 15:18:40.575365 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-455a98dd-cdc2-481c-a2f3-1c7e5337d903 req-1d1a242b-c8e9-4d7e-bf18-2dc38b2681b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033590 Oct 31 15:18:40.576646 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 672/1278] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:40.586061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.586864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.594249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:40.594596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.595776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.596305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.597154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.597712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.598234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.610295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-11298f68-c874-4c96-a449-5e0132ac143e tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.802606 Oct 31 15:18:40.611736 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 607/1279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:40.618366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.619433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.629464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.630377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.631609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.632507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.633484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.634097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.717498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:40.727317 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c564e5ca-b037-456f-a4a4-cbc25a1eda39 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1433 microversion: 2.1 time: 0.147738 Oct 31 15:18:40.728183 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 673/1280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1433 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:40.732983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.733702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.740714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.741214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.741642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.742340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.742800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.743224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.085818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.095295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.097541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.098821 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-96ba470d-373f-4a45-911c-0e209f9c7017 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.485978 Oct 31 15:18:41.099739 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 608/1281] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:41.107282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e69d42b8-ace8-4651-b73b-d76d63f3bf01 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca27e9820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.119050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.128486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4e16f83-1801-4e20-89e5-9ac9ca0fb2e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1472 microversion: 2.1 time: 0.399131 Oct 31 15:18:41.144066 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 674/1282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.144066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.144066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.156995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.159512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.159964 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e69d42b8-ace8-4651-b73b-d76d63f3bf01 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.058872 Oct 31 15:18:41.161251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.161673 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 609/1283] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.162650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.163407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.163734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.166769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.167625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.178655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.179721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.180924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.182111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.182802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.183984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.342389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.351323 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-05b6b583-1f72-4c9d-a46b-7e47b9e82270 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1283 microversion: 2.1 time: 0.188396 Oct 31 15:18:41.364720 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 610/1284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.508765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.517436 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70296791-b1f1-4719-9724-402524ed9efa tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1324 microversion: 2.1 time: 0.378431 Oct 31 15:18:41.519201 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 675/1285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.530713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8732249d-284b-4ec1-a9c5-d82319c9d378 req-2f20992a-bc80-47d9-bdf8-4cc6ead2bdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52000d3-30d6-4c22-8751-b1623197edab", "name": "network-vif-deleted", "tag": "0810769b-07b9-4f0e-8058-ccb8b44d5d89"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:41.551327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8732249d-284b-4ec1-a9c5-d82319c9d378 req-2f20992a-bc80-47d9-bdf8-4cc6ead2bdc0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.552281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8732249d-284b-4ec1-a9c5-d82319c9d378 req-2f20992a-bc80-47d9-bdf8-4cc6ead2bdc0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.552810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8732249d-284b-4ec1-a9c5-d82319c9d378 req-2f20992a-bc80-47d9-bdf8-4cc6ead2bdc0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.568649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8732249d-284b-4ec1-a9c5-d82319c9d378 req-2f20992a-bc80-47d9-bdf8-4cc6ead2bdc0 service nova] Creating event network-vif-deleted:0810769b-07b9-4f0e-8058-ccb8b44d5d89 for instance a52000d3-30d6-4c22-8751-b1623197edab on n-h1-858383-17 Oct 31 15:18:41.574837 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8732249d-284b-4ec1-a9c5-d82319c9d378 req-2f20992a-bc80-47d9-bdf8-4cc6ead2bdc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047867 Oct 31 15:18:41.576109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 611/1286] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:41.635682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.636310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.643759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.644900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.645576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.647002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.647485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.648268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.756098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.757394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.775565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.784364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.786245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.790614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.794365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.800287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.020903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.034729 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-25cf4886-7bbd-4654-b5c8-5cda9c3e0a00 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1304 microversion: 2.1 time: 0.280374 Oct 31 15:18:42.041306 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 612/1287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:42.068060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.078977 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60717fa9-38dd-49dc-8930-417a9a94e4e3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.447207 Oct 31 15:18:42.081236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 676/1288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.129336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.130687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.139361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.145196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.147258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.149673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.157010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.158354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.161138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.162357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.178866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.184827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.185375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.186152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.186639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.190807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.459371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.486134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.488829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.490447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92e83f2f-9b1d-42b5-b7d2-6abe031c0b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.366679 Oct 31 15:18:42.491975 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 613/1289] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:42.497815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3d10640-4c08-48e6-a9e8-a1894ece4870 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca27e9160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.539506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.551710 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23d63012-feb8-42bd-b14e-5735a655ebd1 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1490 microversion: 2.1 time: 0.395071 Oct 31 15:18:42.565967 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 677/1290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1490 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.573254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3d10640-4c08-48e6-a9e8-a1894ece4870 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.079841 Oct 31 15:18:42.575280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.576074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.582980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.583719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.583895 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 614/1291] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.584475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.585380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.585994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.586587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.590584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.591295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.599393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.600216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.601427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.602347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.602980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.604822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.697869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.706434 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7d4db12-ff0c-41e4-80b5-f05aea7d13ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1275 microversion: 2.1 time: 0.138959 Oct 31 15:18:42.706941 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 678/1292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.861234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.872245 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b8484c58-9a4f-4691-8131-6834fad543dc tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1324 microversion: 2.1 time: 0.287068 Oct 31 15:18:42.872870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 615/1293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:43.061725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.062342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.068636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.069155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.069594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.070291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.070754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.071185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.103145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.103626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.104069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.104515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lazy-loading 'fault' on Instance uuid 93c9c446-931d-406c-beef-3f71283a244b {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:43.107804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.108459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.115029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.115516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.115952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.116651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.117135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.117563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.146058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.153919 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d58338c8-3e61-475e-898c-9f5e9b1fdafa tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1309 microversion: 2.1 time: 0.096002 Oct 31 15:18:43.154500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 679/1294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:43.349889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.359104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1e85848-3ca4-4ffe-a95a-dd6fad9fe9c8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.254966 Oct 31 15:18:43.359735 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 616/1295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:43.519245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.519862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.531536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.532055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.532557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.533297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.533757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.534185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.553101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-67ee0d22-4a39-412c-9f29-f4422eb3fb89 req-7f15f765-41ce-43b9-8302-0094419de286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c96a089-868a-48e6-8687-f117e429833b", "name": "network-vif-plugged", "status": "completed", "tag": "3c7edc45-0684-4f16-a7d3-e245bdb94392"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:43.565559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-67ee0d22-4a39-412c-9f29-f4422eb3fb89 req-7f15f765-41ce-43b9-8302-0094419de286 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.566161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-67ee0d22-4a39-412c-9f29-f4422eb3fb89 req-7f15f765-41ce-43b9-8302-0094419de286 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.566881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-67ee0d22-4a39-412c-9f29-f4422eb3fb89 req-7f15f765-41ce-43b9-8302-0094419de286 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.603477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-67ee0d22-4a39-412c-9f29-f4422eb3fb89 req-7f15f765-41ce-43b9-8302-0094419de286 service nova] Creating event network-vif-plugged:3c7edc45-0684-4f16-a7d3-e245bdb94392 for instance 3c96a089-868a-48e6-8687-f117e429833b on n-h2-858383-17 Oct 31 15:18:43.611223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-67ee0d22-4a39-412c-9f29-f4422eb3fb89 req-7f15f765-41ce-43b9-8302-0094419de286 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061566 Oct 31 15:18:43.613626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 617/1296] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:43.632619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.653045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.671734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.672779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.674292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.675595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.676377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.681376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.795323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.807946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.809542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.810755 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f6db2a7-90b0-455c-b4a0-779e069de4f4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.296035 Oct 31 15:18:43.811323 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 680/1297] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:43.816803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ea64e3e-93ca-4433-932b-a47fc8b011b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca22f6d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.872276 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ea64e3e-93ca-4433-932b-a47fc8b011b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.059589 Oct 31 15:18:43.873428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 681/1298] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:43.878132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.878745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.882183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.885652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.886328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.886766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.887473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.887936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.888364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.890901 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-208a7564-eccc-4c07-93b7-c7c9599acd60 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1478 microversion: 2.1 time: 0.276000 Oct 31 15:18:43.891584 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 618/1299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1478 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:43.897189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.898066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.905490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.906283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.906943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.908093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.908847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.909570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.961225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.972810 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7dc82ecc-7d1c-4c72-99d1-206ff2ce8da3 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1275 microversion: 2.1 time: 0.098271 Oct 31 15:18:43.974228 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 682/1300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.132330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.143766 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-501e5c36-8b0f-44b4-9bd5-aec23c56d45d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1324 microversion: 2.1 time: 0.250274 Oct 31 15:18:44.145944 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 619/1301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.178052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.178934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.193936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.194463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.195108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.195822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.196283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.196752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.231275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.231759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.232200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.232646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lazy-loading 'fault' on Instance uuid 93c9c446-931d-406c-beef-3f71283a244b {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:44.275203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.282985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cd40d86-317b-4e4c-8433-af2009be385d tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 200 len: 1309 microversion: 2.1 time: 0.108766 Oct 31 15:18:44.283559 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 683/1302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.390031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.391788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.410603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.416897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.417804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.420677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.425223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.425867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.625842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.633695 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3532ba8-ce4f-4045-aec6-6b35a4d5eb41 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.253816 Oct 31 15:18:44.634268 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 620/1303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.839981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.841373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.848971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.849838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.850887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.852439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.852959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.853397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.888632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dedf8636-f4c8-47b5-af43-a254fdb0afe0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2c13550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.941797 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dedf8636-f4c8-47b5-af43-a254fdb0afe0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.057569 Oct 31 15:18:44.942395 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 621/1304] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:44.955083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.955912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.965853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.966350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.966786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.967521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.969711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.970752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.098346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.114619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.116332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.117789 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd741e3a-7e61-459d-b6f5-e9ed6b96ac28 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.282263 Oct 31 15:18:45.133154 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 684/1305] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:45.141267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.143921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.150143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.150864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.152062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.152967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.153692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.154472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.188407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:45.212438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.224383 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7add7cb0-ad2a-4447-b79b-ac34b816374b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1478 microversion: 2.1 time: 0.280936 Oct 31 15:18:45.226991 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 622/1306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1478 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:45.241213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.242092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.263944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.268316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.269309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.271052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.273237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.275542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.276226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.277359 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e585920-4f8e-477c-b38a-5808cc037198 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1331 microversion: 2.1 time: 0.142769 Oct 31 15:18:45.278458 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 685/1307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:45.306095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.306720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 93c9c446-931d-406c-beef-3f71283a244b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.315097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:45.316562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.318704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.319358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.321719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.322553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.323034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.338565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:45.351566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance 93c9c446-931d-406c-beef-3f71283a244b could not be found. Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b HTTP/1.1 Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:45.356303 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 93c9c446-931d-406c-beef-3f71283a244b could not be found. Oct 31 15:18:45.358009 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '93c9c446-931d-406c-beef-3f71283a244b'} Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c9c446-931d-406c-beef-3f71283a244b could not be found. Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:45.358814 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c9c446-931d-406c-beef-3f71283a244b could not be found. Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c9c446-931d-406c-beef-3f71283a244b could not be found. Oct 31 15:18:45.360135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.364943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance 93c9c446-931d-406c-beef-3f71283a244b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:45.366236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7534c97a-e399-41ed-8ecd-86c5f6d0c566 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b" status: 404 len: 111 microversion: 2.1 time: 0.064277 Oct 31 15:18:45.368883 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 686/1308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/93c9c446-931d-406c-beef-3f71283a244b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:18:45.387066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.390528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: a52000d3-30d6-4c22-8751-b1623197edab] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.415163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.418450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.419030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.419860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.422396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.423632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.468617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance a52000d3-30d6-4c22-8751-b1623197edab could not be found. Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab HTTP/1.1 Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:45.475820 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a52000d3-30d6-4c22-8751-b1623197edab could not be found. Oct 31 15:18:45.477498 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a52000d3-30d6-4c22-8751-b1623197edab'} Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52000d3-30d6-4c22-8751-b1623197edab could not be found. Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:45.478347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52000d3-30d6-4c22-8751-b1623197edab could not be found. Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52000d3-30d6-4c22-8751-b1623197edab could not be found. Oct 31 15:18:45.479795 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:45.489939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance a52000d3-30d6-4c22-8751-b1623197edab could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:45.524795 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c6a2869-dfbd-430e-aa15-a2f80e273115 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab" status: 404 len: 111 microversion: 2.1 time: 0.121884 Oct 31 15:18:45.534965 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 687/1309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/a52000d3-30d6-4c22-8751-b1623197edab => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:45.554270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.554809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-322f71ed-c8e7-45db-bd18-1dd8c40f8514 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.567201 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1c484034-1497-49ee-8f73-86859e0ff2ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1324 microversion: 2.1 time: 0.338578 Oct 31 15:18:45.570061 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 623/1310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:45.665699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802119d0-f33f-421a-910a-9a78e05406a6", "name": "network-vif-plugged", "status": "completed", "tag": "cc06bcb0-9110-476e-a705-7dfb05841e2e"}, {"server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "name": "network-vif-unplugged", "status": "completed", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}, {"server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "name": "network-vif-plugged", "status": "completed", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:45.683733 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-322f71ed-c8e7-45db-bd18-1dd8c40f8514 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/5365e837-d31b-41cc-ac46-c840c3c58481" status: 204 len: 0 microversion: 2.1 time: 0.143959 Oct 31 15:18:45.687682 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 688/1311] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:18:45 2022] DELETE /compute/v2.1/os-server-groups/5365e837-d31b-41cc-ac46-c840c3c58481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:45.687966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.689484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.692005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.699627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.700257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.726319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.726831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.727278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.727996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.729317 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Creating event network-vif-plugged:cc06bcb0-9110-476e-a705-7dfb05841e2e for instance 802119d0-f33f-421a-910a-9a78e05406a6 on n-h2-858383-17 Oct 31 15:18:45.730600 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Creating event network-vif-unplugged:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:18:45.730600 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] Creating event network-vif-plugged:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:18:45.735482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.736741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.754131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-de43b51b-0a46-4c6c-876a-1146e10b0ade req-25921a3a-2f1c-445f-8720-d2722c1c8907 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.101493 Oct 31 15:18:45.757433 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 624/1312] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:45.769947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.772312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.802340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.805973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.806674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.810227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.810931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.811623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.898604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:46.004020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:46.110967 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d3f24d9-b6ed-48c9-97ee-0bdb7ddf4bb1 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 204 len: 0 microversion: 2.1 time: 0.351368 Oct 31 15:18:46.114968 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 625/1313] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:45 2022] DELETE /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:46.121153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b0633520-9812-455d-8289-ee6b1000626b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca27f6430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.200885 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b0633520-9812-455d-8289-ee6b1000626b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.084020 Oct 31 15:18:46.201641 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 626/1314] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.219064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.225960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.237500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.238187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.239232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.240377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.241106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.241864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.264525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.276990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-280e75ca-a01a-4fe0-aba2-b85454762374 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.587979 Oct 31 15:18:46.277743 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 689/1315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.296027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:46.303951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.304973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.313149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.315042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.315766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.317027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.318369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.319024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.413589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a65326f8-6a4a-4c72-bccc-8874759889d0 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 204 len: 0 microversion: 2.1 time: 0.202893 Oct 31 15:18:46.415195 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 627/1316] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:46 2022] DELETE /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:46.424203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.425295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.440979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.444205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.448829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.450857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.453198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.453861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.650156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.660895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.662336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.677507 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0dbedb4d-c8a9-4da9-b51a-90ac8b13213e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.376177 Oct 31 15:18:46.678811 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 690/1317] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:46.698635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.701367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.721347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.721847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.722283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.723331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.723458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.723863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.773068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.781228 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf1f5e8c-e8a8-4519-899d-c3c10a639ca2 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1478 microversion: 2.1 time: 0.364512 Oct 31 15:18:46.782183 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 628/1318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1478 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.788228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.788972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.795230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.795716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.796145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.796931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.797392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.797959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.844433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.855515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ad068fc-3e88-4007-9349-cdd5c7d7b485 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1337 microversion: 2.1 time: 0.175589 Oct 31 15:18:46.856749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 691/1319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1337 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.862288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.863081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.870278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.871103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.871739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.872725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.873426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.874001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.389727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.397563 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7f25beb-f09a-4201-91b4-adf06a6286ab tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1475 microversion: 2.1 time: 0.613808 Oct 31 15:18:47.418121 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 629/1320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1475 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.435586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85371d4d-8bac-4bf3-91f0-425fd633881a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca26d05e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.490880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85371d4d-8bac-4bf3-91f0-425fd633881a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.071515 Oct 31 15:18:47.501293 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 630/1321] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.507458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.508550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.515653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.517172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.517868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.519530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.520236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.520923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.562634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.573380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d602df8e-6a29-4206-b045-c5855150c173 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1522 microversion: 2.1 time: 0.715302 Oct 31 15:18:47.576156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 692/1322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1522 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.616124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.619621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.627109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.627961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.628917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.629894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.630578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.631253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.126419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.138640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d7c1f95-151f-4b36-9a25-1057b31222e5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1522 microversion: 2.1 time: 0.526741 Oct 31 15:18:48.153728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 693/1323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.174243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.176095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.182307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.187544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.189097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.189863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.190873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.191586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.192556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.204347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ec86c0b-3cc1-4c8d-b63c-f98a0b84533b tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.696647 Oct 31 15:18:48.206451 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 631/1324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.219657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.223922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.241651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.242309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.242908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.243997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.244644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.245213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.610794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.623935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.630850 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a275a1a-47fd-4344-9e7e-65f1cfdf4899 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1478 microversion: 2.1 time: 0.422853 Oct 31 15:18:48.632251 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 632/1325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1478 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.643689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.644743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.655112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.655754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.656304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.657764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.658426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.658637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.659384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.663489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.667398 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13b6dd6c-823a-491b-aa4d-f3619c43eb62 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.507048 Oct 31 15:18:48.668306 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 694/1326] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:48.699593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1b9c4755-e361-405c-a179-dc5eae921262 req-af768638-798c-46dd-8410-28af02b0f248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "name": "network-vif-plugged", "status": "completed", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:48.711517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1b9c4755-e361-405c-a179-dc5eae921262 req-af768638-798c-46dd-8410-28af02b0f248 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.712292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1b9c4755-e361-405c-a179-dc5eae921262 req-af768638-798c-46dd-8410-28af02b0f248 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.713261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1b9c4755-e361-405c-a179-dc5eae921262 req-af768638-798c-46dd-8410-28af02b0f248 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.739765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1b9c4755-e361-405c-a179-dc5eae921262 req-af768638-798c-46dd-8410-28af02b0f248 service nova] Creating event network-vif-plugged:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:18:48.752529 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1b9c4755-e361-405c-a179-dc5eae921262 req-af768638-798c-46dd-8410-28af02b0f248 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061377 Oct 31 15:18:48.753511 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 695/1327] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:48.760136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.766551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.767636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Searching by: {'deleted': False, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:48.775948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.776778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.777361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.778259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.778924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.779566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.817982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:48.869313 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d0d9fbd-d913-49f9-9945-a6d73a33bdb4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.114367 Oct 31 15:18:48.871131 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 696/1328] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:48.877939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1391992215"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:48.881749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.890138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.891145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.892850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.894122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.895163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.895853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.915029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.929512 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a1c67e05-3a36-4364-958a-5371d5cce1bd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.293619 Oct 31 15:18:48.931994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 633/1329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.953339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.954406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.966069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.966569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.967004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.967711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.968540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.968995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.225173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.237039 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0062aae7-fda7-4c3a-b12c-8aa862a28428 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1475 microversion: 2.1 time: 0.293775 Oct 31 15:18:49.238003 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 634/1330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.246991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49935a0b-c35e-49e7-9cd1-32bd5364652b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca27f6ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.306023 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49935a0b-c35e-49e7-9cd1-32bd5364652b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.065687 Oct 31 15:18:49.307194 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 635/1331] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.310740 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3fc90032-dbe2-4d08-93e6-a07ce202f12c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b/action" status: 202 len: 0 microversion: 2.1 time: 0.438180 Oct 31 15:18:49.311760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 697/1332] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:48 2022] POST /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:18:49.315531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.330348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.331653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.333182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.334244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Searching by: {'deleted': False, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:49.339659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.340390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.341065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.342206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.342969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.343557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.343946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:49.346484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.346966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.347403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.348123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.348575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.349029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.408673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:49.473775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.488277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.488992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.489768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.746694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.769819 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65953042-df39-44ee-b911-5baff1629582 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1324 microversion: 2.1 time: 0.450258 Oct 31 15:18:49.784721 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 698/1333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.784721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f17d0026-6608-46b9-9d2b-a7f12c0763ea tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '.version_select at 0x7f5ca22890d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.784997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9569c03f-df1e-4a34-9ae6-7de2d7abf6f9 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1602 microversion: 2.1 time: 0.473496 Oct 31 15:18:49.784997 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 636/1334] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/detail => generated 1602 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.807366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.807957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.826777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.827282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.827725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.828443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.829007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.829421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.042724 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f17d0026-6608-46b9-9d2b-a7f12c0763ea tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5" status: 204 len: 0 microversion: 2.1 time: 0.270148 Oct 31 15:18:50.043614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 699/1335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] DELETE /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:50.052949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.052949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.061630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.065059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.065760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.066812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.067620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.068251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.363732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.393255 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f75f65e4-91a8-43c5-9aeb-08bcfa1152e8 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1478 microversion: 2.1 time: 0.592678 Oct 31 15:18:50.395935 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 637/1336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1478 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:50.408990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac2e45b7-c469-4502-924e-3790126f79d2 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.449602 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac2e45b7-c469-4502-924e-3790126f79d2 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046842 Oct 31 15:18:50.450213 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 638/1337] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:50.466067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.467031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.471450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=20 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:50.480262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.481074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.481669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.482561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.483179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.483786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.983957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.998358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.999836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.006475 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-050dd301-7ff2-4dc3-859a-0aa69d406d55 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.961585 Oct 31 15:18:51.020520 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 700/1338] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:51.020520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c08dfb2-8f74-459f-a530-bbe5ad7667be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '.version_select at 0x7f5ca2289280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.070387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-5c08dfb2-8f74-459f-a530-bbe5ad7667be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Image not found. Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c08dfb2-8f74-459f-a530-bbe5ad7667be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5 HTTP/1.1 Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:18:51.073784 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '95fd1403-29f8-4542-b80a-2f2ae57861c5'} Oct 31 15:18:51.076019 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:18:51.076893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 95fd1403-29f8-4542-b80a-2f2ae57861c5 Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:18:51.077995 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95fd1403-29f8-4542-b80a-2f2ae57861c5 could not be found. Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:18:51.079727 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:18:51.081310 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:18:51.084856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c08dfb2-8f74-459f-a530-bbe5ad7667be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:51.085973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c08dfb2-8f74-459f-a530-bbe5ad7667be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5" status: 404 len: 62 microversion: 2.1 time: 0.077927 Oct 31 15:18:51.090832 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 701/1339] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:18:51.100219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.101364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.108893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.110079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.111050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.112006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.112832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.113650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.222966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.232556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f16fee8-4504-40df-a513-44ac629f5b49 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.771189 Oct 31 15:18:51.233447 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 639/1340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.290270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2499dcf7-0529-4b33-8e50-0e009d9e30ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca26d0280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.369281 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2499dcf7-0529-4b33-8e50-0e009d9e30ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.134546 Oct 31 15:18:51.369992 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 640/1341] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.383513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.384136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.390936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.392925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.393830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.394772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.395635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.396221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.704872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.721631 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39e669ac-0295-4099-8724-08d4ab56dbf6 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 200 len: 1475 microversion: 2.1 time: 0.628833 Oct 31 15:18:51.722691 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 702/1342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.728499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.729265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.740546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.741444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.742098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.743041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.743709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.744480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.785473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:51.873787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.888080 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b7a839a5-805c-47ba-8383-f3e4bb6fcf8c tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1519 microversion: 2.1 time: 0.505830 Oct 31 15:18:51.899449 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 641/1343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1519 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.913318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:51.916251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.917739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.937202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.939335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.939807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.943115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.944008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.944568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.996923 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fb09b88-a662-4eeb-905c-74b40c96ab00 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "DELETE /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 204 len: 0 microversion: 2.1 time: 0.271257 Oct 31 15:18:51.997937 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 703/1344] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:51 2022] DELETE /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:52.014140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.016087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.029840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.030431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.030904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.032098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.032801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.033221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.258648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.268450 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3859e253-f1d2-4921-827d-fa3f3645fe02 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1540 microversion: 2.1 time: 0.367499 Oct 31 15:18:52.269798 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 642/1345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1540 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:52.277495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-330ef131-73d8-457f-a4fc-3a2f28d326e0 req-3e121558-6efa-45d4-b90c-bbc8f0ffc5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d916d41e-cdb8-41c4-9491-b4ab391d1ca7", "name": "network-vif-deleted", "tag": "9e8bd758-ca0a-4f0c-b03b-dc89859f27ed"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:52.292362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-330ef131-73d8-457f-a4fc-3a2f28d326e0 req-3e121558-6efa-45d4-b90c-bbc8f0ffc5c5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.293518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-330ef131-73d8-457f-a4fc-3a2f28d326e0 req-3e121558-6efa-45d4-b90c-bbc8f0ffc5c5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.294250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-330ef131-73d8-457f-a4fc-3a2f28d326e0 req-3e121558-6efa-45d4-b90c-bbc8f0ffc5c5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.307942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.318142 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c9c30d6-4c22-4c21-b202-8a2f606da583 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1463 microversion: 2.1 time: 0.318128 Oct 31 15:18:52.322534 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 704/1346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1463 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:52.327354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0f1fbb2-3bfb-4395-803a-d8728d65e46a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'create', calling method: .version_select at 0x7f5ca23054c0>, body: {"pool": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:52.328541 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-330ef131-73d8-457f-a4fc-3a2f28d326e0 req-3e121558-6efa-45d4-b90c-bbc8f0ffc5c5 service nova] Creating event network-vif-deleted:9e8bd758-ca0a-4f0c-b03b-dc89859f27ed for instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 on n-h1-858383-17 Oct 31 15:18:52.340373 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-330ef131-73d8-457f-a4fc-3a2f28d326e0 req-3e121558-6efa-45d4-b90c-bbc8f0ffc5c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068930 Oct 31 15:18:52.341151 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 643/1347] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:52.357353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.357353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.367121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.368025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.368881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.369763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.370824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.371418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.975144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.989610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b219dd7-1251-46ce-837e-3f9c9e90f1bf tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1605 microversion: 2.1 time: 0.647094 Oct 31 15:18:52.991444 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 644/1348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1605 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:52.998600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.999434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.012491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.015238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.017576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.019579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.020343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.021035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.062118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:53.411599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.430114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.431606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.432906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3db22201-8194-48fb-8112-c5cbd8aa6c22 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.440298 Oct 31 15:18:53.433474 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 645/1349] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:53.450769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.451385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.462220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.464029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.470006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.471280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.472191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.473032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.841880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.858879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01d5b006-9926-47b9-beaf-ea6ec8b930c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.424334 Oct 31 15:18:53.871116 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 646/1350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.876583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:53.879814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.887339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.888072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.888680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.889751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.890415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.891055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.027879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3432874b-db1b-43c8-a582-680fb5ac2480 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 0 microversion: 2.1 time: 0.153285 Oct 31 15:18:54.043981 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 647/1351] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:53 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:54.049295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2b95fcd-4e6e-4b7d-abbb-8208fe9ca8bd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2424820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.153411 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2b95fcd-4e6e-4b7d-abbb-8208fe9ca8bd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.108004 Oct 31 15:18:54.154332 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 648/1352] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.161215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.162072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 2e2557bf-9d54-4682-8964-1fd936d0d706] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.169255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.170438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.171053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.171933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.173248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.173972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.193124 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance 2e2557bf-9d54-4682-8964-1fd936d0d706 could not be found. Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 HTTP/1.1 Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:54.195337 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2e2557bf-9d54-4682-8964-1fd936d0d706 could not be found. Oct 31 15:18:54.197025 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2e2557bf-9d54-4682-8964-1fd936d0d706'} Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2557bf-9d54-4682-8964-1fd936d0d706 could not be found. Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:54.198096 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2557bf-9d54-4682-8964-1fd936d0d706 could not be found. Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2557bf-9d54-4682-8964-1fd936d0d706 could not be found. Oct 31 15:18:54.199539 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:54.202360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance 2e2557bf-9d54-4682-8964-1fd936d0d706 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:54.203378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d2efc0e-810b-43e5-941f-145f6afcc45b tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706" status: 404 len: 111 microversion: 2.1 time: 0.047593 Oct 31 15:18:54.209603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 649/1353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/2e2557bf-9d54-4682-8964-1fd936d0d706 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:54.215354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.216179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.224862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.225586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.226205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.227075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.227698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.228278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.554795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.566637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63e2b270-b68a-4e0d-a1c7-15249ecf7183 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1522 microversion: 2.1 time: 0.355708 Oct 31 15:18:54.568961 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 650/1354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.589305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.590310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.600607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.601134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.601569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.602269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.602727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.603152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.717003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.728833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64ab9dee-1070-4e3b-b207-7ea23e3225c4 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1537 microversion: 2.1 time: 0.156832 Oct 31 15:18:54.744721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 651/1355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1537 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.744937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.749676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.760245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.763785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.763785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.767400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.769148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.771486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.845312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.845970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.846819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.849364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lazy-loading 'fault' on Instance uuid e0f76ff1-0ab5-4867-bd70-298e5c669e14 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:55.116453 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-82b8b68c-e3fa-4b44-8063-9741805a93f1 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1599 microversion: 2.1 time: 0.383081 Oct 31 15:18:55.117076 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 652/1356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1599 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:55.146484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:55.147296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: d916d41e-cdb8-41c4-9491-b4ab391d1ca7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.162043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.165863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.166340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.168778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.171817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.173261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.201379 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 could not be found. Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 HTTP/1.1 Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:18:55.203221 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 could not be found. Oct 31 15:18:55.205204 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd916d41e-cdb8-41c4-9491-b4ab391d1ca7'} Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 could not be found. Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:55.206098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 could not be found. Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 could not be found. Oct 31 15:18:55.207584 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:18:55.208925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance d916d41e-cdb8-41c4-9491-b4ab391d1ca7 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:55.208925 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2575543-b7db-4d96-a041-3cd915a744e2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7" status: 404 len: 111 microversion: 2.1 time: 0.065001 Oct 31 15:18:55.220499 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 653/1357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:55 2022] GET /compute/v2.1/servers/d916d41e-cdb8-41c4-9491-b4ab391d1ca7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:55.225685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2557bf-9d54-4682-8964-1fd936d0d706", "name": "network-vif-deleted", "tag": "337e551d-0dda-4efa-b391-e4efad616e8c"}, {"name": "network-changed", "server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:55.254192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.254974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.255594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.285286 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] Creating event network-vif-deleted:337e551d-0dda-4efa-b391-e4efad616e8c for instance 2e2557bf-9d54-4682-8964-1fd936d0d706 on n-h1-858383-17 Oct 31 15:18:55.289632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] Creating event network-changed:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:18:55.307283 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4e75e5df-08b9-4668-858c-91910fbde8de req-065543b7-ea10-4b4e-857d-357a6987d6ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.085284 Oct 31 15:18:55.308634 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 654/1358] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:55.314933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:55.315872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.325226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.325956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.326593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.327470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.328204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.329028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.506189 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0f1fbb2-3bfb-4395-803a-d8728d65e46a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.182383 Oct 31 15:18:55.522151 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 705/1359] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:18:52 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:55.528420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:55.529375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.537025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.537847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.538524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.540529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.541302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.542073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.591319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:55.742504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:55.760543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:55.763810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:55.766946 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3fb5a2b2-ec44-403b-98a6-b25a23585303 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 204 len: 0 microversion: 2.1 time: 0.241655 Oct 31 15:18:55.769652 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aace766f-7cef-432b-a7f3-37d83a0b7906 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.459593 Oct 31 15:18:55.771175 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 706/1360] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:55 2022] DELETE /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:55.778807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:55.780424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.791349 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 655/1361] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:55 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:55.791961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.792832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.793573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.794556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.795182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.795774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.800446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:55.803146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.810221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.810885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.811495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.812330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.813021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.813711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.967396 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32c772a5-a5fe-41f6-aa62-6cbfea2cefa6 tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action" status: 202 len: 0 microversion: 2.1 time: 0.174393 Oct 31 15:18:55.968885 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 656/1362] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:55 2022] POST /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:55.982291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9139b009-f1a2-46b2-b7af-0119783fe98f req-20203ee3-4ce0-4759-bc29-b9d4da0bbd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "968b5ef7-db40-4099-ab2e-f20a844049d7", "name": "network-vif-deleted", "tag": "b09d4455-f914-4d85-9b6e-c4fd93ebeafe"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:56.003118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9139b009-f1a2-46b2-b7af-0119783fe98f req-20203ee3-4ce0-4759-bc29-b9d4da0bbd21 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.005199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9139b009-f1a2-46b2-b7af-0119783fe98f req-20203ee3-4ce0-4759-bc29-b9d4da0bbd21 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.007384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9139b009-f1a2-46b2-b7af-0119783fe98f req-20203ee3-4ce0-4759-bc29-b9d4da0bbd21 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.034318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9139b009-f1a2-46b2-b7af-0119783fe98f req-20203ee3-4ce0-4759-bc29-b9d4da0bbd21 service nova] Creating event network-vif-deleted:b09d4455-f914-4d85-9b6e-c4fd93ebeafe for instance 968b5ef7-db40-4099-ab2e-f20a844049d7 on n-h2-858383-17 Oct 31 15:18:56.052097 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9139b009-f1a2-46b2-b7af-0119783fe98f req-20203ee3-4ce0-4759-bc29-b9d4da0bbd21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079654 Oct 31 15:18:56.053129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 657/1363] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:56.071350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9f458db-5140-46a3-bd64-9e4de1a2117d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2698940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.078694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:56.106581 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fe0506b-b881-4b32-a789-0d2bf6a7f02c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.333742 Oct 31 15:18:56.109746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 707/1364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:55 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.117909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-246befaf-7f2e-4644-85fc-beea35e5bfb2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.157913 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9f458db-5140-46a3-bd64-9e4de1a2117d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.098767 Oct 31 15:18:56.159880 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 658/1365] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.185159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-246befaf-7f2e-4644-85fc-beea35e5bfb2 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/02de2e26-4114-4a63-b2f0-1fd858bafc1f" status: 204 len: 0 microversion: 2.1 time: 0.066849 Oct 31 15:18:56.190109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 708/1366] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:18:56 2022] DELETE /compute/v2.1/os-server-groups/02de2e26-4114-4a63-b2f0-1fd858bafc1f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:56.192069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-861002947", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "619fc2a7-48a2-488f-822e-32ff25c82360"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:56.198640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-930a9bd8-f198-4b04-8e36-bfa31f699f32 req-05dc37b1-0af7-47d6-b94f-e3f1174b9ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c96a089-868a-48e6-8687-f117e429833b", "name": "network-vif-plugged", "status": "completed", "tag": "3c7edc45-0684-4f16-a7d3-e245bdb94392"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:56.220620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-930a9bd8-f198-4b04-8e36-bfa31f699f32 req-05dc37b1-0af7-47d6-b94f-e3f1174b9ba5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.221256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-930a9bd8-f198-4b04-8e36-bfa31f699f32 req-05dc37b1-0af7-47d6-b94f-e3f1174b9ba5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.221754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-930a9bd8-f198-4b04-8e36-bfa31f699f32 req-05dc37b1-0af7-47d6-b94f-e3f1174b9ba5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.247367 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-930a9bd8-f198-4b04-8e36-bfa31f699f32 req-05dc37b1-0af7-47d6-b94f-e3f1174b9ba5 service nova] Creating event network-vif-plugged:3c7edc45-0684-4f16-a7d3-e245bdb94392 for instance 3c96a089-868a-48e6-8687-f117e429833b on n-h2-858383-17 Oct 31 15:18:56.256245 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-930a9bd8-f198-4b04-8e36-bfa31f699f32 req-05dc37b1-0af7-47d6-b94f-e3f1174b9ba5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064068 Oct 31 15:18:56.257182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 709/1367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:56.266790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] validate_networks() for [('619fc2a7-48a2-488f-822e-32ff25c82360', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:56.277725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.279624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:56.288161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.288833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.289388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.290213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.290777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.291971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.465725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:56.475580 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1cfb3dc1-e2f2-4230-9002-22bc4eda29dc tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1251 microversion: 2.1 time: 0.207178 Oct 31 15:18:56.479985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 710/1368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1251 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.493478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.494134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:56.502503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.503226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.504426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.505463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.506086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.507868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.744559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:56.755486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8d793f7-2528-46ed-b0bd-a12da469ee8d tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1528 microversion: 2.1 time: 0.273754 Oct 31 15:18:56.762196 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 711/1369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.768339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.769723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:56.782350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.783101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.783615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.784713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.785260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.785749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.102603 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62c1420a-bc46-49d6-bc7c-2e3002ea882d tempest-ServersAdminTestJSON-922222236 tempest-ServersAdminTestJSON-922222236-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1616 microversion: 2.1 time: 0.339322 Oct 31 15:18:57.124582 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 712/1370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1616 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:57.130881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:57.138042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:57.144121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:57.144645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:57.145042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:57.145513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:57.145935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:57.154542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.155252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.155855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.159457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.160144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.161347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.164599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.165127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.165573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.166313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.166777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.170872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.196988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Getting quotas for project 9affbb7cbc954cd8b44bf8f30767a1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:57.202934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Getting quotas for user e69c6e6309854c1288ad1a19631704d8 and project 9affbb7cbc954cd8b44bf8f30767a1af. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:57.215589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:57.238909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:57.241630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:57.296062 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f7c91bd9-dd64-46a7-9ffa-c1c6d3759114 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109618 Oct 31 15:18:57.297354 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 659/1371] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:57.302106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:57.303067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:57.311174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.311986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.312837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.313826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.314577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.315172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.367217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0701a9d-bddc-4fde-a641-99edc2da5729 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 204 len: 0 microversion: 2.1 time: 0.241061 Oct 31 15:18:57.368246 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 713/1372] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:57 2022] DELETE /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:57.375526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:57.376156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:57.382787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.384072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.384524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.385266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.385731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.386158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.420912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:57.589510 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3480e579-b491-42ec-bc1e-ab11588cdac6 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 204 len: 0 microversion: 2.1 time: 0.218675 Oct 31 15:18:57.591311 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 714/1373] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:57 2022] DELETE /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:57.600277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:57.606693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:57.619281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.619780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.620226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.620972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.621436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.631752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.889574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:57.903700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:57.910766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:57.914187 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02408b3a-8582-4619-923c-7dba6180cf37 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.615617 Oct 31 15:18:57.916423 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 660/1374] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:57 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:57.927110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45018818-5f89-4389-81eb-8a8f7ee0fc10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2ca3f70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.007299 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45018818-5f89-4389-81eb-8a8f7ee0fc10 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.088616 Oct 31 15:18:58.021859 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 661/1375] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:57 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.034141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-429ea6f2-646b-4349-aa40-6d83d4f029ff tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.034767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-429ea6f2-646b-4349-aa40-6d83d4f029ff tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.048939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.072977 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-395fa130-2ade-4908-a686-21ac1a255256 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.475781 Oct 31 15:18:58.074325 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 715/1376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:57 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.083203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.084143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.119697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.125900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.127613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.129523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.133983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.134761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.178190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-429ea6f2-646b-4349-aa40-6d83d4f029ff tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.189345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-429ea6f2-646b-4349-aa40-6d83d4f029ff tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1223 microversion: 2.1 time: 0.166243 Oct 31 15:18:58.190588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 662/1377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.195640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.196443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.207471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.208264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.208894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.210046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.210670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.211264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.342726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.355504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-305ea0cb-4285-45a0-ace5-c38c9642bdba tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1251 microversion: 2.1 time: 0.163542 Oct 31 15:18:58.357907 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 663/1378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1251 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.370822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.371966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.382117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.383033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.391329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.392553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.393297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.393961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.521373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.530955 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9332cac9-2bf3-4dae-94b5-ff2353b731bc tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1473 microversion: 2.1 time: 0.455105 Oct 31 15:18:58.532680 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 716/1379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1473 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.549875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.550807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.565996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.566748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.567705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.568469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.568953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.569422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.707366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.720581 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4177a34e-628c-4623-902d-d279ab58f8da tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1468 microversion: 2.1 time: 0.360793 Oct 31 15:18:58.725310 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 664/1380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1468 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.737222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7f7c28df-1fb3-4805-82b8-116180580377 req-0529b21f-ec0d-44cd-bf4f-fa2afeaf1ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c96a089-868a-48e6-8687-f117e429833b", "name": "network-vif-unplugged", "status": "completed", "tag": "3c7edc45-0684-4f16-a7d3-e245bdb94392"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:58.757886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7f7c28df-1fb3-4805-82b8-116180580377 req-0529b21f-ec0d-44cd-bf4f-fa2afeaf1ead service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.758899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7f7c28df-1fb3-4805-82b8-116180580377 req-0529b21f-ec0d-44cd-bf4f-fa2afeaf1ead service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.759756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7f7c28df-1fb3-4805-82b8-116180580377 req-0529b21f-ec0d-44cd-bf4f-fa2afeaf1ead service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.782047 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7f7c28df-1fb3-4805-82b8-116180580377 req-0529b21f-ec0d-44cd-bf4f-fa2afeaf1ead service nova] Creating event network-vif-unplugged:3c7edc45-0684-4f16-a7d3-e245bdb94392 for instance 3c96a089-868a-48e6-8687-f117e429833b on n-h2-858383-17 Oct 31 15:18:58.798793 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7f7c28df-1fb3-4805-82b8-116180580377 req-0529b21f-ec0d-44cd-bf4f-fa2afeaf1ead service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071584 Oct 31 15:18:58.800225 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 665/1381] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:58.845648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:58.948063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.949027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.958501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.961275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.961996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.963107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.965132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.966424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.232800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.244826 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0503299d-bc4c-43b4-945d-b1d11ce857ba tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1528 microversion: 2.1 time: 0.706012 Oct 31 15:18:59.258242 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 717/1382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1528 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.267497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83284c8d-f732-4fde-8a26-c818ec4eab05 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca22af040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.329659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83284c8d-f732-4fde-8a26-c818ec4eab05 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.069413 Oct 31 15:18:59.339576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 718/1383] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.339752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.340578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.349903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.351110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.351368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.352579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.353095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.353527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.358989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:59.479304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.482343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:59.496834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.505337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.506754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-54b19625-d754-4251-a24b-c98596e5c246 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.563077 Oct 31 15:18:59.509727 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 666/1384] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:59.533730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.534404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.550618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.551113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.551555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.552274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.561410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.562073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.687396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.708550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df6c6201-8bbc-4190-a340-3de9d9b16019 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1227 microversion: 2.1 time: 0.197500 Oct 31 15:18:59.725102 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 667/1385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1227 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.730540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.731386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.747494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.748385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.749263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.750218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.750936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.751730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.807914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.822612 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-298fa7ca-0b74-468c-8aa0-cbfc980e49df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.487167 Oct 31 15:18:59.823677 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 719/1386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.834861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.835645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.859337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.864052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.864656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.865532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.866111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.866667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.018004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.026291 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-06ca698b-8bbe-4324-97fb-b26b9b087d89 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1251 microversion: 2.1 time: 0.300046 Oct 31 15:19:00.041289 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 668/1387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1251 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.049420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.050268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.056652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.057379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.057985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.058922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.059655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.060331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.451012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.463331 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c55cf057-9326-4685-bcf9-b55c5b5c9b6a tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1473 microversion: 2.1 time: 0.637593 Oct 31 15:19:00.467410 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 720/1388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1473 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.481165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.483965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.496954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.498195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.498721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.499550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.500258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.501030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.556574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:UPDATE=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:00.565666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.566462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.567062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.567726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lazy-loading 'fault' on Instance uuid 3c96a089-868a-48e6-8687-f117e429833b {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:00.576074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.584556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e788745-1c3d-4cee-a392-cafd7da3660e tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1468 microversion: 2.1 time: 0.541924 Oct 31 15:19:00.590177 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 669/1389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1468 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.616030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4aa2cd6c-1d20-4f94-958b-fca360f43984 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca298fd30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.693455 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4aa2cd6c-1d20-4f94-958b-fca360f43984 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.101736 Oct 31 15:19:00.703611 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 670/1390] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.721983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c8e1e5d6-7d23-40c2-b49f-c856f11e4b43 req-6e2c8b81-9dfb-40af-8f1c-38d60f1f472f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c96a089-868a-48e6-8687-f117e429833b", "name": "network-vif-deleted", "tag": "3c7edc45-0684-4f16-a7d3-e245bdb94392"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:00.739377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c8e1e5d6-7d23-40c2-b49f-c856f11e4b43 req-6e2c8b81-9dfb-40af-8f1c-38d60f1f472f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.740901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c8e1e5d6-7d23-40c2-b49f-c856f11e4b43 req-6e2c8b81-9dfb-40af-8f1c-38d60f1f472f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.741648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c8e1e5d6-7d23-40c2-b49f-c856f11e4b43 req-6e2c8b81-9dfb-40af-8f1c-38d60f1f472f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.771327 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c8e1e5d6-7d23-40c2-b49f-c856f11e4b43 req-6e2c8b81-9dfb-40af-8f1c-38d60f1f472f service nova] Creating event network-vif-deleted:3c7edc45-0684-4f16-a7d3-e245bdb94392 for instance 3c96a089-868a-48e6-8687-f117e429833b on n-h2-858383-17 Oct 31 15:19:00.789631 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c8e1e5d6-7d23-40c2-b49f-c856f11e4b43 req-6e2c8b81-9dfb-40af-8f1c-38d60f1f472f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090495 Oct 31 15:19:00.792523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 671/1391] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:00.801148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.802300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.809941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.810961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.811571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.812433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.814257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.815879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.076090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.088572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd24d197-b6cc-4c4f-a840-1b97aa1380be tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 200 len: 1314 microversion: 2.1 time: 0.619876 Oct 31 15:19:01.089184 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 721/1392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:01.104721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.106763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.117933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.120119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.121443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.124248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.125870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.127738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.551769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.570304 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-751d82df-539b-4a02-ba09-00152cb8de30 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1275 microversion: 2.1 time: 0.478688 Oct 31 15:19:01.578621 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 722/1393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:01.597038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-eff78ce7-5bd4-43b0-9e8c-793ec010fe04 req-9b7581a2-ddfc-40d3-abfa-fb8ebb1f05fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "name": "network-vif-plugged", "status": "completed", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:01.644591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eff78ce7-5bd4-43b0-9e8c-793ec010fe04 req-9b7581a2-ddfc-40d3-abfa-fb8ebb1f05fc service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.653485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eff78ce7-5bd4-43b0-9e8c-793ec010fe04 req-9b7581a2-ddfc-40d3-abfa-fb8ebb1f05fc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.655060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eff78ce7-5bd4-43b0-9e8c-793ec010fe04 req-9b7581a2-ddfc-40d3-abfa-fb8ebb1f05fc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.682551 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-eff78ce7-5bd4-43b0-9e8c-793ec010fe04 req-9b7581a2-ddfc-40d3-abfa-fb8ebb1f05fc service nova] Creating event network-vif-plugged:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:19:01.700305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-eff78ce7-5bd4-43b0-9e8c-793ec010fe04 req-9b7581a2-ddfc-40d3-abfa-fb8ebb1f05fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117033 Oct 31 15:19:01.704812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 723/1394] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:01.720866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.722051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.759448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.760264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.760897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.761916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.775081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.776198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.951484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.964959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.967492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.971201 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a89260fc-d5ee-43c1-b3e0-cb3ee48ee845 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 1.175621 Oct 31 15:19:01.995174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 672/1395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:02.006923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.007819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.015431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.018825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.019478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.020741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.021558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.022330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.311295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849ee26672704efe849789e080eb9038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e676a7b344a9fbb96b88fbb4fd69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.324077 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6e01e4a-9caf-4fbb-9c3d-3d1527446483 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 200 len: 1251 microversion: 2.1 time: 0.326983 Oct 31 15:19:02.325383 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 673/1396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 1251 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.343124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.344762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.353495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.355752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.356843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.358663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.361009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.362159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.370132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.394971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08f0e90b-9b2d-4a68-a4cc-d936efa4bd0c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.687312 Oct 31 15:19:02.407424 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 724/1397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.432957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.439376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.458273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.459076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.462630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.465930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.469813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.473059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.605325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.608675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.615711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.616333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lazy-loading 'fault' on Instance uuid 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:02.865967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.874551 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-854428c2-6d93-493a-8694-bf9ef1587ae3 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 200 len: 1304 microversion: 2.1 time: 0.465094 Oct 31 15:19:02.885765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 725/1398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 1304 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.891355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d14ebf5-b575-402f-908b-f1a5c5933a09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca22f65e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.957450 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d14ebf5-b575-402f-908b-f1a5c5933a09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1414 microversion: 2.1 time: 0.070200 Oct 31 15:19:02.958176 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 726/1399] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.970620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.971612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.984971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.985470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.985913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.988027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.988585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.989208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.007746 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b HTTP/1.1 Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:03.009908 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:03.011215 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3c96a089-868a-48e6-8687-f117e429833b'} Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:03.011958 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:03.014970 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.016230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:03.016230 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01d9deaa-dd09-438c-a152-498e620d8d49 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 404 len: 111 microversion: 2.1 time: 0.051352 Oct 31 15:19:03.021952 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 727/1400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:03.027036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.027773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.037785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.038353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.039001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.039863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.040475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.041171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.312304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.320653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08345a85f1cb46f080b0268f151384dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366c148cab043bc8a653080ba52e8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.322435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24eab5c8-d0b0-43c1-ad0a-b172cfdde824 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1281 microversion: 2.1 time: 0.298880 Oct 31 15:19:03.323196 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 728/1401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:03.330087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.331336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.334695 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4c7650f1-b685-4236-8efd-86ef27c24a2c tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 200 len: 1473 microversion: 2.1 time: 1.007961 Oct 31 15:19:03.340908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.341689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.343189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.344761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.345365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.345941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.350446 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 674/1402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 1473 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:03.362907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-328649618", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:03.443303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] validate_networks() for [('f0d5b929-e8f8-4875-990d-aaf4f4a8247a', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:03.829923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.847186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.848619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.849863 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-584b7d80-9480-467e-a1b9-7ae54a31d6d6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.525431 Oct 31 15:19:03.850407 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 729/1403] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:03.855394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-45988ca3-bdcc-4fcc-9570-b92d7e291a7a req-e175e5ec-a1fb-48ac-934c-0d5ab95431c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5", "name": "network-vif-deleted", "tag": "0e86172e-2093-44ee-9850-5faa0eb12535"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:03.881718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-45988ca3-bdcc-4fcc-9570-b92d7e291a7a req-e175e5ec-a1fb-48ac-934c-0d5ab95431c9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.882196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-45988ca3-bdcc-4fcc-9570-b92d7e291a7a req-e175e5ec-a1fb-48ac-934c-0d5ab95431c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.882624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-45988ca3-bdcc-4fcc-9570-b92d7e291a7a req-e175e5ec-a1fb-48ac-934c-0d5ab95431c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.905984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-45988ca3-bdcc-4fcc-9570-b92d7e291a7a req-e175e5ec-a1fb-48ac-934c-0d5ab95431c9 service nova] Creating event network-vif-deleted:0e86172e-2093-44ee-9850-5faa0eb12535 for instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 on n-h2-858383-17 Oct 31 15:19:03.918201 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-45988ca3-bdcc-4fcc-9570-b92d7e291a7a req-e175e5ec-a1fb-48ac-934c-0d5ab95431c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065575 Oct 31 15:19:03.919623 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 730/1404] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:03.928561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.929335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] [instance: 968b5ef7-db40-4099-ab2e-f20a844049d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.936052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.936541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.937014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.937936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.938403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.938825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.957765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] HTTP exception thrown: Instance 968b5ef7-db40-4099-ab2e-f20a844049d7 could not be found. Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Request method failure captured: Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 HTTP/1.1 Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-brPvXdeR_xdLZel0A2Tlo-vDHrf_LS6y4CzQLtPZlsGw0BgdH3iIVpQBEfOSW-UygB4vgwJx9fekcIZ9JU2wENywtPOQJD-mR0J6_YEn4Zg88OOnFIqc0uBEEcsiocK_iGduy7rE_U79hSLTOQXtzN_P_5gk-6l456ItLwr6J89S0 Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 0d2e676a7b344a9fbb96b88fbb4fd69b Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestBootFromVolume-1435322471 Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:03.960180 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0d2e676a7b344a9fbb96b88fbb4fd69b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0d2e676a7b344a9fbb96b88fbb4fd69b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0d2e676a7b344a9fbb96b88fbb4fd69b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0d2e676a7b344a9fbb96b88fbb4fd69b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestBootFromVolume-1435322471 Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 0d2e676a7b344a9fbb96b88fbb4fd69b Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1435322471 Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestBootFromVolume-1435322471-project Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 849ee26672704efe849789e080eb9038 Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestBootFromVolume-1435322471-project Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 968b5ef7-db40-4099-ab2e-f20a844049d7 could not be found. Oct 31 15:19:03.961779 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '968b5ef7-db40-4099-ab2e-f20a844049d7'} Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 968b5ef7-db40-4099-ab2e-f20a844049d7 could not be found. Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:03.963962 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 968b5ef7-db40-4099-ab2e-f20a844049d7 could not be found. Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 968b5ef7-db40-4099-ab2e-f20a844049d7 could not be found. Oct 31 15:19:03.965355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:03.970095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Returning 404 to user: Instance 968b5ef7-db40-4099-ab2e-f20a844049d7 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:03.970095 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec8d108e-52e4-4e38-8ecd-231783bae9e7 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7" status: 404 len: 111 microversion: 2.1 time: 0.040793 Oct 31 15:19:03.970095 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 731/1405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/968b5ef7-db40-4099-ab2e-f20a844049d7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:03.970095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.970095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.980603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.983547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.984060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.987161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.987988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.990409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.911110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:04.920930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c63d322-146f-4c99-ae2d-11c9370703ac tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1379 microversion: 2.1 time: 0.956652 Oct 31 15:19:04.921656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 732/1406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1379 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:04.927804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.929246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:04.938675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.939439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.939942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.940904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.941433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.941933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.955990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] HTTP exception thrown: Instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 could not be found. Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Request method failure captured: Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 HTTP/1.1 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-bT92YJmQVUlI65_AHtEHzoeAV8cBtZSHukARZR5BBJ55YoiUscKc0sCPV-z4r6ZM1tvzXCOxKaqzrBcYIdclwirTQXH5s3PuGDvUkuflAYXs_ow72Mzc9cHLqVytf5FkD1fo3LCv_QJ1kgrMK7_JSPqVFII61G6xwrf9eZe8OkQ50 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a8467f5801594eba9c27b4eb124c8325 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:04.957727 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a8467f5801594eba9c27b4eb124c8325 Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersAdminTestJSON-1613026037-project Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 319cd9ded5c2410392868fb3cb039342 Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersAdminTestJSON-1613026037-project Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 could not be found. Oct 31 15:19:04.959325 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5'} Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 could not be found. Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:04.960302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 could not be found. Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 could not be found. Oct 31 15:19:04.961916 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.963580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Returning 404 to user: Instance 5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:04.964158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36e09a56-c887-4585-8f30-8ae1737b727d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5" status: 404 len: 111 microversion: 2.1 time: 0.040076 Oct 31 15:19:04.965097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 733/1407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/servers/5f7c1d41-f8ed-4e3a-b9e6-00a1dc7269c5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:04.972196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-993cfd02-eb88-40ac-ab2d-f4a3f9d5c5f1 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] Calling method '.version_select at 0x7f5ca24483a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.993923 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-993cfd02-eb88-40ac-ab2d-f4a3f9d5c5f1 tempest-ServersTestBootFromVolume-1435322471 tempest-ServersTestBootFromVolume-1435322471-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-472865569" status: 202 len: 0 microversion: 2.1 time: 0.027110 Oct 31 15:19:04.995746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 734/1408] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-472865569 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:05.002585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b5dc9a3-b899-4e1e-a197-43c5c375f4dc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2921e50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.060554 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b5dc9a3-b899-4e1e-a197-43c5c375f4dc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1423 microversion: 2.1 time: 0.063364 Oct 31 15:19:05.071418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 735/1409] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.078909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.079871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.091796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.092600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.093322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.094864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.095560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.096773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.114799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:05.115363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:05.115691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:05.116102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:05.116511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:05.142917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.143966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.145207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.146240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.146945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.148060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.181678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:05.193276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:05.215690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Getting quotas for user 9315a4916cfa47da9904d8bfbc775e0a and project e0b2fcc7ab184574ab86ddbe03096ccd. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:05.217036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c84e3972-fc2a-4477-a728-97242eae563f tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1281 microversion: 2.1 time: 0.144040 Oct 31 15:19:05.219056 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 736/1410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.232727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:05.233068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.233833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] [instance: 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.236873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:05.249651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.252614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.253428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.254453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.255440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.256058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.273638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:05.278337 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] HTTP exception thrown: Instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 could not be found. Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Request method failure captured: Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 HTTP/1.1 Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-adaUtWl3j-iNFN_XSb7q4ZRqlN24RswW1mqktfeYoupkHIeNKrhOjzVfSADnpNmB-kEPqtWQu0FVeZAC-AhgOvDi6cs5Ly2sAfFHO9hqHnoMBic87LfQ6U3pgDEJw28UvghD_wNfDQTcR983zUj7-oTrjcuwL_wBcSAuM_Sblk1UM Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:05.280271 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4366c148cab043bc8a653080ba52e8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4366c148cab043bc8a653080ba52e8c6 Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867910004 Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 08345a85f1cb46f080b0268f151384dc Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersOnMultiNodesTest-1867910004-project Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 could not be found. Oct 31 15:19:05.282390 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806'} Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 could not be found. Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:05.283492 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 could not be found. Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 could not be found. Oct 31 15:19:05.286840 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:05.291105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] Returning 404 to user: Instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:05.292278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcf94bda-d19b-483b-838a-76698ea5b7a3 tempest-ServersOnMultiNodesTest-1867910004 tempest-ServersOnMultiNodesTest-1867910004-project] 10.222.0.48 "GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806" status: 404 len: 111 microversion: 2.1 time: 0.069221 Oct 31 15:19:05.295106 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 737/1411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:05.308495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.314834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.331800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.333862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.336656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.337958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.339789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.349200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.357238 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ad9fa56-8b55-4683-a565-2f9a7988d563 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.004108 Oct 31 15:19:05.368156 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 675/1412] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:05.379826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.381855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.396507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.397370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.397878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.400919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.401829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.402501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.460051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:05.650367 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-24ec1501-1c18-4ce7-84ab-a2d5dc594c07 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 204 len: 0 microversion: 2.1 time: 0.280661 Oct 31 15:19:05.661883 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 676/1413] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:05 2022] DELETE /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:05.670847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-44689900-971c-4da6-bccb-f3f8b72ed126 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca29fb4c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.839332 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-44689900-971c-4da6-bccb-f3f8b72ed126 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 200 len: 1423 microversion: 2.1 time: 0.172644 Oct 31 15:19:05.842062 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 677/1414] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 1423 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.856928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ea7247a-6b8d-4e44-8130-a561932950b0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.857941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ea7247a-6b8d-4e44-8130-a561932950b0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.960122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3ea7247a-6b8d-4e44-8130-a561932950b0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:05.970659 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ea7247a-6b8d-4e44-8130-a561932950b0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1224 microversion: 2.1 time: 0.127031 Oct 31 15:19:05.971219 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 678/1415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.986767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.987872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.003540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.005016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.005016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.005515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.005976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.006498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.107051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.119296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.121648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.123353 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c6219ba-3d85-4f90-aa09-f42bcf907323 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.826426 Oct 31 15:19:06.124317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 738/1416] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:06.131143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c266b448-40bf-4a35-95ee-7a291ae30f6c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca22a0c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.465556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.478155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bb30d5ba-b7eb-4957-a83c-14e85daf81bb tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1469 microversion: 2.1 time: 0.496044 Oct 31 15:19:06.482858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 679/1417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:06.501335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.502222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.509732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.512690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.513419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.515974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.516680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.519757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.824215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.846962 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e78084c-00aa-4408-9ea2-32c5adba1c2a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1529 microversion: 2.1 time: 0.362140 Oct 31 15:19:06.854398 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 680/1418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1529 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:06.870805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806", "name": "network-vif-deleted", "tag": "fc5fea4c-684c-42ac-8570-5fdf23b00582"}, {"server_uuid": "e86ca09a-927f-4b27-89b2-db9834d10c3c", "name": "network-vif-unplugged", "status": "completed", "tag": "d47e8eda-2de0-4bec-8ab5-ac3c4682b94c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:06.889069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.896282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.898413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.936845 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] Creating event network-vif-deleted:fc5fea4c-684c-42ac-8570-5fdf23b00582 for instance 3cdd6e67-0eb1-42ab-b4c6-38fcd95a2806 on n-h1-858383-17 Oct 31 15:19:06.953026 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] Creating event network-vif-unplugged:d47e8eda-2de0-4bec-8ab5-ac3c4682b94c for instance e86ca09a-927f-4b27-89b2-db9834d10c3c on n-h2-858383-17 Oct 31 15:19:06.971500 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-92098edf-273b-495e-9a1f-48d2c3c9fd3e req-8b8c238f-fce6-4d14-823b-4e627586f0e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.115784 Oct 31 15:19:06.972576 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 681/1419] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:07.010305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.013409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.031323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.034107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.035434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.037564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.038207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.041838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.250431 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c266b448-40bf-4a35-95ee-7a291ae30f6c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 204 len: 0 microversion: 2.1 time: 1.123294 Oct 31 15:19:07.252139 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 739/1420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] DELETE /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:07.258838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.259944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.269086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.271072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.271518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.272580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.274063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.274840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.327615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:07.361636 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-58d578f6-6506-4caa-87a1-9539c251f831 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.363809 Oct 31 15:19:07.365725 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 682/1421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:07.399287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.403427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.422355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.423147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.423806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.425171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.427614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.428268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.917965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:07.930143 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bc09d2c4-98ae-4e47-99ad-01dad83edec5 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1276 microversion: 2.1 time: 0.562836 Oct 31 15:19:07.930652 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 683/1422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1276 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:07.943927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.950647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.962773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.963328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.963700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.964419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.965002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.965343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.331624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.348668 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69c2e35b-0b3a-40d1-aa8b-7f7ddaac16a6 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1529 microversion: 2.1 time: 1.089872 Oct 31 15:19:08.349185 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 740/1423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1529 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:08.354690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.355441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.376113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.376666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.377357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.378930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.379499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.379782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.435361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:08.522873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:08.603314 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10de1746-0272-4629-a3ca-fe86c079eca0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 204 len: 0 microversion: 2.1 time: 0.252435 Oct 31 15:19:08.609455 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 741/1424] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:08 2022] DELETE /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:08.625425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.626796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.639088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.639890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.643366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.644425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.646207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.647169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.700497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.710045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.715293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.721910 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ab8652c-698e-47fb-9484-a4e40091229d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.787170 Oct 31 15:19:08.733103 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 684/1425] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:08.745095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5d960f53-839f-413f-838d-cd8204537b82 req-d5c00eef-8b50-4bc8-b90b-77582f594395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802119d0-f33f-421a-910a-9a78e05406a6", "name": "network-vif-unplugged", "status": "completed", "tag": "cc06bcb0-9110-476e-a705-7dfb05841e2e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:08.756301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5d960f53-839f-413f-838d-cd8204537b82 req-d5c00eef-8b50-4bc8-b90b-77582f594395 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.756999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5d960f53-839f-413f-838d-cd8204537b82 req-d5c00eef-8b50-4bc8-b90b-77582f594395 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.757615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5d960f53-839f-413f-838d-cd8204537b82 req-d5c00eef-8b50-4bc8-b90b-77582f594395 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.772880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5d960f53-839f-413f-838d-cd8204537b82 req-d5c00eef-8b50-4bc8-b90b-77582f594395 service nova] Creating event network-vif-unplugged:cc06bcb0-9110-476e-a705-7dfb05841e2e for instance 802119d0-f33f-421a-910a-9a78e05406a6 on n-h2-858383-17 Oct 31 15:19:08.778589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5d960f53-839f-413f-838d-cd8204537b82 req-d5c00eef-8b50-4bc8-b90b-77582f594395 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044040 Oct 31 15:19:08.779813 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 685/1426] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:08.786306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e43b673-9593-40c8-8c3c-a775622d326f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.820673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e43b673-9593-40c8-8c3c-a775622d326f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/443d3397-f4b8-4acd-98e8-b3a37dfb3f9b" status: 202 len: 0 microversion: 2.1 time: 0.038952 Oct 31 15:19:08.826876 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 686/1427] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:08 2022] DELETE /compute/v2.1/flavors/443d3397-f4b8-4acd-98e8-b3a37dfb3f9b => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:08.835024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.840743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.853744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.854935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.855986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.858397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.861477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.862904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.425963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:09.440663 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5a7c9fe-453c-4b9b-a170-21da2671605a tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1469 microversion: 2.1 time: 0.826049 Oct 31 15:19:09.442891 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 742/1428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:08 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1469 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:09.465723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-558046814", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bc2357ef-c687-4bf5-80c5-a090c70bef3f"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:09.573623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] validate_networks() for [('bc2357ef-c687-4bf5-80c5-a090c70bef3f', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:09.613390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:09.622083 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-158c4bd4-b26b-4bba-98b9-ca75154f55ec tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.794058 Oct 31 15:19:09.622675 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 687/1429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:08 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:09.640644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-795bbcce-3339-4eaf-9c03-5dbee471cb11 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:09.678451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-795bbcce-3339-4eaf-9c03-5dbee471cb11 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054416 Oct 31 15:19:09.681939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 688/1430] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:19:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:09.697721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:09.698699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:09.709837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.710675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.711295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.712443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.713090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.713669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.739496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:10.222934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:10.238660 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75071375-38de-42fa-b371-fe0e5b352983 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1282 microversion: 2.1 time: 0.555246 Oct 31 15:19:10.258819 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 689/1431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:09 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1282 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:10.265299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6311e507-d296-421d-bd07-2f8eb9aaf03d req-3664b48a-7229-41be-b31d-713a37690f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86ca09a-927f-4b27-89b2-db9834d10c3c", "tag": "d47e8eda-2de0-4bec-8ab5-ac3c4682b94c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:10.284337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6311e507-d296-421d-bd07-2f8eb9aaf03d req-3664b48a-7229-41be-b31d-713a37690f6e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.286520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6311e507-d296-421d-bd07-2f8eb9aaf03d req-3664b48a-7229-41be-b31d-713a37690f6e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.287110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6311e507-d296-421d-bd07-2f8eb9aaf03d req-3664b48a-7229-41be-b31d-713a37690f6e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.302594 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6311e507-d296-421d-bd07-2f8eb9aaf03d req-3664b48a-7229-41be-b31d-713a37690f6e service nova] Creating event network-changed:d47e8eda-2de0-4bec-8ab5-ac3c4682b94c for instance e86ca09a-927f-4b27-89b2-db9834d10c3c on n-h2-858383-17 Oct 31 15:19:10.309618 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6311e507-d296-421d-bd07-2f8eb9aaf03d req-3664b48a-7229-41be-b31d-713a37690f6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049025 Oct 31 15:19:10.311025 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 690/1432] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:10.319076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:10.322169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:10.330049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.330817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.331429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.332323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.332983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.333687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.378160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:10.387353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Old instance type tempest-test_resize_flavor_-1765189475, new instance type m1.heat {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:19:10.398780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:10.399206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:10.399689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:10.400244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:10.400666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:10.488808 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b784d02c-14da-4851-ab9c-73275fcbc89b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337/action" status: 202 len: 0 microversion: 2.1 time: 0.175631 Oct 31 15:19:10.490264 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 691/1433] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:10 2022] POST /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:10.496636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:10.497469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:10.506414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.506903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.507680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.508596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.509658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.510721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.332650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.367247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.370155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.381452 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dabbc687-83cf-499b-8334-72ba87b5df3b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.888656 Oct 31 15:19:11.388443 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 692/1434] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:10 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:11.405481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:11.408035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:11.423574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.424609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.425337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.426352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.427499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.428204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.502929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.503541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.504351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.504838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lazy-loading 'fault' on Instance uuid ee43b08d-f9f4-45c0-bfac-b60dde48261d {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:11.721955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.741172 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6dd0c36-e815-4102-b86c-2bbd7bbcdce4 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 200 len: 1303 microversion: 2.1 time: 0.338904 Oct 31 15:19:11.742699 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 693/1435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:11 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 1303 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:11.757234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:11.758219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:11.775932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.777618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.779987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.784046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.793500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.794206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.204348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:12.204928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:12.205646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:12.206172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:12.206871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:12.222673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.223528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.223916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.225161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.225822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.226353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.256511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:12.263091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for user 857b0f5f4fdc4b1faeae0e0770d65125 and project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:12.278858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:12.281916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:12.355937 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bb7a99f-96a5-49b3-bf39-42cd2a1c45ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.911178 Oct 31 15:19:12.360664 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 743/1436] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:12.370507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.372618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.388523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.389176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.390951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.392076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.407362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.407898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.477283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:12.493390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b2f8f81-5596-4812-a37f-b508992ebc93 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1538 microversion: 2.1 time: 0.749152 Oct 31 15:19:12.494094 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 694/1437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:11 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1538 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:12.519717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.520755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.529468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.531881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.532670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.533679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.534401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.535263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.291077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.301576 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5590e7e-9b0a-47e3-941b-f0020e3dcb12 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.939463 Oct 31 15:19:13.304531 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 744/1438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:12 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:13.309725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4441170b-27b7-461b-b7fe-0d00dd76a14e req-4d546001-d5bb-42a1-9461-b8acb19aab3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802119d0-f33f-421a-910a-9a78e05406a6", "name": "network-vif-deleted", "tag": "cc06bcb0-9110-476e-a705-7dfb05841e2e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:13.321422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4441170b-27b7-461b-b7fe-0d00dd76a14e req-4d546001-d5bb-42a1-9461-b8acb19aab3c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.322443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4441170b-27b7-461b-b7fe-0d00dd76a14e req-4d546001-d5bb-42a1-9461-b8acb19aab3c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.323156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4441170b-27b7-461b-b7fe-0d00dd76a14e req-4d546001-d5bb-42a1-9461-b8acb19aab3c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.336629 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4441170b-27b7-461b-b7fe-0d00dd76a14e req-4d546001-d5bb-42a1-9461-b8acb19aab3c service nova] Creating event network-vif-deleted:cc06bcb0-9110-476e-a705-7dfb05841e2e for instance 802119d0-f33f-421a-910a-9a78e05406a6 on n-h2-858383-17 Oct 31 15:19:13.342278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4441170b-27b7-461b-b7fe-0d00dd76a14e req-4d546001-d5bb-42a1-9461-b8acb19aab3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Oct 31 15:19:13.347440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 745/1439] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:13.357808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.358518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.365494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.365979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.366410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.367104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.367556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.367977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.490272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.498303 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3752ba4-b40a-4db7-b0ba-b0ad656b4f8c tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1324 microversion: 2.1 time: 0.989158 Oct 31 15:19:13.506289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.509382 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 695/1440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:12 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1324 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:13.516910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64e3ec65-aa4d-402c-ac0c-1fe07d806770 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1203 microversion: 2.1 time: 0.167804 Oct 31 15:19:13.518548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.519245 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 746/1441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:13.520788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.530661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.531985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.532591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.533434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa974f3-947c-4235-9bec-be3641676a34", "tag": "f00fa763-febd-4347-b88b-86514e3a7657"}, {"server_uuid": "ee43b08d-f9f4-45c0-bfac-b60dde48261d", "name": "network-vif-deleted", "tag": "f1a06634-992a-4099-b9cb-3af51ba7ed45"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:13.535172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.535820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.536397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.551065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.551824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.553434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.571612 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] Creating event network-changed:f00fa763-febd-4347-b88b-86514e3a7657 for instance 4fa974f3-947c-4235-9bec-be3641676a34 on n-h1-858383-17 Oct 31 15:19:13.572372 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] Creating event network-vif-deleted:f1a06634-992a-4099-b9cb-3af51ba7ed45 for instance ee43b08d-f9f4-45c0-bfac-b60dde48261d on n-h1-858383-17 Oct 31 15:19:13.581229 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8f62780c-93c2-4583-8b66-e8635427fec2 req-cbed0551-fd4a-450b-bb73-2f89ff43a9d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059774 Oct 31 15:19:13.582144 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 747/1442] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:13.590674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.591811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: ee43b08d-f9f4-45c0-bfac-b60dde48261d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.600166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.601092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.601840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.602703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.603348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.604036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.624912 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] HTTP exception thrown: Instance ee43b08d-f9f4-45c0-bfac-b60dde48261d could not be found. Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Request method failure captured: Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d HTTP/1.1 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-bT92YJmQVUlI65_AHtEHzoeAV8cBtZSHukARZR5BBJ55YoiUscKc0sCPV-z4r6ZM1tvzXCOxKaqzrBcYIdclwirTQXH5s3PuGDvUkuflAYXs_ow72Mzc9cHLqVytf5FkD1fo3LCv_QJ1kgrMK7_JSPqVFII61G6xwrf9eZe8OkQ50 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a8467f5801594eba9c27b4eb124c8325 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:13.627779 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a8467f5801594eba9c27b4eb124c8325 Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersAdminTestJSON-1613026037-project Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 319cd9ded5c2410392868fb3cb039342 Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersAdminTestJSON-1613026037-project Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance ee43b08d-f9f4-45c0-bfac-b60dde48261d could not be found. Oct 31 15:19:13.630794 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'ee43b08d-f9f4-45c0-bfac-b60dde48261d'} Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee43b08d-f9f4-45c0-bfac-b60dde48261d could not be found. Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:13.631718 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee43b08d-f9f4-45c0-bfac-b60dde48261d could not be found. Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee43b08d-f9f4-45c0-bfac-b60dde48261d could not be found. Oct 31 15:19:13.633380 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:13.634905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Returning 404 to user: Instance ee43b08d-f9f4-45c0-bfac-b60dde48261d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:13.634905 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6cb657be-76b8-4c4c-815c-3e5397e5cc90 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d" status: 404 len: 111 microversion: 2.1 time: 0.046001 Oct 31 15:19:13.635378 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 748/1443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/ee43b08d-f9f4-45c0-bfac-b60dde48261d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:13.648658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.650798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.664322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.665439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.666324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.667296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.669022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.669997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.278972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.332467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.335866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.343906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2c8b40c-5650-4201-856a-e734e08a98da tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.829737 Oct 31 15:19:14.345296 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 696/1444] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:14.351816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.354018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.366976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.367484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.369205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.370619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.371422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.372149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.406506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:14.463352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.476992 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f59e1b71-294e-45d3-9edc-8606d1ad5ac9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1538 microversion: 2.1 time: 0.834936 Oct 31 15:19:14.479400 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 749/1445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1538 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.487629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.489294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.500414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.505774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.506550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.508401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.511088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.512446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.549310 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3259a2aa-dc39-48e5-bee5-b9ccab7b9aaa tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 204 len: 0 microversion: 2.1 time: 0.202189 Oct 31 15:19:14.551326 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 697/1446] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:14 2022] DELETE /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:14.561804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.568020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.581989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.582777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.583412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.584287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.584937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.585536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.100290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.115161 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-571ad93b-10a7-4ae7-ab22-ccf35f3d5530 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.634022 Oct 31 15:19:15.135430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.139099 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 750/1447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:14 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:15.144546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee65d871-8f50-4e8c-840e-6bb8cc0c0e5b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1324 microversion: 2.1 time: 0.591606 Oct 31 15:19:15.145183 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 698/1448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:14 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:15.149882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.157149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.157803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.163430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.167982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:15.179291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.179909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.180451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.181310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.181898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.182432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.188364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.188887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.189323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.190035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.190492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.190910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.289427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.297442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da3468d7-1f08-4dec-b74b-2819b050f145 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1277 microversion: 2.1 time: 0.156349 Oct 31 15:19:15.298015 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 751/1449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:15.373793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.375803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.385336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.389070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.391162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.393788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.396242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.397202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.889360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.908291 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-198ba33d-827b-4263-8cbe-46290430b608 tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1469 microversion: 2.1 time: 0.754078 Oct 31 15:19:15.909549 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 699/1450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1469 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:15.929245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.930108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.941094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.941914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.942508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.943476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.946771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.949597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.016446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=18 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:16.079609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:16.107843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:16.111510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:16.121728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b403eee8-4a17-4c80-a47c-8ea6fc103654 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.750588 Oct 31 15:19:16.124241 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 752/1451] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:19:16.147381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:16.148384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:16.158394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.160413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.162214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.163227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.167756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.169347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.768786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:16.778222 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2633745-d86b-41d9-a3d8-2b12aa6562e4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1538 microversion: 2.1 time: 0.867246 Oct 31 15:19:16.780346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 700/1452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1538 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:16.789807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:16.795558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:16.810467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.812792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.813546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.816026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.816762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.818902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.942829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:16.967183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0126e841-463a-4a7a-be5f-ce0ea3429800 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.821370 Oct 31 15:19:16.970805 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 753/1453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:16 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:17.003507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:17.004611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:17.027492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.029323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.033238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.034356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.042149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.045493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.385652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:17.399953 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b71e24df-7781-47d1-81ed-309463a329f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1265 microversion: 2.1 time: 0.427277 Oct 31 15:19:17.401141 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 754/1454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:16 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:17.413806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:17.414598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:17.433483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.433998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.434752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.435489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.435951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.436377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.692566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '319cd9ded5c2410392868fb3cb039342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8467f5801594eba9c27b4eb124c8325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:17.711226 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cec0b440-4529-4494-ab47-b9d81fb1146d tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 200 len: 1427 microversion: 2.1 time: 0.307176 Oct 31 15:19:17.712268 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 755/1455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:17 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 1427 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:17.730511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a8e7660c-ae5c-490c-a0ff-2ced7e6acad6 req-0c5a320a-e9b8-4b49-9154-36da8ee529c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac87083b-12c8-40a4-8989-6943fa4f6e0b", "tag": "738261b0-90d5-4a47-b221-b61877fb1557"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:17.750474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a8e7660c-ae5c-490c-a0ff-2ced7e6acad6 req-0c5a320a-e9b8-4b49-9154-36da8ee529c9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.751396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a8e7660c-ae5c-490c-a0ff-2ced7e6acad6 req-0c5a320a-e9b8-4b49-9154-36da8ee529c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.752058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a8e7660c-ae5c-490c-a0ff-2ced7e6acad6 req-0c5a320a-e9b8-4b49-9154-36da8ee529c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.780134 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a8e7660c-ae5c-490c-a0ff-2ced7e6acad6 req-0c5a320a-e9b8-4b49-9154-36da8ee529c9 service nova] Creating event network-changed:738261b0-90d5-4a47-b221-b61877fb1557 for instance ac87083b-12c8-40a4-8989-6943fa4f6e0b on n-h2-858383-17 Oct 31 15:19:17.797068 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a8e7660c-ae5c-490c-a0ff-2ced7e6acad6 req-0c5a320a-e9b8-4b49-9154-36da8ee529c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080454 Oct 31 15:19:17.799831 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 756/1456] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:17.816199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:17.817280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:17.832425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.833356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.834022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.835927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.836628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.837608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.885904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:17.896089 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a012e21-388f-4011-82b9-3dc29fc082d8 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1324 microversion: 2.1 time: 1.112830 Oct 31 15:19:17.900743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 701/1457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:16 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1324 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:17.913276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:17.913953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:17.927034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.927572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.928046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.932254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.932792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.933269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.088410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.108076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.110857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.112591 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31569d88-031b-4b5c-b89d-be148ebfd6c2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 1.311280 Oct 31 15:19:19.113491 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 757/1458] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:17 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:19.132243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.133209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.143430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.147821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.148560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.166706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.166706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.166706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.168627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.179195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d92a36e1-0d3d-4cc6-b97e-21b42ab8e676 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1538 microversion: 2.1 time: 1.277189 Oct 31 15:19:19.188458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 702/1459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:17 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1538 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:19.193549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6777905a-2076-48b2-9d54-fc0d0745a5e4 req-dbf08feb-3edd-4ea6-b006-1673d80fda86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f76ff1-0ab5-4867-bd70-298e5c669e14", "name": "network-vif-deleted", "tag": "7f3fe3b4-8a55-44bb-9927-a92f40189c01"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:19.230844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6777905a-2076-48b2-9d54-fc0d0745a5e4 req-dbf08feb-3edd-4ea6-b006-1673d80fda86 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.231393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6777905a-2076-48b2-9d54-fc0d0745a5e4 req-dbf08feb-3edd-4ea6-b006-1673d80fda86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.231836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6777905a-2076-48b2-9d54-fc0d0745a5e4 req-dbf08feb-3edd-4ea6-b006-1673d80fda86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.257075 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6777905a-2076-48b2-9d54-fc0d0745a5e4 req-dbf08feb-3edd-4ea6-b006-1673d80fda86 service nova] Creating event network-vif-deleted:7f3fe3b4-8a55-44bb-9927-a92f40189c01 for instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 on n-h2-858383-17 Oct 31 15:19:19.267997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6777905a-2076-48b2-9d54-fc0d0745a5e4 req-dbf08feb-3edd-4ea6-b006-1673d80fda86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077986 Oct 31 15:19:19.271256 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 703/1460] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:19.284670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.285584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.292736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.293490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.294122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.294998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.296445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.297627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.305443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:19.858200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.913387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f927d5a3-dc6c-4ca7-8210-8919034f59a8 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.792963 Oct 31 15:19:19.914513 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 758/1461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:19.916263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.930220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7c2187f-23ba-43a9-98d3-f75c5d2c6a8a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1307 microversion: 2.1 time: 0.658829 Oct 31 15:19:19.931341 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 704/1462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1307 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:19.933766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.937234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] [instance: e0f76ff1-0ab5-4867-bd70-298e5c669e14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.937997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.947291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.954603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.955323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.955603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.955808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.956108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.956471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.956582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.957522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.957711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.958126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.965365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.966028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.980603 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] HTTP exception thrown: Instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 could not be found. Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Request method failure captured: Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 HTTP/1.1 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-bT92YJmQVUlI65_AHtEHzoeAV8cBtZSHukARZR5BBJ55YoiUscKc0sCPV-z4r6ZM1tvzXCOxKaqzrBcYIdclwirTQXH5s3PuGDvUkuflAYXs_ow72Mzc9cHLqVytf5FkD1fo3LCv_QJ1kgrMK7_JSPqVFII61G6xwrf9eZe8OkQ50 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a8467f5801594eba9c27b4eb124c8325 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:19.982782 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8467f5801594eba9c27b4eb124c8325"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a8467f5801594eba9c27b4eb124c8325 Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersAdminTestJSON-1613026037 Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersAdminTestJSON-1613026037-project Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 319cd9ded5c2410392868fb3cb039342 Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersAdminTestJSON-1613026037-project Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 could not be found. Oct 31 15:19:19.985180 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e0f76ff1-0ab5-4867-bd70-298e5c669e14'} Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 could not be found. Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:19.985923 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 could not be found. Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 could not be found. Oct 31 15:19:19.987343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:19.989672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] Returning 404 to user: Instance e0f76ff1-0ab5-4867-bd70-298e5c669e14 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:19.990708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff575ebe-8e00-400e-ab34-5214bf49c25b tempest-ServersAdminTestJSON-1613026037 tempest-ServersAdminTestJSON-1613026037-project] 10.222.0.48 "GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14" status: 404 len: 111 microversion: 2.1 time: 0.074888 Oct 31 15:19:19.994822 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 759/1463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/e0f76ff1-0ab5-4867-bd70-298e5c669e14 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:20.150994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:20.152147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:20.166134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.171502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.172565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.175386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.176617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.177312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.389142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:20.398485 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e31dddf0-42de-402d-8812-7d3389b665c0 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1324 microversion: 2.1 time: 0.465903 Oct 31 15:19:20.406611 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 705/1464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:20.414811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:20.415577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:20.431827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.432128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.432799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.433726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.434345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.434987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.711414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:20.725350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:20.726946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:20.728199 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed89be2b-967e-484b-a8ff-dd8adb5a76a5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.590088 Oct 31 15:19:20.728784 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 760/1465] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:20 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:19:20.862029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:20.880614 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff902cf2-2c32-48b3-aa6a-9463e231d60b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1543 microversion: 2.1 time: 0.472563 Oct 31 15:19:20.881402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 706/1466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:20 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1543 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:20.956554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:20.958641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:20.960145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:20.962369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:20.983856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.985024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.986445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.987509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.988161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.988790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.991055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.991670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.993021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.993224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.993933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.994537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.696003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:21.718114 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00a15b35-994a-4fe4-800f-3a7e4da0ca09 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1307 microversion: 2.1 time: 0.766891 Oct 31 15:19:21.719380 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 707/1467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:20 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1307 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:21.740521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8b3d9698-044f-48e7-ab21-cc2b1dea8741 req-48030a97-a962-4f4f-af2d-330fe31a851c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa974f3-947c-4235-9bec-be3641676a34", "name": "network-vif-plugged", "status": "completed", "tag": "f00fa763-febd-4347-b88b-86514e3a7657"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:21.758781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8b3d9698-044f-48e7-ab21-cc2b1dea8741 req-48030a97-a962-4f4f-af2d-330fe31a851c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.761057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8b3d9698-044f-48e7-ab21-cc2b1dea8741 req-48030a97-a962-4f4f-af2d-330fe31a851c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.763178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8b3d9698-044f-48e7-ab21-cc2b1dea8741 req-48030a97-a962-4f4f-af2d-330fe31a851c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.794510 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8b3d9698-044f-48e7-ab21-cc2b1dea8741 req-48030a97-a962-4f4f-af2d-330fe31a851c service nova] Creating event network-vif-plugged:f00fa763-febd-4347-b88b-86514e3a7657 for instance 4fa974f3-947c-4235-9bec-be3641676a34 on n-h1-858383-17 Oct 31 15:19:21.805072 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8b3d9698-044f-48e7-ab21-cc2b1dea8741 req-48030a97-a962-4f4f-af2d-330fe31a851c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084233 Oct 31 15:19:21.807732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 708/1468] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:21.819111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e9ff7957-a6e0-42a9-8671-abdb5fcda930 req-6d70ff61-645a-4065-ae38-260da163e098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1", "tag": "65c32b74-b6d6-42ab-900d-530fe5ad0b7f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:21.833803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e9ff7957-a6e0-42a9-8671-abdb5fcda930 req-6d70ff61-645a-4065-ae38-260da163e098 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.834781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e9ff7957-a6e0-42a9-8671-abdb5fcda930 req-6d70ff61-645a-4065-ae38-260da163e098 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.835548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e9ff7957-a6e0-42a9-8671-abdb5fcda930 req-6d70ff61-645a-4065-ae38-260da163e098 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.850047 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e9ff7957-a6e0-42a9-8671-abdb5fcda930 req-6d70ff61-645a-4065-ae38-260da163e098 service nova] Creating event network-changed:65c32b74-b6d6-42ab-900d-530fe5ad0b7f for instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 on n-h2-858383-17 Oct 31 15:19:21.856106 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e9ff7957-a6e0-42a9-8671-abdb5fcda930 req-6d70ff61-645a-4065-ae38-260da163e098 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041259 Oct 31 15:19:21.857928 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 709/1469] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:21.865829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:21.867000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:21.874824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.875826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.876494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.877496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.878172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.878822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:22.245565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:22.272070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:22.794738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:22.813889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cda30e19-40f8-4c01-9000-36aaecd99c43 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 1.878881 Oct 31 15:19:22.829751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 761/1470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:20 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:22.835100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:22.835720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:22.847665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:22.855173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:22.857279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:22.858847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:22.859863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:22.860562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:22.861397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:22.889278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:22.952606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:22.966051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0c9c8470-4c99-40a0-97ad-8918f9488ec7 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1324 microversion: 2.1 time: 1.105711 Oct 31 15:19:22.971954 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 710/1471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:21 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1324 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:22.980088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:22.980723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:23.000196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:23.000859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:23.001269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:23.002086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:23.003731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:23.004351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:23.577194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:23.595819 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78e52565-44e0-4ce9-a88e-1a7c3e034d05 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1543 microversion: 2.1 time: 0.621121 Oct 31 15:19:23.598018 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 711/1472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:22 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1543 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:23.630204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:23.641143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:23.642911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:23.652571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0afe75f2-7aea-4d57-95b2-b118fc9742fe tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1813 microversion: 2.25 time: 0.822541 Oct 31 15:19:23.653724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 762/1473] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:22 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1813 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:23.659246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:23.663083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:23.676540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:23.677962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:23.684436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:23.685530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:23.686754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:23.687430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:24.129555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-507762f6-ba39-4e68-af04-b56a50a7e6ab tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Action: 'create', calling method: .version_select at 0x7f5ca2a26280>, body: {"pool": null} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:24.288627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:24.321155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48ceaad0-f9c3-43a3-8dd9-08dcedbb13ce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1307 microversion: 2.1 time: 0.663968 Oct 31 15:19:24.322913 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 763/1474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:23 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1307 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:24.344444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:24.345098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:24.351459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:24.351956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:24.352568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:24.353325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:24.353792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:24.354221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:24.786539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:24.794945 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1896b53-c23a-45a1-b2fa-15fdcd100fa3 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1323 microversion: 2.1 time: 0.470966 Oct 31 15:19:24.795623 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 764/1475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:24 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:24.816534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:24.817672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:24.823987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:24.824734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:24.825654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:24.825889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:24.826355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:24.827549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:25.501835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:25.516079 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6253886c-1007-45f9-b28e-1e400061be08 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1324 microversion: 2.1 time: 0.705944 Oct 31 15:19:25.534452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 765/1476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:24 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1324 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:25.539552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4a2cb149-eabc-43be-933b-ddd6f451ef16 req-210018a1-d421-4254-9315-47cef6cd195a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac87083b-12c8-40a4-8989-6943fa4f6e0b", "name": "network-vif-plugged", "status": "completed", "tag": "738261b0-90d5-4a47-b221-b61877fb1557"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:25.556294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4a2cb149-eabc-43be-933b-ddd6f451ef16 req-210018a1-d421-4254-9315-47cef6cd195a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:25.557134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4a2cb149-eabc-43be-933b-ddd6f451ef16 req-210018a1-d421-4254-9315-47cef6cd195a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:25.557991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4a2cb149-eabc-43be-933b-ddd6f451ef16 req-210018a1-d421-4254-9315-47cef6cd195a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:25.578411 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4a2cb149-eabc-43be-933b-ddd6f451ef16 req-210018a1-d421-4254-9315-47cef6cd195a service nova] Creating event network-vif-plugged:738261b0-90d5-4a47-b221-b61877fb1557 for instance ac87083b-12c8-40a4-8989-6943fa4f6e0b on n-h2-858383-17 Oct 31 15:19:25.583738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4a2cb149-eabc-43be-933b-ddd6f451ef16 req-210018a1-d421-4254-9315-47cef6cd195a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049560 Oct 31 15:19:25.585500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 766/1477] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:25.752720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1020738578", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:25.844542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:25.845935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:25.846670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:25.847239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:25.850064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:25.862488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:25.863654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:25.864279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:25.866322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:25.867552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:25.868432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:25.921713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Getting quotas for project 7c945f81e29947a8be49836c19edcb55. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:25.938056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Getting quotas for user 73881ad312b94dfc865df7d6d93699bf and project 7c945f81e29947a8be49836c19edcb55. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:25.983605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:25.990698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:26.125231 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ddd912a-a02b-4292-a396-679adf9e2275 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.531347 Oct 31 15:19:26.128143 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 767/1478] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:19:26.144142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:26.147215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:26.157738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.158244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.158813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.165846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.167306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.168514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.580019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:26.592421 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef6ef599-96fd-4c37-b35f-8a0f390d6a39 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1543 microversion: 2.1 time: 0.460685 Oct 31 15:19:26.593273 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 768/1479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:26 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1543 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:26.597831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:26.598446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:26.627462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.628521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.634516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.635664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.637686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.638185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.395151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.411591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.413899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.417922 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-296c239e-012b-46b7-8b5c-411f0cbeef2c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1803 microversion: 2.25 time: 0.823787 Oct 31 15:19:27.421427 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 769/1480] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:26 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1803 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:27.438362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.439155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:27.459979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.460649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.462649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.463494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.464919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.469228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.855290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.870110 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-507762f6-ba39-4e68-af04-b56a50a7e6ab tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.268703 Oct 31 15:19:27.871575 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 712/1481] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:19:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:27.879302 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43d9a96c-00bb-4d0f-aefd-b82c3bd84177 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1307 microversion: 2.1 time: 0.449902 Oct 31 15:19:27.879302 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 770/1482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1307 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:27.886190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.887082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:27.891152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.891827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:27.905929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.906645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.907249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.908564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.909486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.910058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.917439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.917946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.918997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.919937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.920818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.921688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.060556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.070885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.072813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.077735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:28.079666 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3ba984d-ba52-46d3-8b1d-9f5e83216ed3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1506 microversion: 2.91 time: 0.198472 Oct 31 15:19:28.080808 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 713/1483] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:28.085872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.086762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:28.093689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.094466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.095149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.096123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.097146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.097828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.147503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.158435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e566a8f6-226e-48bb-a4c2-2b199ce316a1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 200 len: 1518 microversion: 2.1 time: 0.273861 Oct 31 15:19:28.159134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 771/1484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 1518 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:28.182797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74da4012-d237-44a0-a65f-1e47196a67eb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '.version_select at 0x7f5ca22a0670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.188118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74da4012-d237-44a0-a65f-1e47196a67eb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.188822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74da4012-d237-44a0-a65f-1e47196a67eb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.189411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74da4012-d237-44a0-a65f-1e47196a67eb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.208199 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74da4012-d237-44a0-a65f-1e47196a67eb tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2810 microversion: 2.25 time: 0.030403 Oct 31 15:19:28.217032 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 772/1485] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/os-migrations => generated 2810 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:28.228930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.229787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:28.248551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.250020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.250574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.252006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.252608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.253186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.392128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.407421 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64a49e9f-80e7-47f7-b049-39cc1b85c03a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1522 microversion: 2.1 time: 0.325294 Oct 31 15:19:28.408262 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 714/1486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:28.414935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d66c3d5c-e901-45b0-9d95-5ff38b0dd927 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Calling method '.version_select at 0x7f5ca28461f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.603851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.617838 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f7ae152-550c-4ba7-b992-5ec25b3234db tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1543 microversion: 2.1 time: 0.398882 Oct 31 15:19:28.621133 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 773/1487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1543 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:28.652120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'action', calling method: .version_select at 0x7f5ca41ec1f0>, body: {"addFloatingIp": {"address": "172.25.7.5"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:28.655204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:28.683234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.683814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.684336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.685282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.686498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.686943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.810092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:28.811768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquired lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:28.881854 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d66c3d5c-e901-45b0-9d95-5ff38b0dd927 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/137fea99-b8f1-425a-a46c-088951e5ffc3" status: 200 len: 142 microversion: 2.1 time: 0.471762 Oct 31 15:19:28.882559 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 715/1488] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/os-floating-ips/137fea99-b8f1-425a-a46c-088951e5ffc3 => generated 142 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:28.887951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.888823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:28.896938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.897356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.897797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.898505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.899001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.899440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.183854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:29.202376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab6542d5-4573-4894-851a-39fd44457b89 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 2424 microversion: 2.25 time: 0.317968 Oct 31 15:19:29.203101 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 716/1489] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 2424 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:29.212212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1b790615-2b27-4750-a151-8456289ab175 req-aad5af3f-e35a-4d35-91c9-78ce342a685c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1", "name": "network-vif-plugged", "status": "completed", "tag": "65c32b74-b6d6-42ab-900d-530fe5ad0b7f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:29.226406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1b790615-2b27-4750-a151-8456289ab175 req-aad5af3f-e35a-4d35-91c9-78ce342a685c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:29.226834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1b790615-2b27-4750-a151-8456289ab175 req-aad5af3f-e35a-4d35-91c9-78ce342a685c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:29.227276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1b790615-2b27-4750-a151-8456289ab175 req-aad5af3f-e35a-4d35-91c9-78ce342a685c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.240925 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1b790615-2b27-4750-a151-8456289ab175 req-aad5af3f-e35a-4d35-91c9-78ce342a685c service nova] Creating event network-vif-plugged:65c32b74-b6d6-42ab-900d-530fe5ad0b7f for instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 on n-h2-858383-17 Oct 31 15:19:29.246292 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1b790615-2b27-4750-a151-8456289ab175 req-aad5af3f-e35a-4d35-91c9-78ce342a685c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041037 Oct 31 15:19:29.246899 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 717/1490] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:29.258517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:29.259113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:29.266163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:29.266641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:29.267079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.267790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:29.268245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:29.268672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.304089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:29.405081 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d19fe79-4033-4952-864b-7561842fd22a tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 204 len: 0 microversion: 2.1 time: 0.156187 Oct 31 15:19:29.409483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 718/1491] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:29 2022] DELETE /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:29.480219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69e31f60-e434-4e8e-a28b-8175e9dfc3c2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Action: 'create', calling method: .version_select at 0x7f5ca2ae0af0>, body: {"keypair": {"name": "tempest-keypair-1315684071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdbTulhkVDKvINA0LpQL44VfLKKWoFe3a2DHk30wZfjUyLmgZvaLb8YPrzL2zAvRSy7IWKVP3EOdXS3Rv0XXBggoB3X9K5R2nmC7YlQRu8t91BQNwJ13oWCYOEjIbhynw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:29.500153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-69e31f60-e434-4e8e-a28b-8175e9dfc3c2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Getting quotas for project 08df63f2dbf84fe79d057a786451404d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:29.509082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-69e31f60-e434-4e8e-a28b-8175e9dfc3c2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Getting quotas for user d5fbe57fd4f443c980d1b44cad293dbf and project 08df63f2dbf84fe79d057a786451404d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:29.536781 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69e31f60-e434-4e8e-a28b-8175e9dfc3c2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125533 Oct 31 15:19:29.538137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 719/1492] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:19:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:29.554490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c72bd5c3-3e64-42ba-abcf-a5d3d0ce17fc tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Calling method '.version_select at 0x7f5ca25135e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:29.976282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c72bd5c3-3e64-42ba-abcf-a5d3d0ce17fc tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.436844 Oct 31 15:19:29.985603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 720/1493] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:19:29 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:29.989853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:29.990603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:29.997762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:29.998371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:29.998893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.999941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.000549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.001055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.545447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.556209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa090236-c8ab-4e84-a9ad-8909a1d1eca9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1307 microversion: 2.1 time: 0.577921 Oct 31 15:19:30.556813 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 721/1494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:29 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1307 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:30.562552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.563160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:30.569290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.569978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.570698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.571659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.572282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.572719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.648811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.658348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.660291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.665589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a7c44c8-25cc-4c7d-b876-c8f0870b6b9b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1512 microversion: 2.91 time: 0.107643 Oct 31 15:19:30.666163 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 722/1495] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:30.688424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.689073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:30.695472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.695890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.696319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.697235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.697690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.698110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.932520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:30.940499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Building network info cache for instance {{(pid=120625) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:30.955308 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4261c1ec-9675-4732-93c1-3898f51b802b tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 2424 microversion: 2.25 time: 0.287913 Oct 31 15:19:30.956408 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 723/1496] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 2424 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:30.989136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.989715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:31.001633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.002713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.003315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.004184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.004839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.005418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.024406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:31.327222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9315a4916cfa47da9904d8bfbc775e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b2fcc7ab184574ab86ddbe03096ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:31.335048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc69bf6a-690c-4232-8aad-9d75c5b216f1 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 200 len: 1528 microversion: 2.1 time: 0.377409 Oct 31 15:19:31.335633 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 724/1497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 1528 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:31.348967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:31.349581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:31.363736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.364475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.365190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.366596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.367248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.367858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.673668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:31.686955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-361ad55f-3acd-4137-878a-22b1e32db4b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1543 microversion: 2.1 time: 0.350269 Oct 31 15:19:31.688368 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 725/1498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:31 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1543 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:31.721933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32ad08a7-55ae-45af-a3f7-2e4a74e20a7e tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Calling method '.version_select at 0x7f5ca2846ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.142501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Updating instance_info_cache with network_info: [{"id": "ce57ed71-c323-4435-9d03-734e53a856fb", "address": "fa:16:3e:d9:37:86", "network": {"id": "619fc2a7-48a2-488f-822e-32ff25c82360", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-594354118-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9affbb7cbc954cd8b44bf8f30767a1af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce57ed71-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120625) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:32.169006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Releasing lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:32.171257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-90cd8b7d-833c-4be2-af83-d030cd30e01a tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action" status: 202 len: 0 microversion: 2.1 time: 3.547872 Oct 31 15:19:32.172590 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 774/1499] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:28 2022] POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action => generated 0 bytes in 3551 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:32.191500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-115b1286-caef-46b2-a72f-4ed354700c51 req-45c05e4d-fc11-4d2a-94e7-80b5f17f94a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:32.203245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-115b1286-caef-46b2-a72f-4ed354700c51 req-45c05e4d-fc11-4d2a-94e7-80b5f17f94a3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.203963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-115b1286-caef-46b2-a72f-4ed354700c51 req-45c05e4d-fc11-4d2a-94e7-80b5f17f94a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.204889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-115b1286-caef-46b2-a72f-4ed354700c51 req-45c05e4d-fc11-4d2a-94e7-80b5f17f94a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.221559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-115b1286-caef-46b2-a72f-4ed354700c51 req-45c05e4d-fc11-4d2a-94e7-80b5f17f94a3 service nova] Creating event network-changed:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:19:32.231022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-115b1286-caef-46b2-a72f-4ed354700c51 req-45c05e4d-fc11-4d2a-94e7-80b5f17f94a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055746 Oct 31 15:19:32.237051 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 775/1500] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:32.243087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.243771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:32.251051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.251669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.252181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.253262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.253806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.254306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.425741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lazy-loading 'services' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:32.575639 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9591d15-4a1d-4050-9e8e-e9bb56e538bf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments/d0aeb4ec-0164-4640-8f37-5a9bc59f0837" status: 202 len: 0 microversion: 2.25 time: 0.336820 Oct 31 15:19:32.583045 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 776/1501] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Oct 31 15:19:32 2022] DELETE /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments/d0aeb4ec-0164-4640-8f37-5a9bc59f0837 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:32.601643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1997908185", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e391cb73-837a-4083-8a0a-989c32852199"}], "security_groups": [{"name": "tempest-securitygroup--1908347596"}], "key_name": "tempest-keypair-1315684071", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:32.988146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] validate_networks() for [('e391cb73-837a-4083-8a0a-989c32852199', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:34.122720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32ad08a7-55ae-45af-a3f7-2e4a74e20a7e tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/137fea99-b8f1-425a-a46c-088951e5ffc3" status: 202 len: 0 microversion: 2.1 time: 2.432853 Oct 31 15:19:34.124352 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 726/1502] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:19:31 2022] DELETE /compute/v2.1/os-floating-ips/137fea99-b8f1-425a-a46c-088951e5ffc3 => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:34.133763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.134969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.150542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.151432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.152232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.153782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.156117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.156826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.338245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Getting quotas for project 08df63f2dbf84fe79d057a786451404d. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:34.346371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Getting quotas for user d5fbe57fd4f443c980d1b44cad293dbf and project 08df63f2dbf84fe79d057a786451404d. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:34.360984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:34.362099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:34.362685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:34.363486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:34.364047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:34.364631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:34.371369 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32fa483a-a888-42bf-8023-70d51de18230 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1487 microversion: 2.1 time: 0.244808 Oct 31 15:19:34.372249 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 727/1503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:34 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1487 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:34.382424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.389579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.390405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.391521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.392011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.392444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.393724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.394448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.401146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.401641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.402078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.403453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.404100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.405156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.417897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Getting quotas for project 08df63f2dbf84fe79d057a786451404d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:34.426529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Getting quotas for user d5fbe57fd4f443c980d1b44cad293dbf and project 08df63f2dbf84fe79d057a786451404d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:34.445946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:34.448459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:34.488444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:34.498535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:34.499969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:34.505745 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d05dd540-07d3-482e-bc46-7ee6892d9b17 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1533 microversion: 2.91 time: 0.132272 Oct 31 15:19:34.506621 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 728/1504] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:34 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1533 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:34.509536 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-987ebb08-f89d-4431-8b54-d38d070f8ef2 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.923798 Oct 31 15:19:34.510601 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 777/1505] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:34.515272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.516072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: ac87083b-12c8-40a4-8989-6943fa4f6e0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.520016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'action', calling method: .version_select at 0x7f5ca44783a0>, body: {"addFloatingIp": {"address": "172.25.7.5"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:34.524576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.538844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.539336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.539771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.540478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.540964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.541390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.541662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.542376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.543001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.543889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.544689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.546175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.558206 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance ac87083b-12c8-40a4-8989-6943fa4f6e0b could not be found. Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b HTTP/1.1 Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:34.559985 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance ac87083b-12c8-40a4-8989-6943fa4f6e0b could not be found. Oct 31 15:19:34.561984 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'ac87083b-12c8-40a4-8989-6943fa4f6e0b'} Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac87083b-12c8-40a4-8989-6943fa4f6e0b could not be found. Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:34.563034 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac87083b-12c8-40a4-8989-6943fa4f6e0b could not be found. Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac87083b-12c8-40a4-8989-6943fa4f6e0b could not be found. Oct 31 15:19:34.564613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:34.566128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance ac87083b-12c8-40a4-8989-6943fa4f6e0b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:34.566128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-858a0e4d-b557-441d-8f41-5ba6f385f878 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b" status: 404 len: 111 microversion: 2.1 time: 0.050397 Oct 31 15:19:34.566128 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 778/1506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:34 2022] GET /compute/v2.1/servers/ac87083b-12c8-40a4-8989-6943fa4f6e0b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:34.572458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.574812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.581748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.582313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.582823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.583653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.584238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.584802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.619164 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7aaabc2-1450-4226-b817-0b5fb1ab1e90 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055172 Oct 31 15:19:34.624391 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 779/1507] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:19:34 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:19:34.629557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.630454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.636214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "refresh_cache-4fa974f3-947c-4235-9bec-be3641676a34" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:34.636614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquired lock "refresh_cache-4fa974f3-947c-4235-9bec-be3641676a34" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:34.637306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.637908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.638461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.639825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.640506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.641166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.907908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:34.918996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dc6aff77-e26a-4a7e-90c5-574c30e8fedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1543 microversion: 2.1 time: 0.293586 Oct 31 15:19:34.920858 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 780/1508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:34 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1543 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:34.927402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2c2623d-66f1-4975-a045-fdb98eb86a48 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Action: 'create', calling method: .version_select at 0x7f5ca22fb310>, body: {"pool": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:37.652526 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2c2623d-66f1-4975-a045-fdb98eb86a48 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.730188 Oct 31 15:19:37.653820 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 781/1509] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:19:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:37.659637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-da9592a1-7af7-4994-b4b3-6750c82b8c41 req-d337bb5d-6527-4a1c-a97a-c896d69acab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac87083b-12c8-40a4-8989-6943fa4f6e0b", "name": "network-vif-deleted", "tag": "738261b0-90d5-4a47-b221-b61877fb1557"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:37.680096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-da9592a1-7af7-4994-b4b3-6750c82b8c41 req-d337bb5d-6527-4a1c-a97a-c896d69acab8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:37.685218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-da9592a1-7af7-4994-b4b3-6750c82b8c41 req-d337bb5d-6527-4a1c-a97a-c896d69acab8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:37.686231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-da9592a1-7af7-4994-b4b3-6750c82b8c41 req-d337bb5d-6527-4a1c-a97a-c896d69acab8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:37.709373 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-da9592a1-7af7-4994-b4b3-6750c82b8c41 req-d337bb5d-6527-4a1c-a97a-c896d69acab8 service nova] Creating event network-vif-deleted:738261b0-90d5-4a47-b221-b61877fb1557 for instance ac87083b-12c8-40a4-8989-6943fa4f6e0b on n-h2-858383-17 Oct 31 15:19:37.730592 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-da9592a1-7af7-4994-b4b3-6750c82b8c41 req-d337bb5d-6527-4a1c-a97a-c896d69acab8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074562 Oct 31 15:19:37.731553 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 782/1510] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:37.737329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e68cd02-0d5c-45ce-b3a7-f61e209bb073 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:37.746250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68cd02-0d5c-45ce-b3a7-f61e209bb073 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:37.747005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68cd02-0d5c-45ce-b3a7-f61e209bb073 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:37.747816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68cd02-0d5c-45ce-b3a7-f61e209bb073 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:37.786949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:37.836353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e68cd02-0d5c-45ce-b3a7-f61e209bb073 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:19:37.911566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e68cd02-0d5c-45ce-b3a7-f61e209bb073 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.177976 Oct 31 15:19:37.913128 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 783/1511] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:37 2022] POST /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:37.926372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:37.927463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:37.937192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:37.938243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:37.939009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:37.940280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:37.941334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:37.942296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.248492 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.neutron [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] re-assign floating IP 172.25.7.5 from instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d Oct 31 15:19:38.339855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:38.515873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:38.531509 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94bd4299-9418-4dc0-8e41-d717ccab17e8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1404 microversion: 2.1 time: 0.616901 Oct 31 15:19:38.533380 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 784/1512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:37 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1404 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:38.653332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:38.654839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:38.672577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.673171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.673829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.674723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.675350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.675942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.807103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lazy-loading 'services' on Instance uuid f88dff41-8ec3-4d48-9a13-6fe19f53512a {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:38.829040 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38ab990f-0e52-4801-9dee-535cec8ea007 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1940 microversion: 2.91 time: 0.291728 Oct 31 15:19:38.830342 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 785/1513] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:38 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1940 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:38.835767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec68f30c-3f90-418a-9609-cf649a34b15f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '.version_select at 0x7f5ca2392ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:38.883014 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ec68f30c-3f90-418a-9609-cf649a34b15f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Image not found. Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec68f30c-3f90-418a-9609-cf649a34b15f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5 HTTP/1.1 Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:38.884998 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '95fd1403-29f8-4542-b80a-2f2ae57861c5'} Oct 31 15:19:38.886418 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 95fd1403-29f8-4542-b80a-2f2ae57861c5 to delete Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:38.887215 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95fd1403-29f8-4542-b80a-2f2ae57861c5 could not be found. Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:38.889862 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec68f30c-3f90-418a-9609-cf649a34b15f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:38.891524 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec68f30c-3f90-418a-9609-cf649a34b15f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5" status: 404 len: 62 microversion: 2.1 time: 0.054995 Oct 31 15:19:38.892735 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 786/1514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:38 2022] DELETE /compute/v2.1/images/95fd1403-29f8-4542-b80a-2f2ae57861c5 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:38.895375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:38.897639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:38.908894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.909319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.909766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.910486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.910955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.911389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.970250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99922cf5-ee03-4ed4-aa07-71c6f93cb83c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.082033 Oct 31 15:19:38.971295 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 787/1515] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:19:38 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:38.977054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:38.979042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:38.986773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.987469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.988561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:38.989856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:38.990572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:38.991149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:39.209964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Updating instance_info_cache with network_info: [{"id": "ce57ed71-c323-4435-9d03-734e53a856fb", "address": "fa:16:3e:d9:37:86", "network": {"id": "619fc2a7-48a2-488f-822e-32ff25c82360", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-594354118-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9affbb7cbc954cd8b44bf8f30767a1af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce57ed71-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:39.229516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:39.421258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:39.431083 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-163b219f-4194-418a-a669-91586284d064 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1474 microversion: 2.1 time: 0.458459 Oct 31 15:19:39.448864 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 788/1516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:38 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1474 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:39.458133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6bbaca73-b7b4-4a1a-89b5-c9ca4523d59c tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Calling method '.version_select at 0x7f5ca2435f70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:39.516992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:40.330787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Updating instance_info_cache with network_info: [{"id": "f00fa763-febd-4347-b88b-86514e3a7657", "address": "fa:16:3e:cd:33:66", "network": {"id": "619fc2a7-48a2-488f-822e-32ff25c82360", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-594354118-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9affbb7cbc954cd8b44bf8f30767a1af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf00fa763-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:40.348762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Releasing lock "refresh_cache-4fa974f3-947c-4235-9bec-be3641676a34" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:40.350392 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-565fcf0a-779b-46b5-b726-983ce821e877 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34/action" status: 202 len: 0 microversion: 2.1 time: 5.842639 Oct 31 15:19:40.351568 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 729/1517] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:34 2022] POST /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34/action => generated 0 bytes in 5844 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:40.359658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:40.360282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:40.366683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.367386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.368301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.369220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.369840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.370416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.579337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:40.588162 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-779a6b81-dd56-409a-a12d-f108b0b0d3d4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.233592 Oct 31 15:19:40.604913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 730/1518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:40 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:40.612637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:40.613543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:40.619722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.620339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.620812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:40.621726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:40.622510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:40.623131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.020980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lazy-loading 'services' on Instance uuid f88dff41-8ec3-4d48-9a13-6fe19f53512a {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:41.031851 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6bbaca73-b7b4-4a1a-89b5-c9ca4523d59c tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c" status: 202 len: 0 microversion: 2.1 time: 1.581537 Oct 31 15:19:41.032438 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 789/1519] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:19:39 2022] DELETE /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c => generated 0 bytes in 1583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:41.038928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.039419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.039830 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd4c4cbe-86e8-4589-8fd4-32318f12f9de tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1940 microversion: 2.91 time: 0.433452 Oct 31 15:19:41.040482 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 731/1520] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:40 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1940 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:41.045503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2c67702f-e7fe-4f24-81cb-4af2b9394bc8 req-a49f2461-b991-4fff-94db-c07ff7bb17dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973fea37-d308-4817-9f35-986c6e157132", "tag": "3535208e-6962-459d-b917-574d50c2cd7d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:41.046151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.046638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.047077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.047766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.048217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.048641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.056289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2c67702f-e7fe-4f24-81cb-4af2b9394bc8 req-a49f2461-b991-4fff-94db-c07ff7bb17dd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.056884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2c67702f-e7fe-4f24-81cb-4af2b9394bc8 req-a49f2461-b991-4fff-94db-c07ff7bb17dd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.057310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2c67702f-e7fe-4f24-81cb-4af2b9394bc8 req-a49f2461-b991-4fff-94db-c07ff7bb17dd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.064308 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b HTTP/1.1 Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:41.065926 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.067319 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3c96a089-868a-48e6-8687-f117e429833b'} Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:41.068117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.069454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.072013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:41.072013 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c4922c0-bcc7-4b31-8f7a-74ae86aa022f tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 404 len: 111 microversion: 2.1 time: 0.034136 Oct 31 15:19:41.072013 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 790/1521] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:41 2022] DELETE /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:41.072283 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2c67702f-e7fe-4f24-81cb-4af2b9394bc8 req-a49f2461-b991-4fff-94db-c07ff7bb17dd service nova] Creating event network-changed:3535208e-6962-459d-b917-574d50c2cd7d for instance 973fea37-d308-4817-9f35-986c6e157132 on n-h2-858383-17 Oct 31 15:19:41.074150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.074771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.075130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2c67702f-e7fe-4f24-81cb-4af2b9394bc8 req-a49f2461-b991-4fff-94db-c07ff7bb17dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033483 Oct 31 15:19:41.076531 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 732/1522] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:41.081221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:41.085280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.086052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.086755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.087710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.088348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.088816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.091685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.092409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.093066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.106242 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] Creating event network-vif-unplugged:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:19:41.113790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:19:41.121345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-256f9e89-60f6-4f80-8d18-de32c8dd2dfe req-79db1299-667a-4fb9-a6ac-8929f4ab84ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043640 Oct 31 15:19:41.122255 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 733/1523] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:41.127982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}, {"name": "network-changed", "server_uuid": "4fa974f3-947c-4235-9bec-be3641676a34", "tag": "f00fa763-febd-4347-b88b-86514e3a7657"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:41.139419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.139903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.140333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.155310 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] Creating event network-changed:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:19:41.155828 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] Creating event network-changed:f00fa763-febd-4347-b88b-86514e3a7657 for instance 4fa974f3-947c-4235-9bec-be3641676a34 on n-h1-858383-17 Oct 31 15:19:41.162526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-05716034-8eb0-43b4-92fa-dabc65a93818 req-57b7d9a4-575c-427f-86da-0671ca56ecc3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038428 Oct 31 15:19:41.163426 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 734/1524] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:41.169525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'action', calling method: .version_select at 0x7f5ca4214e50>, body: {"removeFloatingIp": {"address": "172.25.7.5"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:41.247427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:41.259623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac7c5391-e156-4633-81e8-220ee27c56d6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1404 microversion: 2.1 time: 0.189632 Oct 31 15:19:41.260598 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 791/1525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:41.269249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.269989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.276299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.276919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.277424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.278190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.278714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.279740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.509852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.520659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.521550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.522232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.523318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.523995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.524654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.557585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:41.581763 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1003017e-f748-4670-9c32-bb7129593842 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1471 microversion: 2.1 time: 0.318078 Oct 31 15:19:41.583769 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 792/1526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:41.613714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2654a973-8edc-4b5c-a886-019c2364ec74 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Calling method '.version_select at 0x7f5ca25e1e50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.753625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-2654a973-8edc-4b5c-a886-019c2364ec74 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 87d394c7-e60d-4b6a-90f6-127fccda4e3c could not be found", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:19:41.754831 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2654a973-8edc-4b5c-a886-019c2364ec74 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] HTTP exception thrown: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2654a973-8edc-4b5c-a886-019c2364ec74 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Request method failure captured: Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c HTTP/1.1 Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-d6ZHeySZa0jt1SJu6amlFrffScsQoFd72ExJ7OEUxxbvVOn4ev8bSXjUM7GDQZwS4UySqVGdIkFof56nJvxivGwB5A7jyP-_odVRbkRpDRYNxDxQWRXAbEkF_0dnCerT73XungV14kflvLZAXdRjeiUqcmnLabbd3Zs52kPVIr9FA Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 545f5dc2b0214ea9bfb256e1e625dabe Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsTestJSON-1819464650 Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:41.769186 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsTestJSON-1819464650 Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 545f5dc2b0214ea9bfb256e1e625dabe Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1819464650 Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsTestJSON-1819464650-project Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c47d064049b7457d81ae251b70797728 Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsTestJSON-1819464650-project Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: exception: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '87d394c7-e60d-4b6a-90f6-127fccda4e3c'} Oct 31 15:19:41.770999 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:19:41.772570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 87d394c7-e60d-4b6a-90f6-127fccda4e3c could not be found Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0215d30c-ebc1-4116-98d1-6d29b8160ea5'] Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c. Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.774144 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:41.776425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:41.777973 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:41.777973 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.777973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2654a973-8edc-4b5c-a886-019c2364ec74 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Returning 404 to user: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:41.777973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2654a973-8edc-4b5c-a886-019c2364ec74 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c" status: 404 len: 111 microversion: 2.1 time: 0.184552 Oct 31 15:19:41.777973 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 793/1527] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:41.779750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.793938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.794503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.795059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.796157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.809033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.810572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.875097 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0dc4ca4c-22a8-4b27-aada-25f1d9fed6ff tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.098922 Oct 31 15:19:41.881789 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 794/1528] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:19:41.895045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.897318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: 3c96a089-868a-48e6-8687-f117e429833b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.915090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.915365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.916153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.917067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.917813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.918400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.934432 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b HTTP/1.1 Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:41.937239 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.939394 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3c96a089-868a-48e6-8687-f117e429833b'} Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:41.940290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. Oct 31 15:19:41.941778 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:41.943161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance 3c96a089-868a-48e6-8687-f117e429833b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:41.944115 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d577991c-3678-4c67-a7af-8c4187472dd4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b" status: 404 len: 111 microversion: 2.1 time: 0.063668 Oct 31 15:19:41.944449 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 795/1529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/servers/3c96a089-868a-48e6-8687-f117e429833b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:41.949422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:41.950116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.962208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:41.964162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.965219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.965935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.967604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.968414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.969107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.031540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.033265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.033845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.035332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.037339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.038083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.104579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:42.112968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for user 8184a0251b8e4cb882556b458bbc4de7 and project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:42.262771 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] HTTP exception thrown: Floating IP 172.25.7.5 is not associated with instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d. Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Request method failure captured: Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action HTTP/1.1 Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 47 Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-dCEoiOuuX00f6JI1dKhSKQeGsHR2SnSW6bExw1_hrGG_pTkFSA099O0f3hVFlqgBILnIvA3WQW_esXAUhIYJntvs4y8BEnl6aS9R0u7n9v18NFdR7QZFwoevnYjiUi-R80rVULjAU1cL8GFw-Q4Cjstl900vQBi1hDLX2h7G1mZcI Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:19:42.265933 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: e69c6e6309854c1288ad1a19631704d8 Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: {"removeFloatingIp": {"address": "172.25.7.5"}} Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:19:42.267840 n-d-858383-17 devstack@n-api.service[120626]: exception: Floating IP 172.25.7.5 is not associated with instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d. Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5f9d833d-bff4-4ce0-b06d-05a71eca779d', 'body': {'removeFloatingIp': {'address': '172.25.7.5'}}} Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.5 is not associated with instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d. Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.268801 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:42.270084 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:42.270084 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:42.270084 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:42.270084 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:42.270084 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.5 is not associated with instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d. Oct 31 15:19:42.270084 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.276095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Returning 409 to user: Floating IP 172.25.7.5 is not associated with instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:42.277845 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f391130a-6ca8-45b8-ba72-bee81bf82ae0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action" status: 409 len: 144 microversion: 2.1 time: 1.112541 Oct 31 15:19:42.279283 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 735/1530] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:41 2022] POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action => generated 144 bytes in 1115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:42.285687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:42.286692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:42.295653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.296642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.297362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.298520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.299636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.300743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.343443 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4bbad839-4bf5-4850-a83e-1ed59bf1d8cf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337/action" status: 202 len: 0 microversion: 2.1 time: 0.397343 Oct 31 15:19:42.348847 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 796/1531] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:41 2022] POST /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:42.360838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5201d515-fbbb-45fd-878f-460027f4eb29 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Calling method '.version_select at 0x7f5ca2461f70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:42.495669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-5201d515-fbbb-45fd-878f-460027f4eb29 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 87d394c7-e60d-4b6a-90f6-127fccda4e3c could not be found", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:19:42.496733 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-5201d515-fbbb-45fd-878f-460027f4eb29 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] HTTP exception thrown: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5201d515-fbbb-45fd-878f-460027f4eb29 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Request method failure captured: Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c HTTP/1.1 Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-d6ZHeySZa0jt1SJu6amlFrffScsQoFd72ExJ7OEUxxbvVOn4ev8bSXjUM7GDQZwS4UySqVGdIkFof56nJvxivGwB5A7jyP-_odVRbkRpDRYNxDxQWRXAbEkF_0dnCerT73XungV14kflvLZAXdRjeiUqcmnLabbd3Zs52kPVIr9FA Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 545f5dc2b0214ea9bfb256e1e625dabe Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsTestJSON-1819464650 Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:42.501515 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/545f5dc2b0214ea9bfb256e1e625dabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsTestJSON-1819464650 Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 545f5dc2b0214ea9bfb256e1e625dabe Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1819464650 Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsTestJSON-1819464650-project Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c47d064049b7457d81ae251b70797728 Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsTestJSON-1819464650-project Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: exception: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '87d394c7-e60d-4b6a-90f6-127fccda4e3c'} Oct 31 15:19:42.503213 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:19:42.504226 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 87d394c7-e60d-4b6a-90f6-127fccda4e3c could not be found Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b5dcb2d-561a-4727-907b-a9a92a33b2a8'] Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c. Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:42.505630 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:42.506913 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:42.508316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c Oct 31 15:19:42.508316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:42.508316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5201d515-fbbb-45fd-878f-460027f4eb29 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] Returning 404 to user: Floating IP not found for ID 87d394c7-e60d-4b6a-90f6-127fccda4e3c {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:42.508316 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5201d515-fbbb-45fd-878f-460027f4eb29 tempest-FloatingIPsTestJSON-1819464650 tempest-FloatingIPsTestJSON-1819464650-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c" status: 404 len: 111 microversion: 2.1 time: 0.151623 Oct 31 15:19:42.513465 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 797/1532] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:19:42 2022] DELETE /compute/v2.1/os-floating-ips/87d394c7-e60d-4b6a-90f6-127fccda4e3c => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:42.517652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:42.517940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:42.526536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.527198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.527744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.528565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.529715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.530415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.559178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lazy-loading 'flavor' on Instance uuid f88dff41-8ec3-4d48-9a13-6fe19f53512a {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:42.816258 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4dc05cc-e4d3-4e12-91b7-b998dbb90316 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action" status: 202 len: 0 microversion: 2.91 time: 0.305141 Oct 31 15:19:42.817339 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 798/1533] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:19:42 2022] POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:42.823009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0c90b0c-0b13-4c1f-87ea-186f118002a2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '.version_select at 0x7f5ca272b040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:42.851525 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0c90b0c-0b13-4c1f-87ea-186f118002a2 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683871846" status: 202 len: 0 microversion: 2.1 time: 0.032595 Oct 31 15:19:42.853271 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 799/1534] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683871846 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:42.859403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:42.860608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:42.863487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:42.872211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.873699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.874490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.875402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.876040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.877119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.895673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:42.903264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d431903-11cf-4e4b-8a8f-84ed0291cc98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.622515 Oct 31 15:19:42.920618 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 736/1535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:42 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:42.929662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.5"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:43.417931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:43.428566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba5c64e1-4aa9-4d66-8971-16e3a91be5ad tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1404 microversion: 2.1 time: 0.573976 Oct 31 15:19:43.429611 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 800/1536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:42 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1404 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:43.440237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:43.440920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:43.443625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:43.447668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:43.448169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:43.448891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:43.449870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:43.450204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:43.450940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:43.457963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:43.459038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:43.459802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:43.461040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:43.462624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:43.463314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.439397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:44.618979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:44.627032 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc470cd7-4c4e-4fc7-8522-55f895e29315 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1470 microversion: 2.1 time: 1.192075 Oct 31 15:19:44.627603 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 801/1537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:43 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1470 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:44.632233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:44.632978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:44.641063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.641777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.642381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.643818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.644435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.645057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.777081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:44.785955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:44.787530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:44.793563 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b84c64d8-5348-4e31-b590-da7b62fd2586 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.164738 Oct 31 15:19:44.811189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 802/1538] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:44 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:44.811189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da6780cd-69e6-4fd4-92da-3321e86d68c4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '.version_select at 0x7f5ca26e4940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:44.814413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "refresh_cache-4fa974f3-947c-4235-9bec-be3641676a34" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:44.814836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquired lock "refresh_cache-4fa974f3-947c-4235-9bec-be3641676a34" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:44.835563 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-da6780cd-69e6-4fd4-92da-3321e86d68c4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Image not found. Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da6780cd-69e6-4fd4-92da-3321e86d68c4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/7bcd3cab-3a75-4274-af37-8c01d528bb71 HTTP/1.1 Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:44.837714 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '7bcd3cab-3a75-4274-af37-8c01d528bb71'} Oct 31 15:19:44.839289 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7bcd3cab-3a75-4274-af37-8c01d528bb71 to delete Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:44.840298 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bcd3cab-3a75-4274-af37-8c01d528bb71 could not be found. Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:44.841608 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da6780cd-69e6-4fd4-92da-3321e86d68c4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:44.842924 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da6780cd-69e6-4fd4-92da-3321e86d68c4 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/images/7bcd3cab-3a75-4274-af37-8c01d528bb71" status: 404 len: 62 microversion: 2.1 time: 0.042980 Oct 31 15:19:44.843999 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 803/1539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:44 2022] DELETE /compute/v2.1/images/7bcd3cab-3a75-4274-af37-8c01d528bb71 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:44.848089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "name": "network-vif-plugged", "status": "completed", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:44.859063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.859525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.859958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.871548 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] Creating event network-vif-plugged:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:19:44.878636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:19:44.887366 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9bef1127-dbee-42f5-b58d-f4f4429d02b5 req-79c524b5-9c2d-42fe-a06a-a9117a33de86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042462 Oct 31 15:19:44.889450 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 804/1540] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:44.896287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:44.897170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:44.905074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.905913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.906800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.907822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.908370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.909171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.325077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:45.333988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ac8a318-5620-49e3-b1cf-02422da2dc20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.443215 Oct 31 15:19:45.334687 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 805/1541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:44 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:45.339686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:45.340427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:45.347409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.347902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.348339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.349078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.349546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.350037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.713681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:45.726770 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aad65b0b-3e84-4cf3-8634-9251e9c93ad7 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1404 microversion: 2.1 time: 0.390904 Oct 31 15:19:45.727546 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 806/1542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:45 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1404 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:45.733710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:45.734473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:45.741370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.742088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.743170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.744071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.744738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.745397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.761176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 HTTP/1.1 Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:45.763278 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:45.765093 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939'} Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:45.765894 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:45.767086 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:45.768277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:45.768277 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-90f3e0a3-dbd1-4633-bb13-6aa8f0ba9773 tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 404 len: 111 microversion: 2.1 time: 0.035634 Oct 31 15:19:45.769082 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 807/1543] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:45 2022] DELETE /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:45.774943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:45.776364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:45.784950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.785726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.786331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.787825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.788473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.789126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.378768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.395796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2549f037-20d3-45ff-8ef5-03d62295f260 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1470 microversion: 2.1 time: 0.625428 Oct 31 15:19:46.408930 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 808/1544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:45 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1470 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:46.408930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.408930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] [instance: e49d2d14-1dea-4aeb-8b9c-e947eb21f939] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:46.416620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.416620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.416620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.416620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.417119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.417119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.433142 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] HTTP exception thrown: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Request method failure captured: Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 HTTP/1.1 Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-cibhlmboyoLjJNWKaG2wo-FnWRM8hMOwPbUo72Rr7cKIBs6vUEAYg4pZWECx9jtYTlfSfh6QnqT7dZrfU0992DTKWlhJz44hFRT0infIy42u_doPuRb5e7ZxBKPI3_6l1bHUgscgig5Smng3dMD4ap63H9-LvlR_AKrhCI5o_up38 Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:19:46.434695 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0b2fcc7ab184574ab86ddbe03096ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: e0b2fcc7ab184574ab86ddbe03096ccd Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-49671115 Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9315a4916cfa47da9904d8bfbc775e0a Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-49671115-project Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:46.436861 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e49d2d14-1dea-4aeb-8b9c-e947eb21f939'} Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:46.437626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. Oct 31 15:19:46.438872 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.439961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] Returning 404 to user: Instance e49d2d14-1dea-4aeb-8b9c-e947eb21f939 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:46.439961 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d99f029a-81a0-4f71-a9b3-2ba23c092e3b tempest-ImagesOneServerNegativeTestJSON-49671115 tempest-ImagesOneServerNegativeTestJSON-49671115-project] 10.222.0.48 "GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939" status: 404 len: 111 microversion: 2.1 time: 0.038548 Oct 31 15:19:46.439961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 809/1545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/servers/e49d2d14-1dea-4aeb-8b9c-e947eb21f939 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:46.442761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.443369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:46.451423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.451923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.452359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.453098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.453565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.453976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.571074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.585027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.587240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.594502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99bd0b15-0fb1-4686-9e57-d4858bf6e1cb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.155001 Oct 31 15:19:46.595410 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 810/1546] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:46.601084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.601742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:46.610826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.611320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.611808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.613132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.613596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.614023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.036419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:47.058396 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-827b6630-be18-4c2b-9a5d-84a61cd68b25 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.461440 Oct 31 15:19:47.076162 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 811/1547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:47.076162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:47.076162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:47.076762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:47.109667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.111030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.112609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.117802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.118727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.119168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.579792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:47.590568 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4213388b-ff1a-4871-bc67-c1c112545125 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1404 microversion: 2.1 time: 0.523051 Oct 31 15:19:47.595656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 812/1548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:47 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:47.610412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5f47b3da-884d-4702-99a3-b2cd184836aa req-b81d4ac7-23d9-4839-a370-08643623e1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973fea37-d308-4817-9f35-986c6e157132", "name": "network-vif-plugged", "status": "completed", "tag": "3535208e-6962-459d-b917-574d50c2cd7d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:47.659159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f47b3da-884d-4702-99a3-b2cd184836aa req-b81d4ac7-23d9-4839-a370-08643623e1bf service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.659646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f47b3da-884d-4702-99a3-b2cd184836aa req-b81d4ac7-23d9-4839-a370-08643623e1bf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.660072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f47b3da-884d-4702-99a3-b2cd184836aa req-b81d4ac7-23d9-4839-a370-08643623e1bf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.711766 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5f47b3da-884d-4702-99a3-b2cd184836aa req-b81d4ac7-23d9-4839-a370-08643623e1bf service nova] Creating event network-vif-plugged:3535208e-6962-459d-b917-574d50c2cd7d for instance 973fea37-d308-4817-9f35-986c6e157132 on n-h2-858383-17 Oct 31 15:19:47.726873 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5f47b3da-884d-4702-99a3-b2cd184836aa req-b81d4ac7-23d9-4839-a370-08643623e1bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129366 Oct 31 15:19:47.731392 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 813/1549] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:47.739496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e55fecae-de3e-4764-81d4-4feadc4b1646 req-c8abd6e1-070c-4a34-9690-a550ec3aedfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa974f3-947c-4235-9bec-be3641676a34", "tag": "f00fa763-febd-4347-b88b-86514e3a7657"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:47.763563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e55fecae-de3e-4764-81d4-4feadc4b1646 req-c8abd6e1-070c-4a34-9690-a550ec3aedfd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.763974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e55fecae-de3e-4764-81d4-4feadc4b1646 req-c8abd6e1-070c-4a34-9690-a550ec3aedfd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.764411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e55fecae-de3e-4764-81d4-4feadc4b1646 req-c8abd6e1-070c-4a34-9690-a550ec3aedfd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.779476 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e55fecae-de3e-4764-81d4-4feadc4b1646 req-c8abd6e1-070c-4a34-9690-a550ec3aedfd service nova] Creating event network-changed:f00fa763-febd-4347-b88b-86514e3a7657 for instance 4fa974f3-947c-4235-9bec-be3641676a34 on n-h1-858383-17 Oct 31 15:19:47.787605 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e55fecae-de3e-4764-81d4-4feadc4b1646 req-c8abd6e1-070c-4a34-9690-a550ec3aedfd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052469 Oct 31 15:19:47.787605 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 814/1550] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:47.796030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:47.796860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:47.805268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.805773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.806214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.806934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.807396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.807831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:48.903150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:48.918165 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ceefb5c5-6f85-42b1-bcc2-5092009835c0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1536 microversion: 2.1 time: 1.129065 Oct 31 15:19:48.920417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 815/1551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:47 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1536 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:48.931187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:48.937922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:48.952046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:48.952870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:48.957400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:48.958291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:48.959291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:48.960271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:48.970691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Updating instance_info_cache with network_info: [{"id": "f00fa763-febd-4347-b88b-86514e3a7657", "address": "fa:16:3e:cd:33:66", "network": {"id": "619fc2a7-48a2-488f-822e-32ff25c82360", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-594354118-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9affbb7cbc954cd8b44bf8f30767a1af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf00fa763-fe", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:49.009439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Releasing lock "refresh_cache-4fa974f3-947c-4235-9bec-be3641676a34" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:49.013506 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22ee9bdb-6040-43d2-9a49-220a51659003 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34/action" status: 202 len: 0 microversion: 2.1 time: 6.096124 Oct 31 15:19:49.017458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 737/1552] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:42 2022] POST /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34/action => generated 0 bytes in 6103 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:49.031153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.034492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:49.061343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.063845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.065171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.066464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.066464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.066844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.193471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.202686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.210300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.226394 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d26edec4-5f13-41e2-839d-e1734bbfa419 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.300831 Oct 31 15:19:49.227376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 816/1553] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:48 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:49.233032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.238706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:49.252256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.255336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.258600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.259800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.264117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.265067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.553392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.585473 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee5e3388-f3d5-4daa-9f86-2c93c82b5d82 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.566538 Oct 31 15:19:49.603190 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 738/1554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:49 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:49.611514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.617864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:49.629005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.636644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.638295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.640460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.641219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.641918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.749604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:49.765795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.774531 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5406ba3d-2c96-4b78-b620-86920772234c tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1404 microversion: 2.1 time: 0.545834 Oct 31 15:19:49.796913 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 817/1555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:49 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1404 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:49.868853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:49.945197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.945197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:49.962261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.963212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.965722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.967454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.968793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.970379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.008404 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d0bb2a8-c782-449d-a7db-c4baa805544d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 204 len: 0 microversion: 2.1 time: 0.401905 Oct 31 15:19:50.010094 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 739/1556] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:49 2022] DELETE /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:50.025579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.5"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:50.030317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:50.041390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.042479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.043149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.044803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.045582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.046167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.085758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:50.086159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquired lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:50.347833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:50.356124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f96d38c6-fd66-49b6-aa9b-8348107521c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1536 microversion: 2.1 time: 0.415171 Oct 31 15:19:50.362201 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 818/1557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:49 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1536 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:50.368717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:50.369584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:50.381967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.382659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.383294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.384180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.384850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.385445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.498377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:50.507131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:50.508571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:50.519871 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eabde368-f5ad-4fec-8e20-42411730cd59 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.156298 Oct 31 15:19:50.521125 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 819/1558] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:50 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:50.610570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:50.611419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:50.620964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.621735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.622521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.623558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.624186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.624803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:51.607842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:51.622776 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97c97b61-9c78-443d-9c01-240aa4803940 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 1.015859 Oct 31 15:19:51.638600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 820/1559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:50 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:51.646030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:51.646906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:51.664117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:51.666719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:51.669550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:51.672308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:51.673010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:51.674759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:51.734725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:52.081620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=9 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:52.258415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:52.274023 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf7c8b0f-baf5-41fe-a89a-b577368f708a tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1592 microversion: 2.1 time: 0.632675 Oct 31 15:19:52.276601 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 821/1560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:51 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1592 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:52.285353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:52.293115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:52.304335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:52.305415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:52.306046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:52.307203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:52.307861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:52.309125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:52.922265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:52.934041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0457e67-1bb2-4739-a09c-255ff2b28263 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1536 microversion: 2.1 time: 0.655070 Oct 31 15:19:52.941048 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 822/1561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:52 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1536 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:52.946289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:52.951197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:52.963872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:52.967003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:52.968475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:52.971544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:52.972820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:52.975403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.115399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.136452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.142176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.162708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cda7df33-34eb-4aed-8c5c-00157ca1d8b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.220145 Oct 31 15:19:53.163934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 823/1562] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:52 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:53.173614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-daa0c08a-a42c-40df-8e5e-db2b91749ff6 req-7c02fc4a-d085-4966-a621-2dba281f5994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:53.203082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-daa0c08a-a42c-40df-8e5e-db2b91749ff6 req-7c02fc4a-d085-4966-a621-2dba281f5994 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.205753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-daa0c08a-a42c-40df-8e5e-db2b91749ff6 req-7c02fc4a-d085-4966-a621-2dba281f5994 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.208868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-daa0c08a-a42c-40df-8e5e-db2b91749ff6 req-7c02fc4a-d085-4966-a621-2dba281f5994 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.237317 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-daa0c08a-a42c-40df-8e5e-db2b91749ff6 req-7c02fc4a-d085-4966-a621-2dba281f5994 service nova] Creating event network-vif-unplugged:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:19:53.248418 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-daa0c08a-a42c-40df-8e5e-db2b91749ff6 req-7c02fc4a-d085-4966-a621-2dba281f5994 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082912 Oct 31 15:19:53.249678 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 824/1563] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:53.259476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.261198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:53.269090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.269946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.270555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.271673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.272425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.273265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.607982 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-616ce7e3-0ad4-4abb-95c7-5c102ddc2589 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.356746 Oct 31 15:19:53.609119 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 825/1564] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132/os-interface => generated 285 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:53.619878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.620504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:53.633973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.641503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.642443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.646881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.651692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.652411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.096503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:54.363854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:54.379407 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4558dec1-87c2-40c7-88b8-ed6b7d0c0686 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.768918 Oct 31 15:19:54.382912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 826/1565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:54.816500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-26b35992-5c52-495c-a3ec-18d603cce415 req-825f87bf-03cd-43ba-89e6-b8672de24bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa974f3-947c-4235-9bec-be3641676a34", "name": "network-vif-deleted", "tag": "f00fa763-febd-4347-b88b-86514e3a7657"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:54.830679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-26b35992-5c52-495c-a3ec-18d603cce415 req-825f87bf-03cd-43ba-89e6-b8672de24bf7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.833275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-26b35992-5c52-495c-a3ec-18d603cce415 req-825f87bf-03cd-43ba-89e6-b8672de24bf7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.833933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-26b35992-5c52-495c-a3ec-18d603cce415 req-825f87bf-03cd-43ba-89e6-b8672de24bf7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.853286 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-26b35992-5c52-495c-a3ec-18d603cce415 req-825f87bf-03cd-43ba-89e6-b8672de24bf7 service nova] Creating event network-vif-deleted:f00fa763-febd-4347-b88b-86514e3a7657 for instance 4fa974f3-947c-4235-9bec-be3641676a34 on n-h1-858383-17 Oct 31 15:19:54.874452 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-26b35992-5c52-495c-a3ec-18d603cce415 req-825f87bf-03cd-43ba-89e6-b8672de24bf7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474864 Oct 31 15:19:54.877532 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 827/1566] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:54.902551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.906087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:54.922892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.925240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.926009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.928848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.929800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.930576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.527375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:55.552646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dfc3c913-2caa-4921-9283-fe9498fea734 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1529 microversion: 2.1 time: 0.669370 Oct 31 15:19:55.561284 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 828/1567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:54 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1529 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:55.582476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.585996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.602373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Updating instance_info_cache with network_info: [{"id": "ce57ed71-c323-4435-9d03-734e53a856fb", "address": "fa:16:3e:d9:37:86", "network": {"id": "619fc2a7-48a2-488f-822e-32ff25c82360", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-594354118-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9affbb7cbc954cd8b44bf8f30767a1af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce57ed71-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:55.614869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.615871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.616879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.618101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.618948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.619685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.624336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Releasing lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:55.625681 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69e37ca4-710c-4106-a206-070e7603e369 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action" status: 202 len: 0 microversion: 2.1 time: 5.606592 Oct 31 15:19:55.626632 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 740/1568] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:50 2022] POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action => generated 0 bytes in 5608 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:55.638841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.641581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.657421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.665131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.665887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.666849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.668737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.670570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.740652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:55.752047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:55.754876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:55.764777 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ffb2b0be-7fc0-4041-85d0-487598349adb tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.194440 Oct 31 15:19:55.765977 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 829/1569] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:55.770871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.771943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.779713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.780533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.781321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.782891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.785144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.785836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.942756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:55.953638 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-30e83468-efbc-4186-b44d-914c0983d6c1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.324234 Oct 31 15:19:55.954251 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 741/1570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:55.985755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee760801-7029-4760-920d-10692b989bbb tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '.version_select at 0x7f5ca2442040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:56.022444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:56.031618 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a6e82e1-bdaf-4b77-8f9f-59fbf72d0de0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1529 microversion: 2.1 time: 0.264347 Oct 31 15:19:56.057386 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 830/1571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1529 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:56.089092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6dfe7e60-ec6f-4bb5-9e22-c61a8aca82e4 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:56.103825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6dfe7e60-ec6f-4bb5-9e22-c61a8aca82e4 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] HTTP exception thrown: Flavor 443d3397-f4b8-4acd-98e8-b3a37dfb3f9b could not be found. Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6dfe7e60-ec6f-4bb5-9e22-c61a8aca82e4 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Request method failure captured: Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/flavors/443d3397-f4b8-4acd-98e8-b3a37dfb3f9b HTTP/1.1 Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-azaDizV758RMOgcnL7t1X4NQGBjsnoOyII-Tzxyfij6SZyL2DydTk7-asyrOz9mV5CELIXOHvgRELII--am-MaFpvYmLThE0LIk5NmUR9rChrL7vFFAMlOfe4Y9VS3AqrXn0ScFyTwu__mQnfmQfzNaKvlCSJiYUAN4laIB2C6Hdc Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f6b64ffb3dc84f819d343d483cae6d9d Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-MigrationsAdminTest-1269102842 Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:19:56.112248 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6b64ffb3dc84f819d343d483cae6d9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6b64ffb3dc84f819d343d483cae6d9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6b64ffb3dc84f819d343d483cae6d9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6b64ffb3dc84f819d343d483cae6d9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-MigrationsAdminTest-1269102842 Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f6b64ffb3dc84f819d343d483cae6d9d Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-MigrationsAdminTest-1269102842 Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-MigrationsAdminTest-1269102842-project-admin Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0b21e2d662b64de892cf15cccac1dd87 Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-MigrationsAdminTest-1269102842-project-admin Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor 443d3397-f4b8-4acd-98e8-b3a37dfb3f9b could not be found. Oct 31 15:19:56.113745 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '443d3397-f4b8-4acd-98e8-b3a37dfb3f9b'} Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 443d3397-f4b8-4acd-98e8-b3a37dfb3f9b could not be found. Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:56.114563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 443d3397-f4b8-4acd-98e8-b3a37dfb3f9b could not be found. Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 443d3397-f4b8-4acd-98e8-b3a37dfb3f9b could not be found. Oct 31 15:19:56.115902 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:19:56.120356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6dfe7e60-ec6f-4bb5-9e22-c61a8aca82e4 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Returning 404 to user: Flavor 443d3397-f4b8-4acd-98e8-b3a37dfb3f9b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:56.121683 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6dfe7e60-ec6f-4bb5-9e22-c61a8aca82e4 tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/443d3397-f4b8-4acd-98e8-b3a37dfb3f9b" status: 404 len: 109 microversion: 2.1 time: 0.041108 Oct 31 15:19:56.123063 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 831/1572] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:56 2022] DELETE /compute/v2.1/flavors/443d3397-f4b8-4acd-98e8-b3a37dfb3f9b => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:19:56.258891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1523154035", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:56.314094 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee760801-7029-4760-920d-10692b989bbb tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/4fc72e15-4927-4c22-b123-0720ea694102" status: 200 len: 182 microversion: 2.1 time: 0.336461 Oct 31 15:19:56.314703 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 742/1573] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/os-floating-ips/4fc72e15-4927-4c22-b123-0720ea694102 => generated 182 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:56.330491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.5"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:56.370235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:56.618463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:56.629031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:56.629598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:56.630042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:56.631351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:56.632018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:56.635616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.532227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:57.533411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:57.534096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:57.535405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:57.536075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:57.539610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:57.547149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:57.547711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquired lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:57.563731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.564350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.564962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.566528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.571584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.572107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.625957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:57.639965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Getting quotas for user 8184a0251b8e4cb882556b458bbc4de7 and project 839329b3c3094cc087e11ca45c12b0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:57.672041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:57.675921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:57.861750 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ed2f624-e898-4553-a486-eae31ba94f3b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607781 Oct 31 15:19:57.868222 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 832/1574] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:19:57.879858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ba030e2e-35e5-4a32-bea5-56e87c07e191 req-e98c7432-0460-4eab-b313-6359968412cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "name": "network-vif-plugged", "status": "completed", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:57.925535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ba030e2e-35e5-4a32-bea5-56e87c07e191 req-e98c7432-0460-4eab-b313-6359968412cd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.927948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ba030e2e-35e5-4a32-bea5-56e87c07e191 req-e98c7432-0460-4eab-b313-6359968412cd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.928646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ba030e2e-35e5-4a32-bea5-56e87c07e191 req-e98c7432-0460-4eab-b313-6359968412cd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.970969 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ba030e2e-35e5-4a32-bea5-56e87c07e191 req-e98c7432-0460-4eab-b313-6359968412cd service nova] Creating event network-vif-plugged:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:19:57.989654 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ba030e2e-35e5-4a32-bea5-56e87c07e191 req-e98c7432-0460-4eab-b313-6359968412cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117578 Oct 31 15:19:57.990285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 833/1575] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:58.034152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:58.039844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:58.062578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.066286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.066968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.067874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.071761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.072537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.359222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:58.372611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:58.377270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:58.390569 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-744cc435-d55c-4703-a5e8-cadc9d7fc140 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.379526 Oct 31 15:19:58.408030 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 834/1576] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:19:58 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:58.428228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:58.430637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:58.462445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.464474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.465051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.471309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.471951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.472505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.899545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:58.915016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e993bf4f-cb06-4341-ac57-21dc16e2fa69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.501756 Oct 31 15:19:58.916138 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 835/1577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:58 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:58.930746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:58.936151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:58.953119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.953719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.954486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.955816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.959318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.960093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.244333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:59.694270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:59.709825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01039da5-da91-4128-bdea-738286e133e6 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1592 microversion: 2.1 time: 0.788470 Oct 31 15:19:59.712768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 836/1578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:58 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1592 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:59.727741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1f76c319-f3b1-464f-8a04-2a2e02a2c980 req-82485462-39cc-48be-a026-ba58224b9e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973fea37-d308-4817-9f35-986c6e157132", "tag": "3535208e-6962-459d-b917-574d50c2cd7d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:59.757766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1f76c319-f3b1-464f-8a04-2a2e02a2c980 req-82485462-39cc-48be-a026-ba58224b9e43 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.758535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1f76c319-f3b1-464f-8a04-2a2e02a2c980 req-82485462-39cc-48be-a026-ba58224b9e43 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.760971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1f76c319-f3b1-464f-8a04-2a2e02a2c980 req-82485462-39cc-48be-a026-ba58224b9e43 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.791477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1f76c319-f3b1-464f-8a04-2a2e02a2c980 req-82485462-39cc-48be-a026-ba58224b9e43 service nova] Creating event network-changed:3535208e-6962-459d-b917-574d50c2cd7d for instance 973fea37-d308-4817-9f35-986c6e157132 on n-h2-858383-17 Oct 31 15:19:59.812730 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1f76c319-f3b1-464f-8a04-2a2e02a2c980 req-82485462-39cc-48be-a026-ba58224b9e43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095901 Oct 31 15:19:59.815773 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 837/1579] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:59.824683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3bf7fb85-7c74-41e1-a0fe-53ee9e3b7818 req-25ab39f6-691d-4713-bf40-e2d932b873b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:59.855337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3bf7fb85-7c74-41e1-a0fe-53ee9e3b7818 req-25ab39f6-691d-4713-bf40-e2d932b873b8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.857403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3bf7fb85-7c74-41e1-a0fe-53ee9e3b7818 req-25ab39f6-691d-4713-bf40-e2d932b873b8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.857823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3bf7fb85-7c74-41e1-a0fe-53ee9e3b7818 req-25ab39f6-691d-4713-bf40-e2d932b873b8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.892234 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3bf7fb85-7c74-41e1-a0fe-53ee9e3b7818 req-25ab39f6-691d-4713-bf40-e2d932b873b8 service nova] Creating event network-changed:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:19:59.899982 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3bf7fb85-7c74-41e1-a0fe-53ee9e3b7818 req-25ab39f6-691d-4713-bf40-e2d932b873b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079250 Oct 31 15:19:59.905576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 838/1580] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:59.920032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.924755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.936243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.937069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.937611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.939097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.939792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.940391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.105767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.114914 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f69b130f-6829-4f15-9927-304d8773f14a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1265 microversion: 2.1 time: 0.207657 Oct 31 15:20:00.139413 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 839/1581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:59 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:00.147159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:00.147826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:00.158943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.181956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.191018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.192839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.199656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.205585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.346461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.356890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.362340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.385160 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a0eb773-0cbd-48fe-a460-024f521fbfab tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.244416 Oct 31 15:20:00.386382 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 840/1582] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:00 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:00.394268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:00.401660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:00.417642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.418444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.419051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.419984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.420562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.421028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.920862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.930046 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3895af5e-c5fc-4f6b-88a5-4d10bcf5f8be tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.541787 Oct 31 15:20:00.931260 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 841/1583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:00 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:01.147222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:01.147842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:01.154942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.155475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.155965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.156748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.157213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.157641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.760419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:01.772974 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4262852-6a9f-4e72-8c8c-1dac866b89cd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1271 microversion: 2.1 time: 0.629650 Oct 31 15:20:01.775607 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 842/1584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:01 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1271 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:01.790126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:01.792292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:01.806288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.812182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.813259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.815794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.816645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.817349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.831526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:01.948031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:01.978457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:01.983780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:01.999409 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77c2633d-acc2-4b36-a743-ad0aa8f2b022 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.222285 Oct 31 15:20:02.000387 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 843/1585] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:01 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:02.011357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.016181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:02.029686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.032866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.033573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.034570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.037239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.037545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.115923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Updating instance_info_cache with network_info: [{"id": "ce57ed71-c323-4435-9d03-734e53a856fb", "address": "fa:16:3e:d9:37:86", "network": {"id": "619fc2a7-48a2-488f-822e-32ff25c82360", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-594354118-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9affbb7cbc954cd8b44bf8f30767a1af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapce57ed71-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:20:02.133008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Releasing lock "refresh_cache-5f9d833d-bff4-4ce0-b06d-05a71eca779d" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:20:02.134350 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b3e5a33a-fada-48bc-96a6-1fefb46f6118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action" status: 202 len: 0 microversion: 2.1 time: 5.810151 Oct 31 15:20:02.135185 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 743/1586] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:56 2022] POST /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d/action => generated 0 bytes in 5812 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:20:02.141793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9a115045-d192-4b6d-a51e-bef6b03467a6 req-43b92b0a-d3ba-49b3-aef5-223cb40a4b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:02.165497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:02.172076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9a115045-d192-4b6d-a51e-bef6b03467a6 req-43b92b0a-d3ba-49b3-aef5-223cb40a4b0c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.175567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9a115045-d192-4b6d-a51e-bef6b03467a6 req-43b92b0a-d3ba-49b3-aef5-223cb40a4b0c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.176471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9a115045-d192-4b6d-a51e-bef6b03467a6 req-43b92b0a-d3ba-49b3-aef5-223cb40a4b0c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.215756 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9a115045-d192-4b6d-a51e-bef6b03467a6 req-43b92b0a-d3ba-49b3-aef5-223cb40a4b0c service nova] Creating event network-changed:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:20:02.223034 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9a115045-d192-4b6d-a51e-bef6b03467a6 req-43b92b0a-d3ba-49b3-aef5-223cb40a4b0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086335 Oct 31 15:20:02.225779 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 744/1587] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:02.232760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.233712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:02.240605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.241557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.242279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.243193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.243854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.244486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.280657 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] HTTP exception thrown: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Request method failure captured: Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 HTTP/1.1 Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-dCEoiOuuX00f6JI1dKhSKQeGsHR2SnSW6bExw1_hrGG_pTkFSA099O0f3hVFlqgBILnIvA3WQW_esXAUhIYJntvs4y8BEnl6aS9R0u7n9v18NFdR7QZFwoevnYjiUi-R80rVULjAU1cL8GFw-Q4Cjstl900vQBi1hDLX2h7G1mZcI Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:20:02.286193 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: e69c6e6309854c1288ad1a19631704d8 Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.287575 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4fa974f3-947c-4235-9bec-be3641676a34'} Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:02.288355 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.289632 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.293899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Returning 404 to user: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:02.295031 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e108c5df-9d8c-41ea-a9e5-98835d85e044 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 404 len: 111 microversion: 2.1 time: 0.067894 Oct 31 15:20:02.296177 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 745/1588] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:02 2022] DELETE /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:02.307528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.308529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 4fa974f3-947c-4235-9bec-be3641676a34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:02.326588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.327447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.333613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.334634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.335328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.336257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.369375 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] HTTP exception thrown: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Request method failure captured: Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 HTTP/1.1 Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-dCEoiOuuX00f6JI1dKhSKQeGsHR2SnSW6bExw1_hrGG_pTkFSA099O0f3hVFlqgBILnIvA3WQW_esXAUhIYJntvs4y8BEnl6aS9R0u7n9v18NFdR7QZFwoevnYjiUi-R80rVULjAU1cL8GFw-Q4Cjstl900vQBi1hDLX2h7G1mZcI Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:20:02.372350 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: e69c6e6309854c1288ad1a19631704d8 Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.373939 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4fa974f3-947c-4235-9bec-be3641676a34'} Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:02.374979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. Oct 31 15:20:02.376212 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.382895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Returning 404 to user: Instance 4fa974f3-947c-4235-9bec-be3641676a34 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:02.385361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f06669c-8e99-4ca2-bba4-9ef0f0e6d1c0 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34" status: 404 len: 111 microversion: 2.1 time: 0.085424 Oct 31 15:20:02.391390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 746/1589] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:02 2022] GET /compute/v2.1/servers/4fa974f3-947c-4235-9bec-be3641676a34 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:02.408713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d576c5d-8b11-43ec-9d73-4673e6f3561d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '.version_select at 0x7f5ca67ce5e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.814775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:02.823270 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7afb1779-48d6-4dfe-87e9-6f380c3ef7d9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1497 microversion: 2.1 time: 0.817873 Oct 31 15:20:02.825073 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 844/1590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:02 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1497 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:02.830777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.832606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:02.842479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.843246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.844816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.850918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.851860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.852475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.312734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:04.336395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-212f045e-97b2-4cfb-a07b-853557525b5d tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 1.509721 Oct 31 15:20:04.339714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 845/1591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:02 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:04.357074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.358007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.374947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.375466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.378529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.379485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.383770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.384311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.736649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:04.750066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:04.751789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:04.766481 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e1b96cd-758e-45c2-97c9-9e3dc09a02ff tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1560 microversion: 2.91 time: 0.423085 Oct 31 15:20:04.767395 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 846/1592] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:04 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1560 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:04.772041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.772650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.787262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.787762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.788206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.788946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.789405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.789832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.328034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:05.347151 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1015754c-394b-43e4-b4ee-a168cf4776e7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 200 len: 1474 microversion: 2.1 time: 0.576170 Oct 31 15:20:05.377906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 847/1593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:04 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 1474 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:05.383007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:05.383796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:05.426846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.427405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.427852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.429316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.429892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.430375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.239615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:06.254469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5c158e5-fadd-4f48-86a6-298ca78d8e3f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 0.875183 Oct 31 15:20:06.255666 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 848/1594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:05 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:06.264757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1189092551"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:06.268885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.291243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.291914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.292682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.294351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.294989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.296149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.791279 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d576c5d-8b11-43ec-9d73-4673e6f3561d tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/4fc72e15-4927-4c22-b123-0720ea694102" status: 202 len: 0 microversion: 2.1 time: 4.389921 Oct 31 15:20:06.792202 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 747/1595] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:20:02 2022] DELETE /compute/v2.1/os-floating-ips/4fc72e15-4927-4c22-b123-0720ea694102 => generated 0 bytes in 4397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:06.799260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.799886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.810770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.812188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.812999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.814013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.815191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.816146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.880637 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95e8ad1e-dcda-443b-bda6-a4d3bb39e4b8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.623399 Oct 31 15:20:06.890310 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 849/1596] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:06 2022] POST /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:20:06.917166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-cecf927a-396b-4847-bd6b-4dd1e70da1b6 req-d5462a20-d141-4f9a-b4b6-3904eed7bf42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:06.942871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cecf927a-396b-4847-bd6b-4dd1e70da1b6 req-d5462a20-d141-4f9a-b4b6-3904eed7bf42 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.943362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cecf927a-396b-4847-bd6b-4dd1e70da1b6 req-d5462a20-d141-4f9a-b4b6-3904eed7bf42 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.943802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cecf927a-396b-4847-bd6b-4dd1e70da1b6 req-d5462a20-d141-4f9a-b4b6-3904eed7bf42 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.968452 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-cecf927a-396b-4847-bd6b-4dd1e70da1b6 req-d5462a20-d141-4f9a-b4b6-3904eed7bf42 service nova] Creating event network-changed:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h1-858383-17 Oct 31 15:20:06.983226 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-cecf927a-396b-4847-bd6b-4dd1e70da1b6 req-d5462a20-d141-4f9a-b4b6-3904eed7bf42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089723 Oct 31 15:20:06.984258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 850/1597] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:06.995082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-286624842", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "635e1e0a-6ae3-43b6-936a-df7141d79dfa"}], "block_device_mapping_v2": [{"uuid": "8640efc3-b689-48b8-bc2a-f2d7923c77e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:07.124210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:07.143676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:07.151332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:07.154642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] validate_networks() for [('635e1e0a-6ae3-43b6-936a-df7141d79dfa', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:07.178006 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d12ad58c-36a0-4630-8296-7582d557b311 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.380511 Oct 31 15:20:07.184095 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 748/1598] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:06 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:07.203702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:07.206863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:07.227123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.228029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.228947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.231182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.231837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.232664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.291918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:07.477533 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff73815f-9b0e-4977-b884-5d57d3639437 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 204 len: 0 microversion: 2.1 time: 0.288262 Oct 31 15:20:07.482458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 749/1599] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:07 2022] DELETE /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:07.495895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-adaefaee-d9ba-4227-a462-4dd1042c2aab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca6869280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:07.596904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:07.608172 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-adaefaee-d9ba-4227-a462-4dd1042c2aab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1414 microversion: 2.1 time: 0.123491 Oct 31 15:20:07.612212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 750/1600] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:07 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:07.634878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:07.635646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:07.655161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:07.663401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.667916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.668765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.669664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.670284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.670900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.971325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:07.979242 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4657f749-59a1-414b-8f1f-5c1d9e57aa7e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 0.365245 Oct 31 15:20:07.979831 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 751/1601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:07 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:08.010544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:08.014022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:08.028231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.033275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.033983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.034946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.035575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.036190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.185658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:08.186820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:08.187532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:08.188367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:08.188999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:08.211844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.217743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.218382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.219422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.219898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.220336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.267720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:08.285982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Getting quotas for user 8c9c59f229134e1ab069e18a116ebdf2 and project d09369d806ba4afe911914e3272a59e4. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:08.321184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.330211 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3f7ec6cf-05db-4099-8a61-d41e4ceed110 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1525 microversion: 2.1 time: 0.328493 Oct 31 15:20:08.333763 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 752/1602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:08 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1525 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:08.340370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:08.341019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:08.347190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.347695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.348133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.349069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.349695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.350293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.391269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:08.393501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8640efc3-b689-48b8-bc2a-f2d7923c77e0',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:08.440879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.453083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.454645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.460769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc6bd547-6001-406a-95c2-deb6ce479b40 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.125756 Oct 31 15:20:08.477184 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 753/1603] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:08 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:08.632272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4dff504-8857-4437-bc6c-2e67d9190424 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca681e790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:08.662947 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43c98686-16f9-4500-bb4e-63a1d1ac31df tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.677228 Oct 31 15:20:08.665717 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 851/1604] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:20:08.677344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4af3a69a-8cf8-4283-98ba-518e5f88bfdd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:08.678340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4af3a69a-8cf8-4283-98ba-518e5f88bfdd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:08.745196 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4dff504-8857-4437-bc6c-2e67d9190424 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1414 microversion: 2.1 time: 0.120162 Oct 31 15:20:08.745781 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 754/1605] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:08 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:08.916654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4af3a69a-8cf8-4283-98ba-518e5f88bfdd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.926292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4af3a69a-8cf8-4283-98ba-518e5f88bfdd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.936458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4af3a69a-8cf8-4283-98ba-518e5f88bfdd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.939854 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4af3a69a-8cf8-4283-98ba-518e5f88bfdd tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1103 microversion: 2.25 time: 0.266488 Oct 31 15:20:08.945142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 852/1606] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:08 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1103 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:20:09.007752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:09.009509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:09.024298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.031589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.035032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.036739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.043105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.043455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.355447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:09.356901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:09.378281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.378857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.379298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.380038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.380500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.380960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.791627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:09.810335 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b8a8d7e-55f2-405a-9272-f51fe17646ab tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 0.806541 Oct 31 15:20:09.811522 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 755/1607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:09 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:09.816971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:09.821498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:09.835539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.841526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.841981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.842762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.847951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.848665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.061689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.076964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-609d477a-7774-4dbd-803a-1c882482f692 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1525 microversion: 2.1 time: 0.724997 Oct 31 15:20:10.078103 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 853/1608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:09 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1525 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:10.084861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.101305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.107997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.127798 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-811fdd8b-740a-4885-b88b-347e8544f2b8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.311419 Oct 31 15:20:10.142728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 756/1609] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:09 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:10.172663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ede80c7-6f3f-4efc-aba1-3636a049087f tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca68691f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:10.417376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ede80c7-6f3f-4efc-aba1-3636a049087f tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1414 microversion: 2.1 time: 0.270809 Oct 31 15:20:10.418610 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 757/1610] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:10 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1414 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:10.433117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:10.434152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:10.457766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84a2886b-c75a-4d92-86fe-0565faf963e5 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Action: 'create', calling method: .version_select at 0x7f5ca20d5ee0>, body: {"pool": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:10.473445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.474247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.482686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.483901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.484583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.485414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.681255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.706864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.711055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.722819 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d828292-947c-4b25-bba8-964e09750f40 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1184 microversion: 2.25 time: 0.301432 Oct 31 15:20:10.748110 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 758/1611] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:10 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1184 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:10.838097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:10.838828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:10.864601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.869942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.874066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.875160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.877403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.878113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.890311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:14.031450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:14.041291 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b52fc4d6-85a3-43a2-ad04-ae14a54c391a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 3.208454 Oct 31 15:20:14.046462 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 759/1612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:10 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 3214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:14.061531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:14.065830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:14.092507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.094813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.097497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:14.098468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.103391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.104549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.896541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e69c6e6309854c1288ad1a19631704d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9affbb7cbc954cd8b44bf8f30767a1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:16.919127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dd57390-69a7-4a97-9a01-2e09917fa118 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 200 len: 1525 microversion: 2.1 time: 2.871452 Oct 31 15:20:16.934178 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 760/1613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:14 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 1525 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:16.943633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.952474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.975708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.978927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.979959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.982075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.988688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.998273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.595855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.609877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.612505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.639564 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6bed4bbb-aab2-4ff3-9dfd-cd84321cc90d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.704109 Oct 31 15:20:17.652949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 761/1614] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:17.652949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e3486e9-a36a-4792-a6e7-157b592b02f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca24258b0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:18.235311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:18.923151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:19.361452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:20.070297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:20.405996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84a2886b-c75a-4d92-86fe-0565faf963e5 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.326579 Oct 31 15:20:20.415701 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 854/1615] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:20:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:20.657210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:20.658381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:20.722167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.722679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.723385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.724310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.725272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.725865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.451544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.461360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.462963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.464660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f6efde5-9ca0-4782-bb1d-f9d3028699b5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1292 microversion: 2.25 time: 1.047013 Oct 31 15:20:21.507811 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 855/1616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:20 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1292 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:21.684682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4fa53bb0-d2b1-4c2a-ada0-2c9b6dca234a req-7a62eac1-1cf8-4aea-94ea-91f9a46e209f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1", "name": "network-vif-plugged", "status": "completed", "tag": "65c32b74-b6d6-42ab-900d-530fe5ad0b7f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:21.749029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4fa53bb0-d2b1-4c2a-ada0-2c9b6dca234a req-7a62eac1-1cf8-4aea-94ea-91f9a46e209f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.749533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4fa53bb0-d2b1-4c2a-ada0-2c9b6dca234a req-7a62eac1-1cf8-4aea-94ea-91f9a46e209f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.749924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4fa53bb0-d2b1-4c2a-ada0-2c9b6dca234a req-7a62eac1-1cf8-4aea-94ea-91f9a46e209f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.783037 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4fa53bb0-d2b1-4c2a-ada0-2c9b6dca234a req-7a62eac1-1cf8-4aea-94ea-91f9a46e209f service nova] Creating event network-vif-plugged:65c32b74-b6d6-42ab-900d-530fe5ad0b7f for instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 on n-h2-858383-17 Oct 31 15:20:21.790486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4fa53bb0-d2b1-4c2a-ada0-2c9b6dca234a req-7a62eac1-1cf8-4aea-94ea-91f9a46e209f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276424 Oct 31 15:20:21.797191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 856/1617] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:21.804819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:21.816065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:21.824431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.827296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.827912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.828843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.833299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.833944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.336508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.346587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d52bc028-3085-4cb9-8681-25ae1cea90b9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 0.547309 Oct 31 15:20:22.363471 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 857/1618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:21 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:22.368679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:22.369317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] [instance: 5f9d833d-bff4-4ce0-b06d-05a71eca779d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:22.392936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.393431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.393871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.394580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.395042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.395463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.454005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] HTTP exception thrown: Instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d could not be found. Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Request method failure captured: Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d HTTP/1.1 Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-dCEoiOuuX00f6JI1dKhSKQeGsHR2SnSW6bExw1_hrGG_pTkFSA099O0f3hVFlqgBILnIvA3WQW_esXAUhIYJntvs4y8BEnl6aS9R0u7n9v18NFdR7QZFwoevnYjiUi-R80rVULjAU1cL8GFw-Q4Cjstl900vQBi1hDLX2h7G1mZcI Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:20:22.455690 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9affbb7cbc954cd8b44bf8f30767a1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9affbb7cbc954cd8b44bf8f30767a1af Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-30096089 Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: e69c6e6309854c1288ad1a19631704d8 Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-30096089-project Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d could not be found. Oct 31 15:20:22.457249 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '5f9d833d-bff4-4ce0-b06d-05a71eca779d'} Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d could not be found. Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:22.458161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d could not be found. Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d could not be found. Oct 31 15:20:22.459652 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:20:22.461169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] Returning 404 to user: Instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:22.461169 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-943f10d2-0c4a-4c25-b85a-63d0b6da0dd1 tempest-FloatingIPsAssociationTestJSON-30096089 tempest-FloatingIPsAssociationTestJSON-30096089-project] 10.222.0.48 "GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d" status: 404 len: 111 microversion: 2.1 time: 0.094922 Oct 31 15:20:22.469130 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 858/1619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:22 2022] GET /compute/v2.1/servers/5f9d833d-bff4-4ce0-b06d-05a71eca779d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:22.473994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2e91ca71-17ac-46b1-a60a-6eee191f5a0f req-6ee9c59a-c2b1-4870-b9e0-f1fb945fdd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9d833d-bff4-4ce0-b06d-05a71eca779d", "name": "network-vif-deleted", "tag": "ce57ed71-c323-4435-9d03-734e53a856fb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:22.514699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2e91ca71-17ac-46b1-a60a-6eee191f5a0f req-6ee9c59a-c2b1-4870-b9e0-f1fb945fdd44 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.520919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2e91ca71-17ac-46b1-a60a-6eee191f5a0f req-6ee9c59a-c2b1-4870-b9e0-f1fb945fdd44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.521602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2e91ca71-17ac-46b1-a60a-6eee191f5a0f req-6ee9c59a-c2b1-4870-b9e0-f1fb945fdd44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.543669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2e91ca71-17ac-46b1-a60a-6eee191f5a0f req-6ee9c59a-c2b1-4870-b9e0-f1fb945fdd44 service nova] Creating event network-vif-deleted:ce57ed71-c323-4435-9d03-734e53a856fb for instance 5f9d833d-bff4-4ce0-b06d-05a71eca779d on n-h1-858383-17 Oct 31 15:20:22.562581 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2e91ca71-17ac-46b1-a60a-6eee191f5a0f req-6ee9c59a-c2b1-4870-b9e0-f1fb945fdd44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092061 Oct 31 15:20:22.565290 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 859/1620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:22.571517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:22.572482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:22.588293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.589086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.591524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.592516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.593250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.593924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.712489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.722220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.724086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.739314 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e56c963-d594-4169-8b8f-5883a22fb35a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.172514 Oct 31 15:20:22.741680 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 860/1621] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:22 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:22.747473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4e913de-36c9-497b-8873-da1293eb37a4 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Action: 'create', calling method: .version_select at 0x7f5ca247a3a0>, body: {"pool": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:26.568666 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4e913de-36c9-497b-8873-da1293eb37a4 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.825599 Oct 31 15:20:26.578555 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 861/1622] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:20:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:26.713550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1936182100", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "5c5fcdfb-b80e-4129-8cd7-64772e200899"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:27.600741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=16 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:27.621183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:28.130434 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e3486e9-a36a-4792-a6e7-157b592b02f8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1414 microversion: 2.1 time: 10.486420 Oct 31 15:20:28.131013 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 762/1623] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:17 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1414 bytes in 10488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:28.141249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] validate_networks() for [('5c5fcdfb-b80e-4129-8cd7-64772e200899', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:28.145107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.145624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:28.157801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.158328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.158838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.159619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.160627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.161262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.462062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:28.477760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:28.482555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:28.486354 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f2eee7d-49ee-42e3-92fa-69260bd3d9b1 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1280 microversion: 2.25 time: 0.353622 Oct 31 15:20:28.487919 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 763/1624] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1280 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:28.493727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.495192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:28.504286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.505500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.506892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.507951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.508622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.509347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.880049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:28.898396 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b0f95659-cf1d-4379-86bc-f310ce9bb8f4 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 0.408612 Oct 31 15:20:28.899355 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 764/1625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:28.927551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.928985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:28.943478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.945144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.945939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.946973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.948446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.949603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.991526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:28.991911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:28.992636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:28.997511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:28.998209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:29.021990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:29.029660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:29.030411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:29.036157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:29.036976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:29.037778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:29.050527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:29.074872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:29.076398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:29.085681 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8cbec8ea-1c2e-4e8e-b092-e4fc0dfc7a3e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1537 microversion: 2.91 time: 0.176391 Oct 31 15:20:29.092824 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 765/1626] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1537 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:29.102087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Getting quotas for project 29a232779c6d41ef80716968c0d80b7d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:29.104282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c6167bd9-6397-4a5d-8181-1a798965e146 req-82068f41-32cc-44c2-9f90-90ef78f0b431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "name": "network-vif-plugged", "status": "completed", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:29.108269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Getting quotas for user c221b01c0df24a48a1730002a9d3aae2 and project 29a232779c6d41ef80716968c0d80b7d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:29.125989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c6167bd9-6397-4a5d-8181-1a798965e146 req-82068f41-32cc-44c2-9f90-90ef78f0b431 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:29.128884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c6167bd9-6397-4a5d-8181-1a798965e146 req-82068f41-32cc-44c2-9f90-90ef78f0b431 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:29.129814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c6167bd9-6397-4a5d-8181-1a798965e146 req-82068f41-32cc-44c2-9f90-90ef78f0b431 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:29.131953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:29.134341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:29.158999 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c6167bd9-6397-4a5d-8181-1a798965e146 req-82068f41-32cc-44c2-9f90-90ef78f0b431 service nova] Creating event network-vif-plugged:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h1-858383-17 Oct 31 15:20:29.179794 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c6167bd9-6397-4a5d-8181-1a798965e146 req-82068f41-32cc-44c2-9f90-90ef78f0b431 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085332 Oct 31 15:20:29.181107 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 766/1627] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:29.195620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-249c7300-48ae-49fb-b12d-7a875d97a445 req-f313da25-db8f-43b1-8fe7-047c997755c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4549f404-caee-4b2d-9dfb-256e1c495f24", "tag": "b2f00f75-e50d-44ae-a608-b5296991a22f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:29.220651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-249c7300-48ae-49fb-b12d-7a875d97a445 req-f313da25-db8f-43b1-8fe7-047c997755c7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:29.223340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-249c7300-48ae-49fb-b12d-7a875d97a445 req-f313da25-db8f-43b1-8fe7-047c997755c7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:29.223988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-249c7300-48ae-49fb-b12d-7a875d97a445 req-f313da25-db8f-43b1-8fe7-047c997755c7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:29.228919 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64fcc924-b079-4367-b89f-f12f32ca319b tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.649072 Oct 31 15:20:29.229710 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 862/1628] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:20:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:20:29.254232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2ebebcd-1061-4fe7-95a8-0164bd2ce1bf tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Action: 'create', calling method: .version_select at 0x7f5ca21445e0>, body: {"pool": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:29.274439 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-249c7300-48ae-49fb-b12d-7a875d97a445 req-f313da25-db8f-43b1-8fe7-047c997755c7 service nova] Creating event network-changed:b2f00f75-e50d-44ae-a608-b5296991a22f for instance 4549f404-caee-4b2d-9dfb-256e1c495f24 on n-h1-858383-17 Oct 31 15:20:29.285210 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-249c7300-48ae-49fb-b12d-7a875d97a445 req-f313da25-db8f-43b1-8fe7-047c997755c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101218 Oct 31 15:20:29.288936 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 767/1629] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:29.302593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47c4620a-24e1-498c-b78a-d75c2ba1f342 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca298fe50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.394206 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47c4620a-24e1-498c-b78a-d75c2ba1f342 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1414 microversion: 2.1 time: 0.103551 Oct 31 15:20:29.394912 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 768/1630] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:29 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:29.414129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff3fc574-560c-4980-987b-e7c9fe5e9e2d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.424162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff3fc574-560c-4980-987b-e7c9fe5e9e2d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:30.067448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff3fc574-560c-4980-987b-e7c9fe5e9e2d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:30.075367 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff3fc574-560c-4980-987b-e7c9fe5e9e2d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1225 microversion: 2.1 time: 0.676208 Oct 31 15:20:30.077206 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 769/1631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:29 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1225 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:30.102616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:30.105460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:30.116295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:30.117999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:30.118575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:30.119511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:30.120641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:30.121100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:30.585246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:30.595927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:30.597600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:30.598890 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17273c90-8d34-4f07-b7a7-eceb3c638908 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1280 microversion: 2.25 time: 0.502701 Oct 31 15:20:30.615287 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 770/1632] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:30 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1280 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:30.615287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:30.615287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:30.615287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:30.615287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:30.615855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:30.615855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:30.615855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:30.615855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:30.972574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:30.981543 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-146c1b77-123d-48b1-b196-4dc1e15cad0f tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1313 microversion: 2.1 time: 0.380897 Oct 31 15:20:30.982128 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 771/1633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:30 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:30.986954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:30.987562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:30.993398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:31.001086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:31.001726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:31.002576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:31.003118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:31.003582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:31.122662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:31.137543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:31.139255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:31.151956 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-14e5ed59-4f24-44f3-974d-06c4d4cca3b7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1537 microversion: 2.91 time: 0.168715 Oct 31 15:20:31.152639 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 772/1634] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:30 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:31.157489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ffd81d52-440f-49f9-af1f-30743e4c7d87 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca67e23a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:31.217761 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ffd81d52-440f-49f9-af1f-30743e4c7d87 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1423 microversion: 2.1 time: 0.063675 Oct 31 15:20:31.218343 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 773/1635] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:31 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1423 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:31.223253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:31.224082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:31.232017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:31.233065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:31.233518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:31.234228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:31.234685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:31.235304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:31.370096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:31.378114 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a77943ef-f40c-47da-9a23-dcddf3f6abbe tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1221 microversion: 2.1 time: 0.158767 Oct 31 15:20:31.391719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 774/1636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:31 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:31.396774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fae7507c-a27e-4742-a3c8-048546a6e89a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca27f6ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:31.469003 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fae7507c-a27e-4742-a3c8-048546a6e89a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 200 len: 1423 microversion: 2.1 time: 0.071683 Oct 31 15:20:31.471138 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 775/1637] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:31 2022] GET /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:31.487764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b139501-ba09-4c18-a117-9f4ba93507a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca67e2040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.459676 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2ebebcd-1061-4fe7-95a8-0164bd2ce1bf tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.221681 Oct 31 15:20:32.460283 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 863/1638] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:20:29 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:32.467982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.469454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:32.477503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.478673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.479380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.480448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.481237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.481898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.482684 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b139501-ba09-4c18-a117-9f4ba93507a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 204 len: 0 microversion: 2.1 time: 1.000885 Oct 31 15:20:32.484739 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 776/1639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:31 2022] DELETE /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:32.490832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.491641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:32.499458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.500203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.500844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.501880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.502504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.503108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.767250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.771757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.778032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.779864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.781011 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-429c620f-873b-4b22-bc33-c61caae72967 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1462 microversion: 2.1 time: 0.295163 Oct 31 15:20:32.781375 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-094c0c31-b6c0-468e-8aea-e21e4e85dd8e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1280 microversion: 2.25 time: 0.318927 Oct 31 15:20:32.782417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 864/1640] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:32 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:32.787508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.788173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:32.791525 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 777/1641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:32 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1462 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:32.795168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.795881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.796494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.797450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.798059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.798635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.799807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.804755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.805510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Searching by: {'deleted': False, 'project_id': '08df63f2dbf84fe79d057a786451404d'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:20:32.817423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.818270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.818861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.819874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.820565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.821205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.888344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.907185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.908892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:32.915413 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-475a91f8-0128-461c-8425-03018321685d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1480 microversion: 2.91 time: 0.131391 Oct 31 15:20:32.915591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:20:32.917695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 865/1642] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:32 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1480 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:32.931464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:32.933047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:32.941652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.942360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.943662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.944555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:32.945198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:32.946013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:32.995607 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-250f8a27-67fe-49ce-a8a5-cf364c521b8d tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.201860 Oct 31 15:20:32.996108 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 778/1643] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:20:32 2022] GET /compute/v2.1/servers => generated 340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:33.004238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-114adc90-c5b3-472c-aca3-ad369327b8cd tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Action: 'create', calling method: .version_select at 0x7f5ca681e700>, body: {"pool": null} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:33.278222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:33.298387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ae70484-f2a7-46c6-93fd-41f832b2fb45 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1325 microversion: 2.1 time: 0.371267 Oct 31 15:20:33.305887 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 866/1644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:32 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1325 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:33.317551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:33.318060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:33.328663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.329472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.329991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.330643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.331436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.331579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.366526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:33.500657 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3cb4b126-1fd4-4bf2-9584-20a573c2e9f6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 204 len: 0 microversion: 2.1 time: 0.190384 Oct 31 15:20:33.503270 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 867/1645] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:33 2022] DELETE /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:33.510487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:33.512330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:33.535033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.535880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.537066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.541107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.542321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.545099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.871614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a48781b6-3dc6-4c0e-bb45-9de061e95fbb tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1615 microversion: 2.1 time: 0.365740 Oct 31 15:20:33.872939 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 868/1646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:33 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1615 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:33.880830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:33.883709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:33.890863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.891625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.892250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.893007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:33.893470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:33.894036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:33.983997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-17". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:20:34.062210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-692ca5d9-4adc-46f3-ab7c-85f5cee49c73 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action" status: 202 len: 0 microversion: 2.91 time: 0.187465 Oct 31 15:20:34.063215 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 869/1647] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:20:33 2022] POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:34.069259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:34.075934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:34.077147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Searching by: {'deleted': False, 'project_id': '08df63f2dbf84fe79d057a786451404d'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:20:34.083089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:34.083655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:34.084222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:34.084987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:34.085730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:34.086249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:34.120844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:20:34.239579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:34.246596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:34.247201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:34.247742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:35.058516 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3f05271-cde7-405b-a92b-9524835c1c96 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1714 microversion: 2.1 time: 0.992508 Oct 31 15:20:35.060016 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 870/1648] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:20:34 2022] GET /compute/v2.1/servers/detail => generated 1714 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:35.066525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1730153839", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bc2357ef-c687-4bf5-80c5-a090c70bef3f"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:35.180242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] validate_networks() for [('bc2357ef-c687-4bf5-80c5-a090c70bef3f', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:36.191161 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-114adc90-c5b3-472c-aca3-ad369327b8cd tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.193514 Oct 31 15:20:36.193443 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 779/1649] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:20:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:36.210919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:36.211749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:36.219850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.220766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.221371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.222491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.223259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.223888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.600040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:36.601597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:36.603046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:36.607060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:36.608148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:36.641036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.641867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.643200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.644800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.645460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.652350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.679039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:36.703856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:36.705321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:36.706452 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d412695-7521-471b-93d3-65cce8ef9db3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1280 microversion: 2.25 time: 0.502436 Oct 31 15:20:36.708214 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 780/1650] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:36 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1280 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:36.720960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:36.738588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for user 857b0f5f4fdc4b1faeae0e0770d65125 and project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:36.755229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:36.757838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:36.851673 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5cc3ffd5-8cdd-498c-9599-0c4d4f4feb0a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790226 Oct 31 15:20:36.852530 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 871/1651] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:20:36.869919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:36.870710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:36.877522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.878393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.878977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.879948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.880565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.881237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.996317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0b21e2d662b64de892cf15cccac1dd87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b64ffb3dc84f819d343d483cae6d9d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:36.996854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] flavor_id is None. Assuming migration. {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:20:36.997292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:20:37.044181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1572bf8e-ac61-4db4-8490-19291da8c3c2 req-6042a397-f056-4d22-87cd-4bc3cc915b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b136b9-5bf4-438e-849a-bbd2a80e172f", "tag": "5a53abe6-7804-4cdb-af34-95e415457938"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:37.064951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1572bf8e-ac61-4db4-8490-19291da8c3c2 req-6042a397-f056-4d22-87cd-4bc3cc915b55 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.067237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1572bf8e-ac61-4db4-8490-19291da8c3c2 req-6042a397-f056-4d22-87cd-4bc3cc915b55 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.068821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1572bf8e-ac61-4db4-8490-19291da8c3c2 req-6042a397-f056-4d22-87cd-4bc3cc915b55 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.099878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1572bf8e-ac61-4db4-8490-19291da8c3c2 req-6042a397-f056-4d22-87cd-4bc3cc915b55 service nova] Creating event network-changed:5a53abe6-7804-4cdb-af34-95e415457938 for instance 89b136b9-5bf4-438e-849a-bbd2a80e172f on n-h2-858383-17 Oct 31 15:20:37.116899 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1572bf8e-ac61-4db4-8490-19291da8c3c2 req-6042a397-f056-4d22-87cd-4bc3cc915b55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401732 Oct 31 15:20:37.117869 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 781/1652] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:37.155058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.156768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:37.178767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.180643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.182910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.186368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.187419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.188254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.356312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:37.362287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:37.376749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:37.385841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:37.397195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-925e56d7-1768-4bf0-b1a0-0a9d772fb570 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.275974 Oct 31 15:20:37.401143 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 782/1653] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:37 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:37.413594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.414801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:37.430386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.430984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.432607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.435800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.436381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.437774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.627288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1736877a-1652-44f6-ad72-c2ca8b63ec7f tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695/action" status: 202 len: 0 microversion: 2.1 time: 0.763218 Oct 31 15:20:37.628266 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 872/1654] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:36 2022] POST /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:37.632802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9d0e9be-0364-4185-ba2b-f652471c47a8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.656955 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9d0e9be-0364-4185-ba2b-f652471c47a8 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027057 Oct 31 15:20:37.666407 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 873/1655] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:20:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:37.673720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b712ad59-df96-467b-b3a2-8878ae10c01f tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca2457550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:38.857864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:38.869046 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-766916d5-5cd1-4f09-b84a-8fc23936cc0f tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1325 microversion: 2.1 time: 1.464480 Oct 31 15:20:38.869638 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 783/1656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:37 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1325 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:38.884733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d99c3d7e-42f5-4124-8b36-b7b1409385a3 req-cec439be-271e-4432-b50e-67a0209152fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1", "name": "network-vif-deleted", "tag": "65c32b74-b6d6-42ab-900d-530fe5ad0b7f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:38.912788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d99c3d7e-42f5-4124-8b36-b7b1409385a3 req-cec439be-271e-4432-b50e-67a0209152fa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.915677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d99c3d7e-42f5-4124-8b36-b7b1409385a3 req-cec439be-271e-4432-b50e-67a0209152fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.916896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d99c3d7e-42f5-4124-8b36-b7b1409385a3 req-cec439be-271e-4432-b50e-67a0209152fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.940739 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d99c3d7e-42f5-4124-8b36-b7b1409385a3 req-cec439be-271e-4432-b50e-67a0209152fa service nova] Creating event network-vif-deleted:65c32b74-b6d6-42ab-900d-530fe5ad0b7f for instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 on n-h2-858383-17 Oct 31 15:20:38.951968 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d99c3d7e-42f5-4124-8b36-b7b1409385a3 req-cec439be-271e-4432-b50e-67a0209152fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078448 Oct 31 15:20:38.954809 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 784/1657] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:38.960612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:38.969602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:38.985391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.986271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.986869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.989939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.990593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.992158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.140820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b712ad59-df96-467b-b3a2-8878ae10c01f tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/3d4d4fac-83f8-4c72-b41b-b80274ae0ec7" status: 200 len: 142 microversion: 2.1 time: 1.472171 Oct 31 15:20:39.142097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 874/1658] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:20:37 2022] GET /compute/v2.1/os-floating-ips/3d4d4fac-83f8-4c72-b41b-b80274ae0ec7 => generated 142 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:39.146868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.147812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.168399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.169086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.169758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.170581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.171149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.171790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.271007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.285507 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f294228-56a1-4393-9c09-f0856a67ffa7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1260 microversion: 2.1 time: 0.329144 Oct 31 15:20:39.286454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 785/1659] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:38 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.305133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.305856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.316627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.317207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.317686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.318445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.320189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.320627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.712655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.721329 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-399ea3fa-5b2c-4b76-a9d7-c24c6b7f8232 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1471 microversion: 2.1 time: 0.577957 Oct 31 15:20:39.725428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 875/1660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.732133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.737363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.753584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.754436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.755095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.756027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.756750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.757452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.810809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:39.882125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.894856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.896598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.898212 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-371d0af2-a5f0-4a9b-8c62-ff16b9f5c67d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1280 microversion: 2.25 time: 0.610433 Oct 31 15:20:39.910476 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 786/1661] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1280 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:39.910476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-16b6d7c0-385a-4db5-95d6-d8f718794c21 req-9dd3476d-51ed-4b59-ad38-0d60ab2f28a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549f404-caee-4b2d-9dfb-256e1c495f24", "name": "network-vif-plugged", "status": "completed", "tag": "b2f00f75-e50d-44ae-a608-b5296991a22f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:39.915787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-16b6d7c0-385a-4db5-95d6-d8f718794c21 req-9dd3476d-51ed-4b59-ad38-0d60ab2f28a8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.917492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-16b6d7c0-385a-4db5-95d6-d8f718794c21 req-9dd3476d-51ed-4b59-ad38-0d60ab2f28a8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.918270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-16b6d7c0-385a-4db5-95d6-d8f718794c21 req-9dd3476d-51ed-4b59-ad38-0d60ab2f28a8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.941261 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-16b6d7c0-385a-4db5-95d6-d8f718794c21 req-9dd3476d-51ed-4b59-ad38-0d60ab2f28a8 service nova] Creating event network-vif-plugged:b2f00f75-e50d-44ae-a608-b5296991a22f for instance 4549f404-caee-4b2d-9dfb-256e1c495f24 on n-h1-858383-17 Oct 31 15:20:39.944483 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b491201-1a06-42b4-b402-77fda83dd76e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "DELETE /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 204 len: 0 microversion: 2.1 time: 0.217479 Oct 31 15:20:39.945159 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 876/1662] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:39 2022] DELETE /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:39.949148 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-16b6d7c0-385a-4db5-95d6-d8f718794c21 req-9dd3476d-51ed-4b59-ad38-0d60ab2f28a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048498 Oct 31 15:20:39.952964 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 787/1663] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:39.954175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.954886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.958536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf062c0b-4930-48b9-85e2-cffe4ad8cee5 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca6726040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.973816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.974320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.974762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.975480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.975943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.976372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.069565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:40.190315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:40.198850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:40.200549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:40.215934 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91a473e3-40bd-45a3-b639-32f4e17e0c88 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.265720 Oct 31 15:20:40.221110 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 877/1664] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:40.237649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:40.238579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:40.252869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.253722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.254506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.255442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.257895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.258641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.970095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:40.978580 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77df190f-2226-41fa-9653-84d9a076addb tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1325 microversion: 2.1 time: 0.755730 Oct 31 15:20:40.979160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 878/1665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:40 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1325 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:40.990314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:40.993728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:41.004039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.005347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.006363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.035134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.039447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.044867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.537514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:41.550805 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-849424b2-3d5c-4b36-bc45-4f28db5ab196 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1717 microversion: 2.1 time: 0.566813 Oct 31 15:20:41.551408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 879/1666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:40 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1717 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:41.560303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:41.561767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:41.579844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:41.581668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.593600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.594313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.595522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.597277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.597911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.722432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:41.731013 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59dee85c-9f23-418e-aeb0-236e63d730ab tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1268 microversion: 2.1 time: 0.177575 Oct 31 15:20:41.731609 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 880/1667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:41 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:41.752974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:41.753566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:41.760212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.761393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.761393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.762100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.762640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.762963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.050460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.065283 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07264de0-b17c-4d9b-9fbd-1aa6dc6887f0 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1471 microversion: 2.1 time: 0.318941 Oct 31 15:20:42.067345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 881/1668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:41 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1471 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:42.073894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.074868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:42.081693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.082492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.083369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.084318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.085041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.086053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.299591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf062c0b-4930-48b9-85e2-cffe4ad8cee5 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/3d4d4fac-83f8-4c72-b41b-b80274ae0ec7" status: 202 len: 0 microversion: 2.1 time: 2.345083 Oct 31 15:20:42.300243 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 788/1669] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:20:39 2022] DELETE /compute/v2.1/os-floating-ips/3d4d4fac-83f8-4c72-b41b-b80274ae0ec7 => generated 0 bytes in 2347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:42.305644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.307843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:42.329717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.330225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.330672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.340521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.342117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.354016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.406570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:42.535729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.570633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.575422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.590867 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a71a7a6-ce26-45c8-bd84-15da0afd27e7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.289202 Oct 31 15:20:42.591610 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 789/1670] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:42.602664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-db676aa2-da77-4e37-9a0e-0106c8ff4d83 req-9c506244-a71e-4a90-8de6-9be029d10119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b136b9-5bf4-438e-849a-bbd2a80e172f", "name": "network-vif-plugged", "status": "completed", "tag": "5a53abe6-7804-4cdb-af34-95e415457938"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:42.618603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-db676aa2-da77-4e37-9a0e-0106c8ff4d83 req-9c506244-a71e-4a90-8de6-9be029d10119 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.619748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-db676aa2-da77-4e37-9a0e-0106c8ff4d83 req-9c506244-a71e-4a90-8de6-9be029d10119 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.620352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-db676aa2-da77-4e37-9a0e-0106c8ff4d83 req-9c506244-a71e-4a90-8de6-9be029d10119 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.627743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.637468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.638923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.640080 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-861eff7d-7b13-47c3-8c6d-e0127043c54c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1280 microversion: 2.25 time: 0.571550 Oct 31 15:20:42.640657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 882/1671] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1280 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:42.671782 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-db676aa2-da77-4e37-9a0e-0106c8ff4d83 req-9c506244-a71e-4a90-8de6-9be029d10119 service nova] Creating event network-vif-plugged:5a53abe6-7804-4cdb-af34-95e415457938 for instance 89b136b9-5bf4-438e-849a-bbd2a80e172f on n-h2-858383-17 Oct 31 15:20:42.688369 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-db676aa2-da77-4e37-9a0e-0106c8ff4d83 req-9c506244-a71e-4a90-8de6-9be029d10119 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090125 Oct 31 15:20:42.691230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 790/1672] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:42.694283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.695399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:42.709374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5a9e215-e510-4ded-a7ab-87e1dce8aa85 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca6818940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.721894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.722730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.723050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.724238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.745130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.745984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.849848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:43.882894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5a9e215-e510-4ded-a7ab-87e1dce8aa85 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.185980 Oct 31 15:20:43.884321 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 791/1673] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:20:43.899136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:43.904591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:43.936301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:43.936815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:43.942100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:43.943588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:43.945894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:43.946647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.314229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:44.324501 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e53db5df-0da1-481e-8d30-6ee050432f19 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1325 microversion: 2.1 time: 1.663828 Oct 31 15:20:44.333971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:44.338189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 883/1674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1325 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:44.350561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cd0e740-bc21-4309-a090-2b75d83cb1a4 tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1717 microversion: 2.1 time: 0.457175 Oct 31 15:20:44.355415 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 792/1675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:43 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1717 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:44.363862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:44.365280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:44.376098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:44.377115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:44.392523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.396048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.400602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.401553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.402546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.403280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.406199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.406934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.407627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.408974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.414907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.425143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.606690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:44.618577 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-635698b1-5888-486e-8744-468fc6eebad3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1266 microversion: 2.1 time: 0.278853 Oct 31 15:20:44.621142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 884/1676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:44 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:44.638387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:44.644418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:44.664381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.664986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.665489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.666860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.667385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.667890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:45.195651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.222850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.226595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.242841 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f86d2dca-4c7c-403b-b051-52c3a5197354 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.618103 Oct 31 15:20:45.244798 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 885/1677] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:44 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:45.254441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:45.257384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:45.276281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:45.276982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:45.277550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:45.278339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:45.278950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:45.279388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:45.408933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.420258 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1175fcea-96c3-4a06-a304-b5a0d8da25dd tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1471 microversion: 2.1 time: 1.063474 Oct 31 15:20:45.426188 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 793/1678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:44 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1471 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:45.433463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d79949e-621e-43d9-96c8-57cedf7e3e33 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca681eca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:45.881743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.894047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.897984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:45.903564 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38e2e7ee-ed2c-4468-97c0-1ebfc9b83902 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1476 microversion: 2.25 time: 0.657176 Oct 31 15:20:45.904465 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 886/1679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:45 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1476 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:46.037714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-127653895", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "91a47dbc-d48f-4b7c-b621-07811ef77b68"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:46.122253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] validate_networks() for [('91a47dbc-d48f-4b7c-b621-07811ef77b68', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:46.307140 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d79949e-621e-43d9-96c8-57cedf7e3e33 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.876879 Oct 31 15:20:46.308681 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 794/1680] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:20:45 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:46.313797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.314365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:46.339621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.340277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.340737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.341510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.341968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.342387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.667702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:46.749488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=14 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:46.828217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:46.838424 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4c4169cd-d4d9-4754-9256-8dce5fb176d2 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1325 microversion: 2.1 time: 0.528258 Oct 31 15:20:46.857095 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 795/1681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:46 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:46.863781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.868019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:46.881784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.885373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.886048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.886974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.887607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.888213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.045383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:47.060975 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-689a9348-69c1-4136-a884-82be7019150f tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1649 microversion: 2.1 time: 0.202463 Oct 31 15:20:47.073566 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 796/1682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:46 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1649 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:47.099094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.105789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:47.122588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.123383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.124008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.124917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.125537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.126149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.351359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:47.351938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:47.352455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:47.353698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:47.354496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:47.370338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.373581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.376920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.380330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.381765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.383742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.435983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Getting quotas for project c8c9aaf35cf944028a4aca205aaec129. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:47.454148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Getting quotas for user 9526b0356b7c4aad9e37b40f20bc2798 and project c8c9aaf35cf944028a4aca205aaec129. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:47.490009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:47.497182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:47.628147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc53eb2a-e813-4db0-ba63-74e388ebada3 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722000 Oct 31 15:20:47.637344 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 887/1683] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:20:47.666359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:47.676714 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84040359-2d85-4fb2-b882-8401dd1fbcd5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1308 microversion: 2.1 time: 0.581621 Oct 31 15:20:47.680832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 797/1684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:47 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:47.695520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.696145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:47.707618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.708184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.712984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.714074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.714664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.715121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.843277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:47.864980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:47.866512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:47.879226 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-741289b5-21c5-4861-a5b9-fa819a96ab12 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.196390 Oct 31 15:20:47.882844 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 798/1685] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:47 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:47.889680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e116fbe-fc6c-4205-8642-826f769bb8bf tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca6739820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.910146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.910781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:47.939084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.939897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.941819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.944270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.945890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.946448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.389983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 4549f404-caee-4b2d-9dfb-256e1c495f24 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:48.404036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:48.435575 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fda9b348-82b3-49dc-983d-e7c1a3724736 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1970 microversion: 2.25 time: 0.796965 Oct 31 15:20:48.436184 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 888/1686] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:47 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1970 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:48.449598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:48.450612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:48.459404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.461317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.461934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.463417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.464033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.464608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.859932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:48.867750 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-acaa431b-0070-497e-a4e6-eaa8cb1e6ca7 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1471 microversion: 2.1 time: 0.426702 Oct 31 15:20:48.882307 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 889/1687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:48 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:48.882307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-bc6bf40f-d834-41c6-9611-370e0e62f8ed req-177191ec-dfdc-4037-b6df-58ac691bd487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973fea37-d308-4817-9f35-986c6e157132", "name": "network-vif-deleted", "tag": "3535208e-6962-459d-b917-574d50c2cd7d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:48.902034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc6bf40f-d834-41c6-9611-370e0e62f8ed req-177191ec-dfdc-4037-b6df-58ac691bd487 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.906803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc6bf40f-d834-41c6-9611-370e0e62f8ed req-177191ec-dfdc-4037-b6df-58ac691bd487 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.907505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc6bf40f-d834-41c6-9611-370e0e62f8ed req-177191ec-dfdc-4037-b6df-58ac691bd487 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.935553 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-bc6bf40f-d834-41c6-9611-370e0e62f8ed req-177191ec-dfdc-4037-b6df-58ac691bd487 service nova] Creating event network-vif-deleted:3535208e-6962-459d-b917-574d50c2cd7d for instance 973fea37-d308-4817-9f35-986c6e157132 on n-h2-858383-17 Oct 31 15:20:48.946185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-bc6bf40f-d834-41c6-9611-370e0e62f8ed req-177191ec-dfdc-4037-b6df-58ac691bd487 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076431 Oct 31 15:20:48.952254 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 890/1688] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:48.964058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:48.964947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:48.978545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.979056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.979622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.980179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.981630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.982235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.098993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:49.109763 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e151896-4586-46af-ae12-ff6d57eea640 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1267 microversion: 2.1 time: 0.156114 Oct 31 15:20:49.111332 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 891/1689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:48 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:49.118867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:49.132373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:49.144666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.145186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.146095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.146947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.147477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.147915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.457061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:49.490622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e48be1df-5fa9-4a29-8ca1-85a70760e25a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1522 microversion: 2.1 time: 0.377266 Oct 31 15:20:49.495461 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 892/1690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:49 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:49.527852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:49.529254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:49.546576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.549402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.550065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.551065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.553360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.554371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.616530 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e116fbe-fc6c-4205-8642-826f769bb8bf tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/2f1ca058-6ee6-46f1-b828-b5b2bea9e42d" status: 202 len: 0 microversion: 2.1 time: 1.731924 Oct 31 15:20:49.617910 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 799/1691] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:20:47 2022] DELETE /compute/v2.1/os-floating-ips/2f1ca058-6ee6-46f1-b828-b5b2bea9e42d => generated 0 bytes in 1735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:49.623523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:49.624323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:49.643485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.644039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.644474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.645214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.649892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.650374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.650830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.651294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.662470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.662980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lazy-loading 'fault' on Instance uuid 973fea37-d308-4817-9f35-986c6e157132 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:49.911030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fbe57fd4f443c980d1b44cad293dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08df63f2dbf84fe79d057a786451404d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:49.920909 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-17c3e9f0-abe7-4b0b-8599-2e1786daa6ba tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 200 len: 1368 microversion: 2.1 time: 0.410612 Oct 31 15:20:49.935234 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 893/1692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:49 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:49.959383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:49.962942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:49.976053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.980576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.981929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.985006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.985508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.987357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.182723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 4549f404-caee-4b2d-9dfb-256e1c495f24 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:50.196349 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9742fae4-a552-4566-a6a1-438052f7af7a tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1970 microversion: 2.25 time: 0.577080 Oct 31 15:20:50.197600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 800/1693] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:49 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1970 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:50.202146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:50.202746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:50.208739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.209764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.210504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.211243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.211775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.212244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.314549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:50.323444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:50.324914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:50.329867 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3152d23a-c11c-4005-ad99-6f2217c4d506 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.131312 Oct 31 15:20:50.344718 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 801/1694] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:50 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:50.349299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-27101570-2d33-4837-9548-d4c85c56cd71 req-12c365f1-321f-4635-84f1-974c8a6b4113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a045a089-2ade-4888-aff0-4e067941cb23", "tag": "b7268098-5fbf-433c-afa2-19ac9e1c6d17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:50.359004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-27101570-2d33-4837-9548-d4c85c56cd71 req-12c365f1-321f-4635-84f1-974c8a6b4113 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.359616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-27101570-2d33-4837-9548-d4c85c56cd71 req-12c365f1-321f-4635-84f1-974c8a6b4113 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.360046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-27101570-2d33-4837-9548-d4c85c56cd71 req-12c365f1-321f-4635-84f1-974c8a6b4113 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.371146 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-27101570-2d33-4837-9548-d4c85c56cd71 req-12c365f1-321f-4635-84f1-974c8a6b4113 service nova] Creating event network-changed:b7268098-5fbf-433c-afa2-19ac9e1c6d17 for instance a045a089-2ade-4888-aff0-4e067941cb23 on n-h2-858383-17 Oct 31 15:20:50.375768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:50.376058 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-27101570-2d33-4837-9548-d4c85c56cd71 req-12c365f1-321f-4635-84f1-974c8a6b4113 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044201 Oct 31 15:20:50.376898 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 802/1695] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:50.381673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:50.382261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:50.385566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6f555f5-535c-4623-bb41-74d65e3661d7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1308 microversion: 2.1 time: 0.448591 Oct 31 15:20:50.386502 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 894/1696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:49 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:50.390349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.390930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.391360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.391679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-06aebc76-feb1-437c-af07-d7b54aabcbe8 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca21440d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:50.392086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.392540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.392995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.417028 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] HTTP exception thrown: Instance is not a member of specified network Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Request method failure captured: Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f/ips/invalid HTTP/1.1 Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-e1ryvOFgTg3xPId9WccHpbQy-UaK5w9l55suNajSvWURPay_pgn9mtnV9ghy6BfZOppKerdH8LW44d53xC_9v0psse-pO-57MmuLy8S6rrvNQ5WJuE3mJ_VrPyaCm4dYOx-1Z13I6GgQM1-wmBedo2QooX9CpqmwKUnF_o-3Vkz-U Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 29a232779c6d41ef80716968c0d80b7d Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:20:50.422924 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 29a232779c6d41ef80716968c0d80b7d Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerAddressesNegativeTestJSON-1029053419-project Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: c221b01c0df24a48a1730002a9d3aae2 Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1029053419-project Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance is not a member of specified network Oct 31 15:20:50.424777 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': '89b136b9-5bf4-438e-849a-bbd2a80e172f', 'id': 'invalid'} Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 31 15:20:50.425849 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:50.428219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:50.428219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0d7b141-3e6b-46fb-bbde-0ab6f82ef775 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.048103 Oct 31 15:20:50.428219 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 803/1697] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:20:50 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f/ips/invalid => generated 91 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:20:50.433519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:50.433519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:50.439650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.440359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.440891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:50.441500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:50.442020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:50.442503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.190726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:51.198986 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5829b9a-0180-449a-93ea-27e2eaf8d437 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1471 microversion: 2.1 time: 0.770620 Oct 31 15:20:51.199775 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 804/1698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:50 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:51.219785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.220395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:51.226299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.226778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.227272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.228605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.229014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.229486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.358136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:51.365824 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa9a1874-bbd2-4786-b160-07172a6f2321 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1273 microversion: 2.1 time: 0.149820 Oct 31 15:20:51.366393 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 805/1699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:51.383105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.396547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.397059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.397514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.398221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.398673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.399098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.439622 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4443696-f446-46cc-87de-8a1c7d3d6341 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.072181 Oct 31 15:20:51.440223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 806/1700] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:20:51.446818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-511895dd-5537-42e3-9ce4-d11fcef05f00 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.447942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-511895dd-5537-42e3-9ce4-d11fcef05f00 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Failed to fetch instance by id 999 {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:20:51.448656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-511895dd-5537-42e3-9ce4-d11fcef05f00 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] HTTP exception thrown: Instance 999 could not be found. Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-511895dd-5537-42e3-9ce4-d11fcef05f00 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Request method failure captured: Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-e1ryvOFgTg3xPId9WccHpbQy-UaK5w9l55suNajSvWURPay_pgn9mtnV9ghy6BfZOppKerdH8LW44d53xC_9v0psse-pO-57MmuLy8S6rrvNQ5WJuE3mJ_VrPyaCm4dYOx-1Z13I6GgQM1-wmBedo2QooX9CpqmwKUnF_o-3Vkz-U Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 29a232779c6d41ef80716968c0d80b7d Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:20:51.450200 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 29a232779c6d41ef80716968c0d80b7d Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerAddressesNegativeTestJSON-1029053419-project Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: c221b01c0df24a48a1730002a9d3aae2 Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1029053419-project Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 999 could not be found. Oct 31 15:20:51.451820 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': '999'} Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 31 15:20:51.452671 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.454230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-511895dd-5537-42e3-9ce4-d11fcef05f00 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:51.456059 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-511895dd-5537-42e3-9ce4-d11fcef05f00 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013379 Oct 31 15:20:51.456869 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 807/1701] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:20:51.464550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.465302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] [instance: 973fea37-d308-4817-9f35-986c6e157132] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:51.474961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.475823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.476555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.477568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.478989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.479639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.497217 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] HTTP exception thrown: Instance 973fea37-d308-4817-9f35-986c6e157132 could not be found. Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Request method failure captured: Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 HTTP/1.1 Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-eAUyZQduvg_MZ2w0xZ95gbzqQR7TYTcDdy8YC8B_-tKzB2GbBiTKF4gTsVOPsEeH-kNbdHPH6k2adE1QsyulF9chlem6f-8qYcjnqzX5g0BPPYXd0iDn_igchitGkWWH78h6CKXy71IPP4ZSxaO-f8Mliz4vsg2oDmKwyue52HYcs Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 08df63f2dbf84fe79d057a786451404d Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestManualDisk-1488281855 Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:20:51.499609 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/08df63f2dbf84fe79d057a786451404d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08df63f2dbf84fe79d057a786451404d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_08df63f2dbf84fe79d057a786451404d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08df63f2dbf84fe79d057a786451404d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestManualDisk-1488281855 Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 08df63f2dbf84fe79d057a786451404d Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestManualDisk-1488281855 Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestManualDisk-1488281855-project Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d5fbe57fd4f443c980d1b44cad293dbf Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestManualDisk-1488281855-project Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 973fea37-d308-4817-9f35-986c6e157132 could not be found. Oct 31 15:20:51.501056 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '973fea37-d308-4817-9f35-986c6e157132'} Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973fea37-d308-4817-9f35-986c6e157132 could not be found. Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:51.501897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973fea37-d308-4817-9f35-986c6e157132 could not be found. Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973fea37-d308-4817-9f35-986c6e157132 could not be found. Oct 31 15:20:51.503176 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:51.505353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Returning 404 to user: Instance 973fea37-d308-4817-9f35-986c6e157132 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:51.507448 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4e13ba3-6aaf-4084-b6be-8f84ef0cc59e tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132" status: 404 len: 111 microversion: 2.1 time: 0.049411 Oct 31 15:20:51.508198 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 808/1702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/servers/973fea37-d308-4817-9f35-986c6e157132 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:51.514318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.515190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:51.525393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.526209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.526818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.527721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.528495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.529115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.681728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:51.693947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:51.696204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:51.702047 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73e4b414-e58d-44f2-a0e7-07baffc2dcbf tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.192371 Oct 31 15:20:51.702971 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 809/1703] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:51.708102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.708938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:51.715906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.716569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.717339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.718312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.718909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.719515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.080596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:52.102484 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e0f7a8b-edc0-4eb2-af46-ce6c3f97fce5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1308 microversion: 2.1 time: 0.397024 Oct 31 15:20:52.104798 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 810/1704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:52.121765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-17", "block_migration": "auto"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:52.125931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:52.146510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.147589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.148660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.150946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.151612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.153206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.234828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'flavor' on Instance uuid 4549f404-caee-4b2d-9dfb-256e1c495f24 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:52.256280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Going to try to live migrate instance to n-h2-858383-17 {{(pid=120626) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:20:52.317733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:52.444269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-06aebc76-feb1-437c-af07-d7b54aabcbe8 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/cf87d322-31c5-43c1-ba06-55ff50a3589a" status: 202 len: 0 microversion: 2.1 time: 2.056599 Oct 31 15:20:52.445185 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 895/1705] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:20:50 2022] DELETE /compute/v2.1/os-floating-ips/cf87d322-31c5-43c1-ba06-55ff50a3589a => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:52.452075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.452805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:52.467276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.474621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.475829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.476920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.478237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.478667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.533068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:52.676427 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-360217b2-8e04-441f-8b73-ace9d7ebf76d tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 204 len: 0 microversion: 2.1 time: 0.229535 Oct 31 15:20:52.677161 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 896/1706] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:52 2022] DELETE /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:52.685306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-632ad64e-a267-423a-b3e7-1c77b1bddcbe tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] Calling method '.version_select at 0x7f5ca2b088b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.706749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-632ad64e-a267-423a-b3e7-1c77b1bddcbe tempest-ServersTestManualDisk-1488281855 tempest-ServersTestManualDisk-1488281855-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315684071" status: 202 len: 0 microversion: 2.1 time: 0.027798 Oct 31 15:20:52.707327 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 897/1707] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315684071 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:52.715565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.716484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:52.727575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.727575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.727575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.728291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.728839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.729238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:53.098686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:53.108175 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23920284-ad68-460d-b30c-824f0bb28277 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1476 microversion: 2.1 time: 0.399284 Oct 31 15:20:53.109106 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 898/1708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:52 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:53.114394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:53.115016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:53.122851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:53.123442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:53.124129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:53.125350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:53.126160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:53.126931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:53.449103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:53.457717 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0d43d06-2c6f-4064-a27f-e935d5f57604 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 0.347426 Oct 31 15:20:53.458333 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 899/1709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:53 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:53.472628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f130b8b-3cf4-474a-b840-6f9bb96502d7 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] Calling method '.version_select at 0x7f5ca678d790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.446970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f130b8b-3cf4-474a-b840-6f9bb96502d7 tempest-FloatingIPDetailsTestJSON-134638949 tempest-FloatingIPDetailsTestJSON-134638949-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/d25489a6-1879-45a3-8f50-59e7edbfc64c" status: 202 len: 0 microversion: 2.1 time: 1.986879 Oct 31 15:20:55.451953 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 900/1710] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:20:53 2022] DELETE /compute/v2.1/os-floating-ips/d25489a6-1879-45a3-8f50-59e7edbfc64c => generated 0 bytes in 1993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:55.457419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.459628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:55.470619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.471692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.472474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.474969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.475729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.476816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.532043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69b73718-f392-48d0-a3f2-0bd1e6f4e266 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24/action" status: 202 len: 0 microversion: 2.25 time: 3.425863 Oct 31 15:20:55.533135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 811/1711] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:20:52 2022] POST /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24/action => generated 0 bytes in 3428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:55.539972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.540587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:55.544297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:55.568037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.573566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.578462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.579799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.587140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.587918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.606807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.607294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.613488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.614261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lazy-loading 'fault' on Instance uuid 89b136b9-5bf4-438e-849a-bbd2a80e172f {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:55.717234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c221b01c0df24a48a1730002a9d3aae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29a232779c6d41ef80716968c0d80b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.719515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.727277 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47f357b5-b791-4794-848b-d739e867a57a tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 200 len: 1315 microversion: 2.1 time: 0.271442 Oct 31 15:20:55.730440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 901/1712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:55 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:55.731395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.733329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.741463 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3251386d-9833-4673-813a-801c46b57860 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1533 microversion: 2.91 time: 0.206816 Oct 31 15:20:55.741670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.742644 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 812/1713] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:55 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1533 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:55.748998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:55.751236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-870c0bf5-be47-4d76-b622-7f8c828505d7 req-e1fb52b5-ebda-47a3-9deb-468176e207d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc05baad-c563-40ca-84f8-0b02ec59d60a", "tag": "0bfcf506-b745-416b-bdb1-2d378c05eeaf"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:55.765216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.766549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.768127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-870c0bf5-be47-4d76-b622-7f8c828505d7 req-e1fb52b5-ebda-47a3-9deb-468176e207d2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.768875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-870c0bf5-be47-4d76-b622-7f8c828505d7 req-e1fb52b5-ebda-47a3-9deb-468176e207d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.769515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.769961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-870c0bf5-be47-4d76-b622-7f8c828505d7 req-e1fb52b5-ebda-47a3-9deb-468176e207d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.770259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.771379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.775540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.783257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-870c0bf5-be47-4d76-b622-7f8c828505d7 req-e1fb52b5-ebda-47a3-9deb-468176e207d2 service nova] Creating event network-changed:0bfcf506-b745-416b-bdb1-2d378c05eeaf for instance dc05baad-c563-40ca-84f8-0b02ec59d60a on n-h1-858383-17 Oct 31 15:20:55.790502 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-870c0bf5-be47-4d76-b622-7f8c828505d7 req-e1fb52b5-ebda-47a3-9deb-468176e207d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046110 Oct 31 15:20:55.792241 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 813/1714] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:55.799266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.800510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:55.809596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.811360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.811984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.812928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.813582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.815276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.130716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.137031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.148294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6fa289a1-a51e-41e5-b434-5f024f239e45 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1476 microversion: 2.1 time: 0.354054 Oct 31 15:20:56.165541 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 814/1715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:55 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:56.165541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d9a04b6a-da85-49c6-9cc0-e7bfaa52a76b req-5ebdfaaf-205a-4bb8-8722-c29755c3d1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a045a089-2ade-4888-aff0-4e067941cb23", "name": "network-vif-plugged", "status": "completed", "tag": "b7268098-5fbf-433c-afa2-19ac9e1c6d17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:56.178334 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-097b70f8-8d82-4185-898b-b80499a10349 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1308 microversion: 2.1 time: 0.445226 Oct 31 15:20:56.178949 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 902/1716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:55 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:56.184822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.185749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.193801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.198138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d9a04b6a-da85-49c6-9cc0-e7bfaa52a76b req-5ebdfaaf-205a-4bb8-8722-c29755c3d1c1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.199120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.199538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d9a04b6a-da85-49c6-9cc0-e7bfaa52a76b req-5ebdfaaf-205a-4bb8-8722-c29755c3d1c1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.200035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d9a04b6a-da85-49c6-9cc0-e7bfaa52a76b req-5ebdfaaf-205a-4bb8-8722-c29755c3d1c1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.200548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.204027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.204588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.205265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.221656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d9a04b6a-da85-49c6-9cc0-e7bfaa52a76b req-5ebdfaaf-205a-4bb8-8722-c29755c3d1c1 service nova] Creating event network-vif-plugged:b7268098-5fbf-433c-afa2-19ac9e1c6d17 for instance a045a089-2ade-4888-aff0-4e067941cb23 on n-h2-858383-17 Oct 31 15:20:56.233227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d9a04b6a-da85-49c6-9cc0-e7bfaa52a76b req-5ebdfaaf-205a-4bb8-8722-c29755c3d1c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080988 Oct 31 15:20:56.234674 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 815/1717] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:56.263435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-14cc20c5-f341-4122-a74c-05f39285a59c req-074946a7-d510-4e9d-b572-183c0a2c0006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b136b9-5bf4-438e-849a-bbd2a80e172f", "name": "network-vif-deleted", "tag": "5a53abe6-7804-4cdb-af34-95e415457938"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:56.299310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-14cc20c5-f341-4122-a74c-05f39285a59c req-074946a7-d510-4e9d-b572-183c0a2c0006 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.300789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-14cc20c5-f341-4122-a74c-05f39285a59c req-074946a7-d510-4e9d-b572-183c0a2c0006 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.301418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-14cc20c5-f341-4122-a74c-05f39285a59c req-074946a7-d510-4e9d-b572-183c0a2c0006 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.314518 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-14cc20c5-f341-4122-a74c-05f39285a59c req-074946a7-d510-4e9d-b572-183c0a2c0006 service nova] Creating event network-vif-deleted:5a53abe6-7804-4cdb-af34-95e415457938 for instance 89b136b9-5bf4-438e-849a-bbd2a80e172f on n-h2-858383-17 Oct 31 15:20:56.321651 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-14cc20c5-f341-4122-a74c-05f39285a59c req-074946a7-d510-4e9d-b572-183c0a2c0006 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083889 Oct 31 15:20:56.323264 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 816/1718] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:56.328690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.329785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.337965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.338469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.338907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.340317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.340317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.340836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.516283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.525753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82381eed-24de-4c99-9429-a8c96c9924b7 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 0.344956 Oct 31 15:20:56.531535 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 903/1719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:56.552831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.553857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.562039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.563116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.563774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.564722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.565438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.566733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.654166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.663746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.665312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.666854 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9576f612-a31d-4b60-b7dc-98992bafc9ae tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.342289 Oct 31 15:20:56.667429 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 817/1720] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:56.755394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.758304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] [instance: 89b136b9-5bf4-438e-849a-bbd2a80e172f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.771368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.771719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lazy-loading 'services' on Instance uuid f88dff41-8ec3-4d48-9a13-6fe19f53512a {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:56.773956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.775403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.780158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.780811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.783899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.806667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13884bcd-898c-44dc-be1b-ecee28bde0d0 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1940 microversion: 2.91 time: 0.259789 Oct 31 15:20:56.818464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] HTTP exception thrown: Instance 89b136b9-5bf4-438e-849a-bbd2a80e172f could not be found. Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Request method failure captured: Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f HTTP/1.1 Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-e1ryvOFgTg3xPId9WccHpbQy-UaK5w9l55suNajSvWURPay_pgn9mtnV9ghy6BfZOppKerdH8LW44d53xC_9v0psse-pO-57MmuLy8S6rrvNQ5WJuE3mJ_VrPyaCm4dYOx-1Z13I6GgQM1-wmBedo2QooX9CpqmwKUnF_o-3Vkz-U Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 29a232779c6d41ef80716968c0d80b7d Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:20:56.820562 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29a232779c6d41ef80716968c0d80b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 29a232779c6d41ef80716968c0d80b7d Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1029053419 Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerAddressesNegativeTestJSON-1029053419-project Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: c221b01c0df24a48a1730002a9d3aae2 Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1029053419-project Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 89b136b9-5bf4-438e-849a-bbd2a80e172f could not be found. Oct 31 15:20:56.822636 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '89b136b9-5bf4-438e-849a-bbd2a80e172f'} Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b136b9-5bf4-438e-849a-bbd2a80e172f could not be found. Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:56.823423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b136b9-5bf4-438e-849a-bbd2a80e172f could not be found. Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b136b9-5bf4-438e-849a-bbd2a80e172f could not be found. Oct 31 15:20:56.824659 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:20:56.825788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] Returning 404 to user: Instance 89b136b9-5bf4-438e-849a-bbd2a80e172f could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:56.826525 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb4a6eec-ba02-4552-9241-6fcb15ca7575 tempest-ServerAddressesNegativeTestJSON-1029053419 tempest-ServerAddressesNegativeTestJSON-1029053419-project] 10.222.0.48 "GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f" status: 404 len: 111 microversion: 2.1 time: 0.076300 Oct 31 15:20:56.832056 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 818/1721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/89b136b9-5bf4-438e-849a-bbd2a80e172f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:56.834366 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 904/1722] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1940 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:56.840222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:56.840803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.864120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.864627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.865107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.865809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.866269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.866696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.892672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lazy-loading 'flavor' on Instance uuid f88dff41-8ec3-4d48-9a13-6fe19f53512a {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:57.182898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6da0625e-1667-4d1e-9239-4e5d0c8d5578 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action" status: 202 len: 0 microversion: 2.91 time: 0.346814 Oct 31 15:20:57.190187 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 819/1723] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:20:56 2022] POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:57.201961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:57.204343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:57.217576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:57.218360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:57.222846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.225367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.226270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.226434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.227116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.228849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.229037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.230140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.230818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.230960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.231524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.232047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.342544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:57.350942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:57.352385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:57.357945 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7a707bf-dac4-4998-a655-6fdd89567e1c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.162366 Oct 31 15:20:57.358916 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 820/1724] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:57 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:57.363637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:57.364233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:57.371122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.371823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.372460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.373345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.373972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.374577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.416331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:57.470920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:57.675998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:57.688019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85f606ef-77a1-4516-8995-246c2ad82a8b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1476 microversion: 2.1 time: 0.518929 Oct 31 15:20:57.706254 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 905/1725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:57 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:57.731444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:57.734597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:57.754882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.755699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.756313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.757248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.761576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.762237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.808934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:58.317171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:58.329349 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8bdadbfa-6c0f-4336-b00c-d5727169a4ed tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1308 microversion: 2.1 time: 0.969054 Oct 31 15:20:58.330122 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 821/1726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:57 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1308 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:58.335197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:58.336054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:58.344401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.345708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.346968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.348515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.349651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.351428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.882186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:58.899930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4782416-7da1-48ef-a83b-4f05097783ae tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 1.190561 Oct 31 15:20:58.901631 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 906/1727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:57 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:58.907154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:58.908039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:58.934244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.934845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.935524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.936577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.937338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.940353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.992463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.003790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.005961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.007720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-95026bc3-7cc2-4334-88aa-e221231873ac tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.676004 Oct 31 15:20:59.009687 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 822/1728] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:58 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:59.026917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:59.032641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:59.049092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:59.049705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:59.051591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:59.052419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:59.054927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:59.056275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:59.185108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.199593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.203539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.216061 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-558260f3-83af-4f8f-b690-a20693ae4d45 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.313244 Oct 31 15:20:59.217041 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 907/1729] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:58 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:59.362666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:59.363755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:59.371689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:59.372426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:59.373067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:59.374128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:59.374749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:59.375424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:59.888773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.909356 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e90e3588-db9c-4e50-b610-a0730a7e09df tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1476 microversion: 2.1 time: 0.898531 Oct 31 15:20:59.909945 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 823/1730] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:59 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1476 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:59.927566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:59.928298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:59.942265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:59.942765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:59.943198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:59.943920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:59.944380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:59.944832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.126929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:00.135975 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34d861c6-08a7-47a2-8090-f25b664882cf tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1489 microversion: 2.1 time: 0.781267 Oct 31 15:21:00.136565 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 908/1731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:59 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1489 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:00.154027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:00.154940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:00.185967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.186694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.188377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.189367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.201485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.202381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.575666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:00.598954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01e28395-5cc8-41c2-8764-cea348c4b718 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 0.679823 Oct 31 15:21:00.605929 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 824/1732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:59 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:00.613560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:00.614370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:00.625071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.625966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.626625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.627670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.629501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.630351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.660292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lazy-loading 'flavor' on Instance uuid a045a089-2ade-4888-aff0-4e067941cb23 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:00.779451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6dc0d85e-15b0-4e7a-8899-48fdcf8d80b5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23/action" status: 202 len: 0 microversion: 2.1 time: 0.171139 Oct 31 15:21:00.785779 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 825/1733] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:00 2022] POST /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:00.794213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:00.795372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:00.802435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.803619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.804245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.805707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.806589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.807090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.827129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:00.835255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:00.842569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:00.844028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:00.845298 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-995c7587-6305-4a10-9b3c-24fd43f2db0d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.703504 Oct 31 15:21:00.845862 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 909/1734] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:00 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:00.850529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:00.851130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:00.866785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.869408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.870564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.870675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.879117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.879661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.032031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.041532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.042935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.060651 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21d559e2-3269-400b-af7d-40e3f9246508 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.272763 Oct 31 15:21:01.067107 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 826/1735] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:00 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:01.088975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:01.089903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:01.114704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.115459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.116068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.117005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.117626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.118801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.406353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:01.466442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.478186 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a1fa0a7-42b0-47da-9c32-0656f8bb4cfe tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1497 microversion: 2.1 time: 0.630451 Oct 31 15:21:01.479930 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 910/1736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:00 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1497 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:01.622948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.633154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5752b8b4-747d-4777-b2ec-2800daf59ed1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1476 microversion: 2.1 time: 0.564693 Oct 31 15:21:01.633549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:01.634938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:01.636583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 827/1737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:01 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1476 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:01.668087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.669308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.669994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.671696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.672554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.673330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.873682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:01.874512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:01.891182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.891943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.892571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.893515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.894138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.894727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.598623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.609563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.613125 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf53170b-d370-49eb-b3e6-b91fa0353f66 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 0.989201 Oct 31 15:21:02.614044 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 911/1738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:01 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:02.618869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.619482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:02.630262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.632181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.634497 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd97b82c-986c-4248-a41e-ce4f3653d935 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.766076 Oct 31 15:21:02.649929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.649929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.649929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.649929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.650573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.650573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.651504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 828/1739] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:01 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:02.659545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d3499fb8-a9ee-415a-b8f5-feb4dc00cbe4 req-08ab21db-a903-4b0b-9b4f-50ab6b107cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc05baad-c563-40ca-84f8-0b02ec59d60a", "name": "network-vif-plugged", "status": "completed", "tag": "0bfcf506-b745-416b-bdb1-2d378c05eeaf"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:02.673544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d3499fb8-a9ee-415a-b8f5-feb4dc00cbe4 req-08ab21db-a903-4b0b-9b4f-50ab6b107cea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.674322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d3499fb8-a9ee-415a-b8f5-feb4dc00cbe4 req-08ab21db-a903-4b0b-9b4f-50ab6b107cea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.674934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d3499fb8-a9ee-415a-b8f5-feb4dc00cbe4 req-08ab21db-a903-4b0b-9b4f-50ab6b107cea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.690396 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d3499fb8-a9ee-415a-b8f5-feb4dc00cbe4 req-08ab21db-a903-4b0b-9b4f-50ab6b107cea service nova] Creating event network-vif-plugged:0bfcf506-b745-416b-bdb1-2d378c05eeaf for instance dc05baad-c563-40ca-84f8-0b02ec59d60a on n-h1-858383-17 Oct 31 15:21:02.697144 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d3499fb8-a9ee-415a-b8f5-feb4dc00cbe4 req-08ab21db-a903-4b0b-9b4f-50ab6b107cea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043035 Oct 31 15:21:02.698832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 829/1740] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:02.706376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.707290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:02.715965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.716747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.717380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.718256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.719344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.719937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.835793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.853187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.855299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.867380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee8c7b74-cd91-45c2-b4cd-52cc43dfa071 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.252139 Oct 31 15:21:02.869528 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 912/1741] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:02.878364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.883907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:02.900022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.900990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.901587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.903022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.903683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.904284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.203660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:03.225182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e512652-4c43-422d-91d4-adb297143511 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 200 len: 1480 microversion: 2.1 time: 0.524877 Oct 31 15:21:03.243723 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 830/1742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 1480 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:03.254655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-522132339"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:03.258643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:03.269201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.270517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.271103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.271995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.273585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.274221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.424145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:03.440020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2aac467-4ed4-4936-851d-1090a11c7fa9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1476 microversion: 2.1 time: 0.567835 Oct 31 15:21:03.442772 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 913/1743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1476 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:03.639778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:03.640530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:03.658485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.660115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.663286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.667570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.668306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.669622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.789301 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ada7230-39f5-4481-b87e-9ea87dfc23b9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23/action" status: 202 len: 0 microversion: 2.1 time: 0.539402 Oct 31 15:21:03.790594 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 831/1744] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:03 2022] POST /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:21:03.805952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:03.806816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:03.842337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.842831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.847511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.848543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.857325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.858090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.453638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.468584 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-963ccd53-e6ab-497a-ba59-e75958bc5d5b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 0.831868 Oct 31 15:21:04.470715 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 914/1745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:03 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:04.489725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a55e44e-b11d-4bf5-8833-f4262e8d3050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca67c9ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.565456 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a55e44e-b11d-4bf5-8833-f4262e8d3050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.091670 Oct 31 15:21:04.566705 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 915/1746] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:04 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:04.575233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.576283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:04.585517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:04.589578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.590353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.591971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.593192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.594069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.594819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.648065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.661261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.663938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.667025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e13b13e-c5ea-418e-94b5-3941d2bf7ff6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.866439 Oct 31 15:21:04.690723 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 832/1747] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:03 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:05.002794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:05.015086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:05.021773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:05.038527 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f765cd8f-fe74-4cea-b224-7e7d07c1652b tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.469559 Oct 31 15:21:05.039123 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 916/1748] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:04 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:05.278040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.278969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:05.289134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:05.292753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:05.294767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:05.295732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:05.298008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:05.299529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:05.497231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.497981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:05.509806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:05.510485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:05.513227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:05.514439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:05.515137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:05.516300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:05.856122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:05.869220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fb37ed9-9d54-4a40-8b81-ead0bf1ba7f9 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1475 microversion: 2.1 time: 1.176973 Oct 31 15:21:05.870059 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 833/1749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:04 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1475 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:05.901158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4c76e68-5c4c-4b72-a556-11f160148425 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca6726430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.976283 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4c76e68-5c4c-4b72-a556-11f160148425 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.105349 Oct 31 15:21:05.985266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 834/1750] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:05 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:05.985266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.985266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:06.000051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.000556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.001028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.001748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.002208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.002641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.729306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.745035 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c390900-2bbb-49bd-876c-669d49c2fd00 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1315 microversion: 2.1 time: 1.250051 Oct 31 15:21:06.767566 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 917/1751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:05 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1315 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:06.982646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.999915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:07.010112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:07.014332 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a5a67ec2-284f-4bd6-bb2c-ae75f034fdbf tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 1.034594 Oct 31 15:21:07.016398 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 835/1752] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:05 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:07.034221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Calling method '.version_select at 0x7f5ca67c9c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.069244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.072870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:07.093555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.094136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.095324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.096040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.096915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.097258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.098302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.098688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.098839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.099220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.099791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.100435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.197675 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec757167-0b85-4bc8-bd40-3ba9d9d2c219 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.426318 Oct 31 15:21:07.200791 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 918/1753] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.215182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.216096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:07.235595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.237354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.237817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.241380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.242873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.244147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.589561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:07.598958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:07.600407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:07.630918 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-abfdcbfc-0199-4e56-8d4f-f66ec5170c84 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.612962 Oct 31 15:21:07.632355 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 836/1754] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:07.650250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1185abcf-f87d-4d50-a56d-db7df122a428 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca669db80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.728709 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1185abcf-f87d-4d50-a56d-db7df122a428 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.093100 Oct 31 15:21:07.729378 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 837/1755] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:07.746605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "name": "network-vif-unplugged", "status": "completed", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:07.782518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.783032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.783470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.830455 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] Creating event network-vif-unplugged:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h2-858383-17 Oct 31 15:21:07.862746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] Instance 46bb8c6e-f156-4a62-be80-15f50de92695 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:21:07.918754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-dcfb1eb1-435f-40a2-b845-806aeb45ab94 req-0d5c9d37-b45d-4706-9778-731fdd515f86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182472 Oct 31 15:21:07.919621 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 838/1756] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.934228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2705765", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:08.087722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:08.262963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:08.277699 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-203629a5-3e9a-4382-8fcc-db6892a8eec2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1475 microversion: 2.1 time: 1.074677 Oct 31 15:21:08.286165 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 919/1757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1475 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:08.303549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.304573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:08.312256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.313113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.313782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.314770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.315449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.316354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.002917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.013019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99fd5850-ea0d-4515-abed-0de409d7c900 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1503 microversion: 2.1 time: 0.725345 Oct 31 15:21:09.029139 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 920/1758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:08 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1503 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:09.040601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.041525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:09.051269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Getting quotas for project 3e981a589b674acc96cc40e28f52e99c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:09.051658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.052346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.053004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.053890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.054527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.055656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.073293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Getting quotas for user 559157fc3a13498993ce0c43a15302e9 and project 3e981a589b674acc96cc40e28f52e99c. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:09.105956 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Request method failure captured: Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 1749 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fh4gx-83XcOd0s--Uq854rMgYqvzTIF_A9vYSiCSJmFRS3UZ-xW8aldfCrY3tlYOgLAJxTCQDMgCyOEdNrco-q7x78nvi8xVpeUQiFkh5VukAqxeRneJfHaI7c8dUj12vKKvtSoGuGqKdQR04fFN2lVbgZP99467oRf9gNoqdDOU8 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3e981a589b674acc96cc40e28f52e99c Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-144010544 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3e981a589b674acc96cc40e28f52e99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e981a589b674acc96cc40e28f52e99c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3e981a589b674acc96cc40e28f52e99c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e981a589b674acc96cc40e28f52e99c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-144010544 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3e981a589b674acc96cc40e28f52e99c Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-144010544 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-144010544-project Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 559157fc3a13498993ce0c43a15302e9 Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-144010544-project Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2705765", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:21:09.109545 n-d-858383-17 devstack@n-api.service[120626]: exception: Maximum number of metadata items exceeds 128 Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2705765', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:09.112035 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 31 15:21:09.115126 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.118967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:09.120117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f9911de-959b-44ee-a8ae-c96d87558dc7 tempest-AbsoluteLimitsNegativeTestJSON-144010544 tempest-AbsoluteLimitsNegativeTestJSON-144010544-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.199507 Oct 31 15:21:09.121270 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 839/1759] 10.222.0.48 () {60 vars in 1148 bytes} [Mon Oct 31 15:21:07 2022] POST /compute/v2.1/servers => generated 87 bytes in 1201 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:21:09.127303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.128586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:09.138860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.139862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.140713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.141986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.142992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.143687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.351150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.412036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.422729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.456433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.469603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.479037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.485735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-910bcbe4-2dae-4a8f-8c79-885d7d95bfe5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.452051 Oct 31 15:21:09.486384 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 921/1760] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:09 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:09.489772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a46c06a-7fe0-42d6-85d6-087bd57bbcb7 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.357082 Oct 31 15:21:09.492656 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 840/1761] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:09 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:09.519450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a3d699f7-c7d4-44c6-ba34-d00b4b380824 req-27f664ab-87bd-4a51-8567-ca4c49573319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a045a089-2ade-4888-aff0-4e067941cb23", "name": "network-vif-plugged", "status": "completed", "tag": "b7268098-5fbf-433c-afa2-19ac9e1c6d17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:09.526215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b4d74524-742b-4a67-9e1a-0b9a0d89c089 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca6823310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.593243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3d699f7-c7d4-44c6-ba34-d00b4b380824 req-27f664ab-87bd-4a51-8567-ca4c49573319 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.596393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3d699f7-c7d4-44c6-ba34-d00b4b380824 req-27f664ab-87bd-4a51-8567-ca4c49573319 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.598822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3d699f7-c7d4-44c6-ba34-d00b4b380824 req-27f664ab-87bd-4a51-8567-ca4c49573319 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.612408 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b4d74524-742b-4a67-9e1a-0b9a0d89c089 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.106459 Oct 31 15:21:09.617038 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 922/1762] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:09 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:09.628148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.632007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:09.642000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a3d699f7-c7d4-44c6-ba34-d00b4b380824 req-27f664ab-87bd-4a51-8567-ca4c49573319 service nova] Creating event network-vif-plugged:b7268098-5fbf-433c-afa2-19ac9e1c6d17 for instance a045a089-2ade-4888-aff0-4e067941cb23 on n-h2-858383-17 Oct 31 15:21:09.658753 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a3d699f7-c7d4-44c6-ba34-d00b4b380824 req-27f664ab-87bd-4a51-8567-ca4c49573319 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159025 Oct 31 15:21:09.659956 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 841/1763] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:09.676347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.678207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:09.694221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.694892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.697120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.698646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.700748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.701257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.701585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.703347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.705663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.706916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.709257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.710195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.810902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:10.070158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:10.082560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-357c28e3-8915-4a7d-b5e8-4f7a6e1fcd27 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1473 microversion: 2.1 time: 0.421161 Oct 31 15:21:10.093411 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 842/1764] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:09 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1473 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:10.113507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:10.133699 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12fd18b9-217d-4116-aaa5-9d03a9a60d02 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 204 len: 0 microversion: 2.1 time: 0.509068 Oct 31 15:21:10.141274 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 923/1765] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:09 2022] DELETE /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:10.142158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.144362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.144828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.174844 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] Creating event network-changed:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h2-858383-17 Oct 31 15:21:10.176468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.177926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:10.184584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.185346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.185986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.186856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.187461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.188046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.191191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] Instance 46bb8c6e-f156-4a62-be80-15f50de92695 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:21:10.193629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:10.214213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-857ce1b4-31f9-4084-b92a-8636b73a06cf req-ec5fee2f-5390-440e-ac61-566163833f96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117096 Oct 31 15:21:10.215774 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 843/1766] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:10.515574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.516508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:10.527969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.529350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.537392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.538413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.539200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.539912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.588467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:10.597102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a63c969d-75c5-4d39-a610-432c3e240ce5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1509 microversion: 2.1 time: 0.451000 Oct 31 15:21:10.612726 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 924/1767] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:10 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:10.612726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.612726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:10.626917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.629565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.630054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.630795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.631270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.638855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.928602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:10.951437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:10.963999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:10.978963 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a8aa7a3-d626-41b0-bb07-352fe83c61a9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.373868 Oct 31 15:21:10.982823 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 925/1768] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:10 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:10.993182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8428d57-138b-465e-aadc-3bf6c028283e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca678d310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.075783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.090988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.094255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.097588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a3228906-1f22-4e2a-8084-f9f8b92c0fe6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.586235 Oct 31 15:21:11.100849 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 844/1769] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:10 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:21:11.118193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.119833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.130094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.134062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.134768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.135702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.136396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.137034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.142622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8428d57-138b-465e-aadc-3bf6c028283e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.157745 Oct 31 15:21:11.151194 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 926/1770] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:10 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:11.633472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.640294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.657707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.668413 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c45cb36f-07d6-4e5c-a700-f1bad381d8d1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1470 microversion: 2.1 time: 0.554731 Oct 31 15:21:11.669582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.670264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.672854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.674918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.675952 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 845/1771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:11 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1470 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:11.676323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.677281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.726200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:11.729124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.797130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.804461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.806557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.807352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.807840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.808291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.960661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:12.218295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2408613d-c1ac-468a-8f50-2ce5c236567b tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "POST /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695/action" status: 202 len: 0 microversion: 2.1 time: 0.502559 Oct 31 15:21:12.220409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 846/1772] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:11 2022] POST /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:12.229532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.230871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:12.241736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.243051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.243971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.245297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.246879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.247549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.566964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.581024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.582352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.597705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2eff537c-5ee1-4359-ac4a-a60d351a420e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.375627 Oct 31 15:21:12.601462 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 847/1773] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:12 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:12.616583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.617284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:12.633426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.633426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.634239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.637818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.641196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.642273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.037547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:13.099310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1bea4153-ebcf-4460-8d03-2e730827096a tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1509 microversion: 2.1 time: 1.470503 Oct 31 15:21:13.100134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 927/1774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:11 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1509 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:13.120927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63f17dc9-fc70-4e53-b184-75c214ce43bb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca24bc040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:13.222640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63f17dc9-fc70-4e53-b184-75c214ce43bb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.120086 Oct 31 15:21:13.225168 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 928/1775] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:13 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:13.245057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:13.247412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:13.259533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.260343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.261179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.267279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.268252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.269007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.538060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.547829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.550675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.560722 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a72197c-1646-4344-b51a-31da6ffdcbf9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 1.953485 Oct 31 15:21:14.562144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 848/1776] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:12 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:14.568573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:14.577141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:14.583804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.589220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.589928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.590798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.591376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.591932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.923179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.938539 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe8cece4-ed76-4563-a694-17227747718c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1469 microversion: 2.1 time: 1.707377 Oct 31 15:21:14.956590 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 929/1777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:13 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1469 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:14.973496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:14.974426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:14.996126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.997135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.997825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.999026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.999713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.001919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.269447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:15.315924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:15.325670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:15.356068 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d1b2bdb-606b-4fc2-874b-74c1d882158e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.786945 Oct 31 15:21:15.363862 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 849/1778] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:14 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:15.416758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9526b0356b7c4aad9e37b40f20bc2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c9aaf35cf944028a4aca205aaec129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:15.435163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6dc9bcc0-c8b2-4aec-8edb-7a44766aeec2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1d88af0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:15.438390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2aecfc8a-0458-4815-b156-7d4fae3df43d tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 200 len: 1467 microversion: 2.1 time: 0.477829 Oct 31 15:21:15.453899 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 930/1779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:14 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 1467 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:15.454416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "name": "network-vif-plugged", "status": "completed", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:15.496346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.498509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.503622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.552323 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] Creating event network-vif-plugged:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h2-858383-17 Oct 31 15:21:15.575882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] Instance 46bb8c6e-f156-4a62-be80-15f50de92695 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:21:15.587853 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6dc9bcc0-c8b2-4aec-8edb-7a44766aeec2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.220479 Oct 31 15:21:15.588996 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 850/1780] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:15 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:15.595014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c4ec267c-6f18-4fc9-bd43-69cfaca189ed req-4867cf50-260b-4cfe-9f0c-3fdb634c239c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc05baad-c563-40ca-84f8-0b02ec59d60a", "name": "network-vif-deleted", "tag": "0bfcf506-b745-416b-bdb1-2d378c05eeaf"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:15.610032 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3349f5b5-9893-45e9-986f-aa9415e6380e req-37bf3b2e-53b2-44d6-85f3-355832844f18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164908 Oct 31 15:21:15.613085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 931/1781] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:15.625404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c4ec267c-6f18-4fc9-bd43-69cfaca189ed req-4867cf50-260b-4cfe-9f0c-3fdb634c239c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.626160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c4ec267c-6f18-4fc9-bd43-69cfaca189ed req-4867cf50-260b-4cfe-9f0c-3fdb634c239c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.627336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c4ec267c-6f18-4fc9-bd43-69cfaca189ed req-4867cf50-260b-4cfe-9f0c-3fdb634c239c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.631251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:15.634326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:15.651634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.654174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.657253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.658295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.658938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.660063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.668139 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c4ec267c-6f18-4fc9-bd43-69cfaca189ed req-4867cf50-260b-4cfe-9f0c-3fdb634c239c service nova] Creating event network-vif-deleted:0bfcf506-b745-416b-bdb1-2d378c05eeaf for instance dc05baad-c563-40ca-84f8-0b02ec59d60a on n-h1-858383-17 Oct 31 15:21:15.711024 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c4ec267c-6f18-4fc9-bd43-69cfaca189ed req-4867cf50-260b-4cfe-9f0c-3fdb634c239c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120573 Oct 31 15:21:15.721725 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 851/1782] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:15.966511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:15.967768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:15.977162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:15.981479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.982269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.982936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.984030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.985060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.985704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:16.860345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:16.877829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:16.897321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:16.916217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64c03e9c-034f-4e83-bf1c-851624756cca tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 1.297836 Oct 31 15:21:16.921662 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 932/1783] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:15 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:16.949311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:16.951102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:16.990658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:16.996537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.000471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.006965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.008715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.014557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.113247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:17.194553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:17.322671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:17.328852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:17.345170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:17.346614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:17.356034 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-48110ec9-689f-4771-abf5-b8c430ddbc24 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1469 microversion: 2.1 time: 1.396672 Oct 31 15:21:17.356645 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 852/1784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:15 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1469 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:17.381040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:17.381699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:17.392328 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f22b2c45-c6d2-40b9-bce8-ebb189e8eff8 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.467884 Oct 31 15:21:17.393868 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 933/1785] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:16 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:17.404755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.405499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.406169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.412275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-adab6cb9-ae52-4100-957a-c22aa12d1fb2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca67c9dc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:17.424172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.426933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.430879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.490300 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a HTTP/1.1 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'dc05baad-c563-40ca-84f8-0b02ec59d60a'} Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:17.509841 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.515596 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.518030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:17.520660 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-923cbfec-b378-4036-8d5e-a1800014f562 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 404 len: 111 microversion: 2.1 time: 0.158900 Oct 31 15:21:17.523192 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 853/1786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:17 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:17.541753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-adab6cb9-ae52-4100-957a-c22aa12d1fb2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.146133 Oct 31 15:21:17.550245 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 934/1787] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:17 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:17.589277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-296876635", "metadata": {"image_type": "test"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:17.608537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:17.650123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.656925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.661178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.662897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.668666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.672060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.722351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a/action HTTP/1.1 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 111 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-296876635", "metadata": {"image_type": "test"}}} Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'dc05baad-c563-40ca-84f8-0b02ec59d60a', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-296876635', 'metadata': {'image_type': 'test'}}}} Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:21:17.749319 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:17.753769 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.763300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:17.769055 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d145f319-68ca-407a-83b6-c3cf6ba550f5 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "POST /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a/action" status: 404 len: 111 microversion: 2.1 time: 0.215364 Oct 31 15:21:17.780261 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 935/1788] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Oct 31 15:21:17 2022] POST /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a/action => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:17.799478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd62ace0-143c-46cf-9bcb-9965a9b704f1 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1757614568", "metadata": {"image_type": "test"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:17.817610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd62ace0-143c-46cf-9bcb-9965a9b704f1 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Failed to fetch instance by id tempest-invalid-814575573 {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:21:17.818192 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cd62ace0-143c-46cf-9bcb-9965a9b704f1 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance tempest-invalid-814575573 could not be found. Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd62ace0-143c-46cf-9bcb-9965a9b704f1 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/tempest-invalid-814575573/action HTTP/1.1 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 112 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1757614568", "metadata": {"image_type": "test"}}} Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance tempest-invalid-814575573 could not be found. Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'tempest-invalid-814575573', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1757614568', 'metadata': {'image_type': 'test'}}}} Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-814575573 could not be found. Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:17.842029 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-814575573 could not be found. Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-814575573 could not be found. Oct 31 15:21:17.848978 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:17.852529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd62ace0-143c-46cf-9bcb-9965a9b704f1 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance tempest-invalid-814575573 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:17.859878 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd62ace0-143c-46cf-9bcb-9965a9b704f1 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "POST /compute/v2.1/servers/tempest-invalid-814575573/action" status: 404 len: 100 microversion: 2.1 time: 0.070032 Oct 31 15:21:17.865149 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 936/1789] 10.222.0.48 () {60 vars in 1246 bytes} [Mon Oct 31 15:21:17 2022] POST /compute/v2.1/servers/tempest-invalid-814575573/action => generated 100 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:17.873728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5e125d71-dd20-48bd-8a13-121b61c0e4a6 req-06476f0d-b8d9-4487-8cec-4052a5067b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549f404-caee-4b2d-9dfb-256e1c495f24", "name": "network-vif-unplugged", "status": "completed", "tag": "b2f00f75-e50d-44ae-a608-b5296991a22f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:17.906589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5e125d71-dd20-48bd-8a13-121b61c0e4a6 req-06476f0d-b8d9-4487-8cec-4052a5067b1a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.911307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5e125d71-dd20-48bd-8a13-121b61c0e4a6 req-06476f0d-b8d9-4487-8cec-4052a5067b1a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.912681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5e125d71-dd20-48bd-8a13-121b61c0e4a6 req-06476f0d-b8d9-4487-8cec-4052a5067b1a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.935526 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5e125d71-dd20-48bd-8a13-121b61c0e4a6 req-06476f0d-b8d9-4487-8cec-4052a5067b1a service nova] Creating event network-vif-unplugged:b2f00f75-e50d-44ae-a608-b5296991a22f for instance 4549f404-caee-4b2d-9dfb-256e1c495f24 on n-h1-858383-17 Oct 31 15:21:17.971029 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5e125d71-dd20-48bd-8a13-121b61c0e4a6 req-06476f0d-b8d9-4487-8cec-4052a5067b1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103997 Oct 31 15:21:17.984092 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 937/1790] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:18.021809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd95b8aa-28e1-43ba-b0dd-1563e1cfcc2b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-909234678"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:18.026895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd95b8aa-28e1-43ba-b0dd-1563e1cfcc2b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:21:18.034716 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-fd95b8aa-28e1-43ba-b0dd-1563e1cfcc2b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd95b8aa-28e1-43ba-b0dd-1563e1cfcc2b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 56 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: {"createImage": {"name": "tempest-test-snap-909234678"}} Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-909234678'}}} Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.039291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.044820 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.049740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd95b8aa-28e1-43ba-b0dd-1563e1cfcc2b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:18.053862 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd95b8aa-28e1-43ba-b0dd-1563e1cfcc2b tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.065506 Oct 31 15:21:18.055981 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 938/1791] 10.222.0.48 () {60 vars in 1275 bytes} [Mon Oct 31 15:21:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:18.066485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:18.074455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:18.105286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:18.106191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:18.108470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:18.112964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:18.113678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:18.115273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:18.249465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1926206216", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:18.402673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:18.896628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:18.914246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:18.915887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:18.917235 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-877e918d-90ab-4f64-859a-8be3b5c92871 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 0.860001 Oct 31 15:21:18.920488 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 939/1792] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:18 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:18.927433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-364bc725-3161-465c-b043-b11f81a1a9ec tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-918015587"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:18.939490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-364bc725-3161-465c-b043-b11f81a1a9ec tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:21:18.940077 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-364bc725-3161-465c-b043-b11f81a1a9ec tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-364bc725-3161-465c-b043-b11f81a1a9ec tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 56 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: {"createImage": {"name": "tempest-test-snap-918015587"}} Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-918015587'}}} Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.941722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-364bc725-3161-465c-b043-b11f81a1a9ec tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-364bc725-3161-465c-b043-b11f81a1a9ec tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021595 Oct 31 15:21:18.947292 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 940/1793] 10.222.0.48 () {60 vars in 1281 bytes} [Mon Oct 31 15:21:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:18.962766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:18.963459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:18.978372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:18.978872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:18.981752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:18.982487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:18.985353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:18.985987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.089049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:19.326016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:19.341729 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-883fb983-222b-460f-aac2-54b080feab13 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1469 microversion: 2.1 time: 0.380736 Oct 31 15:21:19.342628 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 941/1794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:18 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:19.363439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.364373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:19.383542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.384232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.384866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.385773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.386388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.386971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.608854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:19.627430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:19.631154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:19.645264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36660601-7fc7-4ecf-90f8-9eb231ce6378 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.300556 Oct 31 15:21:19.646419 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 942/1795] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:19 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:19.682219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-210cf380-c527-484a-bbd0-18cdd9abc8fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca68263a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.773493 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-210cf380-c527-484a-bbd0-18cdd9abc8fc tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.110090 Oct 31 15:21:19.776575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 943/1796] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:19 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:19.785577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.787574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:19.805601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.807427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.810681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.811738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.812374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.813010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.853078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a HTTP/1.1 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'dc05baad-c563-40ca-84f8-0b02ec59d60a'} Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:19.855328 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.860404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.862257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:19.863294 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1a04153-f591-4b12-b158-8707478ad030 tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 404 len: 111 microversion: 2.1 time: 0.085551 Oct 31 15:21:19.868763 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 944/1797] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:19 2022] DELETE /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:19.877584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.880987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] [instance: dc05baad-c563-40ca-84f8-0b02ec59d60a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:19.902486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.904522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.912874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.914759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.915485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.916271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.947166 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] HTTP exception thrown: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Request method failure captured: Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a HTTP/1.1 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fL5yroQA4CHCbBhpX0-XQwcP2l3rXJWCWXur0G9LT3hl8Fn5J-ObYl3xkkDqLn7ttcEvVY_cVATdmuCmzcwUwhXFISFAA9ie4iDZVK3f5s4b9fiBI_u0PSzCx-4LtPcA6oUCpDnZQjenaFT2DhLORK6PEyDB2aHYZuLj1WAvjFgWE Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c9aaf35cf944028a4aca205aaec129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c8c9aaf35cf944028a4aca205aaec129 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-849939282 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 9526b0356b7c4aad9e37b40f20bc2798 Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesNegativeTestJSON-849939282-project Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'dc05baad-c563-40ca-84f8-0b02ec59d60a'} Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:19.949222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. Oct 31 15:21:19.960001 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:19.963342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] Returning 404 to user: Instance dc05baad-c563-40ca-84f8-0b02ec59d60a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:19.964480 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-512bb18f-c3e0-41dc-9ef5-a9cfc9955d1c tempest-ImagesNegativeTestJSON-849939282 tempest-ImagesNegativeTestJSON-849939282-project] 10.222.0.48 "GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a" status: 404 len: 111 microversion: 2.1 time: 0.091715 Oct 31 15:21:19.968601 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 945/1798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:19 2022] GET /compute/v2.1/servers/dc05baad-c563-40ca-84f8-0b02ec59d60a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:19.980312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.981250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:19.997095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.998047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.999102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.004889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.005780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.006455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.477693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:20.478230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:20.478902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:20.479325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:20.479741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:20.500292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.505248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.510000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.512076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.514886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.516896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.566365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:20.582978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:20.623127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:20.626026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:20.794236 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-070af36f-4bb1-4914-a54f-248a46e800af tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.267565 Oct 31 15:21:20.798593 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 854/1799] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:20.821432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4549f404-caee-4b2d-9dfb-256e1c495f24", "tag": "b2f00f75-e50d-44ae-a608-b5296991a22f"}, {"server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "name": "network-vif-unplugged", "status": "completed", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:20.860654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.861177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.861611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.916207 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Creating event network-changed:b2f00f75-e50d-44ae-a608-b5296991a22f for instance 4549f404-caee-4b2d-9dfb-256e1c495f24 on n-h1-858383-17 Oct 31 15:21:20.916652 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Creating event network-vif-unplugged:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h1-858383-17 Oct 31 15:21:20.939615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] Instance 46bb8c6e-f156-4a62-be80-15f50de92695 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:21:20.985263 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-fe6edd81-48b4-4d71-b844-7a18550af5d7 req-a7387425-f5f3-4a21-93d8-72993d3470d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.181333 Oct 31 15:21:20.991972 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 855/1800] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:21.013740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:21.014472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:21.039895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.040409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.047186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.049741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.052482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.053158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.701808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:21.736362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:21.738058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:21.739271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67a8e37f-6118-42f0-b038-e77069b2b217 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 1.769340 Oct 31 15:21:21.739821 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 946/1801] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:19 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:21.770485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:21.780640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:21.797671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.801594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.802432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.805519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.808242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.808242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.811846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:21.826292 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01b6e6db-1e9c-4cc4-b0d6-417c4eafab64 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1469 microversion: 2.1 time: 0.832566 Oct 31 15:21:21.853594 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 856/1802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:20 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1469 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:21.869753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e590dc6-1025-4d2b-93c3-b5941b4e4d8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca66c70d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.087912 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e590dc6-1025-4d2b-93c3-b5941b4e4d8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.232538 Oct 31 15:21:22.088505 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 857/1803] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:21 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:22.108587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.111102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:22.131547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.133952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.134357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.140083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.140605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.142266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.380323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.399193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.402642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.424161 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d36b5480-e17a-4ab4-8566-e94ee4667a21 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.682099 Oct 31 15:21:22.430452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 947/1804] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:21 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:22.552104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.575938 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e3ea2706-c497-41b2-a2ea-62c8a79436bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1219 microversion: 2.1 time: 0.476392 Oct 31 15:21:22.579715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 858/1805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1219 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:22.769218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.770083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:22.789978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.793538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.794028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.794798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.801198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.807591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.861476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.862111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:22.914048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.915361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.916382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.917371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.923322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.926181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.407824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:25.425227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:25.431120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:25.434479 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9bb3d99-9c86-4437-9162-11f6ec7dd038 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 2.667662 Oct 31 15:21:25.436965 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 948/1806] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 2673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:25.452296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f2460da1-963a-4b56-84d7-4581301e3531 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca6779b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:25.575619 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f2460da1-963a-4b56-84d7-4581301e3531 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1439 microversion: 2.1 time: 0.133123 Oct 31 15:21:25.576271 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 949/1807] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:25 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1439 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:25.598491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:25.599447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:25.627256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.631623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.633643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.636381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.639526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.641297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.957731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:25.997004 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee202695-eab1-4bc7-a865-247b616895c5 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1469 microversion: 2.1 time: 3.140414 Oct 31 15:21:26.012787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 859/1808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1469 bytes in 3147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:26.013790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:26.017280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:26.036013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.039635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.040357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.041778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.045048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.046297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.078602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.088500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.094050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.112587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59233de3-b535-4905-a391-8715a3761eda tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.531883 Oct 31 15:21:26.114132 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 950/1809] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:25 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:26.119554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:26.149467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.150418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.151602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.183597 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] Creating event network-changed:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h1-858383-17 Oct 31 15:21:26.200029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] Instance 46bb8c6e-f156-4a62-be80-15f50de92695 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:21:26.229456 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1859f238-1143-47a9-ac4e-250d16c43aa6 req-64cbfb74-89da-4b7c-8fbc-03baaac7d385 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113130 Oct 31 15:21:26.232163 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 951/1810] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:26.470535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:26.471323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:26.486037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.487011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.487492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.490310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.490999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.495490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.514338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:26.580411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.590250 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-335e1284-adea-402a-bdee-75033648ba44 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1273 microversion: 2.1 time: 0.586852 Oct 31 15:21:26.595234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 860/1811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:26 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1273 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:26.612734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad94683d-ddb8-4757-a7d0-e32c8c33cdba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca669d430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:29.425138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:29.480346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:29.496140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:29.506159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a0bbac7-8816-4362-8681-db7dcf4f092e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 3.045530 Oct 31 15:21:29.512318 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 952/1812] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:26 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 3055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:21:29.533133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:29.535393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:29.570970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:29.575664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:29.575880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:29.581209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:29.581731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:29.585728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:30.547845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:30.604045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:30.999814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.014327 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-764d44eb-5d18-48de-a490-1deb3cddd9ea tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1469 microversion: 2.1 time: 1.500477 Oct 31 15:21:31.037609 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 953/1813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:29 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1469 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:31.043505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:31.054860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:31.089344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.089778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.102876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.103868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.104371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.104847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.609846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.623057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.632137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.651802 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ed948a9-193f-4cd1-b530-87a29286c0b2 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.608543 Oct 31 15:21:31.656186 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 954/1814] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:31 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:31.673353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:31.680577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:31.696905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.700404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.703369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.704726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.707474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.710267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.933529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.942044 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-233b51fc-8e47-48cb-9f1b-4874de220310 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1273 microversion: 2.1 time: 0.283120 Oct 31 15:21:31.945894 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 955/1815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:31 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:31.952731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:31.957640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:31.975027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.977875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.981033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:31.982341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:31.983438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:31.985842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:33.494420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:33.515987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:33.518330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:33.524302 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a2d6c50-3144-4724-958e-c52de0cfeff2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 1.577090 Oct 31 15:21:33.525217 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 956/1816] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:31 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:33.556396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:33.559915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:33.578480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:33.579092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:33.584327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:33.585664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:33.586140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:33.586586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.285325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:35.298844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dcd1c009-52ef-4f4a-9da5-af4bf4cd2c33 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1462 microversion: 2.1 time: 1.752541 Oct 31 15:21:35.301053 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 957/1817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:33 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1462 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:35.323280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.323827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:35.325788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:35.345768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.346270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.346718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.360250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.360795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.361258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.673772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad94683d-ddb8-4757-a7d0-e32c8c33cdba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1448 microversion: 2.1 time: 9.076834 Oct 31 15:21:35.675535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 861/1818] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:26 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1448 bytes in 9079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:35.687731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.692761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:35.705195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:35.712296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.718881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.719685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.722011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.724835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.727550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.730893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:35.735103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:35.763069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad14e79f-ff36-427f-b071-4b65a74dfad3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.460898 Oct 31 15:21:35.763686 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 958/1819] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:35 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:35.773508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-be8a8f53-4fc5-49a2-a013-bebf46dfece2 req-1710b1f4-3fc6-403b-baf8-efe402649531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "name": "network-vif-plugged", "status": "completed", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:35.807360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-be8a8f53-4fc5-49a2-a013-bebf46dfece2 req-1710b1f4-3fc6-403b-baf8-efe402649531 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.813521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-be8a8f53-4fc5-49a2-a013-bebf46dfece2 req-1710b1f4-3fc6-403b-baf8-efe402649531 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.815241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-be8a8f53-4fc5-49a2-a013-bebf46dfece2 req-1710b1f4-3fc6-403b-baf8-efe402649531 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.858092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-be8a8f53-4fc5-49a2-a013-bebf46dfece2 req-1710b1f4-3fc6-403b-baf8-efe402649531 service nova] Creating event network-vif-plugged:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h1-858383-17 Oct 31 15:21:35.874619 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-be8a8f53-4fc5-49a2-a013-bebf46dfece2 req-1710b1f4-3fc6-403b-baf8-efe402649531 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109109 Oct 31 15:21:35.889783 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 959/1820] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:35.895233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.895946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:35.916298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.917075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.917712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.921299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.922008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.922654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:37.545959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:37.559608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:37.561362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:37.571674 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46e265cb-1c90-4748-af83-b7bbf4cea95c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1486 microversion: 2.25 time: 1.677817 Oct 31 15:21:37.572457 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 960/1821] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:35 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1486 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:37.637313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:37.651711 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a3b021bb-cd10-45f3-b3f6-d421573af5de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1315 microversion: 2.1 time: 1.971144 Oct 31 15:21:37.653924 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 862/1822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:35 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1315 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:37.665367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6616b1b6-2a9b-4ec8-86ec-1a24417303dd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1dbc550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:37.800199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6616b1b6-2a9b-4ec8-86ec-1a24417303dd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 200 len: 1448 microversion: 2.1 time: 0.141390 Oct 31 15:21:37.801357 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 863/1823] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:37 2022] GET /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 1448 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:37.806740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:37.828471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:37.844090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:37.844593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:37.845068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:37.845789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:37.857434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:37.862034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.260061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:38.261338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:38.270132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:38.276728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.284493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:38.288751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.291163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:38.292213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.293213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.295570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.296271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.307206 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03bb1f37-bbf0-41bc-b3c2-cba56bb1b21e tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.503281 Oct 31 15:21:38.311560 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 864/1824] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:37 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:38.353798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e70e63b-7a2a-432c-a2c0-a926a9e40867 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1d884c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:38.720896 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd3eb374-4ddb-4146-b6de-6a8614b66efa tempest-MigrationsAdminTest-1269102842 tempest-MigrationsAdminTest-1269102842-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1615 microversion: 2.1 time: 1.147098 Oct 31 15:21:38.742848 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 961/1825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:37 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1615 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:38.760041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:38.760938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:38.768574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.769719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.770570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.773492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.774478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.776712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:39.399013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:39.408729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:39.415259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:39.417029 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4fc5c70-87c6-44b5-8c9c-23d55e939b8d tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1476 microversion: 2.25 time: 0.671123 Oct 31 15:21:39.418054 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 962/1826] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:38 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1476 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:39.856811 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e70e63b-7a2a-432c-a2c0-a926a9e40867 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 204 len: 0 microversion: 2.1 time: 1.543572 Oct 31 15:21:39.857954 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 865/1827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:38 2022] DELETE /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 0 bytes in 1546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:39.866737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:39.867350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:39.878029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:39.878527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:39.878961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:39.879673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:39.880125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:39.880548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.077692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b9ca390-896a-44e5-a256-0cfd6a95bd08 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca675c670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1732593291", "description": "tempest-description-1919728413"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:40.258913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:40.293328 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c284e020-acaf-444f-b885-352e9396e7b0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1315 microversion: 2.1 time: 0.421079 Oct 31 15:21:40.294184 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 866/1828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:39 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:40.309435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:40.314842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:40.333645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.336050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.337320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.338312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.339030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.339683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.389988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:40.489002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:40.524997 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b9ca390-896a-44e5-a256-0cfd6a95bd08 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.094019 Oct 31 15:21:40.525450 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 963/1829] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:40.539801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-73257164-d18c-4b87-9914-9a5a68c3aa35 req-51f6bab8-c384-4486-a3ca-6dc31b678185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2579483-111a-48e6-a19a-15446b83f3c5", "tag": "eeb246fd-14ee-4b45-a3ec-46375316ba26"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:40.601343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-73257164-d18c-4b87-9914-9a5a68c3aa35 req-51f6bab8-c384-4486-a3ca-6dc31b678185 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.604488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-73257164-d18c-4b87-9914-9a5a68c3aa35 req-51f6bab8-c384-4486-a3ca-6dc31b678185 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.604488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-73257164-d18c-4b87-9914-9a5a68c3aa35 req-51f6bab8-c384-4486-a3ca-6dc31b678185 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.609087 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20fe2e5e-d14d-4d7d-a1d6-9951308c1071 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "DELETE /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 204 len: 0 microversion: 2.1 time: 0.313753 Oct 31 15:21:40.613966 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 867/1830] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:40 2022] DELETE /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:40.629482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:40.630464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:40.639515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.640430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.641768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.642802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.643540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.644418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.655598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-73257164-d18c-4b87-9914-9a5a68c3aa35 req-51f6bab8-c384-4486-a3ca-6dc31b678185 service nova] Creating event network-changed:eeb246fd-14ee-4b45-a3ec-46375316ba26 for instance d2579483-111a-48e6-a19a-15446b83f3c5 on n-h2-858383-17 Oct 31 15:21:40.662839 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-73257164-d18c-4b87-9914-9a5a68c3aa35 req-51f6bab8-c384-4486-a3ca-6dc31b678185 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127280 Oct 31 15:21:40.668058 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 964/1831] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:40.751354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:40.767598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:40.774028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:40.786033 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c1b7200-ed88-4394-9392-2cf21180f33a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.163004 Oct 31 15:21:40.789806 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 868/1832] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:40 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:40.809457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85a73bc8-b646-4c51-a6e3-78463da1e1f4 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '.version_select at 0x7f5ca6726040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:40.815520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85a73bc8-b646-4c51-a6e3-78463da1e1f4 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.816012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85a73bc8-b646-4c51-a6e3-78463da1e1f4 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.816458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85a73bc8-b646-4c51-a6e3-78463da1e1f4 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.853855 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85a73bc8-b646-4c51-a6e3-78463da1e1f4 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 3416 microversion: 2.25 time: 0.061121 Oct 31 15:21:40.857105 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 869/1833] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Oct 31 15:21:40 2022] GET /compute/v2.1/os-migrations => generated 3416 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:40.877984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:40.878746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:40.888773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.890156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.890791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.891726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.892400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.893097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.948181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:41.094965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-109557040", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a3da133b-28bb-4f56-8da1-41c11b58031a"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:41.129083 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e6ba9ca-582c-490f-b1d8-061711bb2caa tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 204 len: 0 microversion: 2.1 time: 0.262184 Oct 31 15:21:41.130185 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 870/1834] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:40 2022] DELETE /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:41.150443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a6a55c7-6553-483b-912a-d3d094a435e8 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca67261f0>, body: {"security_group_rule": {"parent_group_id": "313ea2eb-107d-489b-a541-cfc0c77755e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:41.248209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] validate_networks() for [('a3da133b-28bb-4f56-8da1-41c11b58031a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:42.107138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a6a55c7-6553-483b-912a-d3d094a435e8 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.967516 Oct 31 15:21:42.108990 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 871/1835] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:41 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:42.117032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:42.118102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:42.133756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:42.138117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:42.138805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:42.139934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:42.140682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:42.141424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:42.950955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:42.960887 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-48788e74-2b65-465b-abe3-143ea16af3ef tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 200 len: 1468 microversion: 2.1 time: 0.850651 Oct 31 15:21:42.991147 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 872/1836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:42 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 1468 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:42.996456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:42.997103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:43.015773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.016686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.017536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:43.018353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.018827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.022786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:43.240756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:43.244396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:43.245109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:43.245709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:43.246304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:43.264839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.265343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.265785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:43.266530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.266994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.273190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:43.331533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Getting quotas for project bbaa41a33c874558856fd876d3b2ab0d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:43.358421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Getting quotas for user 6a4365b2f6f14e9e8735757cc69657cb and project bbaa41a33c874558856fd876d3b2ab0d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:43.406664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:43.412918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:43.583499 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ebd1b4fc-99e3-42db-9650-9be34a6a4473 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.909658 Oct 31 15:21:43.588966 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 965/1837] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:21:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:21:43.608907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:43.610033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:43.630252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.632491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.652013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:43.654655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.656799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.659797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:44.220274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] Lazy-loading 'services' on Instance uuid 4549f404-caee-4b2d-9dfb-256e1c495f24 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:44.304309 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d0c40da-704a-4c25-b2a2-044dd2d4c861 tempest-LiveAutoBlockMigrationV225Test-141413191 tempest-LiveAutoBlockMigrationV225Test-141413191-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1970 microversion: 2.25 time: 1.311844 Oct 31 15:21:44.305131 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 873/1838] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:42 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1970 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:44.330422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d21804d6-37b0-4d4b-b1df-0e51d6a6101f req-8ea5c5f5-6002-4c84-bb56-acdc9ce24a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a045a089-2ade-4888-aff0-4e067941cb23", "name": "network-vif-unplugged", "status": "completed", "tag": "b7268098-5fbf-433c-afa2-19ac9e1c6d17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:44.401266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d21804d6-37b0-4d4b-b1df-0e51d6a6101f req-8ea5c5f5-6002-4c84-bb56-acdc9ce24a30 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:44.401841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d21804d6-37b0-4d4b-b1df-0e51d6a6101f req-8ea5c5f5-6002-4c84-bb56-acdc9ce24a30 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:44.403342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d21804d6-37b0-4d4b-b1df-0e51d6a6101f req-8ea5c5f5-6002-4c84-bb56-acdc9ce24a30 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:44.463620 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d21804d6-37b0-4d4b-b1df-0e51d6a6101f req-8ea5c5f5-6002-4c84-bb56-acdc9ce24a30 service nova] Creating event network-vif-unplugged:b7268098-5fbf-433c-afa2-19ac9e1c6d17 for instance a045a089-2ade-4888-aff0-4e067941cb23 on n-h2-858383-17 Oct 31 15:21:44.479838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d21804d6-37b0-4d4b-b1df-0e51d6a6101f req-8ea5c5f5-6002-4c84-bb56-acdc9ce24a30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167135 Oct 31 15:21:44.482374 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 874/1839] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:44.501657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1405412518", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bc2357ef-c687-4bf5-80c5-a090c70bef3f"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:44.633644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] validate_networks() for [('bc2357ef-c687-4bf5-80c5-a090c70bef3f', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:44.989613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:45.028221 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ec6c4d4-1ae4-4b78-9a9a-78cd6bc42667 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1315 microversion: 2.1 time: 1.436683 Oct 31 15:21:45.046796 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 966/1840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:43 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1315 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:45.052683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:45.054296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:45.073551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:45.074241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:45.076888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:45.078238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:45.081512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:45.082357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:45.514786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:45.556337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:45.565018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:45.591102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41efae98-3b95-485c-8b61-57a50ecf07b3 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.542907 Oct 31 15:21:45.607929 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 967/1841] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:45 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:45.607929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4dee15d-03d9-4c01-a3f2-fa355f4ca1e3 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca675c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-602323393", "description": "tempest-description-1802674777"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:46.673948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:46.674490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:46.674976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:46.675445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:46.675863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:46.684804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:46.715793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:46.716297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:46.716916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:46.719240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:46.719651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:46.720082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:46.762080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:46.770252 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4dee15d-03d9-4c01-a3f2-fa355f4ca1e3 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.171002 Oct 31 15:21:46.771527 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 968/1842] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:46.773818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for user 857b0f5f4fdc4b1faeae0e0770d65125 and project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:46.804417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:46.818034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:46.844476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-56048039", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "81ad0501-00bf-4e05-96db-ca0cdd013834"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:46.922525 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b337b50d-c381-4624-a5e3-14c5ff77e57a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.437046 Oct 31 15:21:46.923371 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 875/1843] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:46.939470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:46.940415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:46.947316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:46.948061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:46.948725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:46.949613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:46.950238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:46.950834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:46.961291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] validate_networks() for [('81ad0501-00bf-4e05-96db-ca0cdd013834', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:47.220907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:47.230446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:47.234126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:47.237220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d4a55be-e3f0-4cfc-8097-c35e63442ea0 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1313 microversion: 2.26 time: 0.312398 Oct 31 15:21:47.241325 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 876/1844] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:46 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:47.280945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:47.282617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 46bb8c6e-f156-4a62-be80-15f50de92695] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:47.304897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.307746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.308326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.311742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.312371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.314176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.359857 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] HTTP exception thrown: Instance 46bb8c6e-f156-4a62-be80-15f50de92695 could not be found. Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Request method failure captured: Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 HTTP/1.1 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-axEn0Jxb5Vg5_xz88-6FXhruuI4FbcIe-ubvC8OLQ8RvYgkfE-h0znKGXNNYs8VtUgdb2AWkH8mva-fdMoA2PrxzhbyGbPVhpoRLl_DDzkQDGz4PDTqzVJZ06qp6cLOC3n4r1YDI41xuR7tuyy8f5GeJirTS8atTmJCnSLSJg107E Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-MigrationsAdminTest-836805078 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-MigrationsAdminTest-836805078-project Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8184a0251b8e4cb882556b458bbc4de7 Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-MigrationsAdminTest-836805078-project Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 46bb8c6e-f156-4a62-be80-15f50de92695 could not be found. Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '46bb8c6e-f156-4a62-be80-15f50de92695'} Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46bb8c6e-f156-4a62-be80-15f50de92695 could not be found. Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46bb8c6e-f156-4a62-be80-15f50de92695 could not be found. Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:47.364309 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46bb8c6e-f156-4a62-be80-15f50de92695 could not be found. Oct 31 15:21:47.373713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:47.401706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Returning 404 to user: Instance 46bb8c6e-f156-4a62-be80-15f50de92695 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:47.403870 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c521602-7797-4d5d-b3c0-70c9be36b690 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695" status: 404 len: 111 microversion: 2.1 time: 0.138882 Oct 31 15:21:47.404914 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 877/1845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:47 2022] GET /compute/v2.1/servers/46bb8c6e-f156-4a62-be80-15f50de92695 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:47.424147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-dd51666b-d9f1-474c-8e95-89a46e842f46 req-b8c83e2d-8cc5-49bd-91ef-cf53bd435b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a045a089-2ade-4888-aff0-4e067941cb23", "name": "network-vif-deleted", "tag": "b7268098-5fbf-433c-afa2-19ac9e1c6d17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:47.439503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dd51666b-d9f1-474c-8e95-89a46e842f46 req-b8c83e2d-8cc5-49bd-91ef-cf53bd435b86 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.440855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dd51666b-d9f1-474c-8e95-89a46e842f46 req-b8c83e2d-8cc5-49bd-91ef-cf53bd435b86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.444549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dd51666b-d9f1-474c-8e95-89a46e842f46 req-b8c83e2d-8cc5-49bd-91ef-cf53bd435b86 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.462831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-dd51666b-d9f1-474c-8e95-89a46e842f46 req-b8c83e2d-8cc5-49bd-91ef-cf53bd435b86 service nova] Creating event network-vif-deleted:b7268098-5fbf-433c-afa2-19ac9e1c6d17 for instance a045a089-2ade-4888-aff0-4e067941cb23 on n-h2-858383-17 Oct 31 15:21:47.471684 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-dd51666b-d9f1-474c-8e95-89a46e842f46 req-b8c83e2d-8cc5-49bd-91ef-cf53bd435b86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064564 Oct 31 15:21:47.478377 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 878/1846] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:47.487647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:47.489169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:47.511653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.515050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.517262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.523982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.524923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.525658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.565071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:47.729145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2c1026b-f04b-4906-9a74-0e74c9797df5 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 204 len: 0 microversion: 2.25 time: 0.248835 Oct 31 15:21:47.731094 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 879/1847] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:21:47 2022] DELETE /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:21:47.738330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-319dc2ce-0c70-4910-9fde-a781a82d3645 req-a80177e3-a1ff-4df3-9a70-cdf3c489214f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bb8c6e-f156-4a62-be80-15f50de92695", "name": "network-vif-deleted", "tag": "5b248206-b177-4379-823e-c8bf43608eb2"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:47.758117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-319dc2ce-0c70-4910-9fde-a781a82d3645 req-a80177e3-a1ff-4df3-9a70-cdf3c489214f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.758901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-319dc2ce-0c70-4910-9fde-a781a82d3645 req-a80177e3-a1ff-4df3-9a70-cdf3c489214f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.759610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-319dc2ce-0c70-4910-9fde-a781a82d3645 req-a80177e3-a1ff-4df3-9a70-cdf3c489214f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.779785 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-319dc2ce-0c70-4910-9fde-a781a82d3645 req-a80177e3-a1ff-4df3-9a70-cdf3c489214f service nova] Creating event network-vif-deleted:5b248206-b177-4379-823e-c8bf43608eb2 for instance 46bb8c6e-f156-4a62-be80-15f50de92695 on n-h1-858383-17 Oct 31 15:21:47.803838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-319dc2ce-0c70-4910-9fde-a781a82d3645 req-a80177e3-a1ff-4df3-9a70-cdf3c489214f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071023 Oct 31 15:21:47.805666 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 880/1848] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:47.816449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:47.817307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:47.825358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.826352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.827666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.829106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.830491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.832914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.283545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:48.285072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:48.285856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:48.286692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:48.287548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:48.296108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:48.306944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.308132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.308868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.309845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.312452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.313885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.317738 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf07f771-e6c9-4637-ba9a-caca04ad5bd6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1315 microversion: 2.1 time: 0.508044 Oct 31 15:21:48.331330 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 881/1849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:47 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:48.342550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:48.349711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:48.359316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Getting quotas for project 1bfb44c13df741fca0c785b2b29ad321. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:48.365728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Getting quotas for user f2076e8958724ce09f1ad0e4ff647fc1 and project 1bfb44c13df741fca0c785b2b29ad321. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:48.370367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.370871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.371326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.372048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.372519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.373028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.384401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:48.387906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:48.454914 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-035e19d8-245d-450e-b229-791b7e143538 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676572 Oct 31 15:21:48.480521 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 969/1850] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:48.487138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1513434-1452-41cd-8378-2802141c74f6 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca67c9430>, body: {"security_group_rule": {"parent_group_id": "f62f8886-259d-42ba-9418-44ecb80ed65e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:48.806669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:48.820530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:48.824092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:48.844295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-109710af-1f6e-4499-ae28-b4a9ce590e5c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.511409 Oct 31 15:21:48.845289 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 882/1851] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:48 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:48.852160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:48.857354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:48.874435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.875180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.876107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.879259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.880066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.881559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.090067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:49.098211 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b68fda66-2f29-47c6-8eec-36b1b108eebd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1260 microversion: 2.1 time: 0.251720 Oct 31 15:21:49.098791 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 883/1852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:48 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:49.133314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:49.133897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:49.147371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.148552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.150252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.152198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.154463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.155314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.197484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:49.250715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:49.314624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-333adcf1-8b72-401b-8ea7-f605f6bb7dda tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 204 len: 0 microversion: 2.1 time: 0.194174 Oct 31 15:21:49.316812 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 884/1853] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:49 2022] DELETE /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:49.327247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:49.328186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:49.337839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.339596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.340634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.341764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.343257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.344037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.828357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:49.843957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1513434-1452-41cd-8378-2802141c74f6 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.361772 Oct 31 15:21:49.844910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 970/1854] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:48 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:49.848615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:49.850769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:49.851970 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8c5d7ec-3883-4910-9944-f32f12bb9bee tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1482 microversion: 2.25 time: 0.532853 Oct 31 15:21:49.853092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 885/1855] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:49 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1482 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:49.856994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-53f12d84-d879-49a7-aa0b-0da4351ee460 req-25ea8f6b-9e80-4c36-b6b9-ea98079b8bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2579483-111a-48e6-a19a-15446b83f3c5", "name": "network-vif-plugged", "status": "completed", "tag": "eeb246fd-14ee-4b45-a3ec-46375316ba26"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:49.868381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:49.869166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:49.880682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-53f12d84-d879-49a7-aa0b-0da4351ee460 req-25ea8f6b-9e80-4c36-b6b9-ea98079b8bef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.881556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-53f12d84-d879-49a7-aa0b-0da4351ee460 req-25ea8f6b-9e80-4c36-b6b9-ea98079b8bef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.883016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-53f12d84-d879-49a7-aa0b-0da4351ee460 req-25ea8f6b-9e80-4c36-b6b9-ea98079b8bef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.888340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.898853 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-53f12d84-d879-49a7-aa0b-0da4351ee460 req-25ea8f6b-9e80-4c36-b6b9-ea98079b8bef service nova] Creating event network-vif-plugged:eeb246fd-14ee-4b45-a3ec-46375316ba26 for instance d2579483-111a-48e6-a19a-15446b83f3c5 on n-h2-858383-17 Oct 31 15:21:49.900196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.900647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.901427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.901898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.902330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.905511 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-53f12d84-d879-49a7-aa0b-0da4351ee460 req-25ea8f6b-9e80-4c36-b6b9-ea98079b8bef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059469 Oct 31 15:21:49.906638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 971/1856] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:49.930136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-538966869", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "81ad0501-00bf-4e05-96db-ca0cdd013834"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:50.038388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] validate_networks() for [('81ad0501-00bf-4e05-96db-ca0cdd013834', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:50.193385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:50.205107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:50.209127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:50.211176 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-23b2360e-d788-4acf-b4a4-c80d0e609358 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1319 microversion: 2.26 time: 0.353819 Oct 31 15:21:50.212267 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 886/1857] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:49 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:50.217338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:50.217956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:50.230809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:50.231463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:50.232535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:50.243071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:50.243642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:50.244087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:50.926865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:50.936227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-96b2057c-51a7-4109-ac4f-217e9b89d685 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 200 len: 1535 microversion: 2.1 time: 0.722639 Oct 31 15:21:50.936839 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 887/1858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:50 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 1535 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:50.953113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:50.961837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:50.972386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:50.972929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:50.973489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:50.974792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:50.975262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:50.975681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:51.916703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:51.939011 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8fdf31b-af2a-4c13-9275-1e4843b06c93 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1315 microversion: 2.1 time: 0.998023 Oct 31 15:21:51.950887 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 888/1859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:50 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:51.961630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e85d01c-cf96-460b-b676-9d71f88352d9 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca1dbe310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1549566003", "description": "tempest-description-1294445548"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:52.327976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:52.328586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:52.329666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:52.330088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:52.330503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:52.347521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:52.353098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:52.353911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:52.354895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:52.355569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:52.356180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:52.396588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Getting quotas for project 1bfb44c13df741fca0c785b2b29ad321. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:52.413122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Getting quotas for user f2076e8958724ce09f1ad0e4ff647fc1 and project 1bfb44c13df741fca0c785b2b29ad321. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:52.449607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:52.452551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:52.566426 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7709ae1b-91af-4251-8db0-fb70afca09ac tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.658241 Oct 31 15:21:52.572459 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 972/1860] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:52.584061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:52.586756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:52.604673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:52.608289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:52.609067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:52.610027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:52.612295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:52.623791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:53.378055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.392576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.397786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.410688 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fa30899-583c-4a74-ab25-de2fb88178b4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1555 microversion: 2.91 time: 0.830967 Oct 31 15:21:53.413600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 973/1861] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:52 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1555 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:53.425104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:53.430083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:53.442490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:53.445139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:53.452951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:53.454053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:53.454701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:53.455367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:53.978219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e85d01c-cf96-460b-b676-9d71f88352d9 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.025935 Oct 31 15:21:53.979533 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 889/1862] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:53.990436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-286165bd-7d51-4421-ac5b-4e6f895259bb req-735ec41c-0ae2-46d3-8cdf-23e1f5ca7521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549f404-caee-4b2d-9dfb-256e1c495f24", "name": "network-vif-deleted", "tag": "b2f00f75-e50d-44ae-a608-b5296991a22f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:54.013695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-286165bd-7d51-4421-ac5b-4e6f895259bb req-735ec41c-0ae2-46d3-8cdf-23e1f5ca7521 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.014517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-286165bd-7d51-4421-ac5b-4e6f895259bb req-735ec41c-0ae2-46d3-8cdf-23e1f5ca7521 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.015174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-286165bd-7d51-4421-ac5b-4e6f895259bb req-735ec41c-0ae2-46d3-8cdf-23e1f5ca7521 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.045763 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-286165bd-7d51-4421-ac5b-4e6f895259bb req-735ec41c-0ae2-46d3-8cdf-23e1f5ca7521 service nova] Creating event network-vif-deleted:b2f00f75-e50d-44ae-a608-b5296991a22f for instance 4549f404-caee-4b2d-9dfb-256e1c495f24 on n-h2-858383-17 Oct 31 15:21:54.052477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-286165bd-7d51-4421-ac5b-4e6f895259bb req-735ec41c-0ae2-46d3-8cdf-23e1f5ca7521 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070536 Oct 31 15:21:54.064814 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 890/1863] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:54.074366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.075540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:54.101373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.105295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.105859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.106701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.107193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.107645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.113947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.128733 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0c0e69e-0135-47c9-a909-e4fc14039dde tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1308 microversion: 2.1 time: 0.708408 Oct 31 15:21:54.132095 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 974/1864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:53 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1308 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:54.137500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.146281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:54.166442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.170124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.170862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.171840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.175514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.176242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.222590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.238978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.240637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.245505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7baa1625-b6db-4e99-9585-d2c6f9bbdc5b tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1265 microversion: 2.25 time: 0.178269 Oct 31 15:21:54.246761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 891/1865] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:54.251978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.252902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 6d7b4ffd-bac1-4439-a156-bd2ff7106337] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:54.260269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.261639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.262265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.263151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.263775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.264411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.303803 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] HTTP exception thrown: Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 could not be found. Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Request method failure captured: Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 HTTP/1.1 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-axEn0Jxb5Vg5_xz88-6FXhruuI4FbcIe-ubvC8OLQ8RvYgkfE-h0znKGXNNYs8VtUgdb2AWkH8mva-fdMoA2PrxzhbyGbPVhpoRLl_DDzkQDGz4PDTqzVJZ06qp6cLOC3n4r1YDI41xuR7tuyy8f5GeJirTS8atTmJCnSLSJg107E Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-MigrationsAdminTest-836805078 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-MigrationsAdminTest-836805078-project Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8184a0251b8e4cb882556b458bbc4de7 Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-MigrationsAdminTest-836805078-project Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 could not be found. Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '6d7b4ffd-bac1-4439-a156-bd2ff7106337'} Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 could not be found. Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 could not be found. Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:54.305965 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 could not be found. Oct 31 15:21:54.311124 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:21:54.315279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Returning 404 to user: Instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:54.317028 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-665d45e9-e587-4452-ad46-cae44df93b4a tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337" status: 404 len: 111 microversion: 2.1 time: 0.068931 Oct 31 15:21:54.320063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 892/1866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/servers/6d7b4ffd-bac1-4439-a156-bd2ff7106337 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:54.336840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-951171e5-ec78-4563-976e-d740c0f412f1 req-68bc0a05-c248-4adb-8b02-b0c26f6a2b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7b4ffd-bac1-4439-a156-bd2ff7106337", "name": "network-vif-deleted", "tag": "f0b3ddb0-3169-45d0-9a00-578abfcad454"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:54.363191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-951171e5-ec78-4563-976e-d740c0f412f1 req-68bc0a05-c248-4adb-8b02-b0c26f6a2b48 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.363878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-951171e5-ec78-4563-976e-d740c0f412f1 req-68bc0a05-c248-4adb-8b02-b0c26f6a2b48 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.364596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-951171e5-ec78-4563-976e-d740c0f412f1 req-68bc0a05-c248-4adb-8b02-b0c26f6a2b48 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.381674 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-951171e5-ec78-4563-976e-d740c0f412f1 req-68bc0a05-c248-4adb-8b02-b0c26f6a2b48 service nova] Creating event network-vif-deleted:f0b3ddb0-3169-45d0-9a00-578abfcad454 for instance 6d7b4ffd-bac1-4439-a156-bd2ff7106337 on n-h2-858383-17 Oct 31 15:21:54.398185 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-951171e5-ec78-4563-976e-d740c0f412f1 req-68bc0a05-c248-4adb-8b02-b0c26f6a2b48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076349 Oct 31 15:21:54.399825 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 893/1867] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:54.407999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-637284246", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "451", "networks": [{"uuid": "81ad0501-00bf-4e05-96db-ca0cdd013834"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:54.475725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] validate_networks() for [('81ad0501-00bf-4e05-96db-ca0cdd013834', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:54.781493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.788074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:54.796477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.798282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.799450 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bde6aa75-c62e-4635-8516-c0484e0622e9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.665801 Oct 31 15:21:54.813155 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 975/1868] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:54.813155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.813155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:54.821317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.821317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.821317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.821317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.821317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.821317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:55.357795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:55.370194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dceed84d-0e8f-4797-8d6d-63c039f255e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1501 microversion: 2.1 time: 0.568208 Oct 31 15:21:55.399881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 976/1869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1501 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:55.410253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e64f8094-18ad-49dc-b9ff-d5ebceaf9b20 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca6710550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2145343687", "description": "tempest-description-81138681"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:55.774788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:55.776285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:55.777430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:55.777935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:55.778472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:55.791117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:55.792065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:55.792727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:55.793643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:55.794567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:55.795506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:55.818340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Getting quotas for project 1bfb44c13df741fca0c785b2b29ad321. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:55.825239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Getting quotas for user f2076e8958724ce09f1ad0e4ff647fc1 and project 1bfb44c13df741fca0c785b2b29ad321. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:55.842010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:55.844967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:55.899495 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ca3a1b58-cc65-43a3-9a1a-5cc7795bcebb tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498080 Oct 31 15:21:55.900446 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 894/1870] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:55.905306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b72e2a71-b29e-4ffa-bf0c-00083b3c3540 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '.version_select at 0x7f5ca6869550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:55.925223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b72e2a71-b29e-4ffa-bf0c-00083b3c3540 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111067039" status: 202 len: 0 microversion: 2.1 time: 0.023432 Oct 31 15:21:55.926456 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 895/1871] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111067039 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:55.932648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:55.933500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:55.940950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:55.941449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:55.941884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:55.943496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:55.943965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:55.944393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.111835 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e64f8094-18ad-49dc-b9ff-d5ebceaf9b20 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.709568 Oct 31 15:21:56.112808 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 977/1872] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:55 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:56.124197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.126404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.127551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:56.137637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.138446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.139112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.142235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.143861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.145094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.147331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.149245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.178595 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-37d0425d-20da-481b-b651-b362726c4125 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1537 microversion: 2.91 time: 0.248619 Oct 31 15:21:56.181222 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 896/1873] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:55 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:56.189537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.190159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:56.209966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.218275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.218741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.219510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.219972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.220406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.410268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.422859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.430758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.435634 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c87bc691-554f-4b7e-9724-dadb0b346b35 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1265 microversion: 2.25 time: 0.251387 Oct 31 15:21:56.447115 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 897/1874] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:56.459680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.462747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:56.481166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.482597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.483433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.484414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.485600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.487047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.513020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.522521 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4daf64c-e508-4cd1-a0bc-116612b418b7 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1308 microversion: 2.1 time: 0.400031 Oct 31 15:21:56.523856 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 978/1875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:56.533154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.537109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:56.544072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:56.571678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.572481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.573132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.574200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.574677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.575106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.721754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90fc1bc0-8ea5-45e1-85a2-b070a0dad205 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 204 len: 0 microversion: 2.1 time: 0.272098 Oct 31 15:21:56.724744 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 898/1876] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:56 2022] DELETE /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:56.729072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.729790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:56.736831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.737325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.737759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.738466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.739806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.739944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.857998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.879219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf11a12a-f46e-46e7-a210-f3ba0b0a7817 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1224 microversion: 2.1 time: 0.154939 Oct 31 15:21:56.881604 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 899/1877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:56.891189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7c7dbacf-5309-421f-a503-90fb573bd6aa req-7434d8ae-dd34-4ea6-bdc6-549ab933e098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9743ece-3bee-4280-be3e-ebe1fe9b57aa", "tag": "1c1a4cc4-b2dc-4df2-bf77-d129bc61c60d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:56.911430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7c7dbacf-5309-421f-a503-90fb573bd6aa req-7434d8ae-dd34-4ea6-bdc6-549ab933e098 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.912016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7c7dbacf-5309-421f-a503-90fb573bd6aa req-7434d8ae-dd34-4ea6-bdc6-549ab933e098 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.912455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7c7dbacf-5309-421f-a503-90fb573bd6aa req-7434d8ae-dd34-4ea6-bdc6-549ab933e098 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.928973 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7c7dbacf-5309-421f-a503-90fb573bd6aa req-7434d8ae-dd34-4ea6-bdc6-549ab933e098 service nova] Creating event network-changed:1c1a4cc4-b2dc-4df2-bf77-d129bc61c60d for instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa on n-h1-858383-17 Oct 31 15:21:56.935967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.936246 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7c7dbacf-5309-421f-a503-90fb573bd6aa req-7434d8ae-dd34-4ea6-bdc6-549ab933e098 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051735 Oct 31 15:21:56.937915 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 900/1878] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:56.945078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf67ade7-a99f-42c2-ae6c-1c71d9d493b7 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca1dbe670>, body: {"security_group_rule": {"parent_group_id": "e373d4ed-fad6-4f56-9835-db7e2bcc8134", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "31303d13-7fd2-4039-810d-2a611fd068a1"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:56.949489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.952626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.954652 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9673e5c8-e596-4cea-8f10-f0c79471440e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.429850 Oct 31 15:21:56.957517 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 979/1879] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:56.972123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9e7e404b-37db-4a2a-86fe-dedb82e7e3da req-8116cb64-18a7-4f04-8274-9524da2691a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc1afd0-e44e-407e-9003-2b4505e1eaf6", "tag": "5915d395-173d-4415-8a4d-063d2a4b965d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:56.986135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9e7e404b-37db-4a2a-86fe-dedb82e7e3da req-8116cb64-18a7-4f04-8274-9524da2691a3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.987014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9e7e404b-37db-4a2a-86fe-dedb82e7e3da req-8116cb64-18a7-4f04-8274-9524da2691a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.987744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9e7e404b-37db-4a2a-86fe-dedb82e7e3da req-8116cb64-18a7-4f04-8274-9524da2691a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.002811 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9e7e404b-37db-4a2a-86fe-dedb82e7e3da req-8116cb64-18a7-4f04-8274-9524da2691a3 service nova] Creating event network-changed:5915d395-173d-4415-8a4d-063d2a4b965d for instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 on n-h2-858383-17 Oct 31 15:21:57.009403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9e7e404b-37db-4a2a-86fe-dedb82e7e3da req-8116cb64-18a7-4f04-8274-9524da2691a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046277 Oct 31 15:21:57.010611 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 980/1880] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:57.017206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.018446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.028187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.029007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.029924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.030887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.031520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.032331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.226328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.234377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4273b78b-7b53-4351-b987-2b644261b315 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1507 microversion: 2.1 time: 0.222281 Oct 31 15:21:57.235140 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 981/1881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:57.240495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.241006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.246690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.247162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.247797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.248680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.249444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.249864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.274694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:57.349551 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf67ade7-a99f-42c2-ae6c-1c71d9d493b7 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.409794 Oct 31 15:21:57.350535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 901/1882] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:56 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:57.355834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.356837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.361215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:57.361747 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ddabf59-421b-4511-afd8-9bb39bd5d935 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 204 len: 0 microversion: 2.1 time: 0.125298 Oct 31 15:21:57.362689 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 982/1883] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:57 2022] DELETE /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:57.367537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.368191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.368592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02fe3e46-dee5-4620-a8cd-3d6a121b9493 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca67c9040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-165140568", "description": "tempest-description-1354554954"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:57.368942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.369757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.370330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.370859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.451669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.464377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.465981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.471693 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ef24d1a-8ab9-49db-a85e-0b80db3b17b1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1537 microversion: 2.91 time: 0.119643 Oct 31 15:21:57.472722 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 902/1884] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1537 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:57.478781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.479400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.485480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.486015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.486514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.487317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.488590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.488590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.592749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02fe3e46-dee5-4620-a8cd-3d6a121b9493 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.228501 Oct 31 15:21:57.601913 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 983/1885] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:57.607503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.608475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.615309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.615804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.616247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.616978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.617441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.617868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.674354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.683662 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-178f6be8-a7ed-4253-980a-872b608da5c2 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1466 microversion: 2.1 time: 0.207944 Oct 31 15:21:57.684486 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 903/1886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1466 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:57.690309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.691109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.691899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.697175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.697869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.698505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.699197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.700107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.700350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.700533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.701806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.702938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-531b4a52-cd10-4e04-b99e-41bcbc17232c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 200 len: 1265 microversion: 2.25 time: 0.099580 Oct 31 15:21:57.703549 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 984/1887] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:57.708876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-79f1dc01-dacc-4868-8348-54dc43808531 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca67c9700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1276990736", "description": "tempest-description-1557526471"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:57.877419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:57.889692 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e03f16e-f1a1-4426-a881-554295597569 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1308 microversion: 2.1 time: 0.203750 Oct 31 15:21:57.906008 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 904/1888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:57.914160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.915550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.924626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.925530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.926132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.927594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.928229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.929397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.933534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-79f1dc01-dacc-4868-8348-54dc43808531 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.228326 Oct 31 15:21:57.942931 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 985/1889] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:57.960070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81e9366f-bdfe-4491-8ba9-554a53929d21 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca6710310>, body: {"security_group_rule": {"parent_group_id": "9398d3fc-176a-497f-8bb1-7f729f050ed5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "25cfeff0-4d32-457d-9e6d-39d389f01cb3"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:57.987637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:58.170683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:58.188199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4e784e2-1b4f-4a02-9fc0-49d1d69c6682 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1224 microversion: 2.1 time: 0.274284 Oct 31 15:21:58.191072 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 905/1890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1224 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:58.203920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:58.205391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:58.214818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.215935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.217852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.219964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.220887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.221761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.604747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:58.613074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:58.614478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:58.615825 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fac523f6-4986-4f54-a0b6-8df7a3e8ac9c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.422779 Oct 31 15:21:58.616549 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 906/1891] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:58 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:58.621107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:58.621915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:58.628579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.629322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.630512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.631389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.632004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.632601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.226354 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81e9366f-bdfe-4491-8ba9-554a53929d21 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.281784 Oct 31 15:21:59.227503 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 986/1892] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:59.233687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:59.235513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:59.256309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.257297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.261700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.262048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.265428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.266166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.282866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.291018 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27c02f38-264e-4e07-aaf9-98686f3ecebb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 200 len: 1507 microversion: 2.1 time: 0.673227 Oct 31 15:21:59.297094 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 907/1893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:58 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 1507 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:59.306047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:59.306673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:59.324240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.325056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.325684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.326566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.327192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.327799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.520428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.548488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.550032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.565266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:59.566932 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff8ae5d8-b01b-4811-ac29-6afa9022490a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1480 microversion: 2.91 time: 0.338168 Oct 31 15:21:59.577054 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 987/1894] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:59 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1480 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:59.597261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:59.598162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4549f404-caee-4b2d-9dfb-256e1c495f24] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:59.618285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.618801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.627482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.628483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.633946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.634678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.677800 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] HTTP exception thrown: Instance 4549f404-caee-4b2d-9dfb-256e1c495f24 could not be found. Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Request method failure captured: Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 HTTP/1.1 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Z6Sm7z2M1p8toEv8qisIr3mKMSFi4sgjd-qM1BiMmLinw_GLsICkIPmLsKKlnVT0wFU4zgAGwPHACEZaRYB2uLOh8fy3d3zJDFJyGsHpEro9EvjR7LpYEMWTiqsEHfW41uSvmCvpWThAlPzpDeN0oucQgzPm3xLaz1sUCD_I3W-ik Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d09369d806ba4afe911914e3272a59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8c9c59f229134e1ab069e18a116ebdf2 Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 4549f404-caee-4b2d-9dfb-256e1c495f24 could not be found. Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '4549f404-caee-4b2d-9dfb-256e1c495f24'} Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4549f404-caee-4b2d-9dfb-256e1c495f24 could not be found. Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4549f404-caee-4b2d-9dfb-256e1c495f24 could not be found. Oct 31 15:21:59.679446 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4549f404-caee-4b2d-9dfb-256e1c495f24 could not be found. Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:21:59.684263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Returning 404 to user: Instance 4549f404-caee-4b2d-9dfb-256e1c495f24 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:59.686477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e2afac20-c916-42ec-ba09-cc1434810402 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24" status: 404 len: 111 microversion: 2.25 time: 0.102311 Oct 31 15:21:59.690126 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 988/1895] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:59 2022] GET /compute/v2.1/servers/4549f404-caee-4b2d-9dfb-256e1c495f24 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:21:59.695804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:59.703417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:59.717055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.717836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.718433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.719296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.723714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.725035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:00.322444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:00.333956 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e0bca90-daaa-43d0-9b49-c08249acc12c tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1466 microversion: 2.1 time: 1.033690 Oct 31 15:22:00.334669 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 908/1896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:59 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1466 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:00.341359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-18b55819-8eac-4ab9-8244-46f4809decfd req-edd0d287-0364-448c-9188-de28e72c4e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3545bebb-a6c1-49e8-94d4-30a2def0af20", "tag": "8f1bfc00-95df-49d2-8890-b3af4c81d704"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:00.374378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-18b55819-8eac-4ab9-8244-46f4809decfd req-edd0d287-0364-448c-9188-de28e72c4e62 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:00.375154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-18b55819-8eac-4ab9-8244-46f4809decfd req-edd0d287-0364-448c-9188-de28e72c4e62 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:00.376492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-18b55819-8eac-4ab9-8244-46f4809decfd req-edd0d287-0364-448c-9188-de28e72c4e62 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:00.412140 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-18b55819-8eac-4ab9-8244-46f4809decfd req-edd0d287-0364-448c-9188-de28e72c4e62 service nova] Creating event network-changed:8f1bfc00-95df-49d2-8890-b3af4c81d704 for instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 on n-h1-858383-17 Oct 31 15:22:00.426088 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-18b55819-8eac-4ab9-8244-46f4809decfd req-edd0d287-0364-448c-9188-de28e72c4e62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088067 Oct 31 15:22:00.432141 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 909/1897] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:00.445011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:00.450225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:00.457652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:00.465699 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a513e2aa-b1b9-4767-8103-f814b1aceea4 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1308 microversion: 2.1 time: 0.774193 Oct 31 15:22:00.467695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 989/1898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:59 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1308 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:00.488590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6efc5113-b72d-4bcf-acd8-cc64f25f4753 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca67c9040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:00.490137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:00.491701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:00.493935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:00.496823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:00.498376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:00.509718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:01.292215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:01.299966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-59d33235-8a33-40b5-abac-f0c67a526a00 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1280 microversion: 2.1 time: 0.866218 Oct 31 15:22:01.316157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 910/1899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:00 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1280 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:01.321742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:01.324352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:01.331909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:01.333511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:01.334305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:01.335274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:01.335958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:01.336608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:01.452367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-17". {{(pid=120626) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:22:01.590780 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b05e0fa7-17fe-4be2-b65d-8f1c4fbd52a4 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action" status: 202 len: 0 microversion: 2.91 time: 0.273275 Oct 31 15:22:01.596718 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 911/1900] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:22:01 2022] POST /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:01.609029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:01.610362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:01.622911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:01.625806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:01.626471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:01.627867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:01.629261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:01.632112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.343802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.354122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.360906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.369306 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-af8135ef-e3ba-401f-8cb8-5f41bd3f1503 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.770280 Oct 31 15:22:02.372207 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 912/1901] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:01 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:02.373494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:02.389796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-826bf1e5-b618-46b1-a830-4fd2dbd4fc6d req-ef5721f9-13b8-4eb6-8de2-afe32268a268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc1afd0-e44e-407e-9003-2b4505e1eaf6", "name": "network-vif-plugged", "status": "completed", "tag": "5915d395-173d-4415-8a4d-063d2a4b965d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:02.409116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-826bf1e5-b618-46b1-a830-4fd2dbd4fc6d req-ef5721f9-13b8-4eb6-8de2-afe32268a268 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.409606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-826bf1e5-b618-46b1-a830-4fd2dbd4fc6d req-ef5721f9-13b8-4eb6-8de2-afe32268a268 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.410044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-826bf1e5-b618-46b1-a830-4fd2dbd4fc6d req-ef5721f9-13b8-4eb6-8de2-afe32268a268 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.436363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:02.439736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-826bf1e5-b618-46b1-a830-4fd2dbd4fc6d req-ef5721f9-13b8-4eb6-8de2-afe32268a268 service nova] Creating event network-vif-plugged:5915d395-173d-4415-8a4d-063d2a4b965d for instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 on n-h2-858383-17 Oct 31 15:22:02.453008 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-826bf1e5-b618-46b1-a830-4fd2dbd4fc6d req-ef5721f9-13b8-4eb6-8de2-afe32268a268 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077783 Oct 31 15:22:02.454295 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 913/1902] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:02.475671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:02.476406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:02.510382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.510886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.511328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.512045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.512501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.520793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.550127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 HTTP/1.1 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd2579483-111a-48e6-a19a-15446b83f3c5'} Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:02.554026 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:22:02.558501 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:02.560668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:02.564065 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd63264c-1d7d-4bec-b84b-82e7d3296557 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 404 len: 111 microversion: 2.1 time: 0.107451 Oct 31 15:22:02.564873 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 914/1903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:02 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:02.583447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-fcde3285-ebcb-4902-99e0-d25b63017528 req-717ef7c3-33e2-498a-a02b-a4fa9c8554ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111e882b-03b2-41b1-8b24-dc614d2d17a3", "tag": "e9680fc3-1bb8-486f-9398-0fbe7cd2c997"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:02.604779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fcde3285-ebcb-4902-99e0-d25b63017528 req-717ef7c3-33e2-498a-a02b-a4fa9c8554ab service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.605277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fcde3285-ebcb-4902-99e0-d25b63017528 req-717ef7c3-33e2-498a-a02b-a4fa9c8554ab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.605714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fcde3285-ebcb-4902-99e0-d25b63017528 req-717ef7c3-33e2-498a-a02b-a4fa9c8554ab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.627131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-fcde3285-ebcb-4902-99e0-d25b63017528 req-717ef7c3-33e2-498a-a02b-a4fa9c8554ab service nova] Creating event network-changed:e9680fc3-1bb8-486f-9398-0fbe7cd2c997 for instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 on n-h2-858383-17 Oct 31 15:22:02.636375 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-fcde3285-ebcb-4902-99e0-d25b63017528 req-717ef7c3-33e2-498a-a02b-a4fa9c8554ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067968 Oct 31 15:22:02.637023 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 915/1904] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:02.655782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:02.656500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:02.672593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.673131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.673578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.674294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.674756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.675185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.758043 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6efc5113-b72d-4bcf-acd8-cc64f25f4753 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/25cfeff0-4d32-457d-9e6d-39d389f01cb3" status: 202 len: 0 microversion: 2.1 time: 2.286429 Oct 31 15:22:02.758735 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 990/1905] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:00 2022] DELETE /compute/v2.1/os-security-groups/25cfeff0-4d32-457d-9e6d-39d389f01cb3 => generated 0 bytes in 2288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:02.766410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:02.767134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:02.798074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.800432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.802115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.809047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.810503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.812104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.910070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.931120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2aba35dd-9739-4f7e-860b-55427f72c9dc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1424 microversion: 2.1 time: 0.292810 Oct 31 15:22:02.944807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 916/1906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:02 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1424 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:02.944807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:02.945101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:02.955237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.955398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.955917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.956724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.957271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.957900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.056086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:03.064999 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e081006f-fef8-4646-9dc7-cd9d6b59a8df tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1308 microversion: 2.1 time: 0.305112 Oct 31 15:22:03.065853 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 991/1907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:02 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:03.090131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:03.101686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:03.102334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:03.102778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:03.104170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:03.109569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.110339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.110489 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7affa7e8-0347-4306-b6e9-c3385f6a9f86 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1488 microversion: 2.91 time: 0.175004 Oct 31 15:22:03.111089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.111994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.112621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.113402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.132672 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 917/1908] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:02 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1488 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:03.144902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cae02c16-e011-466f-a438-c863d4eb3e66 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca1cdf280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:03.248120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cae02c16-e011-466f-a438-c863d4eb3e66 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/9398d3fc-176a-497f-8bb1-7f729f050ed5" status: 200 len: 247 microversion: 2.1 time: 0.114088 Oct 31 15:22:03.248984 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 918/1909] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:22:03 2022] GET /compute/v2.1/os-security-groups/9398d3fc-176a-497f-8bb1-7f729f050ed5 => generated 247 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:03.265601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2579483-111a-48e6-a19a-15446b83f3c5", "name": "network-vif-deleted", "tag": "eeb246fd-14ee-4b45-a3ec-46375316ba26"}, {"server_uuid": "09142860-c91f-4a33-b580-e1288ecae4bd", "name": "network-vif-deleted", "tag": "02a04c3f-55f1-45d0-9693-0d91bb15b3fd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:03.293156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.293944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.300655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.327387 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] Creating event network-vif-deleted:eeb246fd-14ee-4b45-a3ec-46375316ba26 for instance d2579483-111a-48e6-a19a-15446b83f3c5 on n-h2-858383-17 Oct 31 15:22:03.328174 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] Creating event network-vif-deleted:02a04c3f-55f1-45d0-9693-0d91bb15b3fd for instance 09142860-c91f-4a33-b580-e1288ecae4bd on n-h1-858383-17 Oct 31 15:22:03.358592 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b180fa1d-670a-4ef4-9fad-3cbcfd17f6ed req-afb2a0f3-57bf-4fe2-9066-c879d4ad3516 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097210 Oct 31 15:22:03.359513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 919/1910] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:03.365299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1601565222", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:03.423379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:03.433101 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ce93995-8a77-4d60-9ec4-d21364ace939 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.338463 Oct 31 15:22:03.449155 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 992/1911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:03 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:03.452641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd86945d-1350-4ffb-a026-d4aa0930faf6 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca66be0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-188824619", "description": "tempest-description-1118776406"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:03.469499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:03.836581 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd86945d-1350-4ffb-a026-d4aa0930faf6 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.394171 Oct 31 15:22:03.838145 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 993/1912] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:03.843239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:03.846274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:03.857103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.857850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.858483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.859375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.859999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.860595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.125171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:04.140616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:04.142444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:04.144316 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5414e0b-3fec-472f-8924-1f3d577f3728 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.305167 Oct 31 15:22:04.175754 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 994/1913] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:03 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:04.179391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:04.180505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:04.181363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:04.182501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:04.183340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:04.187091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2b7af61-0921-40ff-bc6e-3251156f3fcd tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca66be0d0>, body: {"security_group_rule": {"parent_group_id": "68eff2e6-c46a-46fb-a24f-06e0dd814963", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:04.211704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.219358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.220150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.221415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.222198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.222918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.250413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:04.258265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:04.299775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:04.308480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:04.410285 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9356267-1c08-4dd5-97da-522c380c9a19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049512 Oct 31 15:22:04.417482 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 920/1914] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:04.417482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:04.418511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:04.427888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.430798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.431535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.432715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.436461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.438246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.498244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.499337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.500091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.501426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lazy-loading 'fault' on Instance uuid 09142860-c91f-4a33-b580-e1288ecae4bd {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:04.602271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:04.620325 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3dca854d-f26b-40a8-866d-23364ff7f548 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 200 len: 1301 microversion: 2.1 time: 0.207504 Oct 31 15:22:04.623626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 921/1915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:04 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 1301 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:04.634540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:04.637288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:04.656628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.657721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.659340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.662305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.664865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.665932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.423231 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2b7af61-0921-40ff-bc6e-3251156f3fcd tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.242191 Oct 31 15:22:05.423893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 995/1916] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:22:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:05.429388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:05.430201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:05.448289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.449182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.449634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.450352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.450823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.451253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.759025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.779461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.781046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.787024 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf66eb7a-5843-416a-8aa1-080922abd5a1 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.361704 Oct 31 15:22:05.787615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 996/1917] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:05 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:05.805820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:05.807240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:05.813656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.815028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.815711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.821708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.822463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.823456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.855439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.873013 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1aacb64e-cce0-4e90-8b9d-a407a448e58b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1308 microversion: 2.1 time: 1.242149 Oct 31 15:22:05.875211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 922/1918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:04 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1308 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:05.886071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:05.887161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:05.888070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:05.908165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.909682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.910382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.911395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.924894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.929896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.000998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:06.055096 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98960784-4948-40bf-8e3f-db49958da0c8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 204 len: 0 microversion: 2.25 time: 0.266188 Oct 31 15:22:06.057819 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 997/1919] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:22:05 2022] DELETE /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:06.067716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:06.068795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:06.075852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.076641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.077285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.078236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.078863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.079507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.083942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:06.119726 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5ff6cfa4-6af8-4278-b566-14a82854997a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1267 microversion: 2.1 time: 0.242908 Oct 31 15:22:06.125946 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 923/1920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:05 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:06.151127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8e0eba58-7d6a-4a69-b110-cb523317a68e req-8e238c66-7fff-41b9-9b82-58f6189efe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9743ece-3bee-4280-be3e-ebe1fe9b57aa", "name": "network-vif-plugged", "status": "completed", "tag": "1c1a4cc4-b2dc-4df2-bf77-d129bc61c60d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:06.171519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8e0eba58-7d6a-4a69-b110-cb523317a68e req-8e238c66-7fff-41b9-9b82-58f6189efe6f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.172520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8e0eba58-7d6a-4a69-b110-cb523317a68e req-8e238c66-7fff-41b9-9b82-58f6189efe6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.173589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8e0eba58-7d6a-4a69-b110-cb523317a68e req-8e238c66-7fff-41b9-9b82-58f6189efe6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.192009 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8e0eba58-7d6a-4a69-b110-cb523317a68e req-8e238c66-7fff-41b9-9b82-58f6189efe6f service nova] Creating event network-vif-plugged:1c1a4cc4-b2dc-4df2-bf77-d129bc61c60d for instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa on n-h1-858383-17 Oct 31 15:22:06.200164 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8e0eba58-7d6a-4a69-b110-cb523317a68e req-8e238c66-7fff-41b9-9b82-58f6189efe6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072344 Oct 31 15:22:06.201088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 924/1921] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:06.206906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:06.207876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:06.214844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.215341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.215770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.216471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.216961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.217388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.409779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:06.419454 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-486ce222-cda3-4dde-a93c-fe0397c9a47a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.359048 Oct 31 15:22:06.420346 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 998/1922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:06 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:06.425105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9294e845-19b4-4ac6-af26-4fff10a6806b tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Action: 'create', calling method: .version_select at 0x7f5ca6748280>, body: {"security_group_rule": {"parent_group_id": "68eff2e6-c46a-46fb-a24f-06e0dd814963", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:06.482046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:06.485523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:06.505712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:06.509411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:06.510846 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2aefb930-c802-4299-88ca-801f66917756 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.308455 Oct 31 15:22:06.511408 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 925/1923] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:06 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:06.516777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7b942fd1-11dc-4287-8763-1978b5e79305 req-62120a4f-4407-4b01-a26d-aff98cf060cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed", "tag": "56ee8927-e23b-4403-b7f4-d4386c51dc07"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:06.530239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7b942fd1-11dc-4287-8763-1978b5e79305 req-62120a4f-4407-4b01-a26d-aff98cf060cd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.530730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7b942fd1-11dc-4287-8763-1978b5e79305 req-62120a4f-4407-4b01-a26d-aff98cf060cd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.531171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7b942fd1-11dc-4287-8763-1978b5e79305 req-62120a4f-4407-4b01-a26d-aff98cf060cd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.549490 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7b942fd1-11dc-4287-8763-1978b5e79305 req-62120a4f-4407-4b01-a26d-aff98cf060cd service nova] Creating event network-changed:56ee8927-e23b-4403-b7f4-d4386c51dc07 for instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed on n-h1-858383-17 Oct 31 15:22:06.555329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7b942fd1-11dc-4287-8763-1978b5e79305 req-62120a4f-4407-4b01-a26d-aff98cf060cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042544 Oct 31 15:22:06.556998 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 926/1924] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:06.562971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:06.563686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 09142860-c91f-4a33-b580-e1288ecae4bd] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:06.571927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.572238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.572683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.573422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.574594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.575155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.590667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] HTTP exception thrown: Instance 09142860-c91f-4a33-b580-e1288ecae4bd could not be found. Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Request method failure captured: Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd HTTP/1.1 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-axEn0Jxb5Vg5_xz88-6FXhruuI4FbcIe-ubvC8OLQ8RvYgkfE-h0znKGXNNYs8VtUgdb2AWkH8mva-fdMoA2PrxzhbyGbPVhpoRLl_DDzkQDGz4PDTqzVJZ06qp6cLOC3n4r1YDI41xuR7tuyy8f5GeJirTS8atTmJCnSLSJg107E Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-MigrationsAdminTest-836805078 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-MigrationsAdminTest-836805078-project Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8184a0251b8e4cb882556b458bbc4de7 Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-MigrationsAdminTest-836805078-project Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 09142860-c91f-4a33-b580-e1288ecae4bd could not be found. Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '09142860-c91f-4a33-b580-e1288ecae4bd'} Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09142860-c91f-4a33-b580-e1288ecae4bd could not be found. Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09142860-c91f-4a33-b580-e1288ecae4bd could not be found. Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:06.592625 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09142860-c91f-4a33-b580-e1288ecae4bd could not be found. Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Returning 404 to user: Instance 09142860-c91f-4a33-b580-e1288ecae4bd could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de40359f-e154-46a1-a754-6203d11d20c8 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd" status: 404 len: 111 microversion: 2.1 time: 0.035933 Oct 31 15:22:06.604194 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 927/1925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:06 2022] GET /compute/v2.1/servers/09142860-c91f-4a33-b580-e1288ecae4bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:06.605550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:06.607764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:06.615028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.615680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.616430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.617251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.617889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.619040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.033243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.042668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.044404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.045337 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b0b24510-7451-48cd-8f93-c868e8f07a1f tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1731 microversion: 2.25 time: 0.449491 Oct 31 15:22:07.045928 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 928/1926] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:06 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1731 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:07.050596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.051155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.057327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.057849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.058292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.059003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.059462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.059888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.087335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:07.214939 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7925097c-ff7f-4ae5-8c6f-8364d4be364e tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 204 len: 0 microversion: 2.1 time: 0.165536 Oct 31 15:22:07.215890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 929/1927] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:07 2022] DELETE /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:07.231317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.233159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.246529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.247179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.249135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.250017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.251239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.252140 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9294e845-19b4-4ac6-af26-4fff10a6806b tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.830171 Oct 31 15:22:07.252717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.252855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 999/1928] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:22:06 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:07.257812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.258655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.270870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.273921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.276224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.284226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.285716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.286508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.434470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.476449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.478501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.488727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-825418e2-355c-4132-94f6-61ae667847f9 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.262986 Oct 31 15:22:07.489878 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 930/1929] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:07.502994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.503623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.511693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.512183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.512619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.513366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.514038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.514468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.621979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.623926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.639902 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-61207ec2-b381-4579-a24c-3a3bb95e44d8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1273 microversion: 2.1 time: 0.145520 Oct 31 15:22:07.642221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 931/1930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:07.661440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.662976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.666932 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03090ac1-5b30-4ab9-8cd9-28143af57bbd tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 200 len: 1489 microversion: 2.1 time: 0.388805 Oct 31 15:22:07.667805 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1000/1931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 1489 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:07.680910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.681604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.682060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.683248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14a92d65-b7d1-4bd0-87f2-27b20693d8f4 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca675c550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.683683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.684466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.688747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.895599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14a92d65-b7d1-4bd0-87f2-27b20693d8f4 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/68eff2e6-c46a-46fb-a24f-06e0dd814963" status: 200 len: 664 microversion: 2.1 time: 0.226403 Oct 31 15:22:07.896464 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1001/1932] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/os-security-groups/68eff2e6-c46a-46fb-a24f-06e0dd814963 => generated 664 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:07.904086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.905332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.915426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.916581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.917249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.918157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.919204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.920032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.969676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.979390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d1b6f7e8-aeb6-4fc5-9b4c-f404351acedc tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1469 microversion: 2.1 time: 0.334535 Oct 31 15:22:07.980233 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 932/1933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:07.988365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.989033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:08.015115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.016261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.017180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.020656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.023187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.023722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.329017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:08.338030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:08.339485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:08.340652 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc2430cb-2045-4923-a711-9b9001760162 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.359444 Oct 31 15:22:08.355037 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 933/1934] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:08.355146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:08.360817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-200887853"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:08.364079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:08.366031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-194d011b-b657-49b8-bb50-0d152e77bd2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.465982 Oct 31 15:22:08.366638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1002/1935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:08.373911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.374413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.374934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.375921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.376546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.377157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.390232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19d93722-36d3-4640-9a34-0ee7ee6fd4b7 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca1b8b550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:08.713320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5c3b4db-0836-4f81-9d24-ea1dfd8feb5b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6/action" status: 202 len: 0 microversion: 2.1 time: 0.360840 Oct 31 15:22:08.725240 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 934/1936] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:08 2022] POST /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:22:08.747310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:08.755001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:08.762351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.762853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.763297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.764021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.764529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.765073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.812098 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19d93722-36d3-4640-9a34-0ee7ee6fd4b7 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/7d899755-466d-46cd-bec0-20b6a4a6e124" status: 202 len: 0 microversion: 2.1 time: 0.428599 Oct 31 15:22:08.822655 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1003/1937] 10.222.0.48 () {58 vars in 1287 bytes} [Mon Oct 31 15:22:08 2022] DELETE /compute/v2.1/os-security-group-rules/7d899755-466d-46cd-bec0-20b6a4a6e124 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:08.830831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c575d7f7-e8f4-4a43-b47e-ff6d32606b61 req-dcb240b3-96a0-463e-bae9-15f87da14968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111e882b-03b2-41b1-8b24-dc614d2d17a3", "name": "network-vif-plugged", "status": "completed", "tag": "e9680fc3-1bb8-486f-9398-0fbe7cd2c997"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:08.845385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c575d7f7-e8f4-4a43-b47e-ff6d32606b61 req-dcb240b3-96a0-463e-bae9-15f87da14968 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.846712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c575d7f7-e8f4-4a43-b47e-ff6d32606b61 req-dcb240b3-96a0-463e-bae9-15f87da14968 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.847341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c575d7f7-e8f4-4a43-b47e-ff6d32606b61 req-dcb240b3-96a0-463e-bae9-15f87da14968 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.859366 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c575d7f7-e8f4-4a43-b47e-ff6d32606b61 req-dcb240b3-96a0-463e-bae9-15f87da14968 service nova] Creating event network-vif-plugged:e9680fc3-1bb8-486f-9398-0fbe7cd2c997 for instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 on n-h2-858383-17 Oct 31 15:22:08.865858 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c575d7f7-e8f4-4a43-b47e-ff6d32606b61 req-dcb240b3-96a0-463e-bae9-15f87da14968 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041852 Oct 31 15:22:08.870601 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1004/1938] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:08.877314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:08.878633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:08.887745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.888609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.889258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:08.890156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:08.890782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:08.891377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.003726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.019173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.023067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.039598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b92baab-884e-4d3a-9e1c-c225142a8d8d tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.167165 Oct 31 15:22:09.040203 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1005/1939] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:08 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:09.045876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.047332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:09.056843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.057599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.058276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.071903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.073886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.074540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.079600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.111951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.114195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.122576 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04595eca-7e4d-4fe3-b6e6-305f13ac4b9e tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1731 microversion: 2.25 time: 0.388933 Oct 31 15:22:09.123218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 935/1940] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:08 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1731 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:09.148246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd1c2470-365c-4a6e-b4e4-b18854ef5902 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca669d9d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.246156 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd1c2470-365c-4a6e-b4e4-b18854ef5902 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.120140 Oct 31 15:22:09.246975 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 936/1941] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:09 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:09.251925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89f5c7ba-603b-4e0f-88c3-c42029b75b23 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca6749040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.611936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.626155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b1d9f0a-9597-461d-a88d-4cc2ce0543ce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1315 microversion: 2.1 time: 0.581929 Oct 31 15:22:09.627058 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1006/1942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:09 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:09.643271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.647117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:09.665079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.666629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.668985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.672872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.673742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.674446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.944969 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89f5c7ba-603b-4e0f-88c3-c42029b75b23 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/68eff2e6-c46a-46fb-a24f-06e0dd814963" status: 202 len: 0 microversion: 2.1 time: 0.696700 Oct 31 15:22:09.946712 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 937/1943] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:09 2022] DELETE /compute/v2.1/os-security-groups/68eff2e6-c46a-46fb-a24f-06e0dd814963 => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:09.952520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.953178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:09.973849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.974360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.974797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.975739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.976370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.976995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.044034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.052780 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60f2fad6-fcac-42b4-811c-612f9c90b407 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1469 microversion: 2.1 time: 0.420651 Oct 31 15:22:10.058851 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1007/1944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:09 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:10.087057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.087822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:10.094960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.095591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.096129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.096994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.097553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.099352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.352472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.364323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.365997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.367243 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85129f61-25bc-4c66-acf6-ce615fc7b900 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.420337 Oct 31 15:22:10.367807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 938/1945] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:09 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:10.373003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca1dbcd30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.409229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.417568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:22:10.418655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Neutron security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:22:10.419452 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] HTTP exception thrown: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.419452 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] Oct 31 15:22:10.429815 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c34b8494-7fbf-444b-b776-0d0c97bc9e47 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.352815 Oct 31 15:22:10.430698 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1008/1946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:10.436454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.437315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:10.444420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.445724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.446360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.447261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.448063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.448669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Request method failure captured: Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-security-groups/25cfeff0-4d32-457d-9e6d-39d389f01cb3 HTTP/1.1 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-gCaGjrSHjpIDcJB7bBOHpkea9aOUGXcp021b0JEq72JMilUHA9CWo2cL-Qm44lHBKVxf0FrOybVK1PZckS3bSK-Dq5Iak0T1SSDqAcKTQGCO5rOSBKOH1Vkga919myf7FWnKztlJ5cDOklf1l6jQOT64cI_OCSo-oZoxojnjAbHxs Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c180a5b1493847989f13de423079add7 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1170011306 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c180a5b1493847989f13de423079add7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c180a5b1493847989f13de423079add7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c180a5b1493847989f13de423079add7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c180a5b1493847989f13de423079add7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1170011306 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c180a5b1493847989f13de423079add7 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1170011306 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupRulesTestJSON-1170011306-project Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 5fa3db22aa5d440b9743cb565cd4e2ee Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1170011306-project Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '25cfeff0-4d32-457d-9e6d-39d389f01cb3'} Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:22:10.449410 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Returning 404 to user: Security group 25cfeff0-4d32-457d-9e6d-39d389f01cb3 does not exist Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-693f43d9-7322-40d9-961b-7f4f2131f6e5'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:10.454553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-482c32d9-7232-47d8-b0e0-7ec3a7cb6889 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/25cfeff0-4d32-457d-9e6d-39d389f01cb3" status: 404 len: 194 microversion: 2.1 time: 0.082746 Oct 31 15:22:10.459038 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 939/1947] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:10 2022] DELETE /compute/v2.1/os-security-groups/25cfeff0-4d32-457d-9e6d-39d389f01cb3 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:10.464115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.466460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:10.475548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:10.477948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.478459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.478906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.479654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.480119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.480604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.554676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.566183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.568424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.576870 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d0d6fef-a404-41d1-92c8-2616f04b3de0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.144909 Oct 31 15:22:10.578154 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1009/1948] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:10.583700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45766bbc-a969-4078-8e5a-98c23f9a3a8c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca6823700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.650127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45766bbc-a969-4078-8e5a-98c23f9a3a8c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.070691 Oct 31 15:22:10.651093 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1010/1949] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:10.670105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-489e88b9-e2b6-4f29-9c65-6fd88e9c881c req-622ed1df-c08b-48a4-a6d8-c5b1d582dd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13dab01-1cb3-43d8-ae38-9a881eb387e8", "tag": "b5382590-93df-40d3-bde0-c48e206a9aa4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:10.698118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-489e88b9-e2b6-4f29-9c65-6fd88e9c881c req-622ed1df-c08b-48a4-a6d8-c5b1d582dd65 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.699094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-489e88b9-e2b6-4f29-9c65-6fd88e9c881c req-622ed1df-c08b-48a4-a6d8-c5b1d582dd65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.703077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-489e88b9-e2b6-4f29-9c65-6fd88e9c881c req-622ed1df-c08b-48a4-a6d8-c5b1d582dd65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.730088 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-489e88b9-e2b6-4f29-9c65-6fd88e9c881c req-622ed1df-c08b-48a4-a6d8-c5b1d582dd65 service nova] Creating event network-changed:b5382590-93df-40d3-bde0-c48e206a9aa4 for instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 on n-h2-858383-17 Oct 31 15:22:10.743924 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-489e88b9-e2b6-4f29-9c65-6fd88e9c881c req-622ed1df-c08b-48a4-a6d8-c5b1d582dd65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090928 Oct 31 15:22:10.745116 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1011/1950] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:10.756293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b79f9566-61e1-4bcc-9519-52506dd29c8e tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca66be430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.836599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.846923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.849769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:10.852017 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bdd1d47a-747e-4c63-830c-d9ab9b5b99ff tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1731 microversion: 2.25 time: 0.394570 Oct 31 15:22:10.871249 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 940/1951] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1731 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:10.877205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.878098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:10.885635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.886395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.887801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.889558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.890216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.890821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.576400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:11.607301 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eeaa9580-afb0-4111-bb25-8cbde0f2c74a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1315 microversion: 2.1 time: 0.732396 Oct 31 15:22:11.619212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 941/1952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:11.637414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5d6431cb-b5f1-4c20-b5d6-9e8dfcedcfbf req-fdd8d3e6-46fd-4072-b865-9c96a79c97d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3545bebb-a6c1-49e8-94d4-30a2def0af20", "name": "network-vif-plugged", "status": "completed", "tag": "8f1bfc00-95df-49d2-8890-b3af4c81d704"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:11.657660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b79f9566-61e1-4bcc-9519-52506dd29c8e tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/9398d3fc-176a-497f-8bb1-7f729f050ed5" status: 202 len: 0 microversion: 2.1 time: 0.911127 Oct 31 15:22:11.662376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1012/1953] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:10 2022] DELETE /compute/v2.1/os-security-groups/9398d3fc-176a-497f-8bb1-7f729f050ed5 => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:11.666765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:11.667433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:11.682406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.682976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.685236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.687872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5d6431cb-b5f1-4c20-b5d6-9e8dfcedcfbf req-fdd8d3e6-46fd-4072-b865-9c96a79c97d3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.688481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5d6431cb-b5f1-4c20-b5d6-9e8dfcedcfbf req-fdd8d3e6-46fd-4072-b865-9c96a79c97d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.688910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5d6431cb-b5f1-4c20-b5d6-9e8dfcedcfbf req-fdd8d3e6-46fd-4072-b865-9c96a79c97d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.689360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.690756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.694350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.707758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5d6431cb-b5f1-4c20-b5d6-9e8dfcedcfbf req-fdd8d3e6-46fd-4072-b865-9c96a79c97d3 service nova] Creating event network-vif-plugged:8f1bfc00-95df-49d2-8890-b3af4c81d704 for instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 on n-h1-858383-17 Oct 31 15:22:11.715155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5d6431cb-b5f1-4c20-b5d6-9e8dfcedcfbf req-fdd8d3e6-46fd-4072-b865-9c96a79c97d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093959 Oct 31 15:22:11.716446 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 942/1954] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:11.725170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:11.726105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:11.734673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.735442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.735988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.737357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.738194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.738881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.920139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:11.932071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6169dd2f-e710-4089-acfa-e6386aaa07de tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1469 microversion: 2.1 time: 0.272641 Oct 31 15:22:11.932816 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1013/1955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:11 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:11.943722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:11.947677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:11.958392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.958885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.959321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.960030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.962078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.962891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.088399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.108104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.110301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.111728 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8569a5ee-1f4b-4ec1-af60-c90b49812b3b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 0.392701 Oct 31 15:22:12.112464 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 943/1956] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:11 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:12.125721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.126362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.137199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.137687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.142816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.143832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.154108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.154888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.190795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:12.198665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.223543 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f5149a6-bb9a-42b5-ae43-08e1ffc98eb5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.283782 Oct 31 15:22:12.232744 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1014/1957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:11 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.232744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b12f15f-6ada-4df9-ad92-df6c8a57a1ec tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca67263a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.269431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.281385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.284154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.294488 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a1695b28-513e-4312-adeb-64db3cbba8f0 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.180554 Oct 31 15:22:12.310012 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b12f15f-6ada-4df9-ad92-df6c8a57a1ec tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.072430 Oct 31 15:22:12.310012 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1015/1958] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.311540 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 944/1959] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:12.312554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9541886b-500a-4ebe-a703-4f44f765cab3 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca2fea550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.326104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.327004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.346870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.347795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.348449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.349469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.350104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.350707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.584676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.602831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.611734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.614058 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3439ec6-ec73-4737-a935-4e698a7f5b20 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1731 microversion: 2.25 time: 0.298952 Oct 31 15:22:12.615140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 945/1960] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1731 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:12.650695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.651322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.668546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.669398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.669682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.670394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.670860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.671364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.829914 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9541886b-500a-4ebe-a703-4f44f765cab3 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/31303d13-7fd2-4039-810d-2a611fd068a1" status: 202 len: 0 microversion: 2.1 time: 0.526158 Oct 31 15:22:12.830829 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1016/1961] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:12 2022] DELETE /compute/v2.1/os-security-groups/31303d13-7fd2-4039-810d-2a611fd068a1 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:12.840830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1788eb9-8a54-4141-89f9-9cb428278781 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca6710280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:13.145734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:13.161950 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5fdba79-b6e2-4775-92dc-83dbf6cb89cb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1315 microversion: 2.1 time: 0.529442 Oct 31 15:22:13.184032 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 946/1962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:13.195256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:13.196731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:13.208130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.209191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.209824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.210784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.211415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.212707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.660962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:13.676392 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-008ad1a3-4378-45f6-930d-1e730ffcbc87 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1469 microversion: 2.1 time: 0.489876 Oct 31 15:22:13.685802 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 947/1963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:13 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:13.690981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:13.693447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:13.712968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.717441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.719336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.720402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.721166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.721859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.239597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:14.295436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=18 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:14.490664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1788eb9-8a54-4141-89f9-9cb428278781 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/e373d4ed-fad6-4f56-9835-db7e2bcc8134" status: 202 len: 0 microversion: 2.1 time: 1.653666 Oct 31 15:22:14.495725 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1017/1964] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:12 2022] DELETE /compute/v2.1/os-security-groups/e373d4ed-fad6-4f56-9835-db7e2bcc8134 => generated 0 bytes in 1659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:22:14.502995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:14.504589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:14.517879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:14.518377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:14.518811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.520148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:14.520645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:14.543733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.929768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:14.938745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:14.948394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:14.949851 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0301131c-7f4b-41df-a588-43f137541465 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1361 microversion: 2.26 time: 1.262607 Oct 31 15:22:14.950634 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 948/1965] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:13 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1361 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:14.962082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-71e62211-15eb-4bb0-9991-ffd8bae90d11 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1d90e50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.056201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.065653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34cbbbe5-9a6b-496f-b9e7-64e8c3458e61 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.566680 Oct 31 15:22:15.088654 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1018/1966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:14 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:15.108169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.110200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.123794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.129406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.130144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.131071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.131728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.132343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.267481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.280956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.287818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.301799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ea1bc80-a071-43bf-b448-e235f8bce4c6 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.207230 Oct 31 15:22:15.302652 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1019/1967] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:15 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:15.349856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.350816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.369155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.369667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.370092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.370800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.371296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.371677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.877070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.887900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.894142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.897526 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d15ac2fd-4ee2-41d9-9ed4-eec1dfcc2ec2 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1731 microversion: 2.25 time: 0.572502 Oct 31 15:22:15.898384 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1020/1968] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:15 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1731 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:15.906977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "name": "network-vif-unplugged", "status": "completed", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}, {"server_uuid": "edc1afd0-e44e-407e-9003-2b4505e1eaf6", "name": "network-vif-plugged", "status": "completed", "tag": "5915d395-173d-4415-8a4d-063d2a4b965d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:15.937058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.938012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.939414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.966479 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] Creating event network-vif-unplugged:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h1-858383-17 Oct 31 15:22:15.969532 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] Creating event network-vif-plugged:5915d395-173d-4415-8a4d-063d2a4b965d for instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 on n-h2-858383-17 Oct 31 15:22:15.999038 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6366e8fd-619c-496c-a630-7e08d769b9bc req-8d51f60e-2322-454f-811d-f707f932facd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.097517 Oct 31 15:22:16.002947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1021/1969] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:16.013810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:16.021511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:16.038316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.040394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.043724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.044823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.046055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.047852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.466626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:16.482902 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6b330ea-bc02-43ca-b059-b424fb62a527 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1315 microversion: 2.1 time: 0.475968 Oct 31 15:22:16.487065 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1022/1970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:16 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:16.493319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c101f815-f7f6-4b4b-9e5c-b936282a3619 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca66be040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:16.976416 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c101f815-f7f6-4b4b-9e5c-b936282a3619 tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f62f8886-259d-42ba-9418-44ecb80ed65e" status: 202 len: 0 microversion: 2.1 time: 0.486771 Oct 31 15:22:16.977204 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1023/1971] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:16 2022] DELETE /compute/v2.1/os-security-groups/f62f8886-259d-42ba-9418-44ecb80ed65e => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:16.982359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:16.983181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:17.001853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.002349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.006619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.007469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.009911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.010470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.276973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.286444 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9dd3331-1968-4e45-bf50-fb5c4d079baf tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1469 microversion: 2.1 time: 0.307885 Oct 31 15:22:17.301974 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1024/1972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:16 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:17.307747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:17.309901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:17.330074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.330573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.331013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.334028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.334505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.334935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.355130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:17.555247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.573994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.575782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.577060 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c432ec8-c355-4efb-aba2-a7a7ed653f5b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1544 microversion: 2.26 time: 0.278560 Oct 31 15:22:17.592732 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1025/1973] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:17 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1544 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:17.592732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:17.592732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:17.592732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.592732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.593302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.593758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.594218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.594981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.793474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.803639 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bff34950-e64e-44d2-b37d-4f23cb488e9d tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.224231 Oct 31 15:22:17.828873 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1026/1974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:17 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:17.842237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:17.843157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:17.860749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.862229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.863712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.871167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.872139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.872971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.967461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.978712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.981997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:17.988520 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28974918-acf8-4b4f-8e86-24b21fd9e776 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.155615 Oct 31 15:22:17.989834 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1027/1975] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:17 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:17.995465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:17.996359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.005040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.005820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.006431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.007331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.007959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.008540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.096555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:18.107806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:18.110182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:18.111729 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce20aae6-c26e-4b36-9b35-10e2a484ec8c tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1664 microversion: 2.25 time: 0.119928 Oct 31 15:22:18.112391 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1028/1976] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:17 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1664 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:18.119335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-359ef0f8-9384-4cef-aef1-568656bdf258 req-effcfe9e-6e33-4c3d-abb5-ffd080af9da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86ca09a-927f-4b27-89b2-db9834d10c3c", "name": "network-vif-deleted", "tag": "d47e8eda-2de0-4bec-8ab5-ac3c4682b94c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:18.134804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-359ef0f8-9384-4cef-aef1-568656bdf258 req-effcfe9e-6e33-4c3d-abb5-ffd080af9da5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.135371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-359ef0f8-9384-4cef-aef1-568656bdf258 req-effcfe9e-6e33-4c3d-abb5-ffd080af9da5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.135932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-359ef0f8-9384-4cef-aef1-568656bdf258 req-effcfe9e-6e33-4c3d-abb5-ffd080af9da5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.156944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-359ef0f8-9384-4cef-aef1-568656bdf258 req-effcfe9e-6e33-4c3d-abb5-ffd080af9da5 service nova] Creating event network-vif-deleted:d47e8eda-2de0-4bec-8ab5-ac3c4682b94c for instance e86ca09a-927f-4b27-89b2-db9834d10c3c on n-h1-858383-17 Oct 31 15:22:18.165497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-359ef0f8-9384-4cef-aef1-568656bdf258 req-effcfe9e-6e33-4c3d-abb5-ffd080af9da5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051023 Oct 31 15:22:18.166775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1029/1977] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:18.179974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21595471-9c03-4784-bc47-1c58175aa7fd tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] Calling method '.version_select at 0x7f5ca66a8670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.579227 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21595471-9c03-4784-bc47-1c58175aa7fd tempest-SecurityGroupRulesTestJSON-1170011306 tempest-SecurityGroupRulesTestJSON-1170011306-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/313ea2eb-107d-489b-a541-cfc0c77755e6" status: 202 len: 0 microversion: 2.1 time: 0.406207 Oct 31 15:22:18.583992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1030/1978] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:22:18 2022] DELETE /compute/v2.1/os-security-groups/313ea2eb-107d-489b-a541-cfc0c77755e6 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:18.586760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.588250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.605445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.607471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.610497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.627962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.630026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.631673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.850326 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-71e62211-15eb-4bb0-9991-ffd8bae90d11 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 4.898780 Oct 31 15:22:19.850940 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 949/1979] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:14 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 4900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:19.857021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca6726310>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.883145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.883639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.884082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.884566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.892477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.893000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.893442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.894221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.894682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.895112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.969961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.973704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.974406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.008649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.009465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.010084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.058967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.073349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb94dd8a-49b1-481b-8c89-1c14a64df59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1315 microversion: 2.1 time: 1.491853 Oct 31 15:22:20.074052 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1031/1980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1315 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:20.112421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-14cf1063-f597-43dd-bc1a-cbd0f599b58a req-72a0b886-c32c-4a67-8639-7c73d68c5e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13dab01-1cb3-43d8-ae38-9a881eb387e8", "name": "network-vif-plugged", "status": "completed", "tag": "b5382590-93df-40d3-bde0-c48e206a9aa4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:20.115824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:20.126038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-14cf1063-f597-43dd-bc1a-cbd0f599b58a req-72a0b886-c32c-4a67-8639-7c73d68c5e6c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.127256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-14cf1063-f597-43dd-bc1a-cbd0f599b58a req-72a0b886-c32c-4a67-8639-7c73d68c5e6c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.127963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-14cf1063-f597-43dd-bc1a-cbd0f599b58a req-72a0b886-c32c-4a67-8639-7c73d68c5e6c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.143940 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3224512-61f1-4d11-98ce-d39a6cd1dcb9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1483344469" status: 201 len: 0 microversion: 2.26 time: 0.291961 Oct 31 15:22:20.152685 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-14cf1063-f597-43dd-bc1a-cbd0f599b58a req-72a0b886-c32c-4a67-8639-7c73d68c5e6c service nova] Creating event network-vif-plugged:b5382590-93df-40d3-bde0-c48e206a9aa4 for instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 on n-h2-858383-17 Oct 31 15:22:20.154222 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 950/1981] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Oct 31 15:22:19 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1483344469 => generated 0 bytes in 302 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:22:20.159532 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-14cf1063-f597-43dd-bc1a-cbd0f599b58a req-72a0b886-c32c-4a67-8639-7c73d68c5e6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060595 Oct 31 15:22:20.162815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.163354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.164922 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1032/1982] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:20.171073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.171802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.179887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.181113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.181871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.182628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.189914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.192125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.212332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.213012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.213279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.214411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.214533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.214868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.331886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.340282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b27f758c-30ec-411d-9f85-cffb36298b94 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1427 microversion: 2.1 time: 0.184757 Oct 31 15:22:20.345378 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 951/1983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:20.361816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.364507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.389766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.390734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.391401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.392451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.393222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.393893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.886662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.897876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.899355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.911935 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c90bafe-a2db-46d8-8072-016c3ac3fa0f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.565185 Oct 31 15:22:20.912553 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 952/1984] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:20.929037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.929678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.938432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.938940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.939387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.940103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.940566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.941676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.982828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.983354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.983808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.984265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lazy-loading 'fault' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:21.064043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.079692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.087866 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27c832ee-a471-420f-bb62-650852d7fe69 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.920931 Oct 31 15:22:21.093380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.110756 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1033/1985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.112062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.119731 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6fb3d578-e9f7-4b11-9212-bae223a167c6 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1375 microversion: 2.25 time: 0.203846 Oct 31 15:22:21.121515 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 953/1986] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:21.127589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e85277cb-c77d-4562-84b7-e127ad53263d tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca6726310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.134583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a4c8e529-1405-4d9e-8760-e1695b6bb69d req-a20e2aef-4577-4595-bd61-cc53f938a381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96718579-8de0-4966-8f19-05cc9cc4da10", "name": "network-vif-deleted", "tag": "92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:21.150491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e85277cb-c77d-4562-84b7-e127ad53263d tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.151384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e85277cb-c77d-4562-84b7-e127ad53263d tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.151823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e85277cb-c77d-4562-84b7-e127ad53263d tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.163532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4c8e529-1405-4d9e-8760-e1695b6bb69d req-a20e2aef-4577-4595-bd61-cc53f938a381 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.164046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4c8e529-1405-4d9e-8760-e1695b6bb69d req-a20e2aef-4577-4595-bd61-cc53f938a381 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.164468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4c8e529-1405-4d9e-8760-e1695b6bb69d req-a20e2aef-4577-4595-bd61-cc53f938a381 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.185558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a4c8e529-1405-4d9e-8760-e1695b6bb69d req-a20e2aef-4577-4595-bd61-cc53f938a381 service nova] Creating event network-vif-deleted:92e073d3-8a18-4c2a-8a31-b4c7dd12ecb5 for instance 96718579-8de0-4966-8f19-05cc9cc4da10 on n-h1-858383-17 Oct 31 15:22:21.185735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e85277cb-c77d-4562-84b7-e127ad53263d tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1483344469" status: 204 len: 0 microversion: 2.26 time: 0.072538 Oct 31 15:22:21.186545 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1034/1987] 10.222.0.48 () {60 vars in 1361 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1483344469 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:21.199014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7bddaff-aec7-4ed6-9bc1-cf179331f998 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca674ce50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.201326 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a4c8e529-1405-4d9e-8760-e1695b6bb69d req-a20e2aef-4577-4595-bd61-cc53f938a381 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076307 Oct 31 15:22:21.205152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 954/1988] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:21.213983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.215051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.223323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.224144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.224811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.225745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.226397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.227001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.277020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7bddaff-aec7-4ed6-9bc1-cf179331f998 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.089118 Oct 31 15:22:21.277922 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1035/1989] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.290240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca6726ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.299889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.301309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.302130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.303073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.310340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.311137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.311747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.312630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.313285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.314204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.373716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.373956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.374353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.406588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:21.437141 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b2699db-9000-4f61-bf3e-d8c73dbb8415 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 204 len: 0 microversion: 2.26 time: 0.153005 Oct 31 15:22:21.440749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1036/1990] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Oct 31 15:22:21 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:21.448473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.449138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.462888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.463710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.464338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.465267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.465952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.466550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.490131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.500411 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-186cf7bb-d6d8-497f-a9bf-e8dccf40d5d0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1315 microversion: 2.1 time: 0.293866 Oct 31 15:22:21.502051 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 955/1991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.512833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6cfed48c-cbdb-4d88-ad7b-d273b29cde26 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca1d4a040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.529290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cfed48c-cbdb-4d88-ad7b-d273b29cde26 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.530073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cfed48c-cbdb-4d88-ad7b-d273b29cde26 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.530924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cfed48c-cbdb-4d88-ad7b-d273b29cde26 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.559029 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6cfed48c-cbdb-4d88-ad7b-d273b29cde26 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 200 len: 12 microversion: 2.26 time: 0.054176 Oct 31 15:22:21.568669 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 956/1992] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 12 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.583968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca680f0d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.594138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.599583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.601302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.602897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.603556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.621190 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f1afe0b-3c66-482a-81ad-b670485e32c1 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1427 microversion: 2.1 time: 0.169537 Oct 31 15:22:21.622160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1037/1993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.633116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.635328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.636218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.640372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.641103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.641733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.685860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.686372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.686828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.710581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.711814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.713424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.758633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:21.787063 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b94b2ee5-1220-4719-99b6-eb14a47f12eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1893495788" status: 201 len: 0 microversion: 2.26 time: 0.216751 Oct 31 15:22:21.789038 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 957/1994] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Oct 31 15:22:21 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1893495788 => generated 0 bytes in 219 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:22:21.798452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78287f4e-6bab-4691-87a0-f112ea009079 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca66be280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.813205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78287f4e-6bab-4691-87a0-f112ea009079 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.813562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78287f4e-6bab-4691-87a0-f112ea009079 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.813734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78287f4e-6bab-4691-87a0-f112ea009079 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.833539 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78287f4e-6bab-4691-87a0-f112ea009079 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 200 len: 36 microversion: 2.26 time: 0.038901 Oct 31 15:22:21.834339 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1038/1995] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 36 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.846676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca1dbef70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.863018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.863524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.863974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.864465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.871631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.872417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.872905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.874002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.874469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.874917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.914683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.915374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.915605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.952109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.959331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.978618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.985270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.989212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:21.992612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.994592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.995099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.997733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.030269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:22.071601 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-59af8822-55d9-43f1-8de3-fbf423358d41 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1893495788" status: 204 len: 0 microversion: 2.26 time: 0.230766 Oct 31 15:22:22.075882 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 958/1996] 10.222.0.48 () {60 vars in 1364 bytes} [Mon Oct 31 15:22:21 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1893495788 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:22.083799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b481d4cc-670d-403e-a814-befda5f19e5c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca1d4a040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.095545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b481d4cc-670d-403e-a814-befda5f19e5c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.096047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b481d4cc-670d-403e-a814-befda5f19e5c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.096494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b481d4cc-670d-403e-a814-befda5f19e5c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.124921 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b481d4cc-670d-403e-a814-befda5f19e5c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 200 len: 12 microversion: 2.26 time: 0.045406 Oct 31 15:22:22.125859 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 959/1997] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 12 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:22.133309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.134195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.142309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.142806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.143244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.143998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.144454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.144924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.223680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.234122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.235558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.262527 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78cea3b8-a92e-442b-a9f6-f7106416fb33 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.320400 Oct 31 15:22:22.263432 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1039/1998] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:22.269851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca66a8280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.283324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.291835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.292533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.294845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.308104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:22.313530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.317541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.318223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.319133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.319751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.331697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.387848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.400266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.400941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.425789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:22.460078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb4ed1fc-4cd6-488a-8396-9923ea5ce54e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 204 len: 0 microversion: 2.26 time: 0.195479 Oct 31 15:22:22.461234 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1040/1999] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Oct 31 15:22:22 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:22.473389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.474340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.484024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.487083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.488288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.491173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.491942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.492563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.600409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.601619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.604596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.607681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lazy-loading 'fault' on Instance uuid e86ca09a-927f-4b27-89b2-db9834d10c3c {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:22.775427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.786904 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e8e7a73-5bc6-4b95-a811-35324b620058 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.657349 Oct 31 15:22:22.787493 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 960/2000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:22.803784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8cb3e39-71f4-4756-8366-f1b1c0dee18f tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1d4a040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.864724 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8cb3e39-71f4-4756-8366-f1b1c0dee18f tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.072501 Oct 31 15:22:22.873983 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 961/2001] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:22.879214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca6726c10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.892361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.893149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.894145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.895661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.902652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.903367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.904482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.905783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.906442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.907040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.929846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.941012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.950332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.951606 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5053f32-dc44-4bcc-8fa2-108889ea5544 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 200 len: 1375 microversion: 2.25 time: 0.489266 Oct 31 15:22:22.952383 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1041/2002] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 1375 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:22.958425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.969566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.976456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.978947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.979502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.982502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.982502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.982502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.001014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.001506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.002933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.042656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.043171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.043618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.125551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:23.158396 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6aff0e4d-4097-47a8-8415-44ca2dd997c9 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1203857090" status: 201 len: 0 microversion: 2.26 time: 0.282893 Oct 31 15:22:23.167827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 962/2003] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Oct 31 15:22:22 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1203857090 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:22:23.182120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.184441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.204768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.208688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.214766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.242587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.251186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.256056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.365991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.369307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.370467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.373193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lazy-loading 'fault' on Instance uuid 96718579-8de0-4966-8f19-05cc9cc4da10 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:23.504584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.520561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-14e2358d-e3a4-45f2-98fd-ae9e4f5c7c29 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1303 microversion: 2.1 time: 0.351372 Oct 31 15:22:23.528779 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 963/2004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:23 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1303 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:23.529207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.529714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-21fc61c2-d918-4d9a-a121-ddc98041f3aa req-71f8fda1-02d5-41aa-bc11-f97701853f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed", "name": "network-vif-plugged", "status": "completed", "tag": "56ee8927-e23b-4403-b7f4-d4386c51dc07"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:23.533913 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-562c6102-7123-4e1d-89e8-640a58a64034 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1502 microversion: 2.1 time: 0.580491 Oct 31 15:22:23.535233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1042/2005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1502 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:23.546168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca67c9ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.556015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-21fc61c2-d918-4d9a-a121-ddc98041f3aa req-71f8fda1-02d5-41aa-bc11-f97701853f57 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.563997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-21fc61c2-d918-4d9a-a121-ddc98041f3aa req-71f8fda1-02d5-41aa-bc11-f97701853f57 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.564602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-21fc61c2-d918-4d9a-a121-ddc98041f3aa req-71f8fda1-02d5-41aa-bc11-f97701853f57 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.575755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.576167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.576597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.577097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.580947 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-21fc61c2-d918-4d9a-a121-ddc98041f3aa req-71f8fda1-02d5-41aa-bc11-f97701853f57 service nova] Creating event network-vif-plugged:56ee8927-e23b-4403-b7f4-d4386c51dc07 for instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed on n-h1-858383-17 Oct 31 15:22:23.589113 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-21fc61c2-d918-4d9a-a121-ddc98041f3aa req-71f8fda1-02d5-41aa-bc11-f97701853f57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066603 Oct 31 15:22:23.590760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 964/2006] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:23.598282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.598534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.598774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.599382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.600548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.600721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.600721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.600958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.611439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.612273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.613222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.614645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.615289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.615999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.659840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.667039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.667757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.698747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.700399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.700891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.727350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:23.771614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:23.823722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.839807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.841224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.852819 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-595c9d94-ac51-40eb-96f6-c6fdd3201802 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.260494 Oct 31 15:22:23.867992 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 965/2007] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:23 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:23.894260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.896034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.911267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.911267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.915684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.916862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.917344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.917790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.133103 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc306033-ea88-4fe3-98cc-5e74ee37723c tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-632956750" status: 201 len: 0 microversion: 2.26 time: 0.596262 Oct 31 15:22:24.138408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1043/2008] 10.222.0.48 () {62 vars in 1377 bytes} [Mon Oct 31 15:22:23 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-632956750 => generated 0 bytes in 601 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 31 15:22:24.143459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99f2c1ab-469c-4162-940c-a36fb7161c97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1b5e820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.254949 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99f2c1ab-469c-4162-940c-a36fb7161c97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.116883 Oct 31 15:22:24.256792 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1044/2009] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:24.268787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.269520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: e86ca09a-927f-4b27-89b2-db9834d10c3c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.280336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.282085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.290475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.291530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.293148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.296589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.327050 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] HTTP exception thrown: Instance e86ca09a-927f-4b27-89b2-db9834d10c3c could not be found. Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Request method failure captured: Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c HTTP/1.1 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-Z6Sm7z2M1p8toEv8qisIr3mKMSFi4sgjd-qM1BiMmLinw_GLsICkIPmLsKKlnVT0wFU4zgAGwPHACEZaRYB2uLOh8fy3d3zJDFJyGsHpEro9EvjR7LpYEMWTiqsEHfW41uSvmCvpWThAlPzpDeN0oucQgzPm3xLaz1sUCD_I3W-ik Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d09369d806ba4afe911914e3272a59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8c9c59f229134e1ab069e18a116ebdf2 Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e86ca09a-927f-4b27-89b2-db9834d10c3c could not be found. Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e86ca09a-927f-4b27-89b2-db9834d10c3c'} Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86ca09a-927f-4b27-89b2-db9834d10c3c could not be found. Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86ca09a-927f-4b27-89b2-db9834d10c3c could not be found. Oct 31 15:22:24.328807 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86ca09a-927f-4b27-89b2-db9834d10c3c could not be found. Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Returning 404 to user: Instance e86ca09a-927f-4b27-89b2-db9834d10c3c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-479c6aec-d362-41d8-8a0a-6ee6ce027078 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c" status: 404 len: 111 microversion: 2.25 time: 0.072226 Oct 31 15:22:24.338680 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1045/2010] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/servers/e86ca09a-927f-4b27-89b2-db9834d10c3c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:24.344160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca1b5ef70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.368073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.368565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.369113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.369595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.384379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.384805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.385239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.385941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.386391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.386809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.418934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.419623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.420407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.444262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:24.448108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:24.470548 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-07f4f163-72ef-4924-93fe-5c708c70d574 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.604236 Oct 31 15:22:24.472840 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 966/2011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:23 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:24.479649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3f473dea-ccaa-4cb2-94fd-5795778974d3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '.version_select at 0x7f5ca680fca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.562345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c838c236-2c32-48ee-b742-7b26ad02e3de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 204 len: 0 microversion: 2.26 time: 0.230304 Oct 31 15:22:24.568340 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1046/2012] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Oct 31 15:22:24 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:24.574962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.576781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.578805 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3f473dea-ccaa-4cb2-94fd-5795778974d3 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464716875" status: 204 len: 0 microversion: 2.25 time: 0.102483 Oct 31 15:22:24.589277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.592606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.592785 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 967/2013] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Oct 31 15:22:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464716875 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:24.593573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.594543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.595316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.596238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.605799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b4893ae-036e-4395-8a45-03fae69ec320 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca1d261f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.623066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4893ae-036e-4395-8a45-03fae69ec320 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.623538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4893ae-036e-4395-8a45-03fae69ec320 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.628288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4893ae-036e-4395-8a45-03fae69ec320 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.651668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.653592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.655011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.655746 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b4893ae-036e-4395-8a45-03fae69ec320 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 200 len: 12 microversion: 2.26 time: 0.061743 Oct 31 15:22:24.656530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lazy-loading 'fault' on Instance uuid 96718579-8de0-4966-8f19-05cc9cc4da10 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:24.656662 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 968/2014] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 12 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:24.670832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca6726160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.689917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.693808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.694520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.695201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.711931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.714003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.714635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.717614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.718266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.719039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.769662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.776831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.777660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.778029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8184a0251b8e4cb882556b458bbc4de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839329b3c3094cc087e11ca45c12b0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:24.792116 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c95d1d9-065a-429a-b670-8aa8af8d21da tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 200 len: 1303 microversion: 2.1 time: 0.221232 Oct 31 15:22:24.804771 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1047/2015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:24.818821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:24.861627 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1409b78d-99c5-4bea-95f0-1ea9a25aa427 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 204 len: 0 microversion: 2.26 time: 0.197990 Oct 31 15:22:24.862638 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 969/2016] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Oct 31 15:22:24 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:24.873480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca1b8bdc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.901671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.903454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.906139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.906739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.908397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.909982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.922754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.924600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.925180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.927817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.930728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.931035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.934522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.939121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.939605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.944790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.945373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.945962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.072632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.076893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.079577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.108157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.109093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.110010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.168264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:25.213002 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e60c26ab-c88f-4086-86e1-b988761bd414 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-2142348748" status: 201 len: 0 microversion: 2.26 time: 0.340875 Oct 31 15:22:25.220229 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1048/2017] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Oct 31 15:22:24 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-2142348748 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:22:25.233739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca674c940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.262429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.266986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.267462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.267969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.288350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.291214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.291459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.292336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.294688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.295166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.332987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.333801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.334415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.339718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:25.351997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.352910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.353784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:25.354443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.356490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:25.378592 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-58ad132b-df05-41fd-9e79-0ffa55c02993 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.491282 Oct 31 15:22:25.379792 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 970/2018] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:25.390757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0190318f-f36a-48b2-a2dd-0dd37c6a4f4d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca680f280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.504644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0190318f-f36a-48b2-a2dd-0dd37c6a4f4d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.122963 Oct 31 15:22:25.511306 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 971/2019] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:25.520373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:25.527359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.528060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.558724 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc62e57e-46d9-48fa-9258-847b23b59815 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1117024549" status: 201 len: 0 microversion: 2.26 time: 0.336333 Oct 31 15:22:25.569783 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1049/2020] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Oct 31 15:22:25 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags/tempest-tag-1117024549 => generated 0 bytes in 349 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:22:25.585063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.586245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.595013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.597437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.598534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.599468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.599767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Action: 'update_all', calling method: .version_select at 0x7f5ca1ba3790>, body: {"tags": ["tempest-tag-1337283617", "tempest-tag-1160599889"]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:25.630126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.633155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.635926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.638013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.682670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.687538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.688182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.690072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.695618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.697512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.764426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.766111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.768407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.822751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:25.866263 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51e6e3e0-daa0-41b1-99dd-6dab0be6ed8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 200 len: 62 microversion: 2.26 time: 0.293198 Oct 31 15:22:25.874460 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1050/2021] 10.222.0.48 () {62 vars in 1312 bytes} [Mon Oct 31 15:22:25 2022] PUT /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 62 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:25.880664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.881315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] [instance: 96718579-8de0-4966-8f19-05cc9cc4da10] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.908573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.913832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.914554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.915339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.915826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.916262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.965930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] HTTP exception thrown: Instance 96718579-8de0-4966-8f19-05cc9cc4da10 could not be found. Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Request method failure captured: Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 HTTP/1.1 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-axEn0Jxb5Vg5_xz88-6FXhruuI4FbcIe-ubvC8OLQ8RvYgkfE-h0znKGXNNYs8VtUgdb2AWkH8mva-fdMoA2PrxzhbyGbPVhpoRLl_DDzkQDGz4PDTqzVJZ06qp6cLOC3n4r1YDI41xuR7tuyy8f5GeJirTS8atTmJCnSLSJg107E Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/839329b3c3094cc087e11ca45c12b0fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-MigrationsAdminTest-836805078 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 839329b3c3094cc087e11ca45c12b0fb Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-MigrationsAdminTest-836805078 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-MigrationsAdminTest-836805078-project Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8184a0251b8e4cb882556b458bbc4de7 Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-MigrationsAdminTest-836805078-project Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 96718579-8de0-4966-8f19-05cc9cc4da10 could not be found. Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '96718579-8de0-4966-8f19-05cc9cc4da10'} Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96718579-8de0-4966-8f19-05cc9cc4da10 could not be found. Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96718579-8de0-4966-8f19-05cc9cc4da10 could not be found. Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:25.973664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96718579-8de0-4966-8f19-05cc9cc4da10 could not be found. Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] Returning 404 to user: Instance 96718579-8de0-4966-8f19-05cc9cc4da10 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf5489a8-8ccd-40fc-88a9-636468ee5a68 tempest-MigrationsAdminTest-836805078 tempest-MigrationsAdminTest-836805078-project] 10.222.0.48 "GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10" status: 404 len: 111 microversion: 2.1 time: 0.099066 Oct 31 15:22:25.982828 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1051/2022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/96718579-8de0-4966-8f19-05cc9cc4da10 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:26.019494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5262ab65-b54b-4d46-8dd5-9d549013a9a6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca67c9af0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.039432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.054876 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63336b93-94fc-4b92-937b-38a969c87fb9 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.542247 Oct 31 15:22:26.068733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5262ab65-b54b-4d46-8dd5-9d549013a9a6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.068733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5262ab65-b54b-4d46-8dd5-9d549013a9a6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.068733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5262ab65-b54b-4d46-8dd5-9d549013a9a6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.069670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 972/2023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:26.124449 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5262ab65-b54b-4d46-8dd5-9d549013a9a6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 200 len: 62 microversion: 2.26 time: 0.147587 Oct 31 15:22:26.125403 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1052/2024] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 62 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:26.136997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '.version_select at 0x7f5ca680f670>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.158760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.160618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.161999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.163472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.183569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.184863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.186199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.188062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.189399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.192867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.255739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.256618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.262281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.291704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'flavor' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:26.330831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8fb4b816-8cab-428f-804a-340d94c4b9a5 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags" status: 204 len: 0 microversion: 2.26 time: 0.198763 Oct 31 15:22:26.332275 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 973/2025] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Oct 31 15:22:26 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa/tags => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:26.342820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.343331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.358630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.359239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.359702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.360447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.367648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.368203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.425498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.426223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.449619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.452355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.481133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.486210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.489456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.493112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.523436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:26.686088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.702967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.709512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.722593 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee12667b-c82b-4095-83d1-659730a445d4 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.314868 Oct 31 15:22:26.726965 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 974/2026] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:26 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:26.738070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d1fd7ba-4226-4446-b999-6ea9fedabfd6 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 204 len: 0 microversion: 2.26 time: 0.394560 Oct 31 15:22:26.742416 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1053/2027] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:22:26 2022] DELETE /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:26.746567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b83356eb-2967-411d-bd2c-8e2fc9ffdd54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2418430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.772930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81110f28-fc54-46d7-af84-6cfd7da09ce1"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:26.779207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.796313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.797181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.798512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.799747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.801696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.802382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.805914 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b83356eb-2967-411d-bd2c-8e2fc9ffdd54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.076661 Oct 31 15:22:26.806950 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 975/2028] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:26 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:26.813456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.815335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.832005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.837360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.838288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.839391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.840031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.840622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.050956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:27.075558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.089236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.098159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.102280 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-789200a3-da85-45a6-996c-038df27bbc7e tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1550 microversion: 2.26 time: 0.292908 Oct 31 15:22:27.103699 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 976/2029] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:26 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1550 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:27.114709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.117480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.130584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.132294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.133702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.137192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.138883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.139348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.189004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:27.224741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:27.268303 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ffbf3cd8-9455-4b4b-8d40-58a0cf340997 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520178 Oct 31 15:22:27.269651 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1054/2030] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:22:26 2022] POST /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:27.293151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.293834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.319065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.319524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.319966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.326218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.326697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.328811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.377809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:27.384341 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9c7c6f7-ba34-4166-b9c4-1a5ee740b8e8 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 204 len: 0 microversion: 2.25 time: 0.278090 Oct 31 15:22:27.388719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 977/2031] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:22:27 2022] DELETE /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:27.398264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.399079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.415729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.415729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.415729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.415729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.415729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.418097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.601042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.609072 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d95322e4-14fc-453f-aee5-40c11b11f489 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.338017 Oct 31 15:22:27.611417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1055/2032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:27.757586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.758276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.775428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.777178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.780352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.781354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.785039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.785710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.807733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.860485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.871894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.876643 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcc75bdc-8ac4-4b2e-872e-57908bc67fb9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1549 microversion: 2.25 time: 0.487347 Oct 31 15:22:27.878932 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 978/2033] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1549 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:22:27.896844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17e30a6d-8f12-4a5f-8282-fc6eaa60aaf6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca680fb80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.953020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.963807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.969599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.990854 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3807cc7b-b0cd-4353-88c5-173695ab4c9a tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.240589 Oct 31 15:22:27.992790 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1056/2034] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:28.007609 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17e30a6d-8f12-4a5f-8282-fc6eaa60aaf6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.122617 Oct 31 15:22:28.013439 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 979/2035] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:28.132488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:28.133142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:28.153098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.153595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.154026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.154741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.155195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.155621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.399431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:28.408586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:28.410931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:28.417203 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ff53946-520f-43db-a299-8e1ac62b55de tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1550 microversion: 2.26 time: 0.284632 Oct 31 15:22:28.422361 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1057/2036] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:28 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1550 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:28.645878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:28.646929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:28.669555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.671713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.673287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.676369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.678850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.680221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.903552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:28.904915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:28.919210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.919985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.920600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.921712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.922348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.923044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.020762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.034878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-05693083-8d0a-42ac-b5e7-52a6f2f0d26f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1320 microversion: 2.1 time: 0.396204 Oct 31 15:22:29.037719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 980/2037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:28 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:29.045143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d91933da-6393-49e0-9ba4-5a8468f5bbe6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1dbef70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.233748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.245131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.247093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.249437 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c38b743-fb20-4c42-955f-b2dd83ea2ace tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1549 microversion: 2.25 time: 0.349820 Oct 31 15:22:29.265470 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1058/2038] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:28 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1549 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:29.274483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.277826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:29.303240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.304558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.311068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.313702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.317224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.317683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.449563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.461733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.463181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.476267 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7330c622-b856-4bf2-8f18-746740bafcfa tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1546 microversion: 2.91 time: 0.209172 Oct 31 15:22:29.478975 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1059/2039] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:29.494577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.502060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:29.515825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.523259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.525153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.527044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.528291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.530346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.823892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.839630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.842021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.843249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89222e39-db2d-4160-9ac2-f0013385e0eb tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1550 microversion: 2.26 time: 0.363124 Oct 31 15:22:29.856737 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1060/2040] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1550 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:30.062147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:30.063279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:30.080439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.082373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.083760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.085741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.086457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.088359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.712635 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d91933da-6393-49e0-9ba4-5a8468f5bbe6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 1.670095 Oct 31 15:22:30.719250 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 981/2041] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:30.747486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:30.750687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:30.790547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.791385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.792494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.796927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.798725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.801739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.141711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.156118 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46388dfe-7987-4f74-bd25-31c253408354 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1510 microversion: 2.1 time: 1.100327 Oct 31 15:22:31.166418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1061/2042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:30 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1510 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:31.180653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.186973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.200204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.201150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.204028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.205107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.206677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.208611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.364158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.380394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.392314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.394862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d079d65e-5d48-411e-a318-d3327cfe7d57 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1549 microversion: 2.25 time: 0.674332 Oct 31 15:22:31.397417 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 982/2043] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:30 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1549 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:31.404791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.408678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.427197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.428114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.432791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.433624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.434125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.434576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.456209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.470890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.476547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.491425 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-237d306f-cb6f-4720-9234-20195a85ee9c tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1533 microversion: 2.91 time: 0.316464 Oct 31 15:22:31.506720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1062/2044] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:31 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1533 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:31.511719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.529681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.542391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.549100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.550218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.550991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.551473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.551906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.231482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:32.239369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccebb9b2-ae1d-4660-9ad2-efffc26ec6b3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1509 microversion: 2.1 time: 0.731464 Oct 31 15:22:32.242882 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1063/2045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:31 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1509 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:32.255375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:32.259939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:32.278414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.286604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.287593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.288990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.291079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.291882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.384972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:32.401874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:32.403964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:32.407587 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-731724bc-550a-4497-b082-e75ebb2a2f8f tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1550 microversion: 2.26 time: 1.008896 Oct 31 15:22:32.411927 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 983/2046] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:31 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1550 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:32.426581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b77e8184-d4c1-441f-ad92-97e563ef7b6e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca681e1f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:32.537926 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b77e8184-d4c1-441f-ad92-97e563ef7b6e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1413 microversion: 2.1 time: 0.122846 Oct 31 15:22:32.551429 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 984/2047] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:32 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:32.563573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] Lazy-loading 'services' on Instance uuid f88dff41-8ec3-4d48-9a13-6fe19f53512a {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:32.572916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:32.573579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:32.608917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.609195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.609658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.610407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.610879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.615453 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d541b1b6-3457-40ec-ad74-b1a1a26902c3 tempest-UnshelveToHostMultiNodesTest-2026220082 tempest-UnshelveToHostMultiNodesTest-2026220082-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1940 microversion: 2.91 time: 0.371426 Oct 31 15:22:32.619222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.633321 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1064/2048] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:32 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1940 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:32.961920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2cd5af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:33.131340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.131784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.137658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.138251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.138561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.139057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.139496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.152684 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-deee6443-0f1f-43ab-9acf-cdd637d9fc41 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 200 len: 1511 microversion: 2.1 time: 0.599775 Oct 31 15:22:33.165088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 985/2049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:32 2022] GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:33.218457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.223008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:33.241377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.242597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.243352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.244816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.246659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.248374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.291729 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0caa873d-5f66-47d9-9958-60c100df30f4 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217" status: 200 len: 148 microversion: 2.57 time: 0.657167 Oct 31 15:22:33.292336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1065/2050] 10.222.0.48 () {62 vars in 1303 bytes} [Mon Oct 31 15:22:32 2022] PUT /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217 => generated 148 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:33.295083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.295771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.296376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.297023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lazy-loading 'fault' on Instance uuid 0e1da379-7eab-4e0e-a269-1b980bcd964e {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:33.310861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.311368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:33.330613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.332183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.333100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.335370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.336830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.339352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.386053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.399308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.403834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.405095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8c4a8976-e2c5-4965-b871-e3e7cb2969ad tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 200 len: 1352 microversion: 2.25 time: 0.243082 Oct 31 15:22:33.405670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 986/2051] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:33 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 1352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:33.411077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:33.421764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0a0a7395-ad53-4ddc-8b21-5c0c4b68de32 req-b9f15f10-8016-414a-85c2-dd3eb5037da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1da379-7eab-4e0e-a269-1b980bcd964e", "name": "network-vif-deleted", "tag": "8f534018-dae0-4a5a-8e50-e009f54ec704"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:33.447220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a0a7395-ad53-4ddc-8b21-5c0c4b68de32 req-b9f15f10-8016-414a-85c2-dd3eb5037da0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.448460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a0a7395-ad53-4ddc-8b21-5c0c4b68de32 req-b9f15f10-8016-414a-85c2-dd3eb5037da0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.449784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a0a7395-ad53-4ddc-8b21-5c0c4b68de32 req-b9f15f10-8016-414a-85c2-dd3eb5037da0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.481171 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0a0a7395-ad53-4ddc-8b21-5c0c4b68de32 req-b9f15f10-8016-414a-85c2-dd3eb5037da0 service nova] Creating event network-vif-deleted:8f534018-dae0-4a5a-8e50-e009f54ec704 for instance 0e1da379-7eab-4e0e-a269-1b980bcd964e on n-h1-858383-17 Oct 31 15:22:33.493072 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0a0a7395-ad53-4ddc-8b21-5c0c4b68de32 req-b9f15f10-8016-414a-85c2-dd3eb5037da0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078501 Oct 31 15:22:33.499576 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 987/2052] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:33.513609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.535240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.537402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:33.572671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.573991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.574380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28a12f0a-5d15-482b-8310-031f818d6940 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 204 len: 0 microversion: 2.91 time: 0.267539 Oct 31 15:22:33.576481 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1066/2053] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:22:33 2022] DELETE /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:33.579532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.583820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.585677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.586313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.593504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Calling method '.version_select at 0x7f5ca20e2d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.698080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.698712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.699381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.700235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.700849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.701400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.749469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:33.788659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0593ea2-4aed-426b-aed9-018e66914e29 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217/detail" status: 200 len: 463 microversion: 2.57 time: 0.210466 Oct 31 15:22:33.799927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1067/2054] 10.222.0.48 () {60 vars in 1304 bytes} [Mon Oct 31 15:22:33 2022] GET /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217/detail => generated 463 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:33.829474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.847202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:33.854492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:33.896565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.903352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.905522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.906489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.908113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.910111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.009324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.009944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.012062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.012646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'fault' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:34.174473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.207679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.208174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.208612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.287025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.297404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.298849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.300809 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c24ae0e1-5d10-4585-8682-3d275d125577 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1351 microversion: 2.26 time: 0.499794 Oct 31 15:22:34.302109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1068/2055] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:33 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1351 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:34.307133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0ef8846-0ff1-482c-a6f0-96835440cf98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca682ea60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:34.364957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0ef8846-0ff1-482c-a6f0-96835440cf98 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1422 microversion: 2.1 time: 0.060532 Oct 31 15:22:34.365850 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1069/2056] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:34 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:34.382122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:34.384666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:34.392646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.394283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.395033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.396018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.396761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.397442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.732915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.735165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:34.750178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.751620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73881ad312b94dfc865df7d6d93699bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c945f81e29947a8be49836c19edcb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.770452 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64469737-d1aa-4bc5-a37c-d001ee586e5f tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 200 len: 1539 microversion: 2.91 time: 0.390510 Oct 31 15:22:34.775493 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1070/2057] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:34 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 1539 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:34.789743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca20fb3a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:34.864014 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98707366-e0eb-4866-b346-378cc48050ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 1.361055 Oct 31 15:22:34.864624 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 988/2058] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 31 15:22:33 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:34.870050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eba3f4cf-ca5f-4914-992f-e9b4be83add9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca1d26430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:34.921689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.922183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.922620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.923360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.923820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.924370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.947045 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eba3f4cf-ca5f-4914-992f-e9b4be83add9 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 200 len: 1422 microversion: 2.1 time: 0.081172 Oct 31 15:22:34.947635 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 989/2059] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:34 2022] GET /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:34.980914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:34.987778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 0e1da379-7eab-4e0e-a269-1b980bcd964e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:34.998986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.004486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.006945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.007969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.008536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.009111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.009495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.009990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.011393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.011543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.011964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.012766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.045879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] HTTP exception thrown: Instance 0e1da379-7eab-4e0e-a269-1b980bcd964e could not be found. Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Request method failure captured: Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e HTTP/1.1 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z6Sm7z2M1p8toEv8qisIr3mKMSFi4sgjd-qM1BiMmLinw_GLsICkIPmLsKKlnVT0wFU4zgAGwPHACEZaRYB2uLOh8fy3d3zJDFJyGsHpEro9EvjR7LpYEMWTiqsEHfW41uSvmCvpWThAlPzpDeN0oucQgzPm3xLaz1sUCD_I3W-ik Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d09369d806ba4afe911914e3272a59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8c9c59f229134e1ab069e18a116ebdf2 Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 0e1da379-7eab-4e0e-a269-1b980bcd964e could not be found. Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0e1da379-7eab-4e0e-a269-1b980bcd964e'} Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e1da379-7eab-4e0e-a269-1b980bcd964e could not be found. Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e1da379-7eab-4e0e-a269-1b980bcd964e could not be found. Oct 31 15:22:35.051961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e1da379-7eab-4e0e-a269-1b980bcd964e could not be found. Oct 31 15:22:35.056562 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:35.064189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Returning 404 to user: Instance 0e1da379-7eab-4e0e-a269-1b980bcd964e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:35.068531 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-86e23e66-6198-4da2-8452-813c72697754 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e" status: 404 len: 111 microversion: 2.25 time: 0.105211 Oct 31 15:22:35.070560 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 990/2060] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:34 2022] GET /compute/v2.1/servers/0e1da379-7eab-4e0e-a269-1b980bcd964e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:35.081827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:35.095252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:35.096425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-56048039', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:35.108661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.110488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.111541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.114255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.116378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.118000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.118420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c5a9a19-ce21-45d0-9528-299e851040d7 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217?user_id=1df919ea73b94f9783306822e7975d05" status: 200 len: 148 microversion: 2.57 time: 0.341381 Oct 31 15:22:35.119508 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1071/2061] 10.222.0.48 () {62 vars in 1384 bytes} [Mon Oct 31 15:22:34 2022] PUT /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217?user_id=1df919ea73b94f9783306822e7975d05 => generated 148 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:35.124514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:35.125192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:35.134792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.137564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.138144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.141010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.141607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.142160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.195380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:35.293803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:35.399512 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b283bcf8-f00e-43e7-bfe1-4a3451fd6ad4 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 204 len: 0 microversion: 2.25 time: 0.278033 Oct 31 15:22:35.410529 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1072/2062] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:22:35 2022] DELETE /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:35.416163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d14a7f9-6db5-4d94-a2cb-07890dbe1664 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] Calling method '.version_select at 0x7f5ca1b5e0d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:35.451564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:35.464720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.468925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.469657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.649717 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d14a7f9-6db5-4d94-a2cb-07890dbe1664 tempest-QuotasAdminTestV257-1033383326 tempest-QuotasAdminTestV257-1033383326-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217?user_id=1df919ea73b94f9783306822e7975d05" status: 200 len: 190 microversion: 2.57 time: 0.237524 Oct 31 15:22:35.661598 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1073/2063] 10.222.0.48 () {60 vars in 1364 bytes} [Mon Oct 31 15:22:35 2022] GET /compute/v2.1/os-quota-sets/c5c6160d1eca45a3b81b0aab30122217?user_id=1df919ea73b94f9783306822e7975d05 => generated 190 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:35.681114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-585241933", "imageRef": "3881b925-5cd0-40da-8aa0-be0593574d57", "flavorRef": "452", "networks": [{"uuid": "bc2357ef-c687-4bf5-80c5-a090c70bef3f"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:35.719358 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92459cb4-e1a8-4827-9473-afa24ee41b4c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-56048039" status: 200 len: 1512 microversion: 2.1 time: 0.646515 Oct 31 15:22:35.720788 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 991/2064] 10.222.0.48 () {58 vars in 1259 bytes} [Mon Oct 31 15:22:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-56048039 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:35.727347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:35.730597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:35.739499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.740490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.743705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.745068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.745790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.747043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.845697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] validate_networks() for [('bc2357ef-c687-4bf5-80c5-a090c70bef3f', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:35.852142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.854769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.855237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.855683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lazy-loading 'fault' on Instance uuid d9743ece-3bee-4280-be3e-ebe1fe9b57aa {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:35.999091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.013713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.054357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6a4365b2f6f14e9e8735757cc69657cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbaa41a33c874558856fd876d3b2ab0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.057850 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21e6f958-d7fb-4bf4-b9b9-6089929e7598 tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 200 len: 1351 microversion: 2.26 time: 0.334474 Oct 31 15:22:36.075323 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 992/2065] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:35 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 1351 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:36.098808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:36.100049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:36.117942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.121092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.121819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.125653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.127095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.129561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.974573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.986744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.989992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.993894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13c9e0f9-37de-4f92-820f-56aec5599083 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1565 microversion: 2.25 time: 0.909836 Oct 31 15:22:36.997650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 993/2066] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:36 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1565 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:37.016538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c47031bc-06db-4b31-9fc4-ab9c1139f2cc req-7f80487c-6be6-425f-a078-57d49fb44327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9743ece-3bee-4280-be3e-ebe1fe9b57aa", "name": "network-vif-deleted", "tag": "1c1a4cc4-b2dc-4df2-bf77-d129bc61c60d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:37.071051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c47031bc-06db-4b31-9fc4-ab9c1139f2cc req-7f80487c-6be6-425f-a078-57d49fb44327 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.076176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c47031bc-06db-4b31-9fc4-ab9c1139f2cc req-7f80487c-6be6-425f-a078-57d49fb44327 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.081756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c47031bc-06db-4b31-9fc4-ab9c1139f2cc req-7f80487c-6be6-425f-a078-57d49fb44327 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.124858 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c47031bc-06db-4b31-9fc4-ab9c1139f2cc req-7f80487c-6be6-425f-a078-57d49fb44327 service nova] Creating event network-vif-deleted:1c1a4cc4-b2dc-4df2-bf77-d129bc61c60d for instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa on n-h1-858383-17 Oct 31 15:22:37.141778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c47031bc-06db-4b31-9fc4-ab9c1139f2cc req-7f80487c-6be6-425f-a078-57d49fb44327 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141881 Oct 31 15:22:37.143238 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 994/2067] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:37.152111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.162771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:37.163914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:37.181513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.182548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.183161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.184095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.185521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.187176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.310258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:37.310986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:37.311199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:37.311458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:37.311882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:37.328514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.329125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.329566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.335049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.338691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.339348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.411294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:37.446735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for user 857b0f5f4fdc4b1faeae0e0770d65125 and project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:37.482808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:37.538126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:37.548189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3881b925-5cd0-40da-8aa0-be0593574d57',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:37.683314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:37.714321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.714882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.715335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.747292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:37.751386 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-568f10e8-c38a-4b54-8c39-69cb1364fd69 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085584 Oct 31 15:22:37.753695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1074/2068] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:37.759643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.760618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] [instance: f88dff41-8ec3-4d48-9a13-6fe19f53512a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:37.770317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.771310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.772055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.773341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.774070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.775567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.797193 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] HTTP exception thrown: Instance f88dff41-8ec3-4d48-9a13-6fe19f53512a could not be found. Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Request method failure captured: Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a HTTP/1.1 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-d7hiStaCTAmiiJ2gwStkihUqzya5ICKrjyLpHEwOE0y1wJ2kKB9EDxc3u28tdNumkuBjUgluHLZkjAn1EBjRtMU2qp3FZ-3r42Df5xibln0VvJqlJYlsmQ0hjp_GRzeOP-jKJEZc_HSmx0-wVab_AKeVsfF4oXVC8IpT0sksprNJ8 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.91 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 7c945f81e29947a8be49836c19edcb55 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1302978121 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c945f81e29947a8be49836c19edcb55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c945f81e29947a8be49836c19edcb55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c945f81e29947a8be49836c19edcb55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c945f81e29947a8be49836c19edcb55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1302978121 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 7c945f81e29947a8be49836c19edcb55 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1302978121 Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-UnshelveToHostMultiNodesTest-1302978121-project Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 73881ad312b94dfc865df7d6d93699bf Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1302978121-project Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f88dff41-8ec3-4d48-9a13-6fe19f53512a could not be found. Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f88dff41-8ec3-4d48-9a13-6fe19f53512a'} Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f88dff41-8ec3-4d48-9a13-6fe19f53512a could not be found. Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f88dff41-8ec3-4d48-9a13-6fe19f53512a could not be found. Oct 31 15:22:37.802291 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f88dff41-8ec3-4d48-9a13-6fe19f53512a could not be found. Oct 31 15:22:37.808217 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.812597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] Returning 404 to user: Instance f88dff41-8ec3-4d48-9a13-6fe19f53512a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:37.814479 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2870e06c-5dd0-4253-9a7b-4d8303b29b49 tempest-UnshelveToHostMultiNodesTest-1302978121 tempest-UnshelveToHostMultiNodesTest-1302978121-project] 10.222.0.48 "GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a" status: 404 len: 111 microversion: 2.91 time: 0.059066 Oct 31 15:22:37.816383 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1075/2069] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/f88dff41-8ec3-4d48-9a13-6fe19f53512a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:37.823159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.824111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] [instance: d9743ece-3bee-4280-be3e-ebe1fe9b57aa] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:37.839454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.840132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.840584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.841868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.842543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.843438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.900930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] HTTP exception thrown: Instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa could not be found. Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Request method failure captured: Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa HTTP/1.1 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-gDSCkWc255ynRjHHhyBvyGRo8qUeZwvI232B15NgXlG5pF8qpbZhyH4JGJ08t0fjw_9FxDFQRGXBwYyqM4mgkwWdDMAY3hWTGv7TDl1y_Wyv-HKYG0AitKWGgos6i-fOiA4TxeIF6W7_wAfmJnbXNSDE_zFSvbnQBQfNV60OyclEY Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.26 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bbaa41a33c874558856fd876d3b2ab0d Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerTagsTestJSON-1786656584 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bbaa41a33c874558856fd876d3b2ab0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bbaa41a33c874558856fd876d3b2ab0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bbaa41a33c874558856fd876d3b2ab0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bbaa41a33c874558856fd876d3b2ab0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerTagsTestJSON-1786656584 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bbaa41a33c874558856fd876d3b2ab0d Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerTagsTestJSON-1786656584 Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerTagsTestJSON-1786656584-project Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6a4365b2f6f14e9e8735757cc69657cb Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerTagsTestJSON-1786656584-project Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa could not be found. Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd9743ece-3bee-4280-be3e-ebe1fe9b57aa'} Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa could not be found. Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa could not be found. Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:37.905180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa could not be found. Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] Returning 404 to user: Instance d9743ece-3bee-4280-be3e-ebe1fe9b57aa could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9dee968-a4d8-46af-bd7c-d6a3601d3e0b tempest-ServerTagsTestJSON-1786656584 tempest-ServerTagsTestJSON-1786656584-project] 10.222.0.48 "GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa" status: 404 len: 111 microversion: 2.26 time: 0.089044 Oct 31 15:22:37.914579 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1076/2070] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/d9743ece-3bee-4280-be3e-ebe1fe9b57aa => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:37.927585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f85d86bf-8259-440d-b99f-a9fae99bdb47 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.928258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f85d86bf-8259-440d-b99f-a9fae99bdb47 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:38.306632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f85d86bf-8259-440d-b99f-a9fae99bdb47 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.320501 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f85d86bf-8259-440d-b99f-a9fae99bdb47 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1207 microversion: 2.1 time: 0.402269 Oct 31 15:22:38.321877 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1077/2071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1207 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:38.327077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:38.328435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:38.340145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.342072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.343785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.344995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.345838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.347273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.527017 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf9548d0-a5b1-4054-af88-d6faa10e13b8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4513 microversion: 2.1 time: 1.380560 Oct 31 15:22:38.528081 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 995/2072] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/detail?status=active => generated 4513 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:38.559758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:38.577208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.578094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.compute.servers [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Removing options 'limit' from query {{(pid=120626) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:22:38.579121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:38.597574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.599903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.600434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.603941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.604653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.605147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.640873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.651413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.659440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.670776 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ecd762cd-50fb-49ea-af7d-d7e77af46607 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1523 microversion: 2.25 time: 0.347655 Oct 31 15:22:38.671691 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1078/2073] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:38 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:38.672451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.681080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.681574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.682011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.051952 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a54a0f01-ecc2-4be1-aea6-831b592ec1e0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.497984 Oct 31 15:22:39.053296 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 996/2074] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:22:38 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:39.084855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.101295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.103974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:39.115807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.117379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.118260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.120040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.120931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.121588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.231846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f568e326-f437-46bb-adec-964e5149477c req-a408ce20-b6a9-416a-a694-7d4176746f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4230e338-4315-412b-ae2c-f9b1cc15fbee", "name": "network-vif-deleted", "tag": "72f7a598-0311-4580-973c-6321a81b4a0f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:39.248856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f568e326-f437-46bb-adec-964e5149477c req-a408ce20-b6a9-416a-a694-7d4176746f4e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.249750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f568e326-f437-46bb-adec-964e5149477c req-a408ce20-b6a9-416a-a694-7d4176746f4e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.254458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f568e326-f437-46bb-adec-964e5149477c req-a408ce20-b6a9-416a-a694-7d4176746f4e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.281308 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f568e326-f437-46bb-adec-964e5149477c req-a408ce20-b6a9-416a-a694-7d4176746f4e service nova] Creating event network-vif-deleted:72f7a598-0311-4580-973c-6321a81b4a0f for instance 4230e338-4315-412b-ae2c-f9b1cc15fbee on n-h1-858383-17 Oct 31 15:22:39.295560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f568e326-f437-46bb-adec-964e5149477c req-a408ce20-b6a9-416a-a694-7d4176746f4e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070946 Oct 31 15:22:39.297496 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 997/2075] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:22:39.334753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:39.347030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.347917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:39.357734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.359143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.359742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.360561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.363409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.364329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.482935 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c4f610d-fa9e-4eb5-bc48-6b8a2b1b21ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?status=active" status: 200 len: 1008 microversion: 2.1 time: 0.403726 Oct 31 15:22:39.484027 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1079/2076] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers?status=active => generated 1008 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:39.510002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.524050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.524533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.servers [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Removing options 'limit' from query {{(pid=120625) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:22:39.525244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:39.536064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.536549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.537020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.537747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.538222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.538626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.548476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.559568 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d05f9218-a6bd-4b09-8c8f-20045ad7f263 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1259 microversion: 2.1 time: 0.217396 Oct 31 15:22:39.560152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 998/2077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:39.602378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:39.663451 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd043c29-905a-485d-974c-405a22619a4a tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1008 microversion: 2.1 time: 0.164614 Oct 31 15:22:39.670262 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1080/2078] 10.222.0.48 () {58 vars in 1150 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers?limit=100000 => generated 1008 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:39.682268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.687295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.688043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:39.699771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.700632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:39.718399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.722230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.728673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.729711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.732361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.733749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.734365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.734486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.738735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.740182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.741052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.741646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.818125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:39.818376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.818840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.825958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.826825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lazy-loading 'fault' on Instance uuid 4230e338-4315-412b-ae2c-f9b1cc15fbee {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:39.884928 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5e018e1-2504-4a7c-bcfc-e2e8edebddd6 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1008 microversion: 2.1 time: 0.206502 Oct 31 15:22:39.897398 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 999/2079] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers => generated 1008 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:39.901907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.911502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.922028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c9c59f229134e1ab069e18a116ebdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09369d806ba4afe911914e3272a59e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.923292 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c07e4d20-773d-4d17-9099-bdcdc8bc1c19 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 200 len: 1352 microversion: 2.25 time: 0.228024 Oct 31 15:22:39.925358 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1081/2080] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 1352 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:22:39.937998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.943915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.944590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:39.963891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.964811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.965585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.966676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.967368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.968027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.119433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d025cf97-37de-4864-8ea3-2b391da89c29 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca2ca38b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1500589637", "description": "tempest-description-857344994"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:40.149153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:40.318626 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e885b4a0-8214-400f-a0a3-c3e53e6b0dd4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.388308 Oct 31 15:22:40.319549 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1082/2081] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:40.334949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2a94e6fa-f352-4916-80e0-33467e44fe6d req-a7c8ed22-81f6-4e27-a63c-8109ae5390a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc1afd0-e44e-407e-9003-2b4505e1eaf6", "name": "network-vif-unplugged", "status": "completed", "tag": "5915d395-173d-4415-8a4d-063d2a4b965d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:40.353016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a94e6fa-f352-4916-80e0-33467e44fe6d req-a7c8ed22-81f6-4e27-a63c-8109ae5390a9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.353500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a94e6fa-f352-4916-80e0-33467e44fe6d req-a7c8ed22-81f6-4e27-a63c-8109ae5390a9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.353933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a94e6fa-f352-4916-80e0-33467e44fe6d req-a7c8ed22-81f6-4e27-a63c-8109ae5390a9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.388850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2a94e6fa-f352-4916-80e0-33467e44fe6d req-a7c8ed22-81f6-4e27-a63c-8109ae5390a9 service nova] Creating event network-vif-unplugged:5915d395-173d-4415-8a4d-063d2a4b965d for instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 on n-h2-858383-17 Oct 31 15:22:40.405910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2a94e6fa-f352-4916-80e0-33467e44fe6d req-a7c8ed22-81f6-4e27-a63c-8109ae5390a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082518 Oct 31 15:22:40.407610 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1083/2082] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:40.426505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:40.439277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:40.440065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.servers [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Removing options 'limit' from query {{(pid=120625) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:22:40.446362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:40.463252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.467380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.471521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.472601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.473473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.474068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.550146 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-205ea2b9-2cd7-4c60-af8e-de28ea14ab15 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.138805 Oct 31 15:22:40.551007 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1084/2083] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 31 15:22:40 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:40.568011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:40.576603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:40.577708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-56048039', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:40.592447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.595135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.598016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.599254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.599956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.600627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.811439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:40.964262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b29fea77-24bb-4e7d-b23d-8f6307aa6a63 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-56048039" status: 200 len: 344 microversion: 2.1 time: 0.402589 Oct 31 15:22:40.972644 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1085/2084] 10.222.0.48 () {58 vars in 1238 bytes} [Mon Oct 31 15:22:40 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-56048039 => generated 344 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:40.985935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:40.987321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:40.995755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.998909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.999618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.000614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.009529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.010352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.046486 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d025cf97-37de-4864-8ea3-2b391da89c29 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.147425 Oct 31 15:22:41.047419 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1000/2085] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:41.053731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:41.054552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] [instance: 4230e338-4315-412b-ae2c-f9b1cc15fbee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:41.069155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.071958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.072405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.075907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.076674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.077345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.138015 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] HTTP exception thrown: Instance 4230e338-4315-412b-ae2c-f9b1cc15fbee could not be found. Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Request method failure captured: Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee HTTP/1.1 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-Z6Sm7z2M1p8toEv8qisIr3mKMSFi4sgjd-qM1BiMmLinw_GLsICkIPmLsKKlnVT0wFU4zgAGwPHACEZaRYB2uLOh8fy3d3zJDFJyGsHpEro9EvjR7LpYEMWTiqsEHfW41uSvmCvpWThAlPzpDeN0oucQgzPm3xLaz1sUCD_I3W-ik Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d09369d806ba4afe911914e3272a59e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d09369d806ba4afe911914e3272a59e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d09369d806ba4afe911914e3272a59e4 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-833675804 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8c9c59f229134e1ab069e18a116ebdf2 Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-833675804-project Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4230e338-4315-412b-ae2c-f9b1cc15fbee could not be found. Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4230e338-4315-412b-ae2c-f9b1cc15fbee'} Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4230e338-4315-412b-ae2c-f9b1cc15fbee could not be found. Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4230e338-4315-412b-ae2c-f9b1cc15fbee could not be found. Oct 31 15:22:41.139722 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4230e338-4315-412b-ae2c-f9b1cc15fbee could not be found. Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] Returning 404 to user: Instance 4230e338-4315-412b-ae2c-f9b1cc15fbee could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-544240dd-fc90-46ce-bb2d-3ce7ad9086e9 tempest-LiveAutoBlockMigrationV225Test-833675804 tempest-LiveAutoBlockMigrationV225Test-833675804-project] 10.222.0.48 "GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee" status: 404 len: 111 microversion: 2.25 time: 0.091183 Oct 31 15:22:41.145926 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1001/2086] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:41 2022] GET /compute/v2.1/servers/4230e338-4315-412b-ae2c-f9b1cc15fbee => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:41.171275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-049daa6d-8ad7-4f29-9e1b-c4c9b113adbe tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:41.175368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:41.187232 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f44a3fb-02a4-47d8-9077-09e77bfc41a6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1265 microversion: 2.1 time: 0.212612 Oct 31 15:22:41.188767 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1086/2087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:40 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:41.201214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f25c9553-bebb-409b-8b12-ed858489820d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca24bc3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-612522078", "description": "tempest-description-225793282"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:41.213112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-049daa6d-8ad7-4f29-9e1b-c4c9b113adbe tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.213609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-049daa6d-8ad7-4f29-9e1b-c4c9b113adbe tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.215724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-049daa6d-8ad7-4f29-9e1b-c4c9b113adbe tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.387029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-049daa6d-8ad7-4f29-9e1b-c4c9b113adbe tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Going to try to stop instance {{(pid=120626) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:22:41.499194 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-049daa6d-8ad7-4f29-9e1b-c4c9b113adbe tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "POST /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20/action" status: 202 len: 0 microversion: 2.1 time: 0.355142 Oct 31 15:22:41.506911 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1002/2088] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:41 2022] POST /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:41.522575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:41.525305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:41.543646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.545128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.547115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.552080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.553024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.553706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.855864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:42.899162 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8851a783-b9e4-41b9-8387-f6c26a8427e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1519 microversion: 2.1 time: 1.390357 Oct 31 15:22:42.904741 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1003/2089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:41 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1519 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:42.918918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:42.923263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:42.940087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.943809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.944610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.946602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.947581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.949482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.201896 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f25c9553-bebb-409b-8b12-ed858489820d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.011900 Oct 31 15:22:43.203378 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1087/2090] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:43.474954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-289034891", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "ae90fd65-8f4e-42f6-8d12-c3cb5ff42387"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:43.483826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:43.493294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-190d53e6-943f-4e51-aea0-02a780e6a693 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1265 microversion: 2.1 time: 0.587033 Oct 31 15:22:43.502178 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1004/2091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:42 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1265 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:43.693776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] validate_networks() for [('ae90fd65-8f4e-42f6-8d12-c3cb5ff42387', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:43.930570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:43.931185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:43.947171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.947670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.948112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.955539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.963903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.964679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.636157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:44.660016 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-26c54f80-3729-4619-8ade-94d51a2abe2b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1519 microversion: 2.1 time: 0.734424 Oct 31 15:22:44.667024 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1005/2092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:43 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1519 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:44.678947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:44.679818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:44.697775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.698275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.698716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.699437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.699895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.700334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:46.575921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:46.603024 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db089720-f590-49a3-a181-154970ae676b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 1.934588 Oct 31 15:22:46.617628 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1006/2093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:44 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:46.642016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:46.650883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:46.685235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:46.685965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:46.686676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:46.688101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:46.692975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:46.693669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.344004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:47.345898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:47.346843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:47.347722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:47.348384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:47.366990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.376184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.378081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.379627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.380516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.381256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.419954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:47.435008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Getting quotas for project c1b9c3a3de944b7b9514568f43b3ae3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:47.458849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Getting quotas for user 0d2d88b532854b4ebd5a1e8e49cbf888 and project c1b9c3a3de944b7b9514568f43b3ae3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:47.491588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:47.500102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:47.684907 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83a064db-4ade-441f-9d26-852661e7d4cb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.220344 Oct 31 15:22:47.699279 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1088/2094] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:22:47.716541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:47.717390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:47.737276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.737766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.739128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.739128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.739384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.739764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.775397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:47.789482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1520bdce-8a16-4653-868d-99a523ac7ef3 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1519 microversion: 2.1 time: 1.165526 Oct 31 15:22:47.795052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1007/2095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:46 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1519 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:47.816752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:47.926242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:47.993548 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c81fb87d-5b1c-448d-a200-81c6963f7752 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 204 len: 0 microversion: 2.1 time: 0.292592 Oct 31 15:22:47.994403 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1089/2096] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:47 2022] DELETE /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:48.012972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:48.014040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:48.033243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:48.033739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:48.034192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.034921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:48.035308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:48.046409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.420682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.433169 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db527767-3a57-4365-adb2-964fea7e1b67 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.436657 Oct 31 15:22:48.449257 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1090/2097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:47 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:48.455935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9822b07a-d336-4199-8954-ef8cec0a43b8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:48.456991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9822b07a-d336-4199-8954-ef8cec0a43b8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:48.514826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-944d74eb-57eb-478c-9f2d-de5b3e080ac6 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] Action: 'create', calling method: .version_select at 0x7f5ca2b3bf70>, body: {"security_group": {"name": "tempest-securitygroup-1781275858", "description": "tempest-description-1730432233"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:48.529838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9822b07a-d336-4199-8954-ef8cec0a43b8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.545535 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9822b07a-d336-4199-8954-ef8cec0a43b8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1215 microversion: 2.1 time: 0.094788 Oct 31 15:22:48.546376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1091/2098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:48 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:48.561396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:48.562428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:48.574251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:48.589010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:48.591081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.593837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:48.597407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:48.599086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.666168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:48.973132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.985397 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8fd45eb-cb66-406e-b2db-b094223c4626 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1554 microversion: 2.1 time: 0.437655 Oct 31 15:22:48.987308 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1092/2099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:48 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1554 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:49.000493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:49.002245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:49.009462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.010184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.010994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.011884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.012529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.013472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.620816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:49.639975 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2e189dd-5053-4e1d-8a19-61ff090026d0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1519 microversion: 2.1 time: 0.650125 Oct 31 15:22:49.641087 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1093/2100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:48 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1519 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:49.730447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-944d74eb-57eb-478c-9f2d-de5b3e080ac6 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.932812 Oct 31 15:22:49.731394 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1008/2101] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:47 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:49.739745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:49.741310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:49.759081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.759578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.760012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.760747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.761186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.761609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.781375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:50.013584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca2978ca0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:50.022804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.024854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.028005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.056057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.056899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.059621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.092632 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] HTTP exception thrown: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Request method failure captured: Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b HTTP/1.1 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 56 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-hIZ5jfD6wSIxtgsEhy-dsgoqLwAtfaHzRqGmxUxg-uhyEPOK9DkCd1hsCGejyuLBa0RsORaa8cj_CT5Ux-MOKvNbnlxeIpn5ZAh7hemCVmuY8R1ZR9aPCjS6BNez25Os0DT2WFhOtVa260jpgmk1vohkhAqTj0atsi_vCq3fFr0Xo Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bdeb2942fb0d441bb8f0f339cd350d7d Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bdeb2942fb0d441bb8f0f339cd350d7d Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b0280058ac734e4e8f8c084a0732b515 Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: exception: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '12843ce1-82d5-4a93-949f-504a4d97d10b', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:22:50.096626 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Returning 404 to user: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:50.102853 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67694c95-96c0-4c14-9087-801f0f75b273 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b" status: 404 len: 110 microversion: 2.53 time: 0.458169 Oct 31 15:22:50.114260 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1094/2102] 10.222.0.48 () {62 vars in 1309 bytes} [Mon Oct 31 15:22:49 2022] PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b => generated 110 bytes in 468 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:50.130809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:50.132345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:50.154697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.156133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.159234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.169405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.170941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.172314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.387210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:50.399395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1275 microversion: 2.1 time: 0.283928 Oct 31 15:22:50.403927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1095/2103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:50 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:50.409838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:50.412020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86cff60d-42d5-4c55-8309-574900a0e935 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002659 Oct 31 15:22:50.413656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1096/2104] 10.222.0.48 () {56 vars in 886 bytes} [Mon Oct 31 15:22:50 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:22:50.426456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e8b2081-3976-45b4-85f3-5e4639b47e43 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] Action: 'create', calling method: .version_select at 0x7f5ca278ad30>, body: {"security_group": {"name": "tempest-securitygroup-720922047", "description": "tempest-description-856582037"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:50.475683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:50.502393 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-492ca50b-92f2-48dd-8738-93b6e2d7969c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.765785 Oct 31 15:22:50.505151 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1009/2105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:49 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:50.517575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:50.518785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:50.542700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.544398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.546054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.547767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.550548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.551008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.327020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e8b2081-3976-45b4-85f3-5e4639b47e43 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.911621 Oct 31 15:22:51.328239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1097/2106] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:50 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:51.333874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca278a700>, body: {"status": "disabled"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:51.340249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.342728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.343242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.357898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.358381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.360296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.374089 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] HTTP exception thrown: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Request method failure captured: Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b HTTP/1.1 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 22 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-hIZ5jfD6wSIxtgsEhy-dsgoqLwAtfaHzRqGmxUxg-uhyEPOK9DkCd1hsCGejyuLBa0RsORaa8cj_CT5Ux-MOKvNbnlxeIpn5ZAh7hemCVmuY8R1ZR9aPCjS6BNez25Os0DT2WFhOtVa260jpgmk1vohkhAqTj0atsi_vCq3fFr0Xo Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bdeb2942fb0d441bb8f0f339cd350d7d Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bdeb2942fb0d441bb8f0f339cd350d7d Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b0280058ac734e4e8f8c084a0732b515 Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: {"status": "disabled"} Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: exception: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '12843ce1-82d5-4a93-949f-504a4d97d10b', 'body': {'status': 'disabled'}} Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:22:51.376099 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:51.383229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Returning 404 to user: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:51.393162 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b95193e3-7293-439a-8939-4f5a67d93fa6 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b" status: 404 len: 110 microversion: 2.53 time: 0.054237 Oct 31 15:22:51.393162 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1098/2107] 10.222.0.48 () {62 vars in 1309 bytes} [Mon Oct 31 15:22:51 2022] PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b => generated 110 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:51.396453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:51.412227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:51.418968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.419951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.422277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.423211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.424567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.425258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.443623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:51.460610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0eef9d45-5eba-45b8-a25d-9ea6eb71d523 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1554 microversion: 2.1 time: 0.951902 Oct 31 15:22:51.463477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1010/2108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:50 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1554 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:51.474453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e9ea5c0c-7f5b-4c8b-9579-7f86ed934dc9 req-1babf947-cbe0-4f6f-bb58-157da639e659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b1b865-7989-45f8-978e-41dd4c3c2396", "tag": "2c97e0e4-90fd-411d-a096-6f5a48243d35"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:51.500357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e9ea5c0c-7f5b-4c8b-9579-7f86ed934dc9 req-1babf947-cbe0-4f6f-bb58-157da639e659 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.502756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e9ea5c0c-7f5b-4c8b-9579-7f86ed934dc9 req-1babf947-cbe0-4f6f-bb58-157da639e659 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.503444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e9ea5c0c-7f5b-4c8b-9579-7f86ed934dc9 req-1babf947-cbe0-4f6f-bb58-157da639e659 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.539601 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e9ea5c0c-7f5b-4c8b-9579-7f86ed934dc9 req-1babf947-cbe0-4f6f-bb58-157da639e659 service nova] Creating event network-changed:2c97e0e4-90fd-411d-a096-6f5a48243d35 for instance a5b1b865-7989-45f8-978e-41dd4c3c2396 on n-h2-858383-17 Oct 31 15:22:51.556441 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e9ea5c0c-7f5b-4c8b-9579-7f86ed934dc9 req-1babf947-cbe0-4f6f-bb58-157da639e659 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089602 Oct 31 15:22:51.560737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1011/2109] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:52.139481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-43d55431-0b43-4ee5-b986-fba7835757c4 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] Action: 'create', calling method: .version_select at 0x7f5ca2c5c9d0>, body: {"security_group": {"name": "tempest-securitygroup-620870960", "description": "tempest-description-933085884"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:53.045069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:53.060255 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a799c53-6c5e-4f3c-bb8a-b86201be50d8 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1519 microversion: 2.1 time: 1.674817 Oct 31 15:22:53.062960 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1099/2110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:51 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1519 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:53.077386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca24bcee0>, body: {"status": "enabled"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:53.097425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.098232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.098876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:53.122632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.123276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.123661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:53.147179 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] HTTP exception thrown: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Request method failure captured: Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b HTTP/1.1 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 21 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-hIZ5jfD6wSIxtgsEhy-dsgoqLwAtfaHzRqGmxUxg-uhyEPOK9DkCd1hsCGejyuLBa0RsORaa8cj_CT5Ux-MOKvNbnlxeIpn5ZAh7hemCVmuY8R1ZR9aPCjS6BNez25Os0DT2WFhOtVa260jpgmk1vohkhAqTj0atsi_vCq3fFr0Xo Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bdeb2942fb0d441bb8f0f339cd350d7d Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdeb2942fb0d441bb8f0f339cd350d7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bdeb2942fb0d441bb8f0f339cd350d7d Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b0280058ac734e4e8f8c084a0732b515 Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: {"status": "enabled"} Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: exception: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '12843ce1-82d5-4a93-949f-504a4d97d10b', 'body': {'status': 'enabled'}} Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:22:53.150517 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. Oct 31 15:22:53.157329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:22:53.166046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Returning 404 to user: Service 12843ce1-82d5-4a93-949f-504a4d97d10b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:53.170652 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3493b355-7d54-441f-805c-f0539f67017e tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b" status: 404 len: 110 microversion: 2.53 time: 0.106689 Oct 31 15:22:53.182710 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1100/2111] 10.222.0.48 () {62 vars in 1309 bytes} [Mon Oct 31 15:22:53 2022] PUT /compute/v2.1/os-services/12843ce1-82d5-4a93-949f-504a4d97d10b => generated 110 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:53.197819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:53.203929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:53.233302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.235282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.237009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:53.239008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.239955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.241141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.215157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-43d55431-0b43-4ee5-b986-fba7835757c4 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.652845 Oct 31 15:22:54.225508 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1012/2112] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:51 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:54.230427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:54.231260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:54.248884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.256396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.257134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.260065 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07d04e26-b9ec-4b9e-be75-3b90a9c332fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 1.075825 Oct 31 15:22:54.260457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.261418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.262580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.263195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.268051 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1101/2113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:53 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:54.280141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:54.281137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:54.308631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.309520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.310270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.311233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.314512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.317502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.721509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.736804 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f446b6a-e980-4506-8624-1b047cd2f495 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.509748 Oct 31 15:22:54.738280 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1013/2114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:54 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:54.754684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:54.768463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.769625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.770385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.773008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.775556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.778418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.852722 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1d909e7-b2da-4c3f-8b0b-99765a186117 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.108151 Oct 31 15:22:54.864140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1014/2115] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Oct 31 15:22:54 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:54.873375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:54.874273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:54.882221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.883046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.883719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.884806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.885590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.886446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.156789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:55.167758 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc388252-3ef5-40de-b996-c8c3b306b84f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1554 microversion: 2.1 time: 0.898082 Oct 31 15:22:55.178792 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1102/2116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:54 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1554 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:55.194763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e736972-4871-44f4-83ce-5203d4230c08 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] Action: 'create', calling method: .version_select at 0x7f5ca2461ee0>, body: {"security_group": {"name": "tempest-securitygroup-1788689309", "description": "tempest-description-1757605848"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:55.351425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:55.371573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d14be75-dc55-4cec-9eea-79fb13bc947b tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1519 microversion: 2.1 time: 0.505512 Oct 31 15:22:55.372958 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1015/2117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:54 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1519 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:55.606714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d788e42-bd83-4f7a-a4a5-3a23a4896f86 tempest-ExtensionsTest-879278193 tempest-ExtensionsTest-879278193-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.608505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d788e42-bd83-4f7a-a4a5-3a23a4896f86 tempest-ExtensionsTest-879278193 tempest-ExtensionsTest-879278193-project] 10.222.0.48 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.233998 Oct 31 15:22:55.609124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1016/2118] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:55.617020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.623500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.624079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.624792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.626087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.627603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.628310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.661401 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f478a90e-0e01-448d-9d0e-a5aa5edea118 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.051138 Oct 31 15:22:55.672274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1017/2119] 10.222.0.48 () {60 vars in 1211 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:55.677930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.678724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:55.686975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.687782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.689441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.690485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.691265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.691873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.696274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e736972-4871-44f4-83ce-5203d4230c08 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.515263 Oct 31 15:22:55.697550 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1103/2120] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:22:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:55.703338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-df051516-39cc-4973-9edf-287f5dded6dc req-c70ae84a-4dfd-4999-89c2-15b157292741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13dab01-1cb3-43d8-ae38-9a881eb387e8", "name": "network-vif-deleted", "tag": "b5382590-93df-40d3-bde0-c48e206a9aa4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:55.728584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-df051516-39cc-4973-9edf-287f5dded6dc req-c70ae84a-4dfd-4999-89c2-15b157292741 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.730059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-df051516-39cc-4973-9edf-287f5dded6dc req-c70ae84a-4dfd-4999-89c2-15b157292741 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.733425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-df051516-39cc-4973-9edf-287f5dded6dc req-c70ae84a-4dfd-4999-89c2-15b157292741 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.750938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-df051516-39cc-4973-9edf-287f5dded6dc req-c70ae84a-4dfd-4999-89c2-15b157292741 service nova] Creating event network-vif-deleted:b5382590-93df-40d3-bde0-c48e206a9aa4 for instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 on n-h2-858383-17 Oct 31 15:22:55.756326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:55.764422 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-df051516-39cc-4973-9edf-287f5dded6dc req-c70ae84a-4dfd-4999-89c2-15b157292741 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064479 Oct 31 15:22:55.765236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1104/2121] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:55.782017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8689645c-add8-48e5-b7d8-d5dc4dfd0bc6 tempest-ExtensionsTest-879278193 tempest-ExtensionsTest-879278193-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.784640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8689645c-add8-48e5-b7d8-d5dc4dfd0bc6 tempest-ExtensionsTest-879278193 tempest-ExtensionsTest-879278193-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.015775 Oct 31 15:22:55.785351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1105/2122] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:55.799705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.803730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.804527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.809873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.812083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.813112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.814893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.877210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48b08376-e340-407c-ad91-f65838a00d9f tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.089519 Oct 31 15:22:55.878037 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1106/2123] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:55.885669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e072c5a6-aefd-4c40-bcdb-10f05f9b5dd8 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] Calling method '.version_select at 0x7f5ca2978310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:56.151513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:56.181825 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e09e04a9-ffe1-4797-9ed3-de3fdb63081e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 0.506996 Oct 31 15:22:56.183387 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1018/2124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:56.198286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:56.199762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:56.221519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.226654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.235978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.239173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.240420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.242590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.809985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:56.887188 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-725ec4ba-9dfd-4751-9c27-2d6aa4a44773 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.700896 Oct 31 15:22:56.887793 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1019/2125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:56 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:56.893206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:56.899763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.900474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.901181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.902727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.903489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.906968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.995583 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fdd366fe-67b1-47ce-88d8-508b9c18aab0 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-858383-17&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.104113 Oct 31 15:22:57.003560 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1020/2126] 10.222.0.48 () {60 vars in 1237 bytes} [Mon Oct 31 15:22:56 2022] GET /compute/v2.1/os-services?host=n-d-858383-17&binary=xxx => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:57.022918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.025564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:57.047618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.049069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.049917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.051739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.058564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.061420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.194540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:57.206066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6688a80c-904e-40fd-bcab-5c340a254093 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1346 microversion: 2.1 time: 0.207779 Oct 31 15:22:57.207846 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1021/2127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:56 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:57.213367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.214443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:57.221271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.222110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.222789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.223561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.224132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.224624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.582596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:57.593670 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-31d0ee5d-f682-4386-a602-62c9bccb1630 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1496 microversion: 2.1 time: 0.384482 Oct 31 15:22:57.594273 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1022/2128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:57 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1496 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:57.614964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bc3a0510-1913-40bd-83e5-33411ff86639 req-e6c609c6-9c06-4378-917c-24e8e4e3d646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f4e853-a36d-41be-82f4-3163f2be49c3", "tag": "731fe297-5f66-48ea-bf35-7ef13c2e7528"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:57.625345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:57.628668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bc3a0510-1913-40bd-83e5-33411ff86639 req-e6c609c6-9c06-4378-917c-24e8e4e3d646 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.629282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bc3a0510-1913-40bd-83e5-33411ff86639 req-e6c609c6-9c06-4378-917c-24e8e4e3d646 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.629721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bc3a0510-1913-40bd-83e5-33411ff86639 req-e6c609c6-9c06-4378-917c-24e8e4e3d646 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.652404 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bc3a0510-1913-40bd-83e5-33411ff86639 req-e6c609c6-9c06-4378-917c-24e8e4e3d646 service nova] Creating event network-changed:731fe297-5f66-48ea-bf35-7ef13c2e7528 for instance a4f4e853-a36d-41be-82f4-3163f2be49c3 on n-h1-858383-17 Oct 31 15:22:57.658444 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bc3a0510-1913-40bd-83e5-33411ff86639 req-e6c609c6-9c06-4378-917c-24e8e4e3d646 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059588 Oct 31 15:22:57.663759 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1023/2129] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:57.670866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.682637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.683142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.683578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.685283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.687516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.696612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.749181 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b35182f-53ba-4ada-979a-9c7a0d1a9d1b tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.084088 Oct 31 15:22:57.758772 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1024/2130] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Oct 31 15:22:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:57.763780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.764522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:57.781983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.782687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.783451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.784191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.784662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.785125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.096321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:58.104282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00f99bfe-be8a-4ea9-b85f-fc42dbfca348 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 0.344399 Oct 31 15:22:58.108553 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1025/2131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:57 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:58.115547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.128990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:58.131035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:22:58.149139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.149770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.150317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.152013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.153018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.153704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.219486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:22:58.290902 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b548a3b-f2f6-4977-84bd-61b977597b53 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 344 microversion: 2.1 time: 0.162826 Oct 31 15:22:58.290902 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1026/2132] 10.222.0.48 () {58 vars in 1154 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/servers?status=shutoff => generated 344 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:58.294226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.298774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.299774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.300474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.301512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.302225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.302898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.348297 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63ff1e7a-556c-4745-a6df-70217d1702b8 tempest-ServicesAdminNegativeV253TestJSON-880900577 tempest-ServicesAdminNegativeV253TestJSON-880900577-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.063559 Oct 31 15:22:58.349441 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1027/2133] 10.222.0.48 () {60 vars in 1239 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:58.365742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.367452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:58.374975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.376078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.377960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.378939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.379631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.380331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.535853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=42 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:58.749125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:58.758687 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c56046a5-8909-45a4-8153-a6119eb20ab1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.407215 Oct 31 15:22:58.783277 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1028/2134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:58.792503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.795126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:58.809038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.809871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.810487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.811488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.812121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.812552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.377279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:59.393649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-987d02f4-dfd3-4f08-aaa1-bab4f3519c0d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1346 microversion: 2.1 time: 0.608774 Oct 31 15:22:59.410158 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1029/2135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1346 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:59.421499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69d21e5f-637e-4bbd-931a-5d827ae618e1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:59.436287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69d21e5f-637e-4bbd-931a-5d827ae618e1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.436831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69d21e5f-637e-4bbd-931a-5d827ae618e1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.437268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69d21e5f-637e-4bbd-931a-5d827ae618e1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.489226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69d21e5f-637e-4bbd-931a-5d827ae618e1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Going to try to start instance {{(pid=120626) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:22:59.572480 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69d21e5f-637e-4bbd-931a-5d827ae618e1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "POST /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20/action" status: 202 len: 0 microversion: 2.1 time: 0.159021 Oct 31 15:22:59.576246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1030/2136] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:59 2022] POST /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:00.089607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5da3346f-5d90-49b4-8b01-00a8ae693316 tempest-ServicesAdminNegativeV253TestJSON-663296374 tempest-ServicesAdminNegativeV253TestJSON-663296374-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:00.093330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5da3346f-5d90-49b4-8b01-00a8ae693316 tempest-ServicesAdminNegativeV253TestJSON-663296374 tempest-ServicesAdminNegativeV253TestJSON-663296374-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '6a7b9a32528e4678a512749fefb368a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc52c0637df44f28aeee1f7b355a3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5da3346f-5d90-49b4-8b01-00a8ae693316 tempest-ServicesAdminNegativeV253TestJSON-663296374 tempest-ServicesAdminNegativeV253TestJSON-663296374-project] Request method failure captured: Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-hGfXu34ascaFzjLiKcmhHSFaWm7QKvwJGvtAaIwCCZf-KXBZT_ZTksU4JCGCCF9woF3qaCR28NNLlKdxqCq8VLtwAzRfrjLI_ze-Vl7hSVr0C0t0NKd6KqRGyZ4E0eTkkypCHmTMJWFP85yb5sks6xN-_CBKGWTdTF7WJsDkknlRM Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8dc52c0637df44f28aeee1f7b355a3fa Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-663296374 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8dc52c0637df44f28aeee1f7b355a3fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dc52c0637df44f28aeee1f7b355a3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8dc52c0637df44f28aeee1f7b355a3fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dc52c0637df44f28aeee1f7b355a3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-663296374 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8dc52c0637df44f28aeee1f7b355a3fa Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-663296374 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServicesAdminNegativeV253TestJSON-663296374-project Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 6a7b9a32528e4678a512749fefb368a1 Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-663296374-project Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: action_args: {} Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:23:00.096848 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:23:00.101607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:00.105014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5da3346f-5d90-49b4-8b01-00a8ae693316 tempest-ServicesAdminNegativeV253TestJSON-663296374 tempest-ServicesAdminNegativeV253TestJSON-663296374-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:00.106181 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5da3346f-5d90-49b4-8b01-00a8ae693316 tempest-ServicesAdminNegativeV253TestJSON-663296374 tempest-ServicesAdminNegativeV253TestJSON-663296374-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.528362 Oct 31 15:23:00.111518 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1031/2137] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Oct 31 15:22:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 534 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:23:00.122215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:00.123337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:00.133596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.135048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.135750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.136732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.137434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.138145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.730397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:00.753952 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-77ba4b8f-d723-4c1a-85ca-219317b5a971 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 0.635443 Oct 31 15:23:00.774156 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1032/2138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:00 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:00.786012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:00.787350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:00.795431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.796263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.798782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.799863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.800620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.802585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.251783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:01.264267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-479c67c7-9ad8-4362-825d-61ba24400af5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1505 microversion: 2.1 time: 0.487812 Oct 31 15:23:01.269826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1033/2139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:00 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:01.276638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:01.278420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:01.286252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.287018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.290692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.291782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.292508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.293210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.649759 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e072c5a6-aefd-4c40-bcdb-10f05f9b5dd8 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8824 microversion: 2.1 time: 5.770587 Oct 31 15:23:01.665314 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1107/2140] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8824 bytes in 5786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:01.673676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:01.676240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:01.678482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:01.690295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7169b040-121f-4cdd-b2db-00404d212492 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.415148 Oct 31 15:23:01.690987 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1034/2141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:01 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:01.691261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.695019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.695867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.696826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.697466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.698085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.710969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12e4c572-b66a-4ca9-8b28-a0540ea4ffde tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] Calling method '.version_select at 0x7f5ca2b219d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:01.881846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:01.910314 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7f77943-d466-4ee2-9472-b0cd9d4924bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 200 len: 1346 microversion: 2.1 time: 0.242813 Oct 31 15:23:01.912656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1108/2142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:01 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 1346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:01.923689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:01.932515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:01.944411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.945536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.946438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.947450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.948243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.949362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.341037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:02.358856 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a13ba02-ac3e-4b22-a1d0-e573d187ac75 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 0.441386 Oct 31 15:23:02.359502 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1109/2143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:01 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:02.368291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.370501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:02.380959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.382314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.382953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.383997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.384629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.385267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.397019 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12e4c572-b66a-4ca9-8b28-a0540ea4ffde tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.703967 Oct 31 15:23:02.400760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1035/2144] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Oct 31 15:23:01 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:02.413255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8818788-e0bd-4d67-a0f8-2abb0c84de72 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] Calling method '.version_select at 0x7f5ca2846e50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.745110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:02.763007 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a207801-5bea-4a44-b8da-f7a6470dc63c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1505 microversion: 2.1 time: 0.402288 Oct 31 15:23:02.763622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1110/2145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:02 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:02.768595 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8818788-e0bd-4d67-a0f8-2abb0c84de72 tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/9a0842b8-89d4-4e2c-8bcb-9fa4b6237866" status: 202 len: 0 microversion: 2.1 time: 0.360222 Oct 31 15:23:02.769201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1036/2146] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:02 2022] DELETE /compute/v2.1/os-security-groups/9a0842b8-89d4-4e2c-8bcb-9fa4b6237866 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:23:02.788099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20d42ccf-d1fb-452f-968e-eff64b05a34e tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] Calling method '.version_select at 0x7f5ca29c3c10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.796393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.797409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:02.819813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.822332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.826629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.828412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.831286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.849445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.271455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:03.298983 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61baacac-70f4-4c7e-bc78-10c73b424d88 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.532957 Oct 31 15:23:03.321081 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1111/2147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:02 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:03.333698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:03.334183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:03.353482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.354156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.354535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.355245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.355762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.356116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.358361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20d42ccf-d1fb-452f-968e-eff64b05a34e tempest-SecurityGroupsTestAdminJSON-619632437 tempest-SecurityGroupsTestAdminJSON-619632437-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f3b2d66c-9bf7-410d-9082-32e63001dd3b" status: 202 len: 0 microversion: 2.1 time: 0.576269 Oct 31 15:23:03.358951 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1037/2148] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:02 2022] DELETE /compute/v2.1/os-security-groups/f3b2d66c-9bf7-410d-9082-32e63001dd3b => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:23:03.366941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e6464479-5288-4f17-b76f-9174866b65c1 req-fa188a3c-cdc9-47d2-9675-98714f04e65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f4e853-a36d-41be-82f4-3163f2be49c3", "name": "network-vif-plugged", "status": "completed", "tag": "731fe297-5f66-48ea-bf35-7ef13c2e7528"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:03.382390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e6464479-5288-4f17-b76f-9174866b65c1 req-fa188a3c-cdc9-47d2-9675-98714f04e65c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.383376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e6464479-5288-4f17-b76f-9174866b65c1 req-fa188a3c-cdc9-47d2-9675-98714f04e65c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.384331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e6464479-5288-4f17-b76f-9174866b65c1 req-fa188a3c-cdc9-47d2-9675-98714f04e65c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.394469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 HTTP/1.1 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e13dab01-1cb3-43d8-ae38-9a881eb387e8'} Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:03.398069 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:03.404285 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:03.405199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e6464479-5288-4f17-b76f-9174866b65c1 req-fa188a3c-cdc9-47d2-9675-98714f04e65c service nova] Creating event network-vif-plugged:731fe297-5f66-48ea-bf35-7ef13c2e7528 for instance a4f4e853-a36d-41be-82f4-3163f2be49c3 on n-h1-858383-17 Oct 31 15:23:03.408850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:03.409973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68174864-3d72-4207-80c9-fe3e14b52e32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 404 len: 111 microversion: 2.1 time: 0.086216 Oct 31 15:23:03.411860 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e6464479-5288-4f17-b76f-9174866b65c1 req-fa188a3c-cdc9-47d2-9675-98714f04e65c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051361 Oct 31 15:23:03.412866 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1112/2149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:03 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:03.417637 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1038/2150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:03.428089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef888f54-0a09-483c-908d-abc0ff8f2d09 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] Calling method '.version_select at 0x7f5ca28e6790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:03.449381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:03.450157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:03.470297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.471061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.471738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.472763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.473455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.474110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.316747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:04.332445 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c145a5db-12ce-488f-8cc5-20d0209fce9e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 0.911762 Oct 31 15:23:04.334555 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1039/2151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:03 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:04.342406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:04.347878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:04.357763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.360210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.361307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.364100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.365174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.365459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef888f54-0a09-483c-908d-abc0ff8f2d09 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/9322edc1-09af-4464-8bdd-bcbc79a044fc" status: 202 len: 0 microversion: 2.1 time: 0.951001 Oct 31 15:23:04.366051 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1113/2152] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:03 2022] DELETE /compute/v2.1/os-security-groups/9322edc1-09af-4464-8bdd-bcbc79a044fc => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:04.366822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.371141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:04.372336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:04.419894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:04.428235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.431506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.432223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.436396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.437001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.437991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8/os-volume_attachments HTTP/1.1 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': 'e13dab01-1cb3-43d8-ae38-9a881eb387e8'} Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:04.439380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:23:04.443948 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:04.448414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:04.450562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-251e306c-eec8-4fae-b314-efc2e826a77f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.113680 Oct 31 15:23:04.455732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1040/2153] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:23:04 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8/os-volume_attachments => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:04.462077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:04.462691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:04.470290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.470943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.471745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.472523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.473550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.473991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.798310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:04.803584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:04.812644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00d0471d-3f4a-4949-981c-c800b2ab0d20 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.354914 Oct 31 15:23:04.816432 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1041/2154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:04 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:04.835124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f31aa55a-8056-4ac2-98c1-b4b2a637cdf0 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] Calling method '.version_select at 0x7f5ca2d64430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:04.864975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:04.877477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7de297b1-0373-4ff9-b552-ea28dc5ac634 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1509 microversion: 2.1 time: 0.510185 Oct 31 15:23:04.878767 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1114/2155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:04 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:04.886965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-268677013", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:04.992531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:05.500275 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f31aa55a-8056-4ac2-98c1-b4b2a637cdf0 tempest-SecurityGroupsTestAdminJSON-1306864938 tempest-SecurityGroupsTestAdminJSON-1306864938-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/bd098baa-6597-4855-b6d9-5b16a25dd57d" status: 202 len: 0 microversion: 2.1 time: 0.680015 Oct 31 15:23:05.503361 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1042/2156] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:04 2022] DELETE /compute/v2.1/os-security-groups/bd098baa-6597-4855-b6d9-5b16a25dd57d => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:05.510567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:05.522126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:05.526732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.compute.servers [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Removing options 'limit' from query {{(pid=120626) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:23:05.529792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:05.534365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.537092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.537844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.538845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.541160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.542436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.549026 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0da7f74d-3e07-40fc-86d0-cc2d3d6a9f90 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040897 Oct 31 15:23:05.550958 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1043/2157] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 31 15:23:05 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:23:05.570269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:05.571226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:05.581396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.583216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.583894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.585176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.585957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.602254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.832435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=31 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:06.100753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:06.101419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:06.101571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:06.102141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:06.102652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:06.103171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:06.114862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad58ae7d-f301-499b-8e8f-590e99fa286c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1315 microversion: 2.1 time: 0.560749 Oct 31 15:23:06.119900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.122517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.123615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.124472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.126366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.128000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.130975 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1044/2158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:05 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:06.142876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3633934a-2ee7-4262-b628-de33e1e2ac3f req-7adf2c58-2596-4d92-ac26-c032ca1dde59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b1b865-7989-45f8-978e-41dd4c3c2396", "name": "network-vif-plugged", "status": "completed", "tag": "2c97e0e4-90fd-411d-a096-6f5a48243d35"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:06.158370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3633934a-2ee7-4262-b628-de33e1e2ac3f req-7adf2c58-2596-4d92-ac26-c032ca1dde59 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.159385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3633934a-2ee7-4262-b628-de33e1e2ac3f req-7adf2c58-2596-4d92-ac26-c032ca1dde59 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.166588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3633934a-2ee7-4262-b628-de33e1e2ac3f req-7adf2c58-2596-4d92-ac26-c032ca1dde59 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.174897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:06.193275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:06.211791 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3633934a-2ee7-4262-b628-de33e1e2ac3f req-7adf2c58-2596-4d92-ac26-c032ca1dde59 service nova] Creating event network-vif-plugged:2c97e0e4-90fd-411d-a096-6f5a48243d35 for instance a5b1b865-7989-45f8-978e-41dd4c3c2396 on n-h2-858383-17 Oct 31 15:23:06.218154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3633934a-2ee7-4262-b628-de33e1e2ac3f req-7adf2c58-2596-4d92-ac26-c032ca1dde59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081367 Oct 31 15:23:06.219562 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1045/2159] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:06.226216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:06.227938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:06.233116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:06.237489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:06.247052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.247770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.248557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.249494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.250124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.251545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.355028 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d0eb067-a9af-4d96-83dd-894b53c28d39 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473060 Oct 31 15:23:06.362827 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1115/2160] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:06.390450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:06.393719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:06.408268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.414076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.414685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.416089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.418086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.418989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.819345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:06.840561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6814677a-7323-4feb-a338-45e9a487a05e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1509 microversion: 2.1 time: 0.617133 Oct 31 15:23:06.845134 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1046/2161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:06 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1509 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:06.858928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5cd7472d-1171-4f2e-83d7-ebad3428a507 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:06.866595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5cd7472d-1171-4f2e-83d7-ebad3428a507 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.028342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5cd7472d-1171-4f2e-83d7-ebad3428a507 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.041859 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5cd7472d-1171-4f2e-83d7-ebad3428a507 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23" status: 200 len: 1214 microversion: 2.1 time: 0.193083 Oct 31 15:23:07.060994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1047/2162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:06 2022] GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.083184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.086671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.096185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.105746 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-202fc911-1601-4290-ac4b-bba4be5aa08e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1307 microversion: 2.1 time: 0.738143 Oct 31 15:23:07.106878 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1116/2163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:06 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1307 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.107282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.107786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.108228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.113201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.114832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.116385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.125337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-899b6404-3424-4065-ab70-f6991d38f0f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.127083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-899b6404-3424-4065-ab70-f6991d38f0f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.171747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-899b6404-3424-4065-ab70-f6991d38f0f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:07.376192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.386919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2c536b2-dd6a-4b6b-9a0f-b7bb2292d299 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 200 len: 1511 microversion: 2.1 time: 0.324338 Oct 31 15:23:07.388943 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1048/2164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.397443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.398329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.406316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.408061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.409400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.410452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.411154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.411888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.477888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.scheduler.client.report [None req-899b6404-3424-4065-ab70-f6991d38f0f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Deleted allocations for instance 8da8b385-efbb-4651-b650-78b0127cec23 Oct 31 15:23:07.518772 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-899b6404-3424-4065-ab70-f6991d38f0f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23" status: 204 len: 0 microversion: 2.1 time: 0.409496 Oct 31 15:23:07.522339 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1117/2165] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:07 2022] DELETE /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:07.542055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.545635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.567001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.569906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.570376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.575929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.576570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.577140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.818108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.827641 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d483be75-de55-44d0-a546-567d889da0d4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1503 microversion: 2.1 time: 0.437391 Oct 31 15:23:07.842769 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1049/2166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.861063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.861063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.866862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.867578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.868222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.869269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.870015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.870637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.900139 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 HTTP/1.1 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '8da8b385-efbb-4651-b650-78b0127cec23'} Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:07.903214 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:23:07.908840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:07.913777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:07.915920 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3fbc881b-a079-4ae1-90f4-d869841ed30b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23" status: 404 len: 111 microversion: 2.1 time: 0.065081 Oct 31 15:23:07.917927 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1050/2167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:07.929470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.932053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:07.941899 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65b61951-7a94-4711-b11f-b86610e59093 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1510 microversion: 2.1 time: 0.418382 Oct 31 15:23:07.942851 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1118/2168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.948192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1500589637"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:07.949056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.957030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.957844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.958536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.960286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.961053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.961718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.157781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.network.security_group_api [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Adding security group ed84da4e-bc37-498c-aef3-8f2bdb850a66 to port 731fe297-5f66-48ea-bf35-7ef13c2e7528 Oct 31 15:23:08.309592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:08.695133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1723508633", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:08.763275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:08.859850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-414bffbc-085a-48d8-a54b-af56a46fd2a5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3/action" status: 202 len: 0 microversion: 2.1 time: 0.915350 Oct 31 15:23:08.860673 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1119/2169] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:07 2022] POST /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:08.865544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:08.874701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:08.875924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:09.288817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.301793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.302694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.303916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.304637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.305792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.472845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:09.535020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:09.535559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:09.535896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:09.536306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:09.536754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:09.551673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.552241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.552906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.553768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.557334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.558329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.566022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c129ec16-e249-4d0d-99c6-d6ae7ce0824c tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.704252 Oct 31 15:23:09.566906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1120/2170] 10.222.0.48 () {58 vars in 1154 bytes} [Mon Oct 31 15:23:08 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:09.572565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:09.573369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:09.580912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.581916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.582526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.583425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.584441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.585077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.600623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Getting quotas for project 28a4f5e804b54e08ba48264b3d7b6994. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:09.610872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Getting quotas for user c35619d71c374a6daf6f83988c93ed4c and project 28a4f5e804b54e08ba48264b3d7b6994. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:09.632441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:09.635688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:09.720900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-936c0549-3549-420d-b0f6-e87235256000 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801460 Oct 31 15:23:09.725287 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1051/2171] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:09.730954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1763945691", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:09.818476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:09.824242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:09.838179 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ea46d4f-5b89-4618-8f55-02400c9bef83 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1487 microversion: 2.1 time: 0.267456 Oct 31 15:23:09.843070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1121/2172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:09 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1487 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:09.877193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-612522078"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:09.877864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:09.888900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.894452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.895102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.896727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.898978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.902543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.238115 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.network.security_group_api [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Adding security group 8fcfede5-b92c-490f-9a34-8ff0eda108d6 to port 731fe297-5f66-48ea-bf35-7ef13c2e7528 Oct 31 15:23:10.710793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:10.712592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:10.713101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:10.713514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:10.713941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:10.734253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.736627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.737385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.741466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.741962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.742402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.774687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:10.780617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:10.801274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:10.803857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:10.868214 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3957eaf3-55b2-46a0-b08e-52bd3493b4e1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145116 Oct 31 15:23:10.869702 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1052/2173] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:10.876080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-96c64624-0244-41c5-be93-1c3317a0d60e req-0f957f6a-1fd3-4132-b90b-35ef170eeaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f4e853-a36d-41be-82f4-3163f2be49c3", "tag": "731fe297-5f66-48ea-bf35-7ef13c2e7528"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:10.887886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-96c64624-0244-41c5-be93-1c3317a0d60e req-0f957f6a-1fd3-4132-b90b-35ef170eeaf8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.889272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-96c64624-0244-41c5-be93-1c3317a0d60e req-0f957f6a-1fd3-4132-b90b-35ef170eeaf8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.890301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-96c64624-0244-41c5-be93-1c3317a0d60e req-0f957f6a-1fd3-4132-b90b-35ef170eeaf8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.916656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-96c64624-0244-41c5-be93-1c3317a0d60e req-0f957f6a-1fd3-4132-b90b-35ef170eeaf8 service nova] Creating event network-changed:731fe297-5f66-48ea-bf35-7ef13c2e7528 for instance a4f4e853-a36d-41be-82f4-3163f2be49c3 on n-h1-858383-17 Oct 31 15:23:10.932145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-96c64624-0244-41c5-be93-1c3317a0d60e req-0f957f6a-1fd3-4132-b90b-35ef170eeaf8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060309 Oct 31 15:23:10.933522 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1053/2174] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:11.017480 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f47d281-6b77-40b6-b50f-3dc12897670d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3/action" status: 202 len: 0 microversion: 2.1 time: 1.152034 Oct 31 15:23:11.022024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1122/2175] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:09 2022] POST /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:11.027642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.028506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.044658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.051038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.051797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.053021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.055558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.056208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.352129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9c77934-82ae-4c9c-988c-e63fc68bc732 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: .version_select at 0x7f5ca29c3c10>, body: {"keypair": {"name": "tempest-keypair-295268686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAiVUJWh2NQrBER+ZLzYgVnIYSqScxyHd26+0AAG3RLZ5A4syE5T2qmfR+euCZBSO/VilJmqjKkVYrwlYyk4Zngb7dLqHBm2ysXITMKUx1K71nW1gy/NltxbHvG/0RcGQ=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:11.363578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.373309 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42935c39-1b83-4102-9fe8-8a764f515681 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1509 microversion: 2.1 time: 0.349988 Oct 31 15:23:11.380508 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1123/2176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:11.401733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.402362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.408412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e9c77934-82ae-4c9c-988c-e63fc68bc732 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:11.411765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:11.413320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.414076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.414383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.419538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e9c77934-82ae-4c9c-988c-e63fc68bc732 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for user bf304336d1f2420db7a197a36036ccab and project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:11.419914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.420688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.421343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.492107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9c77934-82ae-4c9c-988c-e63fc68bc732 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.557283 Oct 31 15:23:11.492759 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1054/2177] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:23:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:11.584607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.600261 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d8c1ec5-317d-4d71-905b-f6f0bf49c155 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1266 microversion: 2.1 time: 0.216714 Oct 31 15:23:11.616754 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1124/2178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:11.758222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b043028-4df7-4285-9cf6-9d19b133ebca tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.780133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.780796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.788963 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b043028-4df7-4285-9cf6-9d19b133ebca tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.168173 Oct 31 15:23:11.792248 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1125/2179] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:11.797718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.807572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.808127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.808908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.809046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b907da7-11e8-423f-b8c7-972344e668f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.809378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.809804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.811823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b907da7-11e8-423f-b8c7-972344e668f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.900619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:12.073965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:12.102295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69383725-5a55-4260-82d0-0d5699460c9c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 204 len: 0 microversion: 2.1 time: 0.607185 Oct 31 15:23:12.103580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1055/2180] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:11 2022] DELETE /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:12.112463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:12.115019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:12.135844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.136067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.140127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.141121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.148601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.149868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.491615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b907da7-11e8-423f-b8c7-972344e668f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.506515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b907da7-11e8-423f-b8c7-972344e668f5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1215 microversion: 2.1 time: 0.710841 Oct 31 15:23:12.516298 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1126/2181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1215 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:12.529991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:12.530902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:12.550861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.552844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.553642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.555597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.556641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.557496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.010635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:13.021783 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-638fc48e-1e68-48bd-8ebc-6839c3fe345e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 200 len: 1511 microversion: 2.1 time: 0.503465 Oct 31 15:23:13.022695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1127/2182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:12 2022] GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:13.037146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2bddd3fc-811b-494a-a381-f405b49e8143 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.075167 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2bddd3fc-811b-494a-a381-f405b49e8143 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.050153 Oct 31 15:23:13.075479 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1128/2183] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:13.093718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.094932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:13.114660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.115153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.115594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.116305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.117876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.118487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.151185 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-111e71c6-d5e7-402f-8902-49e0dee426f9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.046163 Oct 31 15:23:13.164617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1056/2184] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Oct 31 15:23:12 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3/os-security-groups => generated 1156 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:13.176229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.177165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:13.189149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.195501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.196352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.197292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.197994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.198578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.441225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:13.456302 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-16aa3e48-1da1-4b9e-9bd0-728a22493292 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1272 microversion: 2.1 time: 0.290380 Oct 31 15:23:13.470860 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1057/2185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:13.481790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1d1cd6cd-d321-4ef3-b5f9-12ba238da830 req-01bd1b27-91e8-4a95-9545-bbd59f68870e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f4e853-a36d-41be-82f4-3163f2be49c3", "tag": "731fe297-5f66-48ea-bf35-7ef13c2e7528"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:13.505465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1d1cd6cd-d321-4ef3-b5f9-12ba238da830 req-01bd1b27-91e8-4a95-9545-bbd59f68870e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.508984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1d1cd6cd-d321-4ef3-b5f9-12ba238da830 req-01bd1b27-91e8-4a95-9545-bbd59f68870e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.509484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1d1cd6cd-d321-4ef3-b5f9-12ba238da830 req-01bd1b27-91e8-4a95-9545-bbd59f68870e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.529376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1d1cd6cd-d321-4ef3-b5f9-12ba238da830 req-01bd1b27-91e8-4a95-9545-bbd59f68870e service nova] Creating event network-changed:731fe297-5f66-48ea-bf35-7ef13c2e7528 for instance a4f4e853-a36d-41be-82f4-3163f2be49c3 on n-h1-858383-17 Oct 31 15:23:13.553767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1d1cd6cd-d321-4ef3-b5f9-12ba238da830 req-01bd1b27-91e8-4a95-9545-bbd59f68870e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081574 Oct 31 15:23:13.554641 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1058/2186] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:13.563904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.564618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:13.585956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.586338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.586836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.587763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.588182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.588605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.935480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:13.964316 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df293b10-e2c9-46f1-b136-a49802edd7a5 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1493 microversion: 2.1 time: 0.887643 Oct 31 15:23:13.965486 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1129/2187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1493 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:13.972625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eaf0baea-2e18-464b-81b0-0e956bbe40cf tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.983441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eaf0baea-2e18-464b-81b0-0e956bbe40cf tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016387 Oct 31 15:23:13.984437 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1130/2188] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:13.997853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c835a70c-0255-4253-a491-a428fb872151 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca20fb0d0>, body: {"security_group": {"name": " tempest-securitygroup -1148288370 ", "description": "tempest-description-177859948"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:14.521051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.532230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dc46e26-7def-41f3-8bb8-851f6f8fcf54 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1510 microversion: 2.1 time: 0.975963 Oct 31 15:23:14.545250 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1059/2189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1510 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:14.550989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.552060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:14.569809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.583272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.584839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.585993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.590582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.591319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.936094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.945355 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52414873-be7d-4639-9a99-9dbd33a0d314 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1273 microversion: 2.1 time: 0.405920 Oct 31 15:23:14.948775 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1060/2190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:14 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1273 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:14.954895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c835a70c-0255-4253-a491-a428fb872151 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.968931 Oct 31 15:23:14.956020 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1131/2191] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:23:13 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:14.961139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.961934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:14.967397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2bd5a576-7796-4dd9-a706-1c100b9acaaf tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.980609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.987492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.988246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.989352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.989986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.993647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2bd5a576-7796-4dd9-a706-1c100b9acaaf tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043582 Oct 31 15:23:14.994407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.004175 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1061/2192] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:15.014147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:15.027925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:15.038800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:15.060893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.068053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.068731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.077922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.079329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.079942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.142729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:15.194647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:15.206261 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c567207-b6c0-40d6-9640-4472cb0f02e8 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1272 microversion: 2.1 time: 0.248694 Oct 31 15:23:15.211365 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1132/2193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:14 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:15.221559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51ee18f1-d516-4339-9dc1-392a1e9b87b7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca28e63a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:15.257956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:15.266663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.267561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.268163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.922317 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51ee18f1-d516-4339-9dc1-392a1e9b87b7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c" status: 200 len: 223 microversion: 2.1 time: 0.709500 Oct 31 15:23:15.922993 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1133/2194] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:23:15 2022] GET /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c => generated 223 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:15.927231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:15.927841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:15.941401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.941899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.942336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.943046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.943493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.961286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.025315 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a427752-d72a-4948-91aa-ed482317efd7 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 4513 microversion: 2.1 time: 1.016682 Oct 31 15:23:16.027378 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1062/2195] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:23:15 2022] GET /compute/v2.1/servers/detail => generated 4513 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.034185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f72e1c4d-fb3c-4855-83df-077175d2db5a tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.088583 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f72e1c4d-fb3c-4855-83df-077175d2db5a tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.059328 Oct 31 15:23:16.089913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1063/2196] 10.222.0.48 () {58 vars in 1165 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.095467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38895b6c-b31c-4c95-a67c-6f97471732c2 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca1dbe4c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.814228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.824925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-772268dd-710a-4f17-8f48-afe7981f98a3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 200 len: 1493 microversion: 2.1 time: 0.900866 Oct 31 15:23:16.829262 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1134/2197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:15 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 1493 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.839161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.839786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:16.867226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.867675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.868131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.868933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.869404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.869841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.361776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:17.370431 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-690503cb-7fb4-4337-951f-1ff254174c20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1315 microversion: 2.1 time: 0.537607 Oct 31 15:23:17.371856 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1135/2198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:17.378826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.389343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:17.395624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:17.431710 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38895b6c-b31c-4c95-a67c-6f97471732c2 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c" status: 202 len: 0 microversion: 2.1 time: 1.340015 Oct 31 15:23:17.446278 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1064/2199] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:16 2022] DELETE /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c => generated 0 bytes in 1355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:17.451320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-505a4808-4b7e-4a2f-ad81-0a0a63a76dc6 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.468505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-505a4808-4b7e-4a2f-ad81-0a0a63a76dc6 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020961 Oct 31 15:23:17.469258 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1065/2200] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:17.477402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.478278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:17.497153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.498559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.499853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.501793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.503349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.504023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.538637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.539339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.539946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.540900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.541590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.542211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.596591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:17.643547 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8794408-b52c-4bb5-921d-8b6e474d770e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1008 microversion: 2.1 time: 0.269597 Oct 31 15:23:17.643780 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1136/2201] 10.222.0.48 () {58 vars in 1150 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1008 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:17.650685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-898880844", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e78089d-afe3-4c24-b00f-32f46e5b5900"}], "security_groups": [{"name": "tempest-securitygroup--111917247"}], "key_name": "tempest-keypair-295268686", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:18.149661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] validate_networks() for [('8e78089d-afe3-4c24-b00f-32f46e5b5900', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:18.373027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.395128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b34167e-c954-43ac-a2d7-1b4ce660460e tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.916902 Oct 31 15:23:18.414583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1066/2202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:18.424766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-68838295-a855-4bf3-b0f5-9a1c0a7d1017 req-3decf3e9-1d14-4f97-882f-e5df6dca5c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b1b865-7989-45f8-978e-41dd4c3c2396", "name": "network-vif-deleted", "tag": "2c97e0e4-90fd-411d-a096-6f5a48243d35"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:18.435582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-68838295-a855-4bf3-b0f5-9a1c0a7d1017 req-3decf3e9-1d14-4f97-882f-e5df6dca5c79 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.442738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-68838295-a855-4bf3-b0f5-9a1c0a7d1017 req-3decf3e9-1d14-4f97-882f-e5df6dca5c79 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.443474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-68838295-a855-4bf3-b0f5-9a1c0a7d1017 req-3decf3e9-1d14-4f97-882f-e5df6dca5c79 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.471546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-68838295-a855-4bf3-b0f5-9a1c0a7d1017 req-3decf3e9-1d14-4f97-882f-e5df6dca5c79 service nova] Creating event network-vif-deleted:2c97e0e4-90fd-411d-a096-6f5a48243d35 for instance a5b1b865-7989-45f8-978e-41dd4c3c2396 on n-h2-858383-17 Oct 31 15:23:18.487882 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-68838295-a855-4bf3-b0f5-9a1c0a7d1017 req-3decf3e9-1d14-4f97-882f-e5df6dca5c79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071434 Oct 31 15:23:18.490256 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1067/2203] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:18.497384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca29ed3a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.552837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:18.553433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group b72cd018-2437-4431-b4a5-86acf593642c not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:23:18.554157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.554157 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c HTTP/1.1 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b72cd018-2437-4431-b4a5-86acf593642c'} Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:18.556572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-02ece01d-cdec-4639-816b-e2047d16091d'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:18.564966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d6d7f32-0a43-4f40-87cf-811a4a452677 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c" status: 404 len: 194 microversion: 2.1 time: 0.065988 Oct 31 15:23:18.574023 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1068/2204] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:18.574023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c680996c-7e13-4d47-bafa-ddaab81f94db tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.597626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c680996c-7e13-4d47-bafa-ddaab81f94db tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.030357 Oct 31 15:23:18.609235 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1069/2205] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:18.615176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.621327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.622246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:18.629926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.630412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.630847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.631573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.632033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.632922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.742701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:18.811228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:18.838664 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2d48c42f-bb2e-4b00-96a5-469fc6e21987 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1008 microversion: 2.1 time: 0.226235 Oct 31 15:23:18.839801 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1070/2206] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1008 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:18.847460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.848433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:18.859188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.860256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.861306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.862334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.863054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.863874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.902171 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 HTTP/1.1 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a5b1b865-7989-45f8-978e-41dd4c3c2396'} Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.909088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-25a3ce15-73a3-48da-9216-44d9f5bffcce tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 404 len: 111 microversion: 2.1 time: 0.069695 Oct 31 15:23:18.919907 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1071/2207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:18.924048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.924683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:18.940194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.941421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.941871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.942581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.943053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.943462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.367059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:19.367555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:19.367945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:19.368355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:19.368844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:19.384648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.385219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.385695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.386426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.386888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.387316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.408993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:19.419294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f1f6830a-deac-425d-abb8-5b70b77bd351 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1315 microversion: 2.1 time: 0.504891 Oct 31 15:23:19.419880 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1072/2208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:19.436630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e934a569-1c3b-42ed-a90d-c7f616b76a12 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca240d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1646094710", "description": "tempest-description-2124757596"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:19.457856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:19.464841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for user bf304336d1f2420db7a197a36036ccab and project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:19.482172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:19.486225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:19.565569 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66edd893-f70b-4959-819d-9076fba9c9c8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.917800 Oct 31 15:23:19.573885 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1137/2209] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:19.584498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-100ec83e-c4a4-4460-a8f9-381e1807e0ed tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.602882 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-100ec83e-c4a4-4460-a8f9-381e1807e0ed tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.027688 Oct 31 15:23:19.604158 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1138/2210] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 15:23:19 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:19.610910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.619461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:19.620495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:19.628310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.629249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.629923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.630924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.631641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.632319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.770147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:19.858543 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fef5dd3d-b336-4563-b06d-d59451dbc5f1 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1008 microversion: 2.1 time: 0.252676 Oct 31 15:23:19.859731 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1139/2211] 10.222.0.48 () {58 vars in 1196 bytes} [Mon Oct 31 15:23:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1008 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:19.867048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-116f772a-f6c1-41a2-9411-eb9c0574604c req-aa80b52c-ee01-4cb1-877a-ad99eaec0fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97916142-5b3c-4189-ac6b-b2069733c992", "tag": "bdffb692-13b3-4ce4-a60c-d975e657c5e3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:19.881237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-116f772a-f6c1-41a2-9411-eb9c0574604c req-aa80b52c-ee01-4cb1-877a-ad99eaec0fd5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.881836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-116f772a-f6c1-41a2-9411-eb9c0574604c req-aa80b52c-ee01-4cb1-877a-ad99eaec0fd5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.882346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-116f772a-f6c1-41a2-9411-eb9c0574604c req-aa80b52c-ee01-4cb1-877a-ad99eaec0fd5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.897641 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-116f772a-f6c1-41a2-9411-eb9c0574604c req-aa80b52c-ee01-4cb1-877a-ad99eaec0fd5 service nova] Creating event network-changed:bdffb692-13b3-4ce4-a60c-d975e657c5e3 for instance 97916142-5b3c-4189-ac6b-b2069733c992 on n-h2-858383-17 Oct 31 15:23:19.904168 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-116f772a-f6c1-41a2-9411-eb9c0574604c req-aa80b52c-ee01-4cb1-877a-ad99eaec0fd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042933 Oct 31 15:23:19.904902 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1140/2212] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:19.906522 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e934a569-1c3b-42ed-a90d-c7f616b76a12 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.485149 Oct 31 15:23:19.907971 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1073/2213] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:23:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:19.913292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.913914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:19.929338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.929851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.930289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.931142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b7a26566-01ec-4cc5-b440-95ef97ec1a9a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca235c8b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.934549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.937190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.957393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.313925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.324769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c31a672b-b02a-4e42-92f6-c3e2abc789a2 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.416094 Oct 31 15:23:20.336963 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1074/2214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:19 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:20.354499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b7850ec-bca6-468e-b683-7acb37a9e6d5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:20.355241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b7850ec-bca6-468e-b683-7acb37a9e6d5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:20.493539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0b7850ec-bca6-468e-b683-7acb37a9e6d5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.502622 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b7850ec-bca6-468e-b683-7acb37a9e6d5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1236 microversion: 2.1 time: 0.164082 Oct 31 15:23:20.540883 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1075/2215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:20 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1236 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:20.546915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4493b86d-4690-415c-b5ed-91a607f74edc tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:20.558922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4493b86d-4690-415c-b5ed-91a607f74edc tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028429 Oct 31 15:23:20.566780 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1076/2216] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:20.587667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:20.604454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.606053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': 'e-56048039', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:20.615836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:20.617450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:20.618222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.619126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:20.619637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:20.620110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.834432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:21.065020 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc58be59-d313-4392-8037-f5361fe6330f tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?name=e-56048039" status: 200 len: 344 microversion: 2.1 time: 0.490200 Oct 31 15:23:21.074040 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1077/2217] 10.222.0.48 () {58 vars in 1156 bytes} [Mon Oct 31 15:23:20 2022] GET /compute/v2.1/servers?name=e-56048039 => generated 344 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:21.079630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ae38ea6-5290-4e97-afa2-d403464e7a08 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca2acc310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-224314627", "description": "tempest-description-593176921"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:21.162126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b7a26566-01ec-4cc5-b440-95ef97ec1a9a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 204 len: 0 microversion: 2.1 time: 1.255658 Oct 31 15:23:21.163076 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1141/2218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:19 2022] DELETE /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 0 bytes in 1257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:21.168187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:21.169284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:21.183140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.193511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.196288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.198312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.211526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.212007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.009153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:22.019127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4a334d5-a19f-4f2b-a636-e7de4574db9a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1315 microversion: 2.1 time: 0.854602 Oct 31 15:23:22.046287 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1142/2219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:21 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.053607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fda99ca9-07c4-4446-b2f2-283793328c3c tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.104112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fda99ca9-07c4-4446-b2f2-283793328c3c tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.055835 Oct 31 15:23:22.107485 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1143/2220] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.112961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e63c722e-7d2c-42d2-913d-3d37564e8a78 req-232a9086-5443-4673-a989-2d24c5bc8f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145a1314-095c-4f62-bb7b-e5572addc62a", "tag": "76cf7f9d-f5fd-4fea-bcd9-6886850a2289"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:22.124430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e63c722e-7d2c-42d2-913d-3d37564e8a78 req-232a9086-5443-4673-a989-2d24c5bc8f6c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.125950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e63c722e-7d2c-42d2-913d-3d37564e8a78 req-232a9086-5443-4673-a989-2d24c5bc8f6c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.126592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e63c722e-7d2c-42d2-913d-3d37564e8a78 req-232a9086-5443-4673-a989-2d24c5bc8f6c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.138841 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e63c722e-7d2c-42d2-913d-3d37564e8a78 req-232a9086-5443-4673-a989-2d24c5bc8f6c service nova] Creating event network-changed:76cf7f9d-f5fd-4fea-bcd9-6886850a2289 for instance 145a1314-095c-4f62-bb7b-e5572addc62a on n-h1-858383-17 Oct 31 15:23:22.145026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e63c722e-7d2c-42d2-913d-3d37564e8a78 req-232a9086-5443-4673-a989-2d24c5bc8f6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036066 Oct 31 15:23:22.146534 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1144/2221] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:22.152172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.177669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:22.179272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:22.185317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.186063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.186677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.187840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.189524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.190132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.291434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:22.315576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:22.382860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b327902-4828-4e7b-a286-b1e516cba021 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1008 microversion: 2.1 time: 0.234893 Oct 31 15:23:22.390966 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1145/2222] 10.222.0.48 () {58 vars in 1154 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/servers?name=-instance => generated 1008 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.390966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.390966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:22.398399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.399117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.399821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.400853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.401596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.402159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.433284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:22.617237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54960aa9-d224-41af-9060-af6c9ef9970e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 204 len: 0 microversion: 2.1 time: 0.230233 Oct 31 15:23:22.619746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1146/2223] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:22 2022] DELETE /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:22.640564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.641898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:22.670311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.680157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.684002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.685861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.687129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.688847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.814081 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ae38ea6-5290-4e97-afa2-d403464e7a08 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.738502 Oct 31 15:23:22.815124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1078/2224] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:23:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:22.821141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.822132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:22.834977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.835468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.835904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.836621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.843247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:22.844482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.952507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:22.961717 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0486024-c387-4fd7-8c3e-6ba0bdd54677 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1294 microversion: 2.1 time: 0.144457 Oct 31 15:23:22.962301 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1079/2225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1294 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.973141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5532ad6-96c7-410c-9559-808d578ca84a tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:22.993235 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5532ad6-96c7-410c-9559-808d578ca84a tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024447 Oct 31 15:23:22.996937 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1080/2226] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:23.005451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.013887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.021454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-5604803', 'deleted': False, 'project_id': '1bfb44c13df741fca0c785b2b29ad321'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:23:23.036472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.038790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.039346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.040121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.040588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.045411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.108100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.115936 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6af475b6-03ed-4010-9591-2b622341be5b tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.491806 Oct 31 15:23:23.116530 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1147/2227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:23.124740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6bf9f9a2-f86f-4b2d-accf-eef9bd37cc70 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca2435dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1818546128", "description": "tempest-description-34189875"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:23.225083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:23:23.327051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5d14512-dd93-42dd-a08d-5b55646686be tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-5604803" status: 200 len: 344 microversion: 2.1 time: 0.328012 Oct 31 15:23:23.336960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1081/2228] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Oct 31 15:23:22 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-5604803 => generated 344 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:23.347895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1613172328", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bc2357ef-c687-4bf5-80c5-a090c70bef3f"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:23.410381 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6bf9f9a2-f86f-4b2d-accf-eef9bd37cc70 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.292643 Oct 31 15:23:23.420773 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1148/2229] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:23:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:23.429492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54e8045a-b1bb-45b0-a455-e5b1cb2248cc tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.448020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] validate_networks() for [('bc2357ef-c687-4bf5-80c5-a090c70bef3f', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:23.477224 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54e8045a-b1bb-45b0-a455-e5b1cb2248cc tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.055167 Oct 31 15:23:23.479164 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1149/2230] 10.222.0.48 () {58 vars in 1144 bytes} [Mon Oct 31 15:23:23 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:23.492051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.493153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:23.499539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.500869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.501059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.501791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.502582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.502844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.829315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.840257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7be79de2-4ae4-44d9-b30b-b54a25dc7387 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1315 microversion: 2.1 time: 0.359231 Oct 31 15:23:23.841351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1150/2231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:23 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:23.866732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.867580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:23.877089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.878477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.879389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.885974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.887120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.887810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.008576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:24.162331 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a34d3e82-e9cf-4b2d-831d-ae1995cfceba tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 204 len: 0 microversion: 2.1 time: 0.318142 Oct 31 15:23:24.163750 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1151/2232] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:23 2022] DELETE /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:24.178114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-607e7a3f-7857-4200-889c-6f5e14a72cef tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca22f5820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:24.606525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:24.607100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:24.611685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:24.612356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:24.612828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:24.691546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.691546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.691546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.691546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.691546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.691546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.729068 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-607e7a3f-7857-4200-889c-6f5e14a72cef tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.562359 Oct 31 15:23:24.736731 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1152/2233] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:23:24 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:24.738481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80293570-98b3-483a-b588-8c7603e7fed7 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:24.751974 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80293570-98b3-483a-b588-8c7603e7fed7 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015980 Oct 31 15:23:24.754204 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1153/2234] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:24.760384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:24.764861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:24.767076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:24.767198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Getting quotas for user 857b0f5f4fdc4b1faeae0e0770d65125 and project 48f50f35cbe74ea4b2ac1a7795c00dcd. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:24.774476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.774974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.775419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.776148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.776611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.777092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:24.787897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:24.790258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:24.930870 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dff54188-e073-4a15-aac4-5d577d620ec6 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594910 Oct 31 15:23:24.933274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1082/2235] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:24.941518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d090a566-b9fe-4388-af1b-b5991edbfa1d req-e44ea12e-0ee4-4078-932e-1e083c5ac18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97916142-5b3c-4189-ac6b-b2069733c992", "name": "network-vif-plugged", "status": "completed", "tag": "bdffb692-13b3-4ce4-a60c-d975e657c5e3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:24.955905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d090a566-b9fe-4388-af1b-b5991edbfa1d req-e44ea12e-0ee4-4078-932e-1e083c5ac18d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:24.957628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d090a566-b9fe-4388-af1b-b5991edbfa1d req-e44ea12e-0ee4-4078-932e-1e083c5ac18d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:24.982078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d090a566-b9fe-4388-af1b-b5991edbfa1d req-e44ea12e-0ee4-4078-932e-1e083c5ac18d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.018801 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d090a566-b9fe-4388-af1b-b5991edbfa1d req-e44ea12e-0ee4-4078-932e-1e083c5ac18d service nova] Creating event network-vif-plugged:bdffb692-13b3-4ce4-a60c-d975e657c5e3 for instance 97916142-5b3c-4189-ac6b-b2069733c992 on n-h2-858383-17 Oct 31 15:23:25.034308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:25.046298 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-96c8d73a-3659-48be-bbe6-76d4e050e23d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1361 microversion: 2.1 time: 0.290809 Oct 31 15:23:25.047175 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d090a566-b9fe-4388-af1b-b5991edbfa1d req-e44ea12e-0ee4-4078-932e-1e083c5ac18d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099424 Oct 31 15:23:25.050448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1154/2236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:24 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:25.060135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.061401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:25.068447 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1083/2237] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:25.069937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.070985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.072039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.073124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.073880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.074517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.095196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.096888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:25.120264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.124312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.125822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.127231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.128027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.133130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.416714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:25.431712 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ccdda2a-d392-4e51-a192-b3d1830d9e33 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1516 microversion: 2.1 time: 0.356573 Oct 31 15:23:25.432569 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1084/2238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:25 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:25.446040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-169408a2-5811-419d-bdfe-d6be9e1258e5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca2705820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.763746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:25.774739 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13d01de1-49e6-41b5-b6c4-f242f29ca926 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.720734 Oct 31 15:23:25.778317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1155/2239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:25 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:25.790228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0fc91655-4042-46bf-8fe7-591c7ea29502 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.829938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0fc91655-4042-46bf-8fe7-591c7ea29502 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.049168 Oct 31 15:23:25.830536 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1156/2240] 10.222.0.48 () {58 vars in 1148 bytes} [Mon Oct 31 15:23:25 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:25.838420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.839237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:25.846732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.847446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.848019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.848896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.849492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.850055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.960833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-169408a2-5811-419d-bdfe-d6be9e1258e5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28" status: 202 len: 0 microversion: 2.1 time: 0.526946 Oct 31 15:23:25.962053 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1085/2241] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:25 2022] DELETE /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:25.968444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.969778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:25.981857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.982861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.985784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.988295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.989552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.994659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.087872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:26.104380 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-77c2071d-f0e0-476c-b099-0ab550b56541 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1212 microversion: 2.1 time: 0.141109 Oct 31 15:23:26.113030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1086/2242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:25 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1212 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.117596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:26.119887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2776053f-cd70-431a-8ae2-0288a6b70fca tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.125457 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7c91cff-7a63-46cc-99fe-3dee99c36956 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1315 microversion: 2.1 time: 0.293608 Oct 31 15:23:26.127285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1157/2243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:25 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.132089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca23e6700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.151360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2776053f-cd70-431a-8ae2-0288a6b70fca tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.032107 Oct 31 15:23:26.160856 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1087/2244] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:26.165445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:26.165607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5a63f3ff-8e23-4e76-ac80-4c0fde2e4d94 req-533efe0c-019d-4c4d-821e-698d0a43b50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc1afd0-e44e-407e-9003-2b4505e1eaf6", "name": "network-vif-deleted", "tag": "5915d395-173d-4415-8a4d-063d2a4b965d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:26.166427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:23:26.167113 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.167113 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28 HTTP/1.1 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '6e41961f-8d5f-4590-bca0-7ac3d660dd28'} Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:26.170136 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:23:26.174361 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-b8d89243-dd05-453f-9655-9f6fec5ff1c5'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:26.178008 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f28b9197-6e14-4a30-9f7e-ce6c77836337 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28" status: 404 len: 194 microversion: 2.1 time: 0.048293 Oct 31 15:23:26.181364 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1158/2245] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:26.183313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.184368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:26.193838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5a63f3ff-8e23-4e76-ac80-4c0fde2e4d94 req-533efe0c-019d-4c4d-821e-698d0a43b50b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.194681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5a63f3ff-8e23-4e76-ac80-4c0fde2e4d94 req-533efe0c-019d-4c4d-821e-698d0a43b50b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.195105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.195613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.195715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5a63f3ff-8e23-4e76-ac80-4c0fde2e4d94 req-533efe0c-019d-4c4d-821e-698d0a43b50b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.196051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.196850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.197259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.197702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.209427 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5a63f3ff-8e23-4e76-ac80-4c0fde2e4d94 req-533efe0c-019d-4c4d-821e-698d0a43b50b service nova] Creating event network-vif-deleted:5915d395-173d-4415-8a4d-063d2a4b965d for instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 on n-h2-858383-17 Oct 31 15:23:26.220770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5a63f3ff-8e23-4e76-ac80-4c0fde2e4d94 req-533efe0c-019d-4c4d-821e-698d0a43b50b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066748 Oct 31 15:23:26.222175 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1088/2246] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:26.228991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f08ab570-e3ca-4cb7-a7af-6c42a8b53401 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.239955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f08ab570-e3ca-4cb7-a7af-6c42a8b53401 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016122 Oct 31 15:23:26.241046 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1089/2247] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:26.247094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c757eb95-0209-48f2-92f6-6a649c50d974 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca26f8700>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.453747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:26.465640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2847c49-b6e1-4934-bc60-85c0e0928c3a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1361 microversion: 2.1 time: 0.286028 Oct 31 15:23:26.480720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1159/2248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.480720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9cd2bd6e-6e71-4b29-a597-bee0dc2feff2 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.528393 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9cd2bd6e-6e71-4b29-a597-bee0dc2feff2 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.054854 Oct 31 15:23:26.529358 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1160/2249] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.545769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.548069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:26.558399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.559425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.561400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.564675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.575832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.576797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.867639 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c757eb95-0209-48f2-92f6-6a649c50d974 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662" status: 202 len: 0 microversion: 2.1 time: 0.624996 Oct 31 15:23:26.868430 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1090/2250] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:26 2022] DELETE /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662 => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:26.878800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf4016f8-fb12-480b-8b5d-7b76fd81cbcd tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.925736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf4016f8-fb12-480b-8b5d-7b76fd81cbcd tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052280 Oct 31 15:23:26.936739 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1091/2251] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.942697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.943580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:26.953892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.954477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:26.955626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.956179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.958248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.958729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.960168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.967272 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac44dce8-0ed3-43ec-a97d-51d7d2104301 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1516 microversion: 2.1 time: 0.436248 Oct 31 15:23:26.968000 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1161/2252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1516 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.979083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca239d040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.117790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:27.118869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 79b7b1f6-17d9-4670-a619-ef8220095662 not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:23:27.119682 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.119682 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662 HTTP/1.1 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '79b7b1f6-17d9-4670-a619-ef8220095662'} Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:27.122015 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] Oct 31 15:23:27.124912 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:27.129898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:23:27.129898 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-52fd4e41-77c1-4a6e-ab39-19e7737a6971'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:27.131256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b365b9c-dc41-4047-a123-ce37052eb7cc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662" status: 404 len: 194 microversion: 2.1 time: 0.158645 Oct 31 15:23:27.133004 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1162/2253] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:27.145827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0790fb56-4fea-448d-8a97-641ce5c97963 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.178943 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0790fb56-4fea-448d-8a97-641ce5c97963 tempest-FlavorsV2TestJSON-1600904487 tempest-FlavorsV2TestJSON-1600904487-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044388 Oct 31 15:23:27.186011 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1163/2254] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:27.192074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53dcb85e-2970-4b77-b442-8624d0961e0e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca1b5e550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.430575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:27.445862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0fe16dcd-98c6-40f2-b439-7f2f2dcccc12 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.506802 Oct 31 15:23:27.448943 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1092/2255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:27.463192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.464786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:27.484077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.486930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.489069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.490742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.495241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.497823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.657838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:27.670587 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2eb66a18-f569-4eb0-ad17-851f154f791a tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1260 microversion: 2.1 time: 0.220308 Oct 31 15:23:27.671989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1093/2256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:27 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:27.685257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.686189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:27.694284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.695459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.696653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.697907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.698941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.699571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.318077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:28.338572 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ff167b9-4341-4bd1-b4db-be8221c20f91 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1501 microversion: 2.1 time: 0.664969 Oct 31 15:23:28.340589 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1094/2257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:27 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1501 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:28.352291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:28.353174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:28.366736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.367329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.367836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.368613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.369403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.369915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.766877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53dcb85e-2970-4b77-b442-8624d0961e0e tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a" status: 202 len: 0 microversion: 2.1 time: 1.578717 Oct 31 15:23:28.771441 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1164/2258] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:27 2022] DELETE /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a => generated 0 bytes in 1584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:28.777544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:28.778421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:28.786634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.787274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.787853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.788757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.789356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.789922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.089556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.100082 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ab4248b-3abe-49d5-83a9-39d859957864 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1361 microversion: 2.1 time: 0.757707 Oct 31 15:23:29.115996 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1095/2259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:28 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1361 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:29.124888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d07e6379-98ae-415b-8b7b-4501c16ce4b8 req-1d2f270d-c214-4f48-ac3a-2303e577ed89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36cbe18-c310-412f-b545-20d7a7ba77b4", "tag": "e2c86d50-98ee-4ccd-8632-f7be7a5b24dd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:29.143087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d07e6379-98ae-415b-8b7b-4501c16ce4b8 req-1d2f270d-c214-4f48-ac3a-2303e577ed89 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.143635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d07e6379-98ae-415b-8b7b-4501c16ce4b8 req-1d2f270d-c214-4f48-ac3a-2303e577ed89 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.144124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d07e6379-98ae-415b-8b7b-4501c16ce4b8 req-1d2f270d-c214-4f48-ac3a-2303e577ed89 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.178444 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d07e6379-98ae-415b-8b7b-4501c16ce4b8 req-1d2f270d-c214-4f48-ac3a-2303e577ed89 service nova] Creating event network-changed:e2c86d50-98ee-4ccd-8632-f7be7a5b24dd for instance b36cbe18-c310-412f-b545-20d7a7ba77b4 on n-h2-858383-17 Oct 31 15:23:29.192138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d07e6379-98ae-415b-8b7b-4501c16ce4b8 req-1d2f270d-c214-4f48-ac3a-2303e577ed89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073448 Oct 31 15:23:29.195265 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1096/2260] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:29.209454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:29.211692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:29.231989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.232738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.233877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.236667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.237358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.239167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.398107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.414759 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa82efde-a78b-45a8-8163-d93f9ea931e5 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 200 len: 1516 microversion: 2.1 time: 0.641902 Oct 31 15:23:29.424859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1165/2261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:28 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 1516 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:29.443388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.446705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-933d65bb-c6f1-4dc0-bd03-b5621ec0af5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992/action" status: 202 len: 0 microversion: 2.1 time: 0.248026 Oct 31 15:23:29.449210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:29.453504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1097/2262] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:29 2022] POST /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:29.477924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:29.479856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.485798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:29.486827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.489967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.491290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.495105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.498493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.499206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.506997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.511128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.513181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.514212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.516495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.519421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.801146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.832008 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7533299-784e-4aff-aed3-1f76a5580cc8 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1266 microversion: 2.1 time: 0.374117 Oct 31 15:23:29.837672 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1098/2263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:29 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:29.858733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca24f4940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.944538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:29.945328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 7f4f3266-0a95-46cc-b19c-8df1702da59a not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:23:29.946132 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.946132 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a HTTP/1.1 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '7f4f3266-0a95-46cc-b19c-8df1702da59a'} Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:29.949412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] Oct 31 15:23:29.953001 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.957067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:23:29.957067 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-4c7dae7f-8c07-4616-b3ed-94426a43565e'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:29.958859 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-750f954a-042d-4d2f-b772-d9537c76927b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a" status: 404 len: 194 microversion: 2.1 time: 0.119789 Oct 31 15:23:29.964952 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1099/2264] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:23:29 2022] GET /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:29.982732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.983678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:30.002877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:30.007232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:30.007994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:30.008924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:30.009696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:30.014212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:30.034474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:30.394437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:30.412504 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52d1421d-66db-4d9e-b894-b33cf7fc59ee tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.983757 Oct 31 15:23:30.416850 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1166/2265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:29 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:30.430256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d2845508-2bce-4419-be48-640d05478280 req-9eb42aa5-1884-4ed6-a606-4627ca4c8b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed", "name": "network-vif-deleted", "tag": "56ee8927-e23b-4403-b7f4-d4386c51dc07"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:30.451037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:30.458604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d2845508-2bce-4419-be48-640d05478280 req-9eb42aa5-1884-4ed6-a606-4627ca4c8b55 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:30.459402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d2845508-2bce-4419-be48-640d05478280 req-9eb42aa5-1884-4ed6-a606-4627ca4c8b55 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:30.460020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d2845508-2bce-4419-be48-640d05478280 req-9eb42aa5-1884-4ed6-a606-4627ca4c8b55 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:30.512029 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d2845508-2bce-4419-be48-640d05478280 req-9eb42aa5-1884-4ed6-a606-4627ca4c8b55 service nova] Creating event network-vif-deleted:56ee8927-e23b-4403-b7f4-d4386c51dc07 for instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed on n-h1-858383-17 Oct 31 15:23:30.525837 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d2845508-2bce-4419-be48-640d05478280 req-9eb42aa5-1884-4ed6-a606-4627ca4c8b55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104156 Oct 31 15:23:30.528826 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1167/2266] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:30.539818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d8baf8a-0676-428d-9a26-95b1f64f34b1 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca239d940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.033342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:31.041852 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d121b3cb-0197-4e3d-aee4-debcf2f26d68 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1486 microversion: 2.1 time: 1.072863 Oct 31 15:23:31.049471 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1100/2267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:29 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1486 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:31.054698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.062702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.071136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.072456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.077461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.078455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.079107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.079677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.363267 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d8baf8a-0676-428d-9a26-95b1f64f34b1 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.826095 Oct 31 15:23:31.375219 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1168/2268] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:23:30 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:31.375219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.375219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.386697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:31.390389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.392862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.393547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.394498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.395787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.396461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.398326 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9dbf8c32-00f9-4297-b41d-b416b4f2d5ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1361 microversion: 2.1 time: 0.347450 Oct 31 15:23:31.412742 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1101/2269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:31.412742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-84d60bdc-ecfb-4ca7-884e-90171a12f2a3 req-97e3a75b-7cce-4704-a475-d4161c7d6167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145a1314-095c-4f62-bb7b-e5572addc62a", "name": "network-vif-plugged", "status": "completed", "tag": "76cf7f9d-f5fd-4fea-bcd9-6886850a2289"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:31.412742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:31.422762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-84d60bdc-ecfb-4ca7-884e-90171a12f2a3 req-97e3a75b-7cce-4704-a475-d4161c7d6167 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.423533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-84d60bdc-ecfb-4ca7-884e-90171a12f2a3 req-97e3a75b-7cce-4704-a475-d4161c7d6167 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.424017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-84d60bdc-ecfb-4ca7-884e-90171a12f2a3 req-97e3a75b-7cce-4704-a475-d4161c7d6167 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.439032 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-84d60bdc-ecfb-4ca7-884e-90171a12f2a3 req-97e3a75b-7cce-4704-a475-d4161c7d6167 service nova] Creating event network-vif-plugged:76cf7f9d-f5fd-4fea-bcd9-6886850a2289 for instance 145a1314-095c-4f62-bb7b-e5572addc62a on n-h1-858383-17 Oct 31 15:23:31.445646 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-84d60bdc-ecfb-4ca7-884e-90171a12f2a3 req-97e3a75b-7cce-4704-a475-d4161c7d6167 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041399 Oct 31 15:23:31.446640 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1102/2270] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:31.449755 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] HTTP exception thrown: Instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed could not be found. Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Request method failure captured: Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed HTTP/1.1 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-gGFiwwOnGG5-GtcKRhJCRt4dmTDr8v6Sd0tzNIa04zYlbMbPWM8es_Woe06xG0FWO9Bf-627Yhc5PVLkSsc3J9JbMXUj5FlZKOlGq6LMzjo6GMRVp0TLrb5Vrznrea0EmlERKXt2vmBfg0-9W7tqw1mgUYpfGL4UT1H76TfOY3hDo Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 1bfb44c13df741fca0c785b2b29ad321 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 1bfb44c13df741fca0c785b2b29ad321 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListServerFiltersTestJSON-207311673-project Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: f2076e8958724ce09f1ad0e4ff647fc1 Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListServerFiltersTestJSON-207311673-project Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed could not be found. Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed'} Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed could not be found. Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed could not be found. Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:31.453249 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed could not be found. Oct 31 15:23:31.458210 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.458545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.458963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.459512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Returning 404 to user: Instance 5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:31.460424 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71e6b6c2-c2b0-4c82-9ec1-eebdb199cdbc tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed" status: 404 len: 111 microversion: 2.1 time: 0.093862 Oct 31 15:23:31.469591 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1169/2271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/5c98aca9-f1d3-4c0b-9420-3fbe3c0a19ed => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:31.470333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.470908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.471406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.472337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.472970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.473620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.476073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.476761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.484629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.485467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.485868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.486572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.487221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.494401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.541802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:31.568570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:31.638739 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2abcf98d-429a-4b46-8314-087dcdf149fb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 204 len: 0 microversion: 2.1 time: 0.167362 Oct 31 15:23:31.639612 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1170/2272] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:31 2022] DELETE /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:31.647000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-88c0480e-142d-45a3-ae50-eb4e656119e0 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca6726040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-542799413", "description": "tempest-description-1752700975"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:32.034536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.042482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0f225b7-84d7-434a-9800-3f93127f4dee tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 0.594043 Oct 31 15:23:32.055768 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1103/2273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:32.062630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.063322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.070635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.071150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.071674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.072463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.073237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.073749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.235249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:32.696659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-88c0480e-142d-45a3-ae50-eb4e656119e0 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.053976 Oct 31 15:23:32.698332 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1171/2274] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:23:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:32.703584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.703926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.712492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.713031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.713471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.714185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.714644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.715071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.741414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.746733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:32.763478 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2002d10-b044-4812-b6de-7beb6b57632a tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1314 microversion: 2.1 time: 0.705677 Oct 31 15:23:32.769779 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1104/2275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:32.784851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.785778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.793215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.793760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.794437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.795608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.796204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.796816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.848089 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bdfabd8-c1fc-400c-9483-9ca6263479aa tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "DELETE /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 204 len: 0 microversion: 2.1 time: 0.148134 Oct 31 15:23:32.851720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1172/2276] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:32 2022] DELETE /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:32.858700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.860190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.866515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.867171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.867742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.868598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.869376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.869817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.253648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:33.264497 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67575e5d-38ac-4a4b-9638-637460e83cb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1492 microversion: 2.1 time: 0.493086 Oct 31 15:23:33.283316 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1105/2277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1492 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:33.285329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:33.293232 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4aae0061-d9a8-45d6-8b50-76c58e75249a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1361 microversion: 2.1 time: 0.439593 Oct 31 15:23:33.293814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1173/2278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:33.295715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ddfff5b-8f1e-460b-8752-de393fefc26a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca26f8790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-796560733", "description": "tempest-description-871812406"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:33.317831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.325321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:33.333815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.334325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.334747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.339283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.349595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.350020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.648987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:33.665973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d5485bb-05c6-4afe-b32b-1d034d2f4b89 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 200 len: 1517 microversion: 2.1 time: 0.351815 Oct 31 15:23:33.666801 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1174/2279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:33 2022] GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:33.686940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.688145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:33.701140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.706475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.706987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.708011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.708460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.708922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.044269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.057102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5dce8f3-c03c-405d-a961-57824f2d68ba tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 0.374926 Oct 31 15:23:34.057720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1175/2280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:33 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:34.072066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.072674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.088052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.089071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.089792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.090654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.092099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.098236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.185123 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2ddfff5b-8f1e-460b-8752-de393fefc26a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.898857 Oct 31 15:23:34.204397 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1106/2281] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:23:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:34.322234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.324009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.367158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.370517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.371476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.377232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.379932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.381376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.704814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.720499 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bce72e8c-5498-4650-a1ca-a0fed661e754 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1464 microversion: 2.1 time: 0.659310 Oct 31 15:23:34.721377 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1176/2282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1464 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:34.734920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-dea2850a-463c-4c7a-b6b6-86fcfa31f07e req-33ce5036-906f-489c-9846-629b0d35b030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36cbe18-c310-412f-b545-20d7a7ba77b4", "name": "network-vif-plugged", "status": "completed", "tag": "e2c86d50-98ee-4ccd-8632-f7be7a5b24dd"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:34.745851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=14 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:34.755009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dea2850a-463c-4c7a-b6b6-86fcfa31f07e req-33ce5036-906f-489c-9846-629b0d35b030 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.755495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dea2850a-463c-4c7a-b6b6-86fcfa31f07e req-33ce5036-906f-489c-9846-629b0d35b030 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.755925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dea2850a-463c-4c7a-b6b6-86fcfa31f07e req-33ce5036-906f-489c-9846-629b0d35b030 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.771468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-dea2850a-463c-4c7a-b6b6-86fcfa31f07e req-33ce5036-906f-489c-9846-629b0d35b030 service nova] Creating event network-vif-plugged:e2c86d50-98ee-4ccd-8632-f7be7a5b24dd for instance b36cbe18-c310-412f-b545-20d7a7ba77b4 on n-h2-858383-17 Oct 31 15:23:34.776337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=28 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:34.777308 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-dea2850a-463c-4c7a-b6b6-86fcfa31f07e req-33ce5036-906f-489c-9846-629b0d35b030 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046213 Oct 31 15:23:34.778661 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1177/2283] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:34.785412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.786281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.794061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.794799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.795569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.796420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.797046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.797756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.822437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.835716 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d63d5f93-6930-4335-ba2d-814139c32e3d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1492 microversion: 2.1 time: 0.544255 Oct 31 15:23:34.847865 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1107/2284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1492 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:34.853147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-653396449", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "ae90fd65-8f4e-42f6-8d12-c3cb5ff42387"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:34.967937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] validate_networks() for [('ae90fd65-8f4e-42f6-8d12-c3cb5ff42387', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:35.496314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:35.506983 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-943c3ea1-5b60-46b6-bd55-e4dedf61c260 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1361 microversion: 2.1 time: 0.725074 Oct 31 15:23:35.509825 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1178/2285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1361 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:35.525178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.525801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.539908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.540420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.540881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.541594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.542047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.542470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.408168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:36.438303 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b07c780-954f-4519-bb29-f390620c1686 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 200 len: 1517 microversion: 2.1 time: 0.925674 Oct 31 15:23:36.441004 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1179/2286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:35 2022] GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 1517 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:36.769635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:36.770119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:36.771220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:36.771652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:36.772227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:36.794749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Calling method '.version_select at 0x7f5ca6726f70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.799383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.800555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.801169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.802058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.802700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.803341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.811149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.811636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.812078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.861184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.862928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.863554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.884939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Getting quotas for project c1b9c3a3de944b7b9514568f43b3ae3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:36.906018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Getting quotas for user 0d2d88b532854b4ebd5a1e8e49cbf888 and project c1b9c3a3de944b7b9514568f43b3ae3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:36.907989 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-019da7d2-b29a-4fe7-833d-c3d81a61a9f9 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/28a4f5e804b54e08ba48264b3d7b6994?start=2022-10-30T15%3A23%3A34.737034&end=2022-11-01T15%3A23%3A34.737034" status: 200 len: 695 microversion: 2.1 time: 0.462875 Oct 31 15:23:36.923446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1180/2287] 10.222.0.48 () {58 vars in 1412 bytes} [Mon Oct 31 15:23:36 2022] GET /compute/v2.1/os-simple-tenant-usage/28a4f5e804b54e08ba48264b3d7b6994?start=2022-10-30T15%3A23%3A34.737034&end=2022-11-01T15%3A23%3A34.737034 => generated 695 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:36.933244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:36.937410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.938583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:36.938948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:36.952787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.953290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.953960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.960709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.961386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.964345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.097589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b840761-57c2-4808-af11-db259e589183 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245002 Oct 31 15:23:37.108853 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1108/2288] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:37.128847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.129483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:37.139580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.140326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.141369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.142191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.142816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.143831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.234682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.235461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.235956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.236431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lazy-loading 'fault' on Instance uuid 97916142-5b3c-4189-ac6b-b2069733c992 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:37.368854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:37.383213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-05cae55d-0c83-4c5c-8e00-c3cf46103e74 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 200 len: 1305 microversion: 2.1 time: 0.271122 Oct 31 15:23:37.384861 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1109/2289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 1305 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:37.411079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-50949902-7e8b-40d5-b500-96b3a5dba95d req-f05faf5c-dbf5-4719-82b1-c91e0bbf8387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97916142-5b3c-4189-ac6b-b2069733c992", "name": "network-vif-deleted", "tag": "bdffb692-13b3-4ce4-a60c-d975e657c5e3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:37.437272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-50949902-7e8b-40d5-b500-96b3a5dba95d req-f05faf5c-dbf5-4719-82b1-c91e0bbf8387 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.438437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-50949902-7e8b-40d5-b500-96b3a5dba95d req-f05faf5c-dbf5-4719-82b1-c91e0bbf8387 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.439416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-50949902-7e8b-40d5-b500-96b3a5dba95d req-f05faf5c-dbf5-4719-82b1-c91e0bbf8387 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.482716 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-50949902-7e8b-40d5-b500-96b3a5dba95d req-f05faf5c-dbf5-4719-82b1-c91e0bbf8387 service nova] Creating event network-vif-deleted:bdffb692-13b3-4ce4-a60c-d975e657c5e3 for instance 97916142-5b3c-4189-ac6b-b2069733c992 on n-h2-858383-17 Oct 31 15:23:37.490637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-50949902-7e8b-40d5-b500-96b3a5dba95d req-f05faf5c-dbf5-4719-82b1-c91e0bbf8387 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103093 Oct 31 15:23:37.492744 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1110/2290] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:37.521718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.525033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:37.554152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.556177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.558057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.561189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.561826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.565091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.639061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:37.655491 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8c4c3a6-dfb3-492a-946e-c3f4842b015c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 0.728248 Oct 31 15:23:37.657275 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1181/2291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:36 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:37.668173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0f4733ea-9195-400f-abc1-b7ccab7ba84c req-1aadccf7-49f8-445a-8798-648a322100a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1268bcd-736f-4f48-9a6e-469aa8894cb5", "tag": "24940940-4d10-447a-8bdb-19b9ca378d31"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:37.697316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f4733ea-9195-400f-abc1-b7ccab7ba84c req-1aadccf7-49f8-445a-8798-648a322100a5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.699222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f4733ea-9195-400f-abc1-b7ccab7ba84c req-1aadccf7-49f8-445a-8798-648a322100a5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.700559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f4733ea-9195-400f-abc1-b7ccab7ba84c req-1aadccf7-49f8-445a-8798-648a322100a5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.739979 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0f4733ea-9195-400f-abc1-b7ccab7ba84c req-1aadccf7-49f8-445a-8798-648a322100a5 service nova] Creating event network-changed:24940940-4d10-447a-8bdb-19b9ca378d31 for instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 on n-h1-858383-17 Oct 31 15:23:37.751271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0f4733ea-9195-400f-abc1-b7ccab7ba84c req-1aadccf7-49f8-445a-8798-648a322100a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088966 Oct 31 15:23:37.753600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1182/2292] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:37.765719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '.version_select at 0x7f5ca67ecaf0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.792477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.793168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.793632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.816219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.816735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.817183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.838000 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdb075d4-2652-4e77-b6d8-13a08c3cc1cd tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/28a4f5e804b54e08ba48264b3d7b6994?start=2022-10-30T15%3A23%3A34.737034&end=2022-11-01T15%3A23%3A34.737034" status: 200 len: 694 microversion: 2.1 time: 0.080650 Oct 31 15:23:37.838601 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1183/2293] 10.222.0.48 () {58 vars in 1412 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/os-simple-tenant-usage/28a4f5e804b54e08ba48264b3d7b6994?start=2022-10-30T15%3A23%3A34.737034&end=2022-11-01T15%3A23%3A34.737034 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:37.862756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38877344-d3a9-4cc0-8e2e-6c7f0293a909 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.863514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38877344-d3a9-4cc0-8e2e-6c7f0293a909 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.104671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38877344-d3a9-4cc0-8e2e-6c7f0293a909 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:38.113443 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38877344-d3a9-4cc0-8e2e-6c7f0293a909 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1215 microversion: 2.1 time: 0.273812 Oct 31 15:23:38.122928 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1184/2294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1215 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:38.153106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.154398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 111e882b-03b2-41b1-8b24-dc614d2d17a3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.178314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:38.188727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ca4e9f5-4c1f-477f-ac2c-704e8db8476e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1547 microversion: 2.1 time: 0.683835 Oct 31 15:23:38.191933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.192293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.204643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.204946 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1111/2295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1547 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:38.205642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.206138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.206581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.219876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Calling method '.version_select at 0x7f5ca2b3b160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.253761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.254480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.255034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.263689 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] HTTP exception thrown: Instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 could not be found. Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Request method failure captured: Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 HTTP/1.1 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-gGFiwwOnGG5-GtcKRhJCRt4dmTDr8v6Sd0tzNIa04zYlbMbPWM8es_Woe06xG0FWO9Bf-627Yhc5PVLkSsc3J9JbMXUj5FlZKOlGq6LMzjo6GMRVp0TLrb5Vrznrea0EmlERKXt2vmBfg0-9W7tqw1mgUYpfGL4UT1H76TfOY3hDo Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 1bfb44c13df741fca0c785b2b29ad321 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 1bfb44c13df741fca0c785b2b29ad321 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListServerFiltersTestJSON-207311673-project Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: f2076e8958724ce09f1ad0e4ff647fc1 Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListServerFiltersTestJSON-207311673-project Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 could not be found. Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '111e882b-03b2-41b1-8b24-dc614d2d17a3'} Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 could not be found. Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 could not be found. Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:38.265425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 could not be found. Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Returning 404 to user: Instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:38.270853 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9af66e95-78fc-4834-8846-47c466d6b713 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3" status: 404 len: 111 microversion: 2.1 time: 0.141010 Oct 31 15:23:38.282134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1185/2296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/111e882b-03b2-41b1-8b24-dc614d2d17a3 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:38.288335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.289789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.317852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.318372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.318819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.321251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.321822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.322262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.333786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.339676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.340244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.536759 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e8395e0-354f-48f0-9bed-e11db7424440 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253815 Oct 31 15:23:38.546134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1186/2297] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:38.553113 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32cf2aa5-55bd-44cf-92e4-d2287deeb198 tempest-TenantUsagesTestJSON-751586474 tempest-TenantUsagesTestJSON-751586474-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A23%3A34.737034&end=2022-11-01T15%3A23%3A34.737034&detailed=1" status: 200 len: 28618 microversion: 2.1 time: 0.346419 Oct 31 15:23:38.554477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1112/2298] 10.222.0.48 () {58 vars in 1335 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A23%3A34.737034&end=2022-11-01T15%3A23%3A34.737034&detailed=1 => generated 28618 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:23:38.560887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.561403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.576730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.577996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.582397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.583591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.584204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.585124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.585733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.586396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.597921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.598645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.599204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.600067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.600840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.601340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.631879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 HTTP/1.1 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '97916142-5b3c-4189-ac6b-b2069733c992'} Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:38.634670 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:23:38.638646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.643593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:38.644763 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4465afaa-28ed-48c5-93e5-c48cc8adbb85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 404 len: 111 microversion: 2.1 time: 0.088828 Oct 31 15:23:38.645749 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1113/2299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:38.646624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:38.654580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.655384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.688791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.695704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.697818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.698985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.701313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.704335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.792633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:38.865030 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6812d7fe-41f3-46f1-ac4a-69823d7ca9ae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 204 len: 0 microversion: 2.1 time: 0.317146 Oct 31 15:23:38.865632 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1187/2300] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:38 2022] DELETE /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:38.895464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.898174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.921629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.924498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.926050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.928575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.929360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.930890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.026264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9719f55-6053-46ed-95b5-1bf043484116 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "DELETE /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 204 len: 0 microversion: 2.1 time: 0.378993 Oct 31 15:23:39.027574 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1114/2301] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:38 2022] DELETE /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:39.036612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.038955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:39.052240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.063382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.064233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.065709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.066853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.067551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.528323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:39.530942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:39.539860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4627a97-9b27-4619-8fc2-c4ee9b5d7748 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 0.666773 Oct 31 15:23:39.548292 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1188/2302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:39.553848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1594035868", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:39.642547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:39.952181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:39.960995 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b954c6ae-c0cc-4460-9d16-45a199548823 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1515 microversion: 2.1 time: 0.932033 Oct 31 15:23:39.977190 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1115/2303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:39 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1515 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:39.983402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.984228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:39.991263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.992123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.992730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.993580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.994176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.994740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:40.977260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:40.986815 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94ce2fd3-67f5-43e1-ad8a-651195fc07f5 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1470 microversion: 2.1 time: 1.008138 Oct 31 15:23:40.987741 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1116/2304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:39 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1470 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:40.992487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:40.994672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:41.001553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:41.002371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:41.003148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:41.004108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:41.004768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:41.005421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:41.669492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:41.680135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-97cc9600-8946-4660-98f6-f3f369fb9490 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1315 microversion: 2.1 time: 0.691174 Oct 31 15:23:41.682208 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1117/2305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:40 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:41.689247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6c20ec14-797f-4724-a248-949141eafb9b req-3190a5d2-d14a-41c8-92ed-511f45add487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111e882b-03b2-41b1-8b24-dc614d2d17a3", "name": "network-vif-deleted", "tag": "e9680fc3-1bb8-486f-9398-0fbe7cd2c997"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:41.704993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c20ec14-797f-4724-a248-949141eafb9b req-3190a5d2-d14a-41c8-92ed-511f45add487 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:41.705977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c20ec14-797f-4724-a248-949141eafb9b req-3190a5d2-d14a-41c8-92ed-511f45add487 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:41.706620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c20ec14-797f-4724-a248-949141eafb9b req-3190a5d2-d14a-41c8-92ed-511f45add487 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:41.733648 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6c20ec14-797f-4724-a248-949141eafb9b req-3190a5d2-d14a-41c8-92ed-511f45add487 service nova] Creating event network-vif-deleted:e9680fc3-1bb8-486f-9398-0fbe7cd2c997 for instance 111e882b-03b2-41b1-8b24-dc614d2d17a3 on n-h2-858383-17 Oct 31 15:23:41.741838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6c20ec14-797f-4724-a248-949141eafb9b req-3190a5d2-d14a-41c8-92ed-511f45add487 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058094 Oct 31 15:23:41.744221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1118/2306] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:41.755327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:41.756494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:41.770760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:41.771666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:41.772309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:41.773396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:41.774061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:41.774764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.159596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:42.171439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:42.174220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:42.175080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:42.176219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:42.193308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.194299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.194922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.196479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.197476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.198253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.255048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:42.269548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:42.294858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:42.300490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:42.367864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:42.383157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:42.390420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34127a15-4e38-4013-9a21-ecbcd2249e11 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836093 Oct 31 15:23:42.391276 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1189/2307] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:42.392118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fdcd373b-305a-4c39-a901-7e1a6e56524e tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 0.643096 Oct 31 15:23:42.394596 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1119/2308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:41 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:42.405145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:42.414850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:42.416002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:42.426952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:42.429710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.430404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.430837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.431566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.432031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.432451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.450824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.451611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.452222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.453179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.456385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.459028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.994285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:43.002698 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab8dafbc-292d-4582-95a2-9aca689a2cb0 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1515 microversion: 2.1 time: 0.600521 Oct 31 15:23:43.003520 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1190/2309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:42 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1515 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:43.008361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:43.009216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.016152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.016901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.017484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.018186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.018786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.019430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.029179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:43.052117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2a946f3-6604-4891-9243-1b4cfdb62ed9 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1470 microversion: 2.1 time: 0.654468 Oct 31 15:23:43.053432 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1120/2310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:42 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1470 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:43.058462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:43.059580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.066833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.067476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.068018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.068852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.069950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.070631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.205583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:43.215088 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26d3b15e-ad56-4d0c-9ddf-6cc06bcb21db tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1219 microversion: 2.1 time: 0.210348 Oct 31 15:23:43.215972 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1191/2311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:43 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:43.421041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:43.421951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.430348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.431223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.431842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.432726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.434004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.434656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.114579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:44.128144 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42756a25-c179-4d29-9f1a-b3f49a70a965 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1315 microversion: 2.1 time: 1.073193 Oct 31 15:23:44.129523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1121/2312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:43 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:44.135899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a4782be9-32a6-42c4-a57f-3c91c23ecf35 req-56cf792b-4e5e-428e-b8e9-6168ab8ac5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36cbe18-c310-412f-b545-20d7a7ba77b4", "tag": "e2c86d50-98ee-4ccd-8632-f7be7a5b24dd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:44.150016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4782be9-32a6-42c4-a57f-3c91c23ecf35 req-56cf792b-4e5e-428e-b8e9-6168ab8ac5b2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.150756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4782be9-32a6-42c4-a57f-3c91c23ecf35 req-56cf792b-4e5e-428e-b8e9-6168ab8ac5b2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.151397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4782be9-32a6-42c4-a57f-3c91c23ecf35 req-56cf792b-4e5e-428e-b8e9-6168ab8ac5b2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.167087 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a4782be9-32a6-42c4-a57f-3c91c23ecf35 req-56cf792b-4e5e-428e-b8e9-6168ab8ac5b2 service nova] Creating event network-changed:e2c86d50-98ee-4ccd-8632-f7be7a5b24dd for instance b36cbe18-c310-412f-b545-20d7a7ba77b4 on n-h2-858383-17 Oct 31 15:23:44.173872 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a4782be9-32a6-42c4-a57f-3c91c23ecf35 req-56cf792b-4e5e-428e-b8e9-6168ab8ac5b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041972 Oct 31 15:23:44.175875 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1122/2313] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:44.194053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-76512c4a-fbc9-4d1f-812c-eecabf615003 req-28d1bf2e-b439-4cf9-b3e8-4c33f6e16901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3", "tag": "a9fd7a38-4c98-4700-a63f-efce7db0542e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:44.215265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-76512c4a-fbc9-4d1f-812c-eecabf615003 req-28d1bf2e-b439-4cf9-b3e8-4c33f6e16901 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.215745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-76512c4a-fbc9-4d1f-812c-eecabf615003 req-28d1bf2e-b439-4cf9-b3e8-4c33f6e16901 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.216168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-76512c4a-fbc9-4d1f-812c-eecabf615003 req-28d1bf2e-b439-4cf9-b3e8-4c33f6e16901 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.230085 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-76512c4a-fbc9-4d1f-812c-eecabf615003 req-28d1bf2e-b439-4cf9-b3e8-4c33f6e16901 service nova] Creating event network-changed:a9fd7a38-4c98-4700-a63f-efce7db0542e for instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 on n-h2-858383-17 Oct 31 15:23:44.236648 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-76512c4a-fbc9-4d1f-812c-eecabf615003 req-28d1bf2e-b439-4cf9-b3e8-4c33f6e16901 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059114 Oct 31 15:23:44.238319 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1123/2314] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:44.243719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:44.244611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:44.257047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.258185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.259194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.260104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.260733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.261171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.565890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:44.574761 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1d13edb-f093-4c24-a12e-1d9105c0bb54 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 1.159249 Oct 31 15:23:44.587917 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1192/2315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:43 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:44.599361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:44.599990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:44.606474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.606972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.607416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.608128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.608586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.610940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.189846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:45.199721 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a2f1e23-e7a1-4336-95a1-2914655da3a4 tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1515 microversion: 2.1 time: 0.960022 Oct 31 15:23:45.201921 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1124/2316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:44 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1515 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.209241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.210071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.217132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.217822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.218385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.220563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.222355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.223116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.542349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:45.551887 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5261d0ab-7e98-4e0f-9b61-e763805ca018 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1470 microversion: 2.1 time: 0.961619 Oct 31 15:23:45.565399 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1193/2317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:44 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1470 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.565399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-13c29a1f-4941-4286-b0d2-bbd514a4f803 req-9cf7e33c-5f9f-4aee-9be4-5eac3a5c0712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1268bcd-736f-4f48-9a6e-469aa8894cb5", "name": "network-vif-plugged", "status": "completed", "tag": "24940940-4d10-447a-8bdb-19b9ca378d31"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:45.572172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-13c29a1f-4941-4286-b0d2-bbd514a4f803 req-9cf7e33c-5f9f-4aee-9be4-5eac3a5c0712 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.572836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-13c29a1f-4941-4286-b0d2-bbd514a4f803 req-9cf7e33c-5f9f-4aee-9be4-5eac3a5c0712 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.573152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-13c29a1f-4941-4286-b0d2-bbd514a4f803 req-9cf7e33c-5f9f-4aee-9be4-5eac3a5c0712 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.586985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-13c29a1f-4941-4286-b0d2-bbd514a4f803 req-9cf7e33c-5f9f-4aee-9be4-5eac3a5c0712 service nova] Creating event network-vif-plugged:24940940-4d10-447a-8bdb-19b9ca378d31 for instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 on n-h1-858383-17 Oct 31 15:23:45.592781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-13c29a1f-4941-4286-b0d2-bbd514a4f803 req-9cf7e33c-5f9f-4aee-9be4-5eac3a5c0712 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038547 Oct 31 15:23:45.593877 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1194/2318] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:45.602199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.602983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.610132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.610720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.611226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.612056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.612584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.613105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.542298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:46.555121 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d73b00bf-eb0d-42db-bac9-21d3b4e01a28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1315 microversion: 2.1 time: 1.351966 Oct 31 15:23:46.557752 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1125/2319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:46.585485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.587606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:46.599414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.600336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.605369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.607869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.609542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.611077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.705383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:46.716926 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d451bf3-79da-459a-aa7f-ed5f89fc500a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1315 microversion: 2.1 time: 1.120880 Oct 31 15:23:46.718285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1195/2320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:46.726408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.727812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:46.737042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.737925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.738635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.740475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.741604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.747818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.925529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:46.976018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:46.986188 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-794d38d1-eaae-469a-8477-b6f3c748578e tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1473 microversion: 2.1 time: 0.265746 Oct 31 15:23:46.987471 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1196/2321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1473 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:46.992677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.993341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:47.010682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.011420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.012568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.013462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.014074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.014646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.207333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:47.216132 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e05379f-4330-4a0a-a871-e2d84821f2c0 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1428 microversion: 2.1 time: 0.227387 Oct 31 15:23:47.229375 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1197/2322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1428 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:47.237598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-868dbb99-1cd4-4bfe-b556-7051e38286f9 req-4ae085d1-480e-49a0-8be4-215e33f6acb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa22140e-0ab8-4cca-9dd5-469cbb78cd14", "tag": "eaf8c73a-01f1-435c-95df-a26934141340"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:47.255500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-868dbb99-1cd4-4bfe-b556-7051e38286f9 req-4ae085d1-480e-49a0-8be4-215e33f6acb1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.256200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-868dbb99-1cd4-4bfe-b556-7051e38286f9 req-4ae085d1-480e-49a0-8be4-215e33f6acb1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.256735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-868dbb99-1cd4-4bfe-b556-7051e38286f9 req-4ae085d1-480e-49a0-8be4-215e33f6acb1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.278492 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-868dbb99-1cd4-4bfe-b556-7051e38286f9 req-4ae085d1-480e-49a0-8be4-215e33f6acb1 service nova] Creating event network-changed:eaf8c73a-01f1-435c-95df-a26934141340 for instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 on n-h2-858383-17 Oct 31 15:23:47.285112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-868dbb99-1cd4-4bfe-b556-7051e38286f9 req-4ae085d1-480e-49a0-8be4-215e33f6acb1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054313 Oct 31 15:23:47.286363 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1198/2323] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:47.292533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f1165f03-f8c2-4c29-922b-1828c5a7450b req-90241065-90d0-4a0c-9c19-64e22259d4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3545bebb-a6c1-49e8-94d4-30a2def0af20", "name": "network-vif-deleted", "tag": "8f1bfc00-95df-49d2-8890-b3af4c81d704"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:47.303264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:47.303842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f1165f03-f8c2-4c29-922b-1828c5a7450b req-90241065-90d0-4a0c-9c19-64e22259d4a4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.304345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f1165f03-f8c2-4c29-922b-1828c5a7450b req-90241065-90d0-4a0c-9c19-64e22259d4a4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.304840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f1165f03-f8c2-4c29-922b-1828c5a7450b req-90241065-90d0-4a0c-9c19-64e22259d4a4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.324584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0caa0585-b62d-4522-87c7-98ecec887aad tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1308 microversion: 2.1 time: 0.758039 Oct 31 15:23:47.325877 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1126/2324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1308 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:47.331626 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f1165f03-f8c2-4c29-922b-1828c5a7450b req-90241065-90d0-4a0c-9c19-64e22259d4a4 service nova] Creating event network-vif-deleted:8f1bfc00-95df-49d2-8890-b3af4c81d704 for instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 on n-h1-858383-17 Oct 31 15:23:47.351547 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f1165f03-f8c2-4c29-922b-1828c5a7450b req-90241065-90d0-4a0c-9c19-64e22259d4a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063565 Oct 31 15:23:47.352479 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1199/2325] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:47.591474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:47.593174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:47.606751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.608371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.608990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.611628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.612379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.613111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.746152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:47.746856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:47.753964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.754552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.755048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.755841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.756361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.756975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.011825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.060312 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c410c35e-82f3-4c78-b06d-7cdbe91b0538 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1315 microversion: 2.1 time: 0.477907 Oct 31 15:23:48.063772 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1127/2326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:47 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:48.073504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.079873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:48.099167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.100149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.100849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.103705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.104472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.105123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.132564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.143288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3e7052a-22b2-4f38-98aa-c5d257127160 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1315 microversion: 2.1 time: 0.402319 Oct 31 15:23:48.147376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1200/2327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:47 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:48.155520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8fca1d83-a60b-448f-9bc5-928eaec5ebf4 req-ee96d6c0-6838-4833-bff2-6a193e8d7f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3", "name": "network-vif-plugged", "status": "completed", "tag": "a9fd7a38-4c98-4700-a63f-efce7db0542e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:48.182844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8fca1d83-a60b-448f-9bc5-928eaec5ebf4 req-ee96d6c0-6838-4833-bff2-6a193e8d7f98 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.183602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8fca1d83-a60b-448f-9bc5-928eaec5ebf4 req-ee96d6c0-6838-4833-bff2-6a193e8d7f98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.184191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8fca1d83-a60b-448f-9bc5-928eaec5ebf4 req-ee96d6c0-6838-4833-bff2-6a193e8d7f98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.208293 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8fca1d83-a60b-448f-9bc5-928eaec5ebf4 req-ee96d6c0-6838-4833-bff2-6a193e8d7f98 service nova] Creating event network-vif-plugged:a9fd7a38-4c98-4700-a63f-efce7db0542e for instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 on n-h2-858383-17 Oct 31 15:23:48.214473 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8fca1d83-a60b-448f-9bc5-928eaec5ebf4 req-ee96d6c0-6838-4833-bff2-6a193e8d7f98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064090 Oct 31 15:23:48.217799 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1201/2328] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:48.221111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.222439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.223128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.223704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lazy-loading 'fault' on Instance uuid 3545bebb-a6c1-49e8-94d4-30a2def0af20 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:48.243639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.244349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:48.252986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:48.255061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.255518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.255950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.256658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.257142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.257565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.302597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.303561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.304204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.304914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lazy-loading 'fault' on Instance uuid 145a1314-095c-4f62-bb7b-e5572addc62a {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:48.333996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:48.635102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2076e8958724ce09f1ad0e4ff647fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfb44c13df741fca0c785b2b29ad321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.642833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35619d71c374a6daf6f83988c93ed4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a4f5e804b54e08ba48264b3d7b6994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.649867 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a048f85b-fe0d-4ece-bf32-6ebf880b33ee tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 200 len: 1309 microversion: 2.1 time: 0.584790 Oct 31 15:23:48.650454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1128/2329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 1309 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:48.650602 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b104f401-6227-44b7-a992-a242d68021fb tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 200 len: 1304 microversion: 2.1 time: 0.411693 Oct 31 15:23:48.664731 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1202/2330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 1304 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:48.672058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.673006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:48.679463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.679960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.680384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.681517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.682224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.682731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.914450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7778bce8-3c3c-412a-aab1-9f3ede72a240 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Calling method '.version_select at 0x7f5ca6726ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.996114 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7778bce8-3c3c-412a-aab1-9f3ede72a240 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.155058 Oct 31 15:23:48.999881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1203/2331] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:23:49.009914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78cc23a3-11ee-4b88-9fa3-b9f6d301814d tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Action: 'create', calling method: .version_select at 0x7f5ca22f6040>, body: {"pool": "non_exist_pool"} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.043485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:49.051932 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ad88bb7-045b-489d-b834-b8f64a0f4b65 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1489 microversion: 2.1 time: 0.400116 Oct 31 15:23:49.052518 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1129/2332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1489 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.074937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1108392382"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.077386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.079148 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-78cc23a3-11ee-4b88-9fa3-b9f6d301814d tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] HTTP exception thrown: Floating IP pool not found. Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78cc23a3-11ee-4b88-9fa3-b9f6d301814d tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Request method failure captured: Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 26 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-iEX48Top5Zr-uDHE15jr619N69368aKrqPjadRfFbeTe_sIRPoO-PZjDea_6gDwGImsvXwIr0hcWNMMD0xz_w54A0Ef8fSQrY7cCNbiA6MWxcQsBlmXQNfdYKoJiFReJ1sBMdaiiXQtNuASXbqlzRq-93j4W_5xpOIiF-JVL--Jq4 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b17d53ed9dc944f0b5dc7de3eeb1fa0c Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-628310822 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-628310822 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b17d53ed9dc944f0b5dc7de3eeb1fa0c Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-628310822 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsNegativeTestJSON-628310822-project Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea26a4e086aa4a93b327a2119f6235b6 Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-628310822-project Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: {"pool": "non_exist_pool"} Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: exception: Floating IP pool not found. Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:49.080720 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:49.084493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 31 15:23:49.084493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.084493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78cc23a3-11ee-4b88-9fa3-b9f6d301814d tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Returning 404 to user: Floating IP pool not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:49.084493 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78cc23a3-11ee-4b88-9fa3-b9f6d301814d tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.076252 Oct 31 15:23:49.084493 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1204/2333] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:49.088203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.088907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.089357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.090078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.090540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.090988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.093244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.093943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.101867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.102627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.103270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.104189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.104895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.105523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.341339 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67c31137-b15e-48c9-acaf-4ee80a192f26 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "POST /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5/action" status: 202 len: 0 microversion: 2.1 time: 0.269935 Oct 31 15:23:49.350343 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1130/2334] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 31 15:23:49.356864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c13ff21-5eae-40fc-b6c8-c07ad630d678 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Calling method '.version_select at 0x7f5ca2705ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.429280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:49.436935 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43b89cdb-4b47-492f-ae1b-279a75e0f9b4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1315 microversion: 2.1 time: 0.347234 Oct 31 15:23:49.457673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-4c13ff21-5eae-40fc-b6c8-c07ad630d678 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0ab2eb4a-e364-4d8f-a416-71585cd206e4 could not be found", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:49.457673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4c13ff21-5eae-40fc-b6c8-c07ad630d678 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] HTTP exception thrown: Floating IP not found for ID 0ab2eb4a-e364-4d8f-a416-71585cd206e4 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c13ff21-5eae-40fc-b6c8-c07ad630d678 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Request method failure captured: Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-floating-ips/0ab2eb4a-e364-4d8f-a416-71585cd206e4 HTTP/1.1 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-iEX48Top5Zr-uDHE15jr619N69368aKrqPjadRfFbeTe_sIRPoO-PZjDea_6gDwGImsvXwIr0hcWNMMD0xz_w54A0Ef8fSQrY7cCNbiA6MWxcQsBlmXQNfdYKoJiFReJ1sBMdaiiXQtNuASXbqlzRq-93j4W_5xpOIiF-JVL--Jq4 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b17d53ed9dc944f0b5dc7de3eeb1fa0c Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-628310822 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b17d53ed9dc944f0b5dc7de3eeb1fa0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-628310822 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b17d53ed9dc944f0b5dc7de3eeb1fa0c Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-628310822 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPsNegativeTestJSON-628310822-project Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ea26a4e086aa4a93b327a2119f6235b6 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-628310822-project Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: exception: Floating IP not found for ID 0ab2eb4a-e364-4d8f-a416-71585cd206e4 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0ab2eb4a-e364-4d8f-a416-71585cd206e4'} Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0ab2eb4a-e364-4d8f-a416-71585cd206e4 could not be found Oct 31 15:23:49.458707 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ec2cbc9-4b5f-42ac-92c9-6bcfa7561528'] Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0ab2eb4a-e364-4d8f-a416-71585cd206e4. Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0ab2eb4a-e364-4d8f-a416-71585cd206e4 Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0ab2eb4a-e364-4d8f-a416-71585cd206e4 Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c13ff21-5eae-40fc-b6c8-c07ad630d678 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] Returning 404 to user: Floating IP not found for ID 0ab2eb4a-e364-4d8f-a416-71585cd206e4 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4c13ff21-5eae-40fc-b6c8-c07ad630d678 tempest-FloatingIPsNegativeTestJSON-628310822 tempest-FloatingIPsNegativeTestJSON-628310822-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/0ab2eb4a-e364-4d8f-a416-71585cd206e4" status: 404 len: 111 microversion: 2.1 time: 0.108356 Oct 31 15:23:49.461736 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1131/2335] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:23:49 2022] DELETE /compute/v2.1/os-floating-ips/0ab2eb4a-e364-4d8f-a416-71585cd206e4 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:49.468429 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1205/2336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.474279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.475032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.478391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a6bcaba-cda7-4b40-ae60-d3a565bb50e2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca67261f0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.510637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.511145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.513759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.514883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.517706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.518397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.582121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a6bcaba-cda7-4b40-ae60-d3a565bb50e2 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666" status: 200 len: 1414 microversion: 2.1 time: 0.115351 Oct 31 15:23:49.594244 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1206/2337] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.599846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f5ed3d4d-0ac6-4ad7-8591-a640abea38e2 req-42cdf590-2935-421a-af14-7f65c0a0b4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145a1314-095c-4f62-bb7b-e5572addc62a", "name": "network-vif-deleted", "tag": "76cf7f9d-f5fd-4fea-bcd9-6886850a2289"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.627912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f5ed3d4d-0ac6-4ad7-8591-a640abea38e2 req-42cdf590-2935-421a-af14-7f65c0a0b4e4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.629391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f5ed3d4d-0ac6-4ad7-8591-a640abea38e2 req-42cdf590-2935-421a-af14-7f65c0a0b4e4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.630056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f5ed3d4d-0ac6-4ad7-8591-a640abea38e2 req-42cdf590-2935-421a-af14-7f65c0a0b4e4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.654675 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f5ed3d4d-0ac6-4ad7-8591-a640abea38e2 req-42cdf590-2935-421a-af14-7f65c0a0b4e4 service nova] Creating event network-vif-deleted:76cf7f9d-f5fd-4fea-bcd9-6886850a2289 for instance 145a1314-095c-4f62-bb7b-e5572addc62a on n-h1-858383-17 Oct 31 15:23:49.669990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f5ed3d4d-0ac6-4ad7-8591-a640abea38e2 req-42cdf590-2935-421a-af14-7f65c0a0b4e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072156 Oct 31 15:23:49.674797 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1207/2338] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:49.680556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0bdc6755-4167-46de-ba5b-9e3c0cbc6631 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca25e11f0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.769410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:49.799493 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb74d187-87a0-4af7-8e0e-8c44a5d9a062 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1315 microversion: 2.1 time: 0.334372 Oct 31 15:23:49.801976 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1132/2339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.803020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0bdc6755-4167-46de-ba5b-9e3c0cbc6631 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666" status: 200 len: 1414 microversion: 2.1 time: 0.126509 Oct 31 15:23:49.806140 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1208/2340] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.818720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.819740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] [instance: 3545bebb-a6c1-49e8-94d4-30a2def0af20] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.820908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.822173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] [instance: 145a1314-095c-4f62-bb7b-e5572addc62a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.832624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.836213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.836869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.837443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.838273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.839015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.839553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.840121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.841549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.842206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.849769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.853118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.872628 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] HTTP exception thrown: Instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 could not be found. Oct 31 15:23:49.886495 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] HTTP exception thrown: Instance 145a1314-095c-4f62-bb7b-e5572addc62a could not be found. Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Request method failure captured: Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 HTTP/1.1 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-gGFiwwOnGG5-GtcKRhJCRt4dmTDr8v6Sd0tzNIa04zYlbMbPWM8es_Woe06xG0FWO9Bf-627Yhc5PVLkSsc3J9JbMXUj5FlZKOlGq6LMzjo6GMRVp0TLrb5Vrznrea0EmlERKXt2vmBfg0-9W7tqw1mgUYpfGL4UT1H76TfOY3hDo Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 1bfb44c13df741fca0c785b2b29ad321 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bfb44c13df741fca0c785b2b29ad321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 1bfb44c13df741fca0c785b2b29ad321 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-207311673 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServerFiltersTestJSON-207311673-project Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f2076e8958724ce09f1ad0e4ff647fc1 Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServerFiltersTestJSON-207311673-project Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 could not be found. Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '3545bebb-a6c1-49e8-94d4-30a2def0af20'} Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 could not be found. Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 could not be found. Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.888358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 could not be found. Oct 31 15:23:49.893695 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Request method failure captured: Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a HTTP/1.1 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-hZzqnufP3skq6n6OUedyLgh0dB7IY8Ec5y9oT4bPbl920Bh1bQd4YoeOMFu6kbJPr6Q3CRars92tdMMO7NrqyPZPUnXfMBA2pxJBpYX159USk_zCKQI4LeaVsvOdHQoBccF_TgZXOKAuNqnxVghBMzhG-S62YaB-fSYnBo9r7lgKk Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 28a4f5e804b54e08ba48264b3d7b6994 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TenantUsagesTestJSON-307999000 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/28a4f5e804b54e08ba48264b3d7b6994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/28a4f5e804b54e08ba48264b3d7b6994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_28a4f5e804b54e08ba48264b3d7b6994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/28a4f5e804b54e08ba48264b3d7b6994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TenantUsagesTestJSON-307999000 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 28a4f5e804b54e08ba48264b3d7b6994 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TenantUsagesTestJSON-307999000 Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TenantUsagesTestJSON-307999000-project Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c35619d71c374a6daf6f83988c93ed4c Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TenantUsagesTestJSON-307999000-project Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 145a1314-095c-4f62-bb7b-e5572addc62a could not be found. Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '145a1314-095c-4f62-bb7b-e5572addc62a'} Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145a1314-095c-4f62-bb7b-e5572addc62a could not be found. Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145a1314-095c-4f62-bb7b-e5572addc62a could not be found. Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.895214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145a1314-095c-4f62-bb7b-e5572addc62a could not be found. Oct 31 15:23:49.905893 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.908622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] Returning 404 to user: Instance 3545bebb-a6c1-49e8-94d4-30a2def0af20 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:49.908622 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4278918-a3a0-429e-856b-f40b88db1fae tempest-ListServerFiltersTestJSON-207311673 tempest-ListServerFiltersTestJSON-207311673-project] 10.222.0.48 "GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20" status: 404 len: 111 microversion: 2.1 time: 0.091694 Oct 31 15:23:49.908865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] Returning 404 to user: Instance 145a1314-095c-4f62-bb7b-e5572addc62a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:49.909010 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1133/2341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/3545bebb-a6c1-49e8-94d4-30a2def0af20 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:49.909137 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4fb4ebe2-1b47-407b-a533-570b7511e335 tempest-TenantUsagesTestJSON-307999000 tempest-TenantUsagesTestJSON-307999000-project] 10.222.0.48 "GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a" status: 404 len: 111 microversion: 2.1 time: 0.093950 Oct 31 15:23:49.909137 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1209/2342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/145a1314-095c-4f62-bb7b-e5572addc62a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:49.912033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afd2f4ca-85c0-4741-9af7-4a5868285a9b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca26f85e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.237813 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afd2f4ca-85c0-4741-9af7-4a5868285a9b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666" status: 204 len: 0 microversion: 2.1 time: 0.333486 Oct 31 15:23:50.239520 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1134/2343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] DELETE /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:50.249582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7405b0f-8d54-41bd-b63b-b02c83bd2f3b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca239d940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.291136 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a7405b0f-8d54-41bd-b63b-b02c83bd2f3b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Image not found. Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7405b0f-8d54-41bd-b63b-b02c83bd2f3b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 HTTP/1.1 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'cd6aa9d2-8a57-43e0-b11d-d34d242f2666'} Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cd6aa9d2-8a57-43e0-b11d-d34d242f2666 Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:23:50.293331 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd6aa9d2-8a57-43e0-b11d-d34d242f2666 could not be found. Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:50.298039 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:50.301115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7405b0f-8d54-41bd-b63b-b02c83bd2f3b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:50.302296 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7405b0f-8d54-41bd-b63b-b02c83bd2f3b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666" status: 404 len: 62 microversion: 2.1 time: 0.058612 Oct 31 15:23:50.302982 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1210/2344] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:50.311577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.312502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:50.324292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.339818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.340385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.341277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.342540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.343078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.462118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.462859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:50.476365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.477129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.477810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.478982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.479668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.481315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.064537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:51.066460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:51.074131 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd6bc9a3-9822-4a9f-b782-57f98a09d59f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1315 microversion: 2.1 time: 0.617087 Oct 31 15:23:51.074707 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1211/2345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:51.089625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.089811 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ecd0dd6a-cf9b-4887-a1f0-1afb4912d64b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1501 microversion: 2.1 time: 0.766948 Oct 31 15:23:51.090509 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1135/2346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1501 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:51.095779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:51.111836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.112519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.113000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.113777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.114247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.114680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.617268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:51.626212 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93b55b99-8466-440c-a508-25befd23ccac tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1503 microversion: 2.1 time: 0.540135 Oct 31 15:23:51.626917 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1212/2347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:51 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1503 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:51.649695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-542799413"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:51.650243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:51.659209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.659877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.660466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.661383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.661989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.662582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.961225 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Adding security group dc29609f-efcd-4c2d-9635-a453caf930b7 to port a9fd7a38-4c98-4700-a63f-efce7db0542e Oct 31 15:23:52.102298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.105951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:52.121395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.130041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.130753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.134214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.134941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.137630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.230917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:52.282994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:52.559822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:52.638893 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-625fd9df-afc2-4ff7-932a-21876f95e80b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1315 microversion: 2.1 time: 0.540400 Oct 31 15:23:52.647393 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1213/2348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:52.673349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.674812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:52.698579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.701332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.703599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.705190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.707019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.709097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:53.215430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:53.226748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:53.231154 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5df5aa1a-369f-4b8e-b92d-9fb2c10986b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1507 microversion: 2.1 time: 0.582195 Oct 31 15:23:53.231910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1214/2349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1507 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:53.238655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d46c892f-946a-42fd-a44d-91770e9e38cb req-983ea0ac-b196-4606-9e1e-b33b00a6f1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa22140e-0ab8-4cca-9dd5-469cbb78cd14", "name": "network-vif-plugged", "status": "completed", "tag": "eaf8c73a-01f1-435c-95df-a26934141340"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:53.253778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d46c892f-946a-42fd-a44d-91770e9e38cb req-983ea0ac-b196-4606-9e1e-b33b00a6f1fd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:53.254848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d46c892f-946a-42fd-a44d-91770e9e38cb req-983ea0ac-b196-4606-9e1e-b33b00a6f1fd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:53.255431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d46c892f-946a-42fd-a44d-91770e9e38cb req-983ea0ac-b196-4606-9e1e-b33b00a6f1fd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:53.273797 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d46c892f-946a-42fd-a44d-91770e9e38cb req-983ea0ac-b196-4606-9e1e-b33b00a6f1fd service nova] Creating event network-vif-plugged:eaf8c73a-01f1-435c-95df-a26934141340 for instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 on n-h2-858383-17 Oct 31 15:23:53.280803 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d46c892f-946a-42fd-a44d-91770e9e38cb req-983ea0ac-b196-4606-9e1e-b33b00a6f1fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046415 Oct 31 15:23:53.282256 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1215/2350] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:53.309276 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2112e54d-38f8-40ad-a4ad-8d47f2db2dae tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3/action" status: 202 len: 0 microversion: 2.1 time: 1.660653 Oct 31 15:23:53.310457 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1136/2351] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:51 2022] POST /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3/action => generated 0 bytes in 1665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:53.322271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b7bcbd7-cf9c-4fbf-867c-8dbe76263b8f tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca25e1550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:53.329883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d30d2fa7-f91a-4634-bda5-9c70e06c655d req-b851e104-2538-4972-ba45-24dc34615289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3", "tag": "a9fd7a38-4c98-4700-a63f-efce7db0542e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:53.349548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d30d2fa7-f91a-4634-bda5-9c70e06c655d req-b851e104-2538-4972-ba45-24dc34615289 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:53.350029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d30d2fa7-f91a-4634-bda5-9c70e06c655d req-b851e104-2538-4972-ba45-24dc34615289 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:53.350455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d30d2fa7-f91a-4634-bda5-9c70e06c655d req-b851e104-2538-4972-ba45-24dc34615289 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:53.381882 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d30d2fa7-f91a-4634-bda5-9c70e06c655d req-b851e104-2538-4972-ba45-24dc34615289 service nova] Creating event network-changed:a9fd7a38-4c98-4700-a63f-efce7db0542e for instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 on n-h2-858383-17 Oct 31 15:23:53.408464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d30d2fa7-f91a-4634-bda5-9c70e06c655d req-b851e104-2538-4972-ba45-24dc34615289 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070871 Oct 31 15:23:53.411427 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1137/2352] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:23:53.668286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:53.669470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:53.686726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:53.687404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:53.688172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:53.693776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:53.694609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:53.695791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.447079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:54.462329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90807412-22b7-41f8-badd-b81e6dd2ada2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1315 microversion: 2.1 time: 0.798751 Oct 31 15:23:54.465581 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1138/2353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:53 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:54.474576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:54.476431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.491946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.493109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.493732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.494627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.495418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.496232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.557030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-0b7bcbd7-cf9c-4fbf-867c-8dbe76263b8f tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use.", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:54.557855 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0b7bcbd7-cf9c-4fbf-867c-8dbe76263b8f tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.557855 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b7bcbd7-cf9c-4fbf-867c-8dbe76263b8f tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7 HTTP/1.1 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: exception: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'dc29609f-efcd-4c2d-9635-a453caf930b7'} Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:54.560845 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] Oct 31 15:23:54.564602 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:54.569521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b7bcbd7-cf9c-4fbf-867c-8dbe76263b8f tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 400 to user: Security Group dc29609f-efcd-4c2d-9635-a453caf930b7 in use. Oct 31 15:23:54.569521 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-410cb1c2-4718-4336-9949-8f36f540f85d'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:54.569925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b7bcbd7-cf9c-4fbf-867c-8dbe76263b8f tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7" status: 400 len: 185 microversion: 2.1 time: 1.253128 Oct 31 15:23:54.570851 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1216/2354] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:23:53 2022] DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7 => generated 185 bytes in 1256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:23:54.583657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:54.587148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.595204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.595962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.596511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.597452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.598076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.598614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.714436 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3238782-57a6-4079-b2bb-781f9a1ea5e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.138915 Oct 31 15:23:54.715083 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1217/2355] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:54 2022] POST /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:23:54.725228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:54.726167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.732633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.733358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.733974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.734883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.735521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.736096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.089183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:55.095093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:55.115507 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f098965-86ac-42da-a9c0-889b9a1183b1 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1507 microversion: 2.1 time: 0.648381 Oct 31 15:23:55.119842 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1139/2356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:54 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1507 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.350135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:55.357875 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64421870-d5ca-4c7d-b941-014f550dfdff tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1573 microversion: 2.1 time: 0.637063 Oct 31 15:23:55.358463 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1218/2357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:54 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1573 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.499328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.500605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:55.509724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.510200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.511863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.513224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.514270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.515677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.919741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:55.929929 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-14deb1c0-833c-4d3f-8b3b-8bf937a09061 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1502 microversion: 2.1 time: 0.441005 Oct 31 15:23:55.933559 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1140/2358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1502 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.966267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:55.968019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:55.981517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.982110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.983039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.984948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.986484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.988040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.047140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lazy-loading 'flavor' on Instance uuid aa22140e-0ab8-4cca-9dd5-469cbb78cd14 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:56.312548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbb7cbf6-b5fe-4b5f-9f52-8bd5c7673fb9 tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.336758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bbb7cbf6-b5fe-4b5f-9f52-8bd5c7673fb9 tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.376383 Oct 31 15:23:56.337543 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1141/2359] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:56.353763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.356083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.386225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.386729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.387311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.388201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.388835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.389407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.614873 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64fd9aee-102e-42f8-b6fd-a38b1ed62de6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14/action" status: 202 len: 0 microversion: 2.1 time: 0.659929 Oct 31 15:23:56.617584 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1219/2360] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:55 2022] POST /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:56.627563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.632934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.646235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.646724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.651802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.652548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.653210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.657490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.019235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.028405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a292e66e-314b-46f3-bc8e-0a4baf8df666 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1502 microversion: 2.1 time: 0.688009 Oct 31 15:23:57.037532 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1142/2361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:56 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1502 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.045022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:57.049467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:57.058381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:57.061351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:57.067220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:57.068231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.069902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:57.077070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:57.077918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.231819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.241567 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-546d634c-aefe-48e3-9454-2c671c1de79c tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1573 microversion: 2.1 time: 0.622552 Oct 31 15:23:57.270469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1220/2362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:56 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1573 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.436922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.461256 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ff83b2b-a738-4c31-81b1-13805177929b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.421075 Oct 31 15:23:57.480375 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1143/2363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:57 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.807950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e18d45f-69da-4dfd-8e71-c2c423f0e14c tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1725720761", "imageRef": "8e9efb64-e209-47bc-bd26-dc569acaedc9", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:57.878710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2e18d45f-69da-4dfd-8e71-c2c423f0e14c tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:58.059404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.060646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:58.072497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.075272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.075741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.076480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.076989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.077422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.128619 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2e18d45f-69da-4dfd-8e71-c2c423f0e14c tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e18d45f-69da-4dfd-8e71-c2c423f0e14c tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] Request method failure captured: Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 143 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-iLHiJUF6rGEouN94dG8kFGb4xLrm3T-lONU-MReta60tOVcnFMUj02kCwwHuY4F6GQkiWJ5iauBtYtn5ZagkeqFBsI5kFkhEqkxqovMBN-3ZREqn3UQeYkPpCfcsf60miro9CJKsfjgAlGZSfmW3_BdZ1gDyHCTAbJ-qLE6t9nNCE Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 5bd6e8bbe2ae44c0ae8355d4da4bfee1 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FlavorsV2NegativeTest-12293530 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5bd6e8bbe2ae44c0ae8355d4da4bfee1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5bd6e8bbe2ae44c0ae8355d4da4bfee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5bd6e8bbe2ae44c0ae8355d4da4bfee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5bd6e8bbe2ae44c0ae8355d4da4bfee1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FlavorsV2NegativeTest-12293530 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 5bd6e8bbe2ae44c0ae8355d4da4bfee1 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-12293530 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FlavorsV2NegativeTest-12293530-project Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 270210c092084f98a77c7c42c1805ca5 Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FlavorsV2NegativeTest-12293530-project Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1725720761", "imageRef": "8e9efb64-e209-47bc-bd26-dc569acaedc9", "flavorRef": "452"}} Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor's memory is too small for requested image. Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1725720761', 'imageRef': '8e9efb64-e209-47bc-bd26-dc569acaedc9', 'flavorRef': '452'}}} Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:58.130967 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 31 15:23:58.134959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:58.138588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e18d45f-69da-4dfd-8e71-c2c423f0e14c tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:58.139687 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e18d45f-69da-4dfd-8e71-c2c423f0e14c tempest-FlavorsV2NegativeTest-12293530 tempest-FlavorsV2NegativeTest-12293530-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.337165 Oct 31 15:23:58.143267 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1221/2364] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:57 2022] POST /compute/v2.1/servers => generated 93 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:58.277093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.277722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:58.294276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.296800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.297960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.301051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.301756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.302350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.706410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:58.723972 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5531e46a-0413-49a5-82f4-978f99ca3322 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1489 microversion: 2.1 time: 0.665990 Oct 31 15:23:58.725331 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1144/2365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1489 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:58.739292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.740103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:58.757489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.758199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.759935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.762350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.763358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.763867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.239664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:59.252153 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef0ab297-6a20-443d-af81-37263a5f6767 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1571 microversion: 2.1 time: 0.979004 Oct 31 15:23:59.253123 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1222/2366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1571 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:59.257828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d41b59bc-a970-4700-b589-c81a885c38b7 req-ce936509-2875-4240-aa16-d9f6665270d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1268bcd-736f-4f48-9a6e-469aa8894cb5", "name": "network-vif-plugged", "status": "completed", "tag": "24940940-4d10-447a-8bdb-19b9ca378d31"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:59.268745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d41b59bc-a970-4700-b589-c81a885c38b7 req-ce936509-2875-4240-aa16-d9f6665270d0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.269472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d41b59bc-a970-4700-b589-c81a885c38b7 req-ce936509-2875-4240-aa16-d9f6665270d0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.270115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d41b59bc-a970-4700-b589-c81a885c38b7 req-ce936509-2875-4240-aa16-d9f6665270d0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.283966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d41b59bc-a970-4700-b589-c81a885c38b7 req-ce936509-2875-4240-aa16-d9f6665270d0 service nova] Creating event network-vif-plugged:24940940-4d10-447a-8bdb-19b9ca378d31 for instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 on n-h1-858383-17 Oct 31 15:23:59.290986 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d41b59bc-a970-4700-b589-c81a885c38b7 req-ce936509-2875-4240-aa16-d9f6665270d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036479 Oct 31 15:23:59.291899 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1223/2367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:59.298374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.299041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.308136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.308867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.309465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.310547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.311150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.311727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.341668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:59.346188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:59.350029 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-527c3c44-91a8-4c99-8655-953a5c77068e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.621505 Oct 31 15:23:59.350600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1145/2368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:59.363103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-796560733"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:59.366183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.372409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.372975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.373522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.374208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.374742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.375159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.518995 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2c8bf11-a2f7-4ded-b65d-e36b5e48e0af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 204 len: 0 microversion: 2.1 time: 0.225512 Oct 31 15:23:59.524821 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1224/2369] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:59 2022] DELETE /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:59.532556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c15eee45-4147-4947-94f1-3c57592de168 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca2707700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.574075 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c15eee45-4147-4947-94f1-3c57592de168 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Image not found. Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c15eee45-4147-4947-94f1-3c57592de168 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 HTTP/1.1 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'cd6aa9d2-8a57-43e0-b11d-d34d242f2666'} Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd6aa9d2-8a57-43e0-b11d-d34d242f2666 to delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd6aa9d2-8a57-43e0-b11d-d34d242f2666 could not be found. Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.576180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c15eee45-4147-4947-94f1-3c57592de168 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c15eee45-4147-4947-94f1-3c57592de168 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666" status: 404 len: 62 microversion: 2.1 time: 0.051582 Oct 31 15:23:59.580004 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1225/2370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:59 2022] DELETE /compute/v2.1/images/cd6aa9d2-8a57-43e0-b11d-d34d242f2666 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:59.590974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.593258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.607616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.608240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.608682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.613690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.614399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.614847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.675293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:59.684233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Adding security group 984d5fa5-08ff-436b-a736-962f6546a0b3 to port a9fd7a38-4c98-4700-a63f-efce7db0542e Oct 31 15:23:59.777505 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.compute.api [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Instance is already in deleting state, ignoring this request Oct 31 15:23:59.778369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85e7b182-8876-4132-a5b6-4b73ff6939e3 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 204 len: 0 microversion: 2.1 time: 0.193911 Oct 31 15:23:59.783902 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1226/2371] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:59 2022] DELETE /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:59.789982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.790842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.798358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.799121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.799720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.800580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.801221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.801838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.342542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:00.358458 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72a4877d-fff2-4300-9378-29b763b4e2b0 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1495 microversion: 2.1 time: 0.572368 Oct 31 15:24:00.359256 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1227/2372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:59 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1495 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.377438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.378636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:00.392245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.393820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.395782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.401308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.401821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.402286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.925199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:00.934211 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43960ef4-bec7-40ba-8268-1647a5bc7fb9 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.565347 Oct 31 15:24:00.940102 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1228/2373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:01.058045 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-038c8233-f319-4ddb-9d62-5a1c2b617cdb tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3/action" status: 202 len: 0 microversion: 2.1 time: 1.706159 Oct 31 15:24:01.065468 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1146/2374] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:59 2022] POST /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3/action => generated 0 bytes in 1708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:01.089042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8312935b-445e-4a50-85eb-aa8ed116c62d req-1efa3a87-941f-4e84-aad0-25ba02742d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3", "tag": "a9fd7a38-4c98-4700-a63f-efce7db0542e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:01.092664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8de1a742-a425-4919-a57d-56fb89e78ea7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca66bef70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.116829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8312935b-445e-4a50-85eb-aa8ed116c62d req-1efa3a87-941f-4e84-aad0-25ba02742d65 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.118266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8312935b-445e-4a50-85eb-aa8ed116c62d req-1efa3a87-941f-4e84-aad0-25ba02742d65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.118913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8312935b-445e-4a50-85eb-aa8ed116c62d req-1efa3a87-941f-4e84-aad0-25ba02742d65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.148547 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8312935b-445e-4a50-85eb-aa8ed116c62d req-1efa3a87-941f-4e84-aad0-25ba02742d65 service nova] Creating event network-changed:a9fd7a38-4c98-4700-a63f-efce7db0542e for instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 on n-h2-858383-17 Oct 31 15:24:01.163569 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8312935b-445e-4a50-85eb-aa8ed116c62d req-1efa3a87-941f-4e84-aad0-25ba02742d65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086030 Oct 31 15:24:01.172130 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1147/2375] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:24:01.388451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.389217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.406489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.407902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.408348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.409128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.409592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.410120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.673408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-8de1a742-a425-4919-a57d-56fb89e78ea7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use.", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:01.674003 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8de1a742-a425-4919-a57d-56fb89e78ea7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.674003 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8de1a742-a425-4919-a57d-56fb89e78ea7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3 HTTP/1.1 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: exception: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '984d5fa5-08ff-436b-a736-962f6546a0b3'} Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:01.676048 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8de1a742-a425-4919-a57d-56fb89e78ea7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 400 to user: Security Group 984d5fa5-08ff-436b-a736-962f6546a0b3 in use. Oct 31 15:24:01.679413 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-0f7e305f-133e-469f-8e29-fbf38fd38a91'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:01.683969 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8de1a742-a425-4919-a57d-56fb89e78ea7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3" status: 400 len: 185 microversion: 2.1 time: 0.618718 Oct 31 15:24:01.687568 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1229/2376] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:01 2022] DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3 => generated 185 bytes in 621 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:24:01.693432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.697347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.710946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.717721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.718631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.720001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.720745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.721384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.762401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:01.776596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:01.919828 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a96edc85-86d0-46f4-a09c-66490edb06e8 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 204 len: 0 microversion: 2.1 time: 0.229946 Oct 31 15:24:01.921703 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1230/2377] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:01 2022] DELETE /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:01.943286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.944391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.965807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.966542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.967779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.968798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.970579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.971339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.177819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:02.193685 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50effab6-bca9-4d08-875b-a638e6cb036d tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1495 microversion: 2.1 time: 0.811359 Oct 31 15:24:02.195770 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1148/2378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1495 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.204300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:02.208479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:02.263993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.264489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.272122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.272996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.273624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.274068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.668428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:02.681497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a24d2e66-74fb-44a1-9303-d7b7043b289d tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1645 microversion: 2.1 time: 0.747826 Oct 31 15:24:02.682156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1231/2379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1645 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.791000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:02.799145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-62255aa4-75d9-48bf-af84-93f926540db6 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.600744 Oct 31 15:24:02.799743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1149/2380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:02 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.847213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f2f28167-6aca-48f8-9b63-21424708d58b req-aa525651-6109-4a4b-8ae9-b5c42e9839ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1268bcd-736f-4f48-9a6e-469aa8894cb5", "name": "network-vif-unplugged", "status": "completed", "tag": "24940940-4d10-447a-8bdb-19b9ca378d31"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:02.858779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f2f28167-6aca-48f8-9b63-21424708d58b req-aa525651-6109-4a4b-8ae9-b5c42e9839ea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.860835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f2f28167-6aca-48f8-9b63-21424708d58b req-aa525651-6109-4a4b-8ae9-b5c42e9839ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.863672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f2f28167-6aca-48f8-9b63-21424708d58b req-aa525651-6109-4a4b-8ae9-b5c42e9839ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.896064 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f2f28167-6aca-48f8-9b63-21424708d58b req-aa525651-6109-4a4b-8ae9-b5c42e9839ea service nova] Creating event network-vif-unplugged:24940940-4d10-447a-8bdb-19b9ca378d31 for instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 on n-h1-858383-17 Oct 31 15:24:02.903957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f2f28167-6aca-48f8-9b63-21424708d58b req-aa525651-6109-4a4b-8ae9-b5c42e9839ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061414 Oct 31 15:24:02.904931 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1232/2381] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:03.227328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:03.228639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:03.248268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.249214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.249883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.250847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.251579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.252221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.709378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:03.710103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:03.725815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.726327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.726772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.727495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.744165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.746315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.339162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857b0f5f4fdc4b1faeae0e0770d65125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f50f35cbe74ea4b2ac1a7795c00dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:04.348624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4cb648ae-53ae-45c1-9a97-2831230eb142 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 200 len: 1495 microversion: 2.1 time: 1.129373 Oct 31 15:24:04.371458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1150/2382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:03 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 1495 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:04.377781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:04.385687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:04.405450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.406200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.407066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.408134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.408791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.409403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.125064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:05.134289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:05.159638 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16700e95-0555-4da4-a517-021ddb72a334 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1645 microversion: 2.1 time: 1.454716 Oct 31 15:24:05.160654 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bb380ca1-0985-45cb-93e0-b06dffcde434 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.786415 Oct 31 15:24:05.178754 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1233/2383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:03 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1645 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:05.180366 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1151/2384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:04 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:05.205525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8025990b-9cc3-4759-801e-75e511135b15 req-5ce6adec-302d-44ce-9a23-325032f10bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1268bcd-736f-4f48-9a6e-469aa8894cb5", "name": "network-vif-deleted", "tag": "24940940-4d10-447a-8bdb-19b9ca378d31"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:05.242257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8025990b-9cc3-4759-801e-75e511135b15 req-5ce6adec-302d-44ce-9a23-325032f10bbd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.243136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8025990b-9cc3-4759-801e-75e511135b15 req-5ce6adec-302d-44ce-9a23-325032f10bbd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.245007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8025990b-9cc3-4759-801e-75e511135b15 req-5ce6adec-302d-44ce-9a23-325032f10bbd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.286082 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8025990b-9cc3-4759-801e-75e511135b15 req-5ce6adec-302d-44ce-9a23-325032f10bbd service nova] Creating event network-vif-deleted:24940940-4d10-447a-8bdb-19b9ca378d31 for instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 on n-h1-858383-17 Oct 31 15:24:05.305440 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8025990b-9cc3-4759-801e-75e511135b15 req-5ce6adec-302d-44ce-9a23-325032f10bbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122156 Oct 31 15:24:05.307813 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1234/2385] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:05.379761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.381117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: b1268bcd-736f-4f48-9a6e-469aa8894cb5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.395142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.396025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.397011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.397998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.398810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.399457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.427906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 could not be found. Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 HTTP/1.1 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 could not be found. Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b1268bcd-736f-4f48-9a6e-469aa8894cb5'} Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 could not be found. Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 could not be found. Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.430165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.435678 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.435678 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.435678 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.435678 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.435678 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 could not be found. Oct 31 15:24:05.435678 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.437348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance b1268bcd-736f-4f48-9a6e-469aa8894cb5 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.441371 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a71fc6f4-4f2b-4c77-9808-3ad9fba9cb49 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5" status: 404 len: 111 microversion: 2.1 time: 0.066662 Oct 31 15:24:05.442603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1152/2386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/servers/b1268bcd-736f-4f48-9a6e-469aa8894cb5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:05.466422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.467203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.479344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.479859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.480306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.481085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.485674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.487104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.510217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 HTTP/1.1 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a5b1b865-7989-45f8-978e-41dd4c3c2396'} Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:05.512343 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.517165 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f809a2c-9756-4cc4-8666-5cb1f37a7e5c tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 404 len: 111 microversion: 2.1 time: 0.069413 Oct 31 15:24:05.520897 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1235/2387] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:05 2022] DELETE /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:05.526518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.527317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a5b1b865-7989-45f8-978e-41dd4c3c2396] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.535980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.536813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.537414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.539090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.539724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.540312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.569469 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 HTTP/1.1 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a5b1b865-7989-45f8-978e-41dd4c3c2396'} Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.571223 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.574679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.574679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.574679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.574679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.574679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. Oct 31 15:24:05.574679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.576982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance a5b1b865-7989-45f8-978e-41dd4c3c2396 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.578062 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1bb3bca9-9326-4778-8050-5ad501d78cfb tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396" status: 404 len: 111 microversion: 2.1 time: 0.056245 Oct 31 15:24:05.579949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1153/2388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/servers/a5b1b865-7989-45f8-978e-41dd4c3c2396 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:05.589957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bca1bffa-f81e-49e1-90a6-c1f8007909ac tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca16c33a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.639097 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-bca1bffa-f81e-49e1-90a6-c1f8007909ac tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Image not found. Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bca1bffa-f81e-49e1-90a6-c1f8007909ac tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 HTTP/1.1 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3881b925-5cd0-40da-8aa0-be0593574d57'} Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3881b925-5cd0-40da-8aa0-be0593574d57 to delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3881b925-5cd0-40da-8aa0-be0593574d57 could not be found. Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.641725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:05.645425 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.648189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bca1bffa-f81e-49e1-90a6-c1f8007909ac tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.649278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bca1bffa-f81e-49e1-90a6-c1f8007909ac tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57" status: 404 len: 62 microversion: 2.1 time: 0.064400 Oct 31 15:24:05.650012 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1236/2389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] DELETE /compute/v2.1/images/3881b925-5cd0-40da-8aa0-be0593574d57 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:05.659047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.659562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.673111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.675138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.677355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.678192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.680717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.681184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.738758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 HTTP/1.1 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'edc1afd0-e44e-407e-9003-2b4505e1eaf6'} Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:05.741488 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.744826 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3dee98d5-d849-4d6b-ad93-604671867562 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 404 len: 111 microversion: 2.1 time: 0.088986 Oct 31 15:24:05.755447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.757398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: edc1afd0-e44e-407e-9003-2b4505e1eaf6] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.759456 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1154/2390] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:05 2022] DELETE /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:24:05.768891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.769576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.774906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.775905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.776585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.777375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.808279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 HTTP/1.1 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'edc1afd0-e44e-407e-9003-2b4505e1eaf6'} Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.810148 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.814412 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.814412 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.814412 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.814412 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.814412 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. Oct 31 15:24:05.814412 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.817693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance edc1afd0-e44e-407e-9003-2b4505e1eaf6 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.824806 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf12e030-618f-48dc-9f4f-9389dc4b8c8b tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6" status: 404 len: 111 microversion: 2.1 time: 0.076224 Oct 31 15:24:05.835620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a29bb80-34e7-418d-b2ae-874f23895c22 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca178fee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.846241 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1237/2391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/servers/edc1afd0-e44e-407e-9003-2b4505e1eaf6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:05.879580 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3a29bb80-34e7-418d-b2ae-874f23895c22 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Image not found. Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a29bb80-34e7-418d-b2ae-874f23895c22 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 HTTP/1.1 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '04792955-94aa-4fb4-81df-ab51ed831db0'} Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 04792955-94aa-4fb4-81df-ab51ed831db0 to delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04792955-94aa-4fb4-81df-ab51ed831db0 could not be found. Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.882195 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:05.885795 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.891721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a29bb80-34e7-418d-b2ae-874f23895c22 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.892596 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a29bb80-34e7-418d-b2ae-874f23895c22 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0" status: 404 len: 62 microversion: 2.1 time: 0.061547 Oct 31 15:24:05.893211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1155/2392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] DELETE /compute/v2.1/images/04792955-94aa-4fb4-81df-ab51ed831db0 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:05.903806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.904629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.914282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.915718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.916346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.918994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.919800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.920427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.943466 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 HTTP/1.1 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a045a089-2ade-4888-aff0-4e067941cb23'} Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:05.945466 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:05.948817 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:05.951028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:05.952964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f177a5e-88a0-45da-8c67-eeb85681d050 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 404 len: 111 microversion: 2.1 time: 0.055310 Oct 31 15:24:05.954142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1238/2393] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:05 2022] DELETE /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:05.963299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.964199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: a045a089-2ade-4888-aff0-4e067941cb23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.976838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.977527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.978168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.979083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.979733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.980412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.998705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 HTTP/1.1 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a045a089-2ade-4888-aff0-4e067941cb23'} Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.001273 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.007191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.007191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.007191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.007191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.007191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. Oct 31 15:24:06.007191 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.009918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance a045a089-2ade-4888-aff0-4e067941cb23 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.011081 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0949d931-155d-49a2-8d02-234551d8d5af tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23" status: 404 len: 111 microversion: 2.1 time: 0.053183 Oct 31 15:24:06.012283 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1156/2394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/servers/a045a089-2ade-4888-aff0-4e067941cb23 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:06.027653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91e8c876-fc58-4375-88c2-06608c87a783 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca239dee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.075964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-91e8c876-fc58-4375-88c2-06608c87a783 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Image not found. Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91e8c876-fc58-4375-88c2-06608c87a783 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd HTTP/1.1 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd6a2f641-75ec-4767-93c4-893dae97c8bd'} Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d6a2f641-75ec-4767-93c4-893dae97c8bd to delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6a2f641-75ec-4767-93c4-893dae97c8bd could not be found. Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.078056 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:06.083302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.085958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91e8c876-fc58-4375-88c2-06608c87a783 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.087008 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91e8c876-fc58-4375-88c2-06608c87a783 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd" status: 404 len: 62 microversion: 2.1 time: 0.070831 Oct 31 15:24:06.088112 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1239/2395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] DELETE /compute/v2.1/images/d6a2f641-75ec-4767-93c4-893dae97c8bd => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:06.097413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.098116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.106013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.106691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.107246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.108253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.109061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.111076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.130340 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 HTTP/1.1 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1'} Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:06.131929 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.136097 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.137709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.138753 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6721f2d-45e8-406c-b31a-e8046663e724 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 404 len: 111 microversion: 2.1 time: 0.046809 Oct 31 15:24:06.139506 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1157/2396] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:06 2022] DELETE /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:06.148571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.149812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.159482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.160304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.161183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.162253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.162935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.163524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.191871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.192829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.193100 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 HTTP/1.1 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1'} Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.195404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance 4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29baf49c-f5ce-4a33-8e98-fa286e4f5b33 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1" status: 404 len: 111 microversion: 2.1 time: 0.052633 Oct 31 15:24:06.203886 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1240/2397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/servers/4ac7a42f-8b03-4cb4-9e1f-0fb770526bd1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:06.207068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.208063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.225708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.225903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.226647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.229238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.229838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.231012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.231381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.231789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.232382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.233900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.235630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.238178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.483518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:06.498649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1524abec-d736-4d01-a2b5-ccfe1dc3f9fd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 200 len: 1467 microversion: 2.1 time: 0.313540 Oct 31 15:24:06.499237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1158/2398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 1467 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:06.515009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd5ddaa6-971a-4787-8eb1-4ecfafb2ee86 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '.version_select at 0x7f5ca178fd30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.550711 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-bd5ddaa6-971a-4787-8eb1-4ecfafb2ee86 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Image not found. Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd5ddaa6-971a-4787-8eb1-4ecfafb2ee86 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 HTTP/1.1 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36'} Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 to delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 could not be found. Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.552999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:06.557157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.559411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd5ddaa6-971a-4787-8eb1-4ecfafb2ee86 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.560869 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd5ddaa6-971a-4787-8eb1-4ecfafb2ee86 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36" status: 404 len: 62 microversion: 2.1 time: 0.060501 Oct 31 15:24:06.566262 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1159/2399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] DELETE /compute/v2.1/images/b3c5eb1c-dadc-4e51-baaa-8fbf9dff4f36 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:06.572811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1e6f36c2-ca59-4213-baf7-92d74a390823 req-192c9c51-de62-43df-a683-1987fa9f3672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3", "name": "network-vif-deleted", "tag": "a9fd7a38-4c98-4700-a63f-efce7db0542e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:06.602648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1e6f36c2-ca59-4213-baf7-92d74a390823 req-192c9c51-de62-43df-a683-1987fa9f3672 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.603356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1e6f36c2-ca59-4213-baf7-92d74a390823 req-192c9c51-de62-43df-a683-1987fa9f3672 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.604480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1e6f36c2-ca59-4213-baf7-92d74a390823 req-192c9c51-de62-43df-a683-1987fa9f3672 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.631874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1e6f36c2-ca59-4213-baf7-92d74a390823 req-192c9c51-de62-43df-a683-1987fa9f3672 service nova] Creating event network-vif-deleted:a9fd7a38-4c98-4700-a63f-efce7db0542e for instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 on n-h2-858383-17 Oct 31 15:24:06.653596 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1e6f36c2-ca59-4213-baf7-92d74a390823 req-192c9c51-de62-43df-a683-1987fa9f3672 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085428 Oct 31 15:24:06.660106 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1160/2400] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:06.665643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.666237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.694257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.694782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.697081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.698001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.702049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.702747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.736720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 HTTP/1.1 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '802119d0-f33f-421a-910a-9a78e05406a6'} Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:06.738977 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.743894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f9108f8-2a6b-445a-abd0-eecd802a6000 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "DELETE /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 404 len: 111 microversion: 2.1 time: 0.079598 Oct 31 15:24:06.755322 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1161/2401] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:06 2022] DELETE /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:06.762079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.763039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] [instance: 802119d0-f33f-421a-910a-9a78e05406a6] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.770976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.771827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.772499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.773710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.774805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.775484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.798436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] HTTP exception thrown: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Request method failure captured: Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 HTTP/1.1 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-czqaIECDQSUiX0eqItLahT-h_AOAiRvLWJ3TswTm6d4hdXt481qsL2bAPk8hsZKMIJ3R3LanTEwn1bEdv759qdtjevMxBW3-EQIomXYYbszpfTrjHYuXMH7-KS85lSSqdx9NRVRQMAVEldcX2UOU3vAT-ZWbP983rZpPH-SFyW58Y Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48f50f35cbe74ea4b2ac1a7795c00dcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 48f50f35cbe74ea4b2ac1a7795c00dcd Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesTestJSON-1837102047 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 857b0f5f4fdc4b1faeae0e0770d65125 Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesTestJSON-1837102047-project Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '802119d0-f33f-421a-910a-9a78e05406a6'} Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.802818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:06.807379 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:06.807379 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:06.807379 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:06.807379 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:06.807379 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. Oct 31 15:24:06.807379 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:06.818665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:06.820068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] Returning 404 to user: Instance 802119d0-f33f-421a-910a-9a78e05406a6 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:06.822381 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-177417d2-109f-4f33-9717-6e855d086e97 tempest-ImagesTestJSON-1837102047 tempest-ImagesTestJSON-1837102047-project] 10.222.0.48 "GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6" status: 404 len: 111 microversion: 2.1 time: 0.064747 Oct 31 15:24:06.827827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1162/2402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/servers/802119d0-f33f-421a-910a-9a78e05406a6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:06.839180 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74af7bfc-c63e-43f3-8028-b25ee64e875e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.639364 Oct 31 15:24:06.839529 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1241/2403] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:07.530586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:07.532354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:07.571806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.573326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.575060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.610619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.619730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.626571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.662596 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 HTTP/1.1 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3'} Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:07.664477 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:07.668818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:07.676395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:07.677653 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90a95671-9b35-44f2-a346-34cbacceebf9 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 404 len: 111 microversion: 2.1 time: 0.157102 Oct 31 15:24:07.678797 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1163/2404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:07 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:07.694849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0635ec9-b899-42c6-9769-8f16c18d9123 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca16c3a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:07.865762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:07.866385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:07.872870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.873668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.874763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.875813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.876509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.877172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:08.553562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:08.561966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c6d6b82-df74-479c-a7ea-1af726afb73b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.700465 Oct 31 15:24:08.578226 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0635ec9-b899-42c6-9769-8f16c18d9123 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7" status: 202 len: 0 microversion: 2.1 time: 0.891233 Oct 31 15:24:08.579656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1242/2405] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:07 2022] DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7 => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:08.585083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47a838c5-7c0b-41d0-9cc9-866128933ddc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca66be9d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:08.589146 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1164/2406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:07 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:09.613706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:09.616067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:09.649434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:09.650655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:09.655398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:09.660852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:09.663505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:09.666287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.519623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:10.523648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47a838c5-7c0b-41d0-9cc9-866128933ddc tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3" status: 202 len: 0 microversion: 2.1 time: 1.942662 Oct 31 15:24:10.533657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1243/2407] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:08 2022] DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3 => generated 0 bytes in 1953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:10.539336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8d6ff69-e50d-4902-aa34-c75a37e1f66d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.950700 Oct 31 15:24:10.539764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:10.540200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:10.540623 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1165/2408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:09 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:10.555025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ebfe0032-dbee-441b-95d3-2e9f9904f867 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'create', calling method: .version_select at 0x7f5ca1d069d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-427825595", "description": "tempest-description-725499812"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:10.559060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:10.559557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:10.568386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.569218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:10.569705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:10.570144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.643491 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ebde4fb-e022-4316-b6a4-e9494c77d00c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/ips" status: 200 len: 146 microversion: 2.1 time: 0.108092 Oct 31 15:24:10.649875 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1244/2409] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:24:10 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/ips => generated 146 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:11.568097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.569041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.575894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.576513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.580220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.581498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.582430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.583180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.966375 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ebfe0032-dbee-441b-95d3-2e9f9904f867 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.424088 Oct 31 15:24:11.967525 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1166/2410] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:24:10 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:11.981704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2daab61-df91-4eaf-afd1-e21e49f0af3b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Action: 'update', calling method: .version_select at 0x7f5ca178f8b0>, body: {"security_group": {"name": "tempest-sg-hth-876539244", "description": "tempest-description-hth-1594403307"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:13.074411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:13.091885 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c11aebc9-7136-4a6b-86ca-e48e5422efcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 1.528296 Oct 31 15:24:13.092483 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1245/2411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:11 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:14.116186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:14.117047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:14.124647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:14.125195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:14.125664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:14.126372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:14.126832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:14.136456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:14.240479 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2daab61-df91-4eaf-afd1-e21e49f0af3b tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/8d5175ae-0958-475c-9d1a-6d9e11f978f7" status: 200 len: 217 microversion: 2.1 time: 2.261696 Oct 31 15:24:14.241052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1167/2412] 10.222.0.48 () {60 vars in 1290 bytes} [Mon Oct 31 15:24:11 2022] PUT /compute/v2.1/os-security-groups/8d5175ae-0958-475c-9d1a-6d9e11f978f7 => generated 217 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:14.255606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4e727b0-3490-42aa-b39f-75e0b60d96ec tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca178f430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:14.500126 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4e727b0-3490-42aa-b39f-75e0b60d96ec tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/8d5175ae-0958-475c-9d1a-6d9e11f978f7" status: 200 len: 217 microversion: 2.1 time: 0.249407 Oct 31 15:24:14.501451 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1168/2413] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:24:14 2022] GET /compute/v2.1/os-security-groups/8d5175ae-0958-475c-9d1a-6d9e11f978f7 => generated 217 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:14.517613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a49b6b7-20f1-41d0-8947-d23211b4f13a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca1d4ea60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:15.236072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:15.244056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24075cf8-e152-4592-9670-0c54e217a625 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 1.131624 Oct 31 15:24:15.244638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1246/2414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:14 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:15.747009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661cb803-288c-4a1e-991b-ced5278e477e"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:15.750647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:15.764321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.765341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.769838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.770781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.771445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.772438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.307322 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed4eaa72-aee8-4af5-bf0b-2c0f4f5aa100 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.565207 Oct 31 15:24:16.317183 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1247/2415] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:24:15 2022] POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-volume_attachments => generated 194 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:24:16.419572 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a49b6b7-20f1-41d0-8947-d23211b4f13a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8d5175ae-0958-475c-9d1a-6d9e11f978f7" status: 202 len: 0 microversion: 2.1 time: 1.907432 Oct 31 15:24:16.424522 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1169/2416] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:14 2022] DELETE /compute/v2.1/os-security-groups/8d5175ae-0958-475c-9d1a-6d9e11f978f7 => generated 0 bytes in 1914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:16.429666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:16.430884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:16.445536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.450732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.452192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.453142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.454841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.455649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.530757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:16.716925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1665052846", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6727c5f5-58d2-45cd-b183-ceb4c1501ff0"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:16.825844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] validate_networks() for [('6727c5f5-58d2-45cd-b183-ceb4c1501ff0', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:17.575331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:17.589854 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb0e69f8-69d6-48ac-82d2-4577b187130b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 1.163962 Oct 31 15:24:17.590778 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1170/2417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:16 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:17.595987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.596488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:17.628576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.629127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.629570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.630290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.630735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.631153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.677641 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 HTTP/1.1 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3'} Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:17.687523 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.692922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.695055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:17.696118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c110ec6-1f3a-4247-ab2f-756929c0fa95 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 404 len: 111 microversion: 2.1 time: 0.104324 Oct 31 15:24:17.696913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1171/2418] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:17 2022] DELETE /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:17.707315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.708387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:17.716953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.717760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.718421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.719957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.720942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.721608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.739642 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 HTTP/1.1 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3'} Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.741624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. Oct 31 15:24:17.745036 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.746954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Instance 9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:17.748006 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-482ca24e-b990-4601-862d-fb1ff252fe89 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3" status: 404 len: 111 microversion: 2.1 time: 0.046376 Oct 31 15:24:17.752069 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1172/2419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:17 2022] GET /compute/v2.1/servers/9d76b1ed-bd5b-4199-bc66-d35ec2b5f1d3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:24:17.759445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca174f280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.922332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:17.923329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 984d5fa5-08ff-436b-a736-962f6546a0b3 not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:24:17.924980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.924980 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3 HTTP/1.1 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '984d5fa5-08ff-436b-a736-962f6546a0b3'} Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:17.926226 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 984d5fa5-08ff-436b-a736-962f6546a0b3 does not exist Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-e04b08c3-e218-4347-99d1-6054764013e6'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:17.930578 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3d82166-0125-4350-8e2a-a66aa363acc5 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3" status: 404 len: 194 microversion: 2.1 time: 0.172881 Oct 31 15:24:17.935728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1173/2420] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:17 2022] DELETE /compute/v2.1/os-security-groups/984d5fa5-08ff-436b-a736-962f6546a0b3 => generated 194 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:17.944064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca17a7f70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:18.146536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:18.147569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:18.148887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:18.149560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:18.150512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:18.177959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:18.181996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:18.182453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:18.216137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:18.236906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:18.237748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:18.316454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:18.329981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:18.330859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group dc29609f-efcd-4c2d-9635-a453caf930b7 not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:24:18.332750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.332750 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7 HTTP/1.1 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'dc29609f-efcd-4c2d-9635-a453caf930b7'} Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:18.335282 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] Oct 31 15:24:18.338642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.341613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group dc29609f-efcd-4c2d-9635-a453caf930b7 does not exist Oct 31 15:24:18.341613 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-a3f68d34-123d-4dba-8c0b-5b1e231275ac'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:18.351527 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6eb2ae51-5e47-4b04-802b-961ce544fde7 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7" status: 404 len: 194 microversion: 2.1 time: 0.412380 Oct 31 15:24:18.360042 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1174/2421] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:17 2022] DELETE /compute/v2.1/os-security-groups/dc29609f-efcd-4c2d-9635-a453caf930b7 => generated 194 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:18.368793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Getting quotas for project 8f774210319947aebe01e092c910c109. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:18.376163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca174f4c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:18.421963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Getting quotas for user d7d61f32816347ef8ea82dde24d6549d and project 8f774210319947aebe01e092c910c109. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:18.485688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Going to run 3 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:24:18.494577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:18.502888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:18.503703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 7f4f3266-0a95-46cc-b19c-8df1702da59a not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:24:18.504408 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.504408 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a HTTP/1.1 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '7f4f3266-0a95-46cc-b19c-8df1702da59a'} Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:18.506545 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] Oct 31 15:24:18.510274 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.515101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 7f4f3266-0a95-46cc-b19c-8df1702da59a does not exist Oct 31 15:24:18.515101 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-0febe479-04fd-4a1b-984b-a989a1923830'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:18.516909 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f157dac-4c13-465a-9772-2a47140aaeaa tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a" status: 404 len: 194 microversion: 2.1 time: 0.150437 Oct 31 15:24:18.517668 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1175/2422] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:18 2022] DELETE /compute/v2.1/os-security-groups/7f4f3266-0a95-46cc-b19c-8df1702da59a => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:18.526126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca17a7dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:18.624418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=b0356675-eb87-40d1-9c1d-dcae31785320,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:18.734239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:18.786401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:18.787935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 79b7b1f6-17d9-4670-a619-ef8220095662 not found {{(pid=120626) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:24:18.788656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.788656 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662 HTTP/1.1 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '79b7b1f6-17d9-4670-a619-ef8220095662'} Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:18.798458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] Oct 31 15:24:18.802967 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:18.804986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 79b7b1f6-17d9-4670-a619-ef8220095662 does not exist Oct 31 15:24:18.804986 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-b1e893f7-be38-496f-8130-b8444b76464c'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:18.804986 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-994ef1aa-4e58-4e54-a90f-79cc6f095679 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662" status: 404 len: 194 microversion: 2.1 time: 0.282902 Oct 31 15:24:18.805389 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1176/2423] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:18 2022] DELETE /compute/v2.1/os-security-groups/79b7b1f6-17d9-4670-a619-ef8220095662 => generated 194 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:24:18.830941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:18.837158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:18.862370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:18.886036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:18.886516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:18.887283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:18.887740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:18.888234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:19.033513 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3a856a0-7a5c-4d12-bd97-d73828ef9cd3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.714561 Oct 31 15:24:19.034601 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1248/2424] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:24:19.040656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca66bee50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:19.233892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:19.235242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:24:19.236010 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.236010 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28 HTTP/1.1 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '6e41961f-8d5f-4590-bca0-7ac3d660dd28'} Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:19.238651 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] Oct 31 15:24:19.242398 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.245874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group 6e41961f-8d5f-4590-bca0-7ac3d660dd28 does not exist Oct 31 15:24:19.245874 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-3c29fc47-b637-4538-aec2-1aca4af19b3c'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:19.247058 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-baa1a22e-0fae-4372-9ad0-bf24743fe140 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28" status: 404 len: 194 microversion: 2.1 time: 0.210893 Oct 31 15:24:19.248400 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1249/2425] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:19 2022] DELETE /compute/v2.1/os-security-groups/6e41961f-8d5f-4590-bca0-7ac3d660dd28 => generated 194 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:19.253270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:19.292444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:19.295770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:24:19.391926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:19.399748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:19.400395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:19.402850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:19.404758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:19.412442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:19.515220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-705ff4e4-6621-46d9-831b-08027d57357e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.265469 Oct 31 15:24:19.516982 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1250/2426] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:24:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:19.527138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca66be160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:19.826607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:24:19.827511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Neutron security group b72cd018-2437-4431-b4a5-86acf593642c not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:24:19.828928 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.828928 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c HTTP/1.1 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b72cd018-2437-4431-b4a5-86acf593642c'} Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:24:19.831570 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] Oct 31 15:24:19.835283 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.840483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Security group b72cd018-2437-4431-b4a5-86acf593642c does not exist Oct 31 15:24:19.840483 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-4b1bf6f2-ae01-477e-b99d-8b28d26fa84e'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:19.841651 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-968aeb99-0c6e-4e05-afbe-b5d2f4538e3a tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c" status: 404 len: 194 microversion: 2.1 time: 0.323456 Oct 31 15:24:19.842728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1251/2427] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:19 2022] DELETE /compute/v2.1/os-security-groups/b72cd018-2437-4431-b4a5-86acf593642c => generated 194 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:19.861355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ea88468-552f-4f58-b7eb-0db7e5e20e2b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:19.863943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ea88468-552f-4f58-b7eb-0db7e5e20e2b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:20.135491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:20.153000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-735afd93-1555-40ae-8aa3-87e44302e429 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 1.332069 Oct 31 15:24:20.153970 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1177/2428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:18 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:20.158252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ea88468-552f-4f58-b7eb-0db7e5e20e2b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:20.166273 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ea88468-552f-4f58-b7eb-0db7e5e20e2b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1223 microversion: 2.1 time: 0.320913 Oct 31 15:24:20.171107 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1252/2429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:19 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1223 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:20.175311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:20.184233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:20.198648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.205846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.207022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.207858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.211622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.212221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.305922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:20.594992 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c458c9d4-e29a-475f-a4c2-949de558f520 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 204 len: 0 microversion: 2.1 time: 0.427046 Oct 31 15:24:20.595793 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1178/2430] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:20 2022] DELETE /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:20.604228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:20.605439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:20.618010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.628490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.629214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.631122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.633231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.636567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.182530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:21.183739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:21.202129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.203204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.203880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.204803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.205412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.206014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.539282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:21.551642 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d2844f5-9731-43ba-8b5e-d757224d43bd tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1646 microversion: 2.1 time: 0.950262 Oct 31 15:24:21.554263 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1253/2431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:20 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1646 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:21.585899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:21.588095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:21.613037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.617749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.619044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.620556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.622399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.627591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.911311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:21.930706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-045da57f-d6c6-4d0a-8728-18bef652ddcb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 0.753332 Oct 31 15:24:21.934528 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1179/2432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:21 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:22.046712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:22.068997 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bba9e413-e41d-45b0-9c7b-625171063655 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1227 microversion: 2.1 time: 0.511134 Oct 31 15:24:22.071285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1254/2433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:21 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1227 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:22.581115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:22.581721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:22.598249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.598761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.599207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.599926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.600389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.600845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.959198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:22.961251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:22.980061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.981905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.982618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.990296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.992760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.993889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:24.996480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d88b532854b4ebd5a1e8e49cbf888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b9c3a3de944b7b9514568f43b3ae3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:25.015898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e45a1662-0486-4b89-a8e0-3dba5c2a56e4 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 200 len: 1646 microversion: 2.1 time: 2.439126 Oct 31 15:24:25.018472 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1180/2434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:22 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 1646 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:25.040968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:25.044831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:25.067552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.068540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.070481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.073327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.075692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.076322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.661645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:25.674191 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b20491a0-64d5-4c1f-a4b4-08202a6ad6a7 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1508 microversion: 2.1 time: 2.719897 Oct 31 15:24:25.683673 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1255/2435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:22 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1508 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:25.797938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-770426540", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bedd7a33-4e02-41d8-bd84-cfb19551ccc2"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:25.864689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] validate_networks() for [('bedd7a33-4e02-41d8-bd84-cfb19551ccc2', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:26.886768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:26.915131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c5e36e53-9ad5-4c91-a35d-0c8207f77282 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1323 microversion: 2.1 time: 1.888479 Oct 31 15:24:26.915791 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1181/2436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:25 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1323 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:26.930230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5cb09ce2-855c-48f4-bcbf-20da42395bd3 req-5605e7a7-05fc-4eb5-a3f3-4038be7278ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f4e853-a36d-41be-82f4-3163f2be49c3", "name": "network-vif-deleted", "tag": "731fe297-5f66-48ea-bf35-7ef13c2e7528"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:26.958357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5cb09ce2-855c-48f4-bcbf-20da42395bd3 req-5605e7a7-05fc-4eb5-a3f3-4038be7278ed service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:26.961733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5cb09ce2-855c-48f4-bcbf-20da42395bd3 req-5605e7a7-05fc-4eb5-a3f3-4038be7278ed service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:26.965485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5cb09ce2-855c-48f4-bcbf-20da42395bd3 req-5605e7a7-05fc-4eb5-a3f3-4038be7278ed service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.002504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5cb09ce2-855c-48f4-bcbf-20da42395bd3 req-5605e7a7-05fc-4eb5-a3f3-4038be7278ed service nova] Creating event network-vif-deleted:731fe297-5f66-48ea-bf35-7ef13c2e7528 for instance a4f4e853-a36d-41be-82f4-3163f2be49c3 on n-h1-858383-17 Oct 31 15:24:27.018098 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5cb09ce2-855c-48f4-bcbf-20da42395bd3 req-5605e7a7-05fc-4eb5-a3f3-4038be7278ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099293 Oct 31 15:24:27.024171 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1182/2437] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:27.037082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:27.040862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] [instance: a4f4e853-a36d-41be-82f4-3163f2be49c3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:27.061019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.064312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.065896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.068124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.075841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.077691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.140526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] HTTP exception thrown: Instance a4f4e853-a36d-41be-82f4-3163f2be49c3 could not be found. Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Request method failure captured: Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 HTTP/1.1 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-g_1uZv6UG-5dP5e4E5qswQReA5fxAH3LRfhx4DNyBZjKwDG7araikUX5CDv0NCbM0wppG_Lez0ZYyU2SM-bmCY1j3qRdZsptbQ9mefuXfv3HesyGLysCmLDhaIv0D9B6sGjztPovkOkrpFTypaGrZ-2xSIyLCP7qqToue7IDJz5rA Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c1b9c3a3de944b7b9514568f43b3ae3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c1b9c3a3de944b7b9514568f43b3ae3e Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-275981534 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0d2d88b532854b4ebd5a1e8e49cbf888 Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsTestJSON-275981534-project Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a4f4e853-a36d-41be-82f4-3163f2be49c3 could not be found. Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a4f4e853-a36d-41be-82f4-3163f2be49c3'} Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f4e853-a36d-41be-82f4-3163f2be49c3 could not be found. Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f4e853-a36d-41be-82f4-3163f2be49c3 could not be found. Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:27.143563 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f4e853-a36d-41be-82f4-3163f2be49c3 could not be found. Oct 31 15:24:27.147790 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:27.150992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Returning 404 to user: Instance a4f4e853-a36d-41be-82f4-3163f2be49c3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:27.153620 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a44d716b-c84f-454c-8706-f129f9902869 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3" status: 404 len: 111 microversion: 2.1 time: 0.126453 Oct 31 15:24:27.154762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1183/2438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:27 2022] GET /compute/v2.1/servers/a4f4e853-a36d-41be-82f4-3163f2be49c3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:27.171647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:27.176417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:27.178579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:27.200333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.200889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.201323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.202838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.203464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.203964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.741896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:28.754419 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2c7b9bd-6c2a-4b77-9c75-fd752c4aaab0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1529 microversion: 2.1 time: 1.598232 Oct 31 15:24:28.755355 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1184/2439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:27 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1529 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:28.765001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-24a0a849-0085-4124-a4a1-978db588f9ee tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca1d4e1f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:29.376927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:29.378170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:29.378664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:29.379079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:29.382261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:29.402080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.402577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.403020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.404068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.404502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.404975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.457740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Getting quotas for project 571c0706237341a78eed8885e94bd7aa. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:29.470307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Getting quotas for user 93317ff2aea5495e991052a36e3f0c5e and project 571c0706237341a78eed8885e94bd7aa. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:29.486628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:24:29.489202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:29.564003 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fdb3a83-e00e-4ab1-b6d1-ec5b24724931 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.878146 Oct 31 15:24:29.570715 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1256/2440] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:24:29.576196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0e875b5e-47bc-482d-bf64-723033e43334 req-563b9553-6bd3-4926-a924-7618b363c553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ee1145-b3f9-4bb4-8929-85764de8935b", "tag": "27437b5b-1e5e-4695-8cce-634cc55f4d4a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:29.593117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e875b5e-47bc-482d-bf64-723033e43334 req-563b9553-6bd3-4926-a924-7618b363c553 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.593790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e875b5e-47bc-482d-bf64-723033e43334 req-563b9553-6bd3-4926-a924-7618b363c553 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.595006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e875b5e-47bc-482d-bf64-723033e43334 req-563b9553-6bd3-4926-a924-7618b363c553 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.608240 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0e875b5e-47bc-482d-bf64-723033e43334 req-563b9553-6bd3-4926-a924-7618b363c553 service nova] Creating event network-changed:27437b5b-1e5e-4695-8cce-634cc55f4d4a for instance d8ee1145-b3f9-4bb4-8929-85764de8935b on n-h2-858383-17 Oct 31 15:24:29.614662 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0e875b5e-47bc-482d-bf64-723033e43334 req-563b9553-6bd3-4926-a924-7618b363c553 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048393 Oct 31 15:24:29.620468 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1257/2441] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:29.738308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-990656802", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a894f4b9-7bb9-45b6-b49f-684d8b80987a"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:29.890858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] validate_networks() for [('a894f4b9-7bb9-45b6-b49f-684d8b80987a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:31.137565 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-24a0a849-0085-4124-a4a1-978db588f9ee tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8fcfede5-b92c-490f-9a34-8ff0eda108d6" status: 202 len: 0 microversion: 2.1 time: 2.380723 Oct 31 15:24:31.139390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1185/2442] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:28 2022] DELETE /compute/v2.1/os-security-groups/8fcfede5-b92c-490f-9a34-8ff0eda108d6 => generated 0 bytes in 2383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:31.146916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:31.147869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:31.171913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.173468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.175378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.187980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.189755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.191056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.742748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:32.754891 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e706f83a-ece8-4e28-a3ea-dd961448df29 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1323 microversion: 2.1 time: 1.614077 Oct 31 15:24:32.761598 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1186/2443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:31 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1323 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:32.770189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:32.772283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:32.788767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.790062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.790752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.793700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.796462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.799147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.926809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:32.940721 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d12d05ed-2f7c-4fc5-9283-3ba44924ff50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1289 microversion: 2.1 time: 0.177514 Oct 31 15:24:32.942543 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1187/2444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:32 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:32.952372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:32.955225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:32.970510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.972715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.976320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.977486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.979285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.981526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:33.643823 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:24:33.644352 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 15:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 31 15:24:34.789091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:34.789622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:34.789978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:34.791266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:34.796256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:34.812601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.815418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.816081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.817382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.820967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.821631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.840911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:34.870840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:34.886974 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-476c5040-d43c-4f4d-b8a8-df8b1f4b7ac3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1524 microversion: 2.1 time: 1.943037 Oct 31 15:24:34.896666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:34.897928 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1188/2445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:32 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1524 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:34.903867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-849469bc-9aa4-4371-b0ba-6aaeba9a3462 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] Calling method '.version_select at 0x7f5ca1d06dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:34.933152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for user 847c3c51ceb3406eb86b222c4638fc59 and project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:34.966570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:24:34.969097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:35.064408 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36134920-89c7-4aed-8a73-34cdf6db189c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.441929 Oct 31 15:24:35.073061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1258/2446] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:24:35.081902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:35.097706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:35.129762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:35.132337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:35.135332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:35.136832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:35.139835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:35.143774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.167566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:36.177372 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55c6ad32-ec8d-421f-a337-81fb3be0a2a5 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1323 microversion: 2.1 time: 1.101695 Oct 31 15:24:36.177961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1259/2447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:35 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1323 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:36.201573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f22adcf3-dacf-46f0-9786-89bb7906ad81 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:36.226677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22adcf3-dacf-46f0-9786-89bb7906ad81 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.237553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22adcf3-dacf-46f0-9786-89bb7906ad81 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.238275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f22adcf3-dacf-46f0-9786-89bb7906ad81 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.308057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f22adcf3-dacf-46f0-9786-89bb7906ad81 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:24:36.487985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f22adcf3-dacf-46f0-9786-89bb7906ad81 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action" status: 202 len: 0 microversion: 2.1 time: 0.291344 Oct 31 15:24:36.488708 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1260/2448] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:24:36 2022] POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:36.502401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:36.503128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:36.528248 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-849469bc-9aa4-4371-b0ba-6aaeba9a3462 tempest-SecurityGroupsTestJSON-275981534 tempest-SecurityGroupsTestJSON-275981534-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ed84da4e-bc37-498c-aef3-8f2bdb850a66" status: 202 len: 0 microversion: 2.1 time: 1.628996 Oct 31 15:24:36.529398 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1189/2449] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:24:34 2022] DELETE /compute/v2.1/os-security-groups/ed84da4e-bc37-498c-aef3-8f2bdb850a66 => generated 0 bytes in 1631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:36.539030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.547181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.548389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.557735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.558437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.558885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.817604 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1a249de-0f17-4f95-be4a-89f989a9a62d tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] 10.222.0.48 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.287018 Oct 31 15:24:36.818600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1190/2450] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Oct 31 15:24:36 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:24:36.851975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:36.852680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:36.877092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.877502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.877934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.882168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.882993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.883645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.876603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:37.904673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6c7331e-e57b-42a3-9d64-56f97653a249 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1206 microversion: 2.1 time: 1.084511 Oct 31 15:24:37.913467 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1191/2451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:36 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1206 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:37.919744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-26395c84-09c4-4949-8905-902ac4611287 req-6853ec9b-0485-4a92-9393-613a4cbd70c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a", "tag": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:37.933262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-26395c84-09c4-4949-8905-902ac4611287 req-6853ec9b-0485-4a92-9393-613a4cbd70c4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.933976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-26395c84-09c4-4949-8905-902ac4611287 req-6853ec9b-0485-4a92-9393-613a4cbd70c4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.934554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-26395c84-09c4-4949-8905-902ac4611287 req-6853ec9b-0485-4a92-9393-613a4cbd70c4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.952388 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-26395c84-09c4-4949-8905-902ac4611287 req-6853ec9b-0485-4a92-9393-613a4cbd70c4 service nova] Creating event network-changed:0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 for instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a on n-h2-858383-17 Oct 31 15:24:37.958810 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-26395c84-09c4-4949-8905-902ac4611287 req-6853ec9b-0485-4a92-9393-613a4cbd70c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043910 Oct 31 15:24:37.965104 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1192/2452] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:37.972140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:37.973292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:37.981548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.982400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.983370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.984246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.985424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.986004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.364076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:39.373502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11cba615-87a6-4875-91a7-cc536d469ab4 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1331 microversion: 2.1 time: 2.883541 Oct 31 15:24:39.376559 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1261/2453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:36 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1331 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:39.385802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-180f1b26-6c34-4528-8296-ae52bc53ee96 req-aaa197bb-7a99-4fd5-9333-6b96abbfbc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa22140e-0ab8-4cca-9dd5-469cbb78cd14", "name": "network-vif-plugged", "status": "completed", "tag": "eaf8c73a-01f1-435c-95df-a26934141340"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:39.418633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-180f1b26-6c34-4528-8296-ae52bc53ee96 req-aaa197bb-7a99-4fd5-9333-6b96abbfbc1b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.421237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-180f1b26-6c34-4528-8296-ae52bc53ee96 req-aaa197bb-7a99-4fd5-9333-6b96abbfbc1b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.421905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-180f1b26-6c34-4528-8296-ae52bc53ee96 req-aaa197bb-7a99-4fd5-9333-6b96abbfbc1b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.448249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-180f1b26-6c34-4528-8296-ae52bc53ee96 req-aaa197bb-7a99-4fd5-9333-6b96abbfbc1b service nova] Creating event network-vif-plugged:eaf8c73a-01f1-435c-95df-a26934141340 for instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 on n-h2-858383-17 Oct 31 15:24:39.458030 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-180f1b26-6c34-4528-8296-ae52bc53ee96 req-aaa197bb-7a99-4fd5-9333-6b96abbfbc1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079901 Oct 31 15:24:39.464792 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1262/2454] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:39.471396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.481120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:39.494842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.495727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.496454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.497563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.499521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.500530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.631320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:39.657311 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-83b68d57-00fb-40e4-8378-f32d86960c79 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1524 microversion: 2.1 time: 1.689948 Oct 31 15:24:39.658875 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1193/2455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:37 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1524 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:39.673715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-99560d21-f531-42de-a870-ad84d02f411b req-52e74caa-a4d4-45b5-bcc0-671d3e7bec42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0356675-eb87-40d1-9c1d-dcae31785320", "tag": "7113a062-16ba-4d83-9e62-57a99016fee8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:39.695079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-99560d21-f531-42de-a870-ad84d02f411b req-52e74caa-a4d4-45b5-bcc0-671d3e7bec42 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.696062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-99560d21-f531-42de-a870-ad84d02f411b req-52e74caa-a4d4-45b5-bcc0-671d3e7bec42 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.697030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-99560d21-f531-42de-a870-ad84d02f411b req-52e74caa-a4d4-45b5-bcc0-671d3e7bec42 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.730424 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-99560d21-f531-42de-a870-ad84d02f411b req-52e74caa-a4d4-45b5-bcc0-671d3e7bec42 service nova] Creating event network-changed:7113a062-16ba-4d83-9e62-57a99016fee8 for instance b0356675-eb87-40d1-9c1d-dcae31785320 on n-h1-858383-17 Oct 31 15:24:39.792378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-99560d21-f531-42de-a870-ad84d02f411b req-52e74caa-a4d4-45b5-bcc0-671d3e7bec42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130487 Oct 31 15:24:39.794767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1194/2456] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:39.817348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-66c2383f-8ee1-4cc6-9806-04454e94a316 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Calling method '.version_select at 0x7f5ca230c820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.877398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-66c2383f-8ee1-4cc6-9806-04454e94a316 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] HTTP exception thrown: Image not found. Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-66c2383f-8ee1-4cc6-9806-04454e94a316 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Request method failure captured: Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ixLiwFemannN4fnpBT1Db5DxtT0kTuHaEpOymFCA7WuogSS9PKjr5QY0QFZ87VcRUsuH7E-NpmNpTkRys0zHFzcAWLRox32uHJ6PfEPEcpPNDcwhG8LituTuQZ9G8SrU8fQDCr0QdLOsfCriBGDLhG9g4KpwDHeliqMrkNwFJqPHQ Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bba6c97299c41139a24da51c42e0223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3e4f300e965d458eaf3bab5a75248519 Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '-1'} Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.880895 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:39.884546 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:39.893018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-66c2383f-8ee1-4cc6-9806-04454e94a316 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:39.895207 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-66c2383f-8ee1-4cc6-9806-04454e94a316 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] 10.222.0.48 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.098953 Oct 31 15:24:39.900337 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1195/2457] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Oct 31 15:24:39 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:39.912277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.913658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:39.928767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.930166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.933011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.934350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.935547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.936354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:40.899822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:40.919906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cbc1c84a-fdba-4613-95b6-8b64b04fb1b2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1323 microversion: 2.1 time: 1.017159 Oct 31 15:24:40.921520 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1196/2458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:39 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1323 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:40.933168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:40.934186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:40.943810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:40.944635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:40.945323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:40.946336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:40.947837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:40.948474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:40.978344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:41.087476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:41.102682 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84c2740e-f041-4d12-a310-bee3762c5f9e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 1.635504 Oct 31 15:24:41.103292 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1263/2459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:39 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:41.108130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f8b68d4-ff90-43ea-a396-a2aa4812fec3 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Calling method '.version_select at 0x7f5ca16715e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:41.143851 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2f8b68d4-ff90-43ea-a396-a2aa4812fec3 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] HTTP exception thrown: Image not found. Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f8b68d4-ff90-43ea-a396-a2aa4812fec3 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Request method failure captured: Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/11bab8c2-98df-4770-8322-5ff93217d22j HTTP/1.1 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ixLiwFemannN4fnpBT1Db5DxtT0kTuHaEpOymFCA7WuogSS9PKjr5QY0QFZ87VcRUsuH7E-NpmNpTkRys0zHFzcAWLRox32uHJ6PfEPEcpPNDcwhG8LituTuQZ9G8SrU8fQDCr0QdLOsfCriBGDLhG9g4KpwDHeliqMrkNwFJqPHQ Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bba6c97299c41139a24da51c42e0223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3e4f300e965d458eaf3bab5a75248519 Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '11bab8c2-98df-4770-8322-5ff93217d22j'} Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 11bab8c2-98df-4770-8322-5ff93217d22j to delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 11bab8c2-98df-4770-8322-5ff93217d22j could not be found. Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:41.145767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f8b68d4-ff90-43ea-a396-a2aa4812fec3 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:41.150170 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f8b68d4-ff90-43ea-a396-a2aa4812fec3 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] 10.222.0.48 "DELETE /compute/v2.1/images/11bab8c2-98df-4770-8322-5ff93217d22j" status: 404 len: 62 microversion: 2.1 time: 0.043835 Oct 31 15:24:41.157864 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1264/2460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:41 2022] DELETE /compute/v2.1/images/11bab8c2-98df-4770-8322-5ff93217d22j => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:41.165421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:41.166379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:41.179263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:41.180605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:41.181233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:41.182308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:41.182961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:41.183552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.396089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:42.410360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8298cf33-bcfb-4f41-8119-905700d4279d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 1.483072 Oct 31 15:24:42.411158 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1197/2461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:40 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:42.428105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.431317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:42.444459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.447524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.448008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.448776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.449253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.449683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.561849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:42.575126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a88ace81-34a7-456d-a8ac-86c551eb14f2 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1331 microversion: 2.1 time: 1.415861 Oct 31 15:24:42.577236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1265/2462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:41 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1331 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:42.604969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a55a8caf-cf89-4382-8a26-e064bda774d9 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Calling method '.version_select at 0x7f5ca1671ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.660125 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a55a8caf-cf89-4382-8a26-e064bda774d9 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] HTTP exception thrown: Image not found. Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a55a8caf-cf89-4382-8a26-e064bda774d9 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Request method failure captured: Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/d1db4400-a59e-427d-a6d0-d6fa3d621daf1 HTTP/1.1 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ixLiwFemannN4fnpBT1Db5DxtT0kTuHaEpOymFCA7WuogSS9PKjr5QY0QFZ87VcRUsuH7E-NpmNpTkRys0zHFzcAWLRox32uHJ6PfEPEcpPNDcwhG8LituTuQZ9G8SrU8fQDCr0QdLOsfCriBGDLhG9g4KpwDHeliqMrkNwFJqPHQ Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bba6c97299c41139a24da51c42e0223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3e4f300e965d458eaf3bab5a75248519 Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd1db4400-a59e-427d-a6d0-d6fa3d621daf1'} Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d1db4400-a59e-427d-a6d0-d6fa3d621daf1 to delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1db4400-a59e-427d-a6d0-d6fa3d621daf1 could not be found. Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:42.664077 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:42.668344 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:42.673344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a55a8caf-cf89-4382-8a26-e064bda774d9 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:42.674441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a55a8caf-cf89-4382-8a26-e064bda774d9 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] 10.222.0.48 "DELETE /compute/v2.1/images/d1db4400-a59e-427d-a6d0-d6fa3d621daf1" status: 404 len: 62 microversion: 2.1 time: 0.074935 Oct 31 15:24:42.680898 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1266/2463] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:42 2022] DELETE /compute/v2.1/images/d1db4400-a59e-427d-a6d0-d6fa3d621daf1 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:42.689528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f508b0fe-d6e6-4989-8f55-15aea3a7d83d req-2a77d57a-0daf-47be-85c1-4dc1ed00381b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ee1145-b3f9-4bb4-8929-85764de8935b", "name": "network-vif-plugged", "status": "completed", "tag": "27437b5b-1e5e-4695-8cce-634cc55f4d4a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:42.711063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f508b0fe-d6e6-4989-8f55-15aea3a7d83d req-2a77d57a-0daf-47be-85c1-4dc1ed00381b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.711815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f508b0fe-d6e6-4989-8f55-15aea3a7d83d req-2a77d57a-0daf-47be-85c1-4dc1ed00381b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.712410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f508b0fe-d6e6-4989-8f55-15aea3a7d83d req-2a77d57a-0daf-47be-85c1-4dc1ed00381b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.726640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f508b0fe-d6e6-4989-8f55-15aea3a7d83d req-2a77d57a-0daf-47be-85c1-4dc1ed00381b service nova] Creating event network-vif-plugged:27437b5b-1e5e-4695-8cce-634cc55f4d4a for instance d8ee1145-b3f9-4bb4-8929-85764de8935b on n-h2-858383-17 Oct 31 15:24:42.734312 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f508b0fe-d6e6-4989-8f55-15aea3a7d83d req-2a77d57a-0daf-47be-85c1-4dc1ed00381b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051820 Oct 31 15:24:42.738786 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1267/2464] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:42.759074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.759934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:42.784445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.785401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.786133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.788500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.790609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.791296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.091538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:43.106832 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12ff0e5d-e9ee-4695-8cfc-0bf3e64905de tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1524 microversion: 2.1 time: 0.692836 Oct 31 15:24:43.121096 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1198/2465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:42 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1524 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:43.143010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:43.144540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:43.150503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.151190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.152384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.153374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.154015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.154607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.454128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:43.469953 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ff639c7-6521-4f0c-9d94-c8733f478e62 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1323 microversion: 2.1 time: 0.729259 Oct 31 15:24:43.470545 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1268/2466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:42 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:43.477384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c74a904-9ad7-4fe2-8e33-9e1540ed1118 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Calling method '.version_select at 0x7f5ca67ff4c0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:43.522768 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0c74a904-9ad7-4fe2-8e33-9e1540ed1118 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] HTTP exception thrown: Image not found. Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c74a904-9ad7-4fe2-8e33-9e1540ed1118 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Request method failure captured: Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/images/tempest-invalid-1650635496 HTTP/1.1 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ixLiwFemannN4fnpBT1Db5DxtT0kTuHaEpOymFCA7WuogSS9PKjr5QY0QFZ87VcRUsuH7E-NpmNpTkRys0zHFzcAWLRox32uHJ6PfEPEcpPNDcwhG8LituTuQZ9G8SrU8fQDCr0QdLOsfCriBGDLhG9g4KpwDHeliqMrkNwFJqPHQ Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bba6c97299c41139a24da51c42e0223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3e4f300e965d458eaf3bab5a75248519 Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'tempest-invalid-1650635496'} Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1650635496 to delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1650635496 could not be found. Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.524648 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c74a904-9ad7-4fe2-8e33-9e1540ed1118 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0c74a904-9ad7-4fe2-8e33-9e1540ed1118 tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] 10.222.0.48 "DELETE /compute/v2.1/images/tempest-invalid-1650635496" status: 404 len: 62 microversion: 2.1 time: 0.052356 Oct 31 15:24:43.528342 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1269/2467] 10.222.0.48 () {58 vars in 1206 bytes} [Mon Oct 31 15:24:43 2022] DELETE /compute/v2.1/images/tempest-invalid-1650635496 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:43.532816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8cc1c2e8-0288-4c08-92ff-fa088addd3b5 req-b8600751-5a6e-43c2-8ac0-0fe8bd0ba74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7", "tag": "f0d1929f-65e5-476a-9fe7-fbc1a9e0e4ea"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:43.561449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8cc1c2e8-0288-4c08-92ff-fa088addd3b5 req-b8600751-5a6e-43c2-8ac0-0fe8bd0ba74a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.562145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8cc1c2e8-0288-4c08-92ff-fa088addd3b5 req-b8600751-5a6e-43c2-8ac0-0fe8bd0ba74a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.565470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8cc1c2e8-0288-4c08-92ff-fa088addd3b5 req-b8600751-5a6e-43c2-8ac0-0fe8bd0ba74a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.586455 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8cc1c2e8-0288-4c08-92ff-fa088addd3b5 req-b8600751-5a6e-43c2-8ac0-0fe8bd0ba74a service nova] Creating event network-changed:f0d1929f-65e5-476a-9fe7-fbc1a9e0e4ea for instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 on n-h1-858383-17 Oct 31 15:24:43.592235 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8cc1c2e8-0288-4c08-92ff-fa088addd3b5 req-b8600751-5a6e-43c2-8ac0-0fe8bd0ba74a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063508 Oct 31 15:24:43.593343 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1270/2468] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:43.612867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:43.614794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:43.625123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.633927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.635278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.637556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.638485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.639272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.661823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:43.678302 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-384266e8-d51d-4c37-93ad-1c28dbce8123 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.555957 Oct 31 15:24:43.689459 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1199/2469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:43 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:43.689459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-104ea17a-267a-42dd-a833-e72ab7836a9e tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Calling method '.version_select at 0x7f5ca230c820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:43.718641 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-104ea17a-267a-42dd-a833-e72ab7836a9e tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] HTTP exception thrown: Image not found. Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-104ea17a-267a-42dd-a833-e72ab7836a9e tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Request method failure captured: Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/images/2df1b623-3983-4852-a8c7-aa386a727cd7 HTTP/1.1 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ixLiwFemannN4fnpBT1Db5DxtT0kTuHaEpOymFCA7WuogSS9PKjr5QY0QFZ87VcRUsuH7E-NpmNpTkRys0zHFzcAWLRox32uHJ6PfEPEcpPNDcwhG8LituTuQZ9G8SrU8fQDCr0QdLOsfCriBGDLhG9g4KpwDHeliqMrkNwFJqPHQ Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1bba6c97299c41139a24da51c42e0223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1bba6c97299c41139a24da51c42e0223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 1bba6c97299c41139a24da51c42e0223 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3e4f300e965d458eaf3bab5a75248519 Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1887687646-project Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2df1b623-3983-4852-a8c7-aa386a727cd7'} Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2df1b623-3983-4852-a8c7-aa386a727cd7 to delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2df1b623-3983-4852-a8c7-aa386a727cd7 could not be found. Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.720581 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:43.724121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.726648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-104ea17a-267a-42dd-a833-e72ab7836a9e tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:43.727680 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-104ea17a-267a-42dd-a833-e72ab7836a9e tempest-ImagesDeleteNegativeTestJSON-1887687646 tempest-ImagesDeleteNegativeTestJSON-1887687646-project] 10.222.0.48 "DELETE /compute/v2.1/images/2df1b623-3983-4852-a8c7-aa386a727cd7" status: 404 len: 62 microversion: 2.1 time: 0.047466 Oct 31 15:24:43.728710 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1200/2470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:43 2022] DELETE /compute/v2.1/images/2df1b623-3983-4852-a8c7-aa386a727cd7 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:43.736278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:43.738773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:43.760418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.762163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.763190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.765727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.766786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.767221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.325099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:44.369281 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c842704c-f687-40c6-9870-336a8ff9dc68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.772948 Oct 31 15:24:44.381597 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1271/2471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:43 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:44.397502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:44.400172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:44.415875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.416778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.418225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.419144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.425710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.426086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.553824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:44.575218 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13974a1b-6ce0-4af6-b92f-06bbd342820e tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1331 microversion: 2.1 time: 0.845187 Oct 31 15:24:44.578827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1201/2472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:43 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1331 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:44.590287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:44.592331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:44.613830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.615784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.618181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.619654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.620139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.623092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.839098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:44.958430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=20 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:45.497392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:45.506353 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f8a6272-6290-419b-bfea-8ed55f7c7fce tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1524 microversion: 2.1 time: 1.121229 Oct 31 15:24:45.507345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1272/2473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:44 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1524 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:45.518859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:45.525544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:45.537869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.543392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.544250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:45.545567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.546672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.548133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:45.789138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:45.830580 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea17246a-552d-4e76-9ee5-c924d31707de tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 200 len: 1515 microversion: 2.1 time: 1.245743 Oct 31 15:24:45.831556 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1202/2474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:44 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 1515 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:45.847027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ba3d459d-bc8b-41eb-b3bd-9d2fc9a7b462 req-29da505c-08bd-4935-a2e8-27f5a2774d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a", "name": "network-vif-plugged", "status": "completed", "tag": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:45.860765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ba3d459d-bc8b-41eb-b3bd-9d2fc9a7b462 req-29da505c-08bd-4935-a2e8-27f5a2774d53 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.869460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ba3d459d-bc8b-41eb-b3bd-9d2fc9a7b462 req-29da505c-08bd-4935-a2e8-27f5a2774d53 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.871942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ba3d459d-bc8b-41eb-b3bd-9d2fc9a7b462 req-29da505c-08bd-4935-a2e8-27f5a2774d53 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:45.895757 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ba3d459d-bc8b-41eb-b3bd-9d2fc9a7b462 req-29da505c-08bd-4935-a2e8-27f5a2774d53 service nova] Creating event network-vif-plugged:0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 for instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a on n-h2-858383-17 Oct 31 15:24:45.903898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ba3d459d-bc8b-41eb-b3bd-9d2fc9a7b462 req-29da505c-08bd-4935-a2e8-27f5a2774d53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070616 Oct 31 15:24:45.905259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1203/2475] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:45.931192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:45.933086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:45.946829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.947584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.948428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:45.949397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.950019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.950638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.601770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:46.617952 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d61e0d9-5347-4212-a93a-22b569d74098 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 1.103147 Oct 31 15:24:46.635975 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1273/2476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:45 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:46.642879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:46.643758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:46.652085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.652657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.653232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.654023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.654553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.655059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.802673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:46.814744 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fd9e1f3d-2e86-4333-aa6c-26d370946fc6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.908042 Oct 31 15:24:46.818131 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1204/2477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:45 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:46.827334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:46.828247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:46.839676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.840303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.840765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.841654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.842291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.842874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.472645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:47.480493 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c56e73c-06e7-48eb-9f16-ad178965fe50 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1331 microversion: 2.1 time: 0.842975 Oct 31 15:24:47.495520 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1274/2478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:46 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1331 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:47.495520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-16eac0ca-8545-4211-b461-4465294d9c3e req-ec106b44-fd9c-4880-b032-ff25738a0ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e", "tag": "9708d710-440d-457d-abcf-a70ea42adc02"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:47.511787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-16eac0ca-8545-4211-b461-4465294d9c3e req-ec106b44-fd9c-4880-b032-ff25738a0ae7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.512272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-16eac0ca-8545-4211-b461-4465294d9c3e req-ec106b44-fd9c-4880-b032-ff25738a0ae7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.512722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-16eac0ca-8545-4211-b461-4465294d9c3e req-ec106b44-fd9c-4880-b032-ff25738a0ae7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.544554 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-16eac0ca-8545-4211-b461-4465294d9c3e req-ec106b44-fd9c-4880-b032-ff25738a0ae7 service nova] Creating event network-changed:9708d710-440d-457d-abcf-a70ea42adc02 for instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e on n-h1-858383-17 Oct 31 15:24:47.549938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-16eac0ca-8545-4211-b461-4465294d9c3e req-ec106b44-fd9c-4880-b032-ff25738a0ae7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063569 Oct 31 15:24:47.562142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1275/2479] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:47.824527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89eba792-443e-4901-adce-5fb07212e128 tempest-ListImageFiltersNegativeTestJSON-3855284 tempest-ListImageFiltersNegativeTestJSON-3855284-project] Calling method '.version_select at 0x7f5ca165e5e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:47.856795 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-89eba792-443e-4901-adce-5fb07212e128 tempest-ListImageFiltersNegativeTestJSON-3855284 tempest-ListImageFiltersNegativeTestJSON-3855284-project] HTTP exception thrown: Image not found. Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89eba792-443e-4901-adce-5fb07212e128 tempest-ListImageFiltersNegativeTestJSON-3855284 tempest-ListImageFiltersNegativeTestJSON-3855284-project] Request method failure captured: Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/images/f6d3b018-fa48-42d6-b38d-2c3789ef0698 HTTP/1.1 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-i-fr6A8PhHXtyah96XgE3sD2FYvKkUrCK1PweoOEQfBVvov24I1Nx7iCf0RQ72dTuqOn60c2ux5dIiYK2zZGjNUhUXQX62zvhR4cSU6_mmbqLPxg4gfeQDBm1gRFeUNVm6BukojQfHFxy1B6gvbfUDbtLxFN0ip2XydPR1DDK2vMg Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 27770a392e4842e4ba09bb7839c1fd94 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-3855284 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/27770a392e4842e4ba09bb7839c1fd94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/27770a392e4842e4ba09bb7839c1fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_27770a392e4842e4ba09bb7839c1fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/27770a392e4842e4ba09bb7839c1fd94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-3855284 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 27770a392e4842e4ba09bb7839c1fd94 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-3855284 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListImageFiltersNegativeTestJSON-3855284-project Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c658e7dc060c4a05a467ab5ce132b491 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-3855284-project Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f6d3b018-fa48-42d6-b38d-2c3789ef0698'} Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f6d3b018-fa48-42d6-b38d-2c3789ef0698 Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:24:47.859701 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6d3b018-fa48-42d6-b38d-2c3789ef0698 could not be found. Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:47.864181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:24:47.868340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89eba792-443e-4901-adce-5fb07212e128 tempest-ListImageFiltersNegativeTestJSON-3855284 tempest-ListImageFiltersNegativeTestJSON-3855284-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:47.869905 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89eba792-443e-4901-adce-5fb07212e128 tempest-ListImageFiltersNegativeTestJSON-3855284 tempest-ListImageFiltersNegativeTestJSON-3855284-project] 10.222.0.48 "GET /compute/v2.1/images/f6d3b018-fa48-42d6-b38d-2c3789ef0698" status: 404 len: 62 microversion: 2.1 time: 0.305758 Oct 31 15:24:47.870953 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1276/2480] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:47 2022] GET /compute/v2.1/images/f6d3b018-fa48-42d6-b38d-2c3789ef0698 => generated 62 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:47.878710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:47.879787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:47.887987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.888863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.889486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.890544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.891249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.891941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.229918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:48.251626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a0f2354-277e-4ed2-b2df-e5c432532201 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 1.424857 Oct 31 15:24:48.252388 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1205/2481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:46 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:48.263263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:48.264104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:48.289595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.291840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.292449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.295434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.296792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.300413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.855761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:48.873501 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dec56747-ae00-4684-b9a8-4d2b2a9986ca tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1524 microversion: 2.1 time: 1.001120 Oct 31 15:24:48.876620 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1277/2482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:47 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1524 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:48.890549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:48.891245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:48.902424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=15 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:48.905239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.906152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.907886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.909892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.910574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.913365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.157754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:49.176924 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5327c203-ff47-4de1-9cac-90ac21d8ce33 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.917206 Oct 31 15:24:49.177912 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1206/2483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:48 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:49.183036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:49.183657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:49.208073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.208661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.209945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.216238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.217737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.221479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.763743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:49.774268 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0e81343-020e-4eff-8b4e-b45e1f025d81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.896262 Oct 31 15:24:49.776497 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1278/2484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:48 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:49.784266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a23e8661-9d56-46a1-8487-5756e4583e10 req-72e2923e-c301-4ebe-9584-1c771130db19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0356675-eb87-40d1-9c1d-dcae31785320", "name": "network-vif-plugged", "status": "completed", "tag": "7113a062-16ba-4d83-9e62-57a99016fee8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:49.805928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a23e8661-9d56-46a1-8487-5756e4583e10 req-72e2923e-c301-4ebe-9584-1c771130db19 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.807067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a23e8661-9d56-46a1-8487-5756e4583e10 req-72e2923e-c301-4ebe-9584-1c771130db19 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.807709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a23e8661-9d56-46a1-8487-5756e4583e10 req-72e2923e-c301-4ebe-9584-1c771130db19 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.818860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:49.820171 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a23e8661-9d56-46a1-8487-5756e4583e10 req-72e2923e-c301-4ebe-9584-1c771130db19 service nova] Creating event network-vif-plugged:7113a062-16ba-4d83-9e62-57a99016fee8 for instance b0356675-eb87-40d1-9c1d-dcae31785320 on n-h1-858383-17 Oct 31 15:24:49.827646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a23e8661-9d56-46a1-8487-5756e4583e10 req-72e2923e-c301-4ebe-9584-1c771130db19 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048908 Oct 31 15:24:49.829042 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1279/2485] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:49.836563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:49.837484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:49.838714 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcc38102-be2f-4417-809a-b7e14b02270b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1536 microversion: 2.1 time: 0.659057 Oct 31 15:24:49.846794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.847679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.848345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.849351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.850081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.850768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.855274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1207/2486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:49 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1536 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:49.867759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32779258-c9bb-451b-b3aa-055f6453abd5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'create', calling method: .version_select at 0x7f5ca2425940>, body: {"pool": "ca869cd7-f8cf-416b-b96d-ecb055e8c307"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:50.343579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:50.353169 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e21585b-7e03-4ac6-9c65-51a8ea8e9be3 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.522099 Oct 31 15:24:50.359167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1280/2487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:49 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:50.382510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:50.383343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:50.405834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.410477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.411807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.415507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.417269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.418067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.843293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:50.845925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:50.863908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76789170-dee6-4829-8a4c-276b25dab87b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1524 microversion: 2.1 time: 0.500336 Oct 31 15:24:50.864388 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1281/2488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:50 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:50.892318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:50.893537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:50.902011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.903649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.904359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.905392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.906071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.907429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.316297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:51.330641 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38ee43a8-c17e-463a-9a2b-75adae404569 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.463265 Oct 31 15:24:51.345918 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1282/2489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:50 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:51.623625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d6065f3-306f-49f8-bf7f-a70ec1fe0970 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca16c3700>, body: {"keypair": {"name": "tempest-keypair-1220488164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbvV7zRlAwpPQlOUfEjDR2cKr/ud2WpCp4t/DVLcFmlsD6uMqWVzRlrzdJcJFT7gSZgr9fB/tohxf3rCqhF5KDC1vQCLH+hNyO57BFSw8YPsyeDbfF6deqH1QTxwyRbNg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:51.665193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0d6065f3-306f-49f8-bf7f-a70ec1fe0970 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:51.678511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0d6065f3-306f-49f8-bf7f-a70ec1fe0970 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:51.750261 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d6065f3-306f-49f8-bf7f-a70ec1fe0970 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.403121 Oct 31 15:24:51.757800 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1283/2490] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:24:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 411 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:24:51.762704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:51.763546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:51.786570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.787076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.787519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.788243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.788734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.789165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:52.439087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:52.452174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd81553e-98c0-4167-b50e-a7b4e8665be1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.693188 Oct 31 15:24:52.470920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1284/2491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:51 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:52.484518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:52.486963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:52.509938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:52.512813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:52.513463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:52.515067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:52.516533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:52.517755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:52.858385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:52.867671 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7fba36ec-e3f8-470a-bbc4-9043776a23ff tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.395353 Oct 31 15:24:52.868864 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1285/2492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:52 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:52.876713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-356bef6e-9bba-4429-b590-d5d6057305ba tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca169c550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:52.885797 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-356bef6e-9bba-4429-b590-d5d6057305ba tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1220488164" status: 200 len: 513 microversion: 2.2 time: 0.014934 Oct 31 15:24:52.888115 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1286/2493] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Oct 31 15:24:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1220488164 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:52.893523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:52.894317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:52.907405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:52.908465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:52.909089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:52.911431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:52.912651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:52.913296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.387243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:53.399245 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8594037a-e009-4696-bffc-312432509f4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1506 microversion: 2.1 time: 0.507143 Oct 31 15:24:53.402580 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1287/2494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:52 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:53.410578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:53.413407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:53.431741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:53.433045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:53.433710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.434893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:53.435801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:53.436406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.929625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:53.938356 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-669d7e4d-1333-494a-846a-35bea9d27dae tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.534329 Oct 31 15:24:53.939511 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1288/2495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:53 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:53.944242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c085f5d-1472-450c-89c2-3bae5ee96a0e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca23c49d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:53.967570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c085f5d-1472-450c-89c2-3bae5ee96a0e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220488164" status: 204 len: 0 microversion: 2.2 time: 0.026804 Oct 31 15:24:53.968195 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1289/2496] 10.222.0.48 () {60 vars in 1261 bytes} [Mon Oct 31 15:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220488164 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:53.988128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:53.988827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:54.003792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.004561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.005229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.006316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.006858 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32779258-c9bb-451b-b3aa-055f6453abd5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.143470 Oct 31 15:24:54.007818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.007941 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1208/2497] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:24:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:24:54.008510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.012774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:54.013409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:54.030039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.030635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.033338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.034163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.037328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.037848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.450063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:54.461339 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b0987bc-5ebf-4229-b126-51cec141ae85 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.479843 Oct 31 15:24:54.466291 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1290/2498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:53 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:54.479582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-094b430d-7f73-411e-88e0-1c6ca58dbb5d tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca16c0a60>, body: {"keypair": {"name": "tempest-keypair-1836775447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6Eo0uVs98uNmCSCGkAeJJbnwRbID/aV6eJ7POXXPMSqSLwsIFOldSuQ+MDDaO8u44eyoNQtB/coGm2WEUZVp9G2Ry27pIufMxFdC7GyBtkBHMq5bktUWPUpXKgw/CONg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:54.523769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-094b430d-7f73-411e-88e0-1c6ca58dbb5d tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:54.530727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-094b430d-7f73-411e-88e0-1c6ca58dbb5d tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:54.535971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:54.548841 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-06933657-dcd6-4c7c-a0fa-51b9c6060328 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.534960 Oct 31 15:24:54.549669 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1209/2499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:54 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:54.557310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.209"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:54.563806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:54.585503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.587455 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-094b430d-7f73-411e-88e0-1c6ca58dbb5d tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.119098 Oct 31 15:24:54.588470 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1291/2500] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:24:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:24:54.591486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.592087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.594966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.596167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.597362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.604143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:54.604943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:54.623323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.623959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.627155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.628184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.628892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.630506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.663424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:24:54.665420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquired lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:24:55.079249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:55.094978 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b635de6-1b27-4627-991c-2f07e1e0a739 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1506 microversion: 2.1 time: 0.502452 Oct 31 15:24:55.099889 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1292/2501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:54 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:55.115290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0f97ea7-722a-4196-a910-c327aa80f6b8 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca1674940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:55.180910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0f97ea7-722a-4196-a910-c327aa80f6b8 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836775447" status: 204 len: 0 microversion: 2.2 time: 0.079606 Oct 31 15:24:55.181818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1293/2502] 10.222.0.48 () {60 vars in 1261 bytes} [Mon Oct 31 15:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836775447 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:55.186825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:55.187726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:55.196752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:55.197259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:55.197794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:55.198507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:55.199050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:55.199485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:55.596351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:55.610770 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1cd8511-548a-43d0-9306-5931cd1909dd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.427287 Oct 31 15:24:55.613301 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1294/2503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:55 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:55.618891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-709ef1f4-e05e-4a82-bb70-e7c7d9593d81 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca1690dc0>, body: {"keypair": {"name": "tempest-keypair-1949285755", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:55.659940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-709ef1f4-e05e-4a82-bb70-e7c7d9593d81 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:55.672657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-709ef1f4-e05e-4a82-bb70-e7c7d9593d81 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:55.719731 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-709ef1f4-e05e-4a82-bb70-e7c7d9593d81 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.104667 Oct 31 15:24:55.720277 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1295/2504] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:24:55 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:24:55.730481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:55.736048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:55.747119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:55.747589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:55.748033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:55.748781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:55.749246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:55.749672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.430976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:56.439781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7333c52a-de09-4822-9153-7bb3648d6284 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.718089 Oct 31 15:24:56.453258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1296/2505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:55 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:56.458768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:56.459391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:56.476581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.477392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.477519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.478164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.478625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.479045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.781199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:56.794661 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1bd4d88-f548-41bf-a358-098a33e45244 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.339649 Oct 31 15:24:56.796637 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1297/2506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:56 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:56.813900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a585cf93-1acc-4ff2-be4a-ed00bb642ac6 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca67ecaf0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:56.838053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a585cf93-1acc-4ff2-be4a-ed00bb642ac6 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949285755" status: 204 len: 0 microversion: 2.2 time: 0.037801 Oct 31 15:24:56.839004 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1298/2507] 10.222.0.48 () {60 vars in 1261 bytes} [Mon Oct 31 15:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949285755 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:56.847804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-dc65fa9f-65bd-4146-acd5-60a1e3ba8778 req-1cb3b239-d1e4-436d-8d1e-5b53094edcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa22140e-0ab8-4cca-9dd5-469cbb78cd14", "name": "network-vif-unplugged", "status": "completed", "tag": "eaf8c73a-01f1-435c-95df-a26934141340"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:56.863564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dc65fa9f-65bd-4146-acd5-60a1e3ba8778 req-1cb3b239-d1e4-436d-8d1e-5b53094edcef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.864343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dc65fa9f-65bd-4146-acd5-60a1e3ba8778 req-1cb3b239-d1e4-436d-8d1e-5b53094edcef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.865030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dc65fa9f-65bd-4146-acd5-60a1e3ba8778 req-1cb3b239-d1e4-436d-8d1e-5b53094edcef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.886774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-dc65fa9f-65bd-4146-acd5-60a1e3ba8778 req-1cb3b239-d1e4-436d-8d1e-5b53094edcef service nova] Unable to find a host for instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14. Dropping event network-vif-unplugged {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:24:56.888478 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-dc65fa9f-65bd-4146-acd5-60a1e3ba8778 req-1cb3b239-d1e4-436d-8d1e-5b53094edcef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048130 Oct 31 15:24:56.889636 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1299/2508] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:24:56.910630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:56.912792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:56.923884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.924658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.925406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.926530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.927143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.927712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.176568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:57.187592 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b4f3d624-cfa7-4515-97c8-430ee64abe19 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 200 len: 1449 microversion: 2.1 time: 0.296529 Oct 31 15:24:57.200720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1300/2509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:56 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 1449 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:57.200720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:57.200720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:57.201066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.206215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.206215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.206215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.206215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.206215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.527631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:24:57.628096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:57.640644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4d0b184-7e6a-4f49-aa23-53bd3218efe4 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.451536 Oct 31 15:24:57.644412 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1301/2510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:57 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:57.662783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84710ce6-c043-4633-8c93-5e4db29f284f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca22f5670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1381501698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFruCvymSls47xbvW7qt5yMd+ryVwNV/r3aqSaIRzBJL/ZScqcCJsJ4fCADifvqHxwUEbOM0gh1emqHJldUstgjTECzkEQRgTtOeHb4c038eAvEia3Gjln9Iyd8lEoWXA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:57.702111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-84710ce6-c043-4633-8c93-5e4db29f284f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:57.717637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-84710ce6-c043-4633-8c93-5e4db29f284f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:57.769145 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84710ce6-c043-4633-8c93-5e4db29f284f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.123115 Oct 31 15:24:57.772422 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1302/2511] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:24:57 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:24:57.786223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:57.786990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:57.803648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.804430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.805064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.805950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.809140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.809781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.868668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:57.883682 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.compute.api [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Working on deleting snapshot 5a51c764-fc46-4b90-8e35-5240e3954012 from shelved instance... Oct 31 15:24:58.820361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Updating instance_info_cache with network_info: [{"id": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1", "address": "fa:16:3e:ff:38:95", "network": {"id": "bedd7a33-4e02-41d8-bd84-cfb19551ccc2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2135612685-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "571c0706237341a78eed8885e94bd7aa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0ceb3d27-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:24:58.839413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Releasing lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:24:58.840571 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b72cd5e-a985-4dbb-a8d5-1d5e3198000b tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action" status: 202 len: 0 microversion: 2.1 time: 4.287062 Oct 31 15:24:58.843199 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1210/2512] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:24:54 2022] POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action => generated 0 bytes in 4293 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:24:58.868734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.869361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:58.878726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=42 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:58.897266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.898129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.898759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.901693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.906532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.908240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.208474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:59.220228 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-56de310c-d8ea-4af2-93c7-77321022f861 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.366455 Oct 31 15:24:59.222758 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1211/2513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:59.289772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Doing local delete in cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=120625) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 31 15:24:59.293827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.294558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.295038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.295659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.compute.api [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 31 15:24:59.300175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] deallocate_for_instance() {{(pid=120625) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 31 15:24:59.471544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a1665572-2340-4d93-a44a-075bda830b3f req-646cecd8-ae10-4c62-9022-ffa9b561dc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a", "tag": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:59.489211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a1665572-2340-4d93-a44a-075bda830b3f req-646cecd8-ae10-4c62-9022-ffa9b561dc44 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.497704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a1665572-2340-4d93-a44a-075bda830b3f req-646cecd8-ae10-4c62-9022-ffa9b561dc44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.506294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a1665572-2340-4d93-a44a-075bda830b3f req-646cecd8-ae10-4c62-9022-ffa9b561dc44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.542039 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a1665572-2340-4d93-a44a-075bda830b3f req-646cecd8-ae10-4c62-9022-ffa9b561dc44 service nova] Creating event network-changed:0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 for instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a on n-h2-858383-17 Oct 31 15:24:59.554555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a1665572-2340-4d93-a44a-075bda830b3f req-646cecd8-ae10-4c62-9022-ffa9b561dc44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329804 Oct 31 15:24:59.559685 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1212/2514] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:59.573392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-16561677-efe3-4f1d-a313-1ff2ace0e3bb tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca17800d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-126192891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlr32TwF6oO3t9ZVvkFVBoHdTINVQrhQMfHibOl1lJKXGZflafvu5n0kWKPECBRgT7hSdIbNUo2/kDJwYJZrnxMdD63ZvuKl86HXqABACgoCI9kjjedesKP/jBZ7dZhFw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:59.621488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-16561677-efe3-4f1d-a313-1ff2ace0e3bb tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:59.635917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-16561677-efe3-4f1d-a313-1ff2ace0e3bb tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:59.694155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-16561677-efe3-4f1d-a313-1ff2ace0e3bb tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.131116 Oct 31 15:24:59.705135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1213/2515] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:24:59 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:24:59.711137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:59.712265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:59.721037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.721912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.722606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.724067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.724854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.725709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:00.043976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:00.070305 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-29a25577-6890-4af5-8cb9-6dafe57f2db7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.358866 Oct 31 15:25:00.073117 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1214/2516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:59 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:00.100525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:00.102030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:00.127466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:00.131192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:00.131953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:00.135037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:00.136008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:00.136652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:00.479572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Updating instance_info_cache with network_info: [] {{(pid=120625) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:25:00.573641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:00.592239 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2ff5c2fa-25e1-4f81-a45c-a18a3bcddb91 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1722 microversion: 2.1 time: 0.515912 Oct 31 15:25:00.600087 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1215/2517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:00 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1722 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:00.612053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-004757d1-802d-4301-bf90-4014304f010d tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'create', calling method: .version_select at 0x7f5ca26dcf70>, body: {"pool": "ca869cd7-f8cf-416b-b96d-ecb055e8c307"} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:00.662750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:00.706567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:01.039159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a254de7e-11aa-43fd-a1f7-9bf0cfd6f617 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 204 len: 0 microversion: 2.1 time: 3.263644 Oct 31 15:25:01.039790 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1303/2518] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:57 2022] DELETE /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 0 bytes in 3267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:01.055832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4bc43a9f-abb2-486e-95e7-ab366908f1d5 req-efd3776f-a9c7-464a-90c1-b460b216c755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e", "name": "network-vif-plugged", "status": "completed", "tag": "9708d710-440d-457d-abcf-a70ea42adc02"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:01.091111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4bc43a9f-abb2-486e-95e7-ab366908f1d5 req-efd3776f-a9c7-464a-90c1-b460b216c755 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.091639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4bc43a9f-abb2-486e-95e7-ab366908f1d5 req-efd3776f-a9c7-464a-90c1-b460b216c755 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.092078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4bc43a9f-abb2-486e-95e7-ab366908f1d5 req-efd3776f-a9c7-464a-90c1-b460b216c755 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.129594 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4bc43a9f-abb2-486e-95e7-ab366908f1d5 req-efd3776f-a9c7-464a-90c1-b460b216c755 service nova] Creating event network-vif-plugged:9708d710-440d-457d-abcf-a70ea42adc02 for instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e on n-h1-858383-17 Oct 31 15:25:01.138398 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4bc43a9f-abb2-486e-95e7-ab366908f1d5 req-efd3776f-a9c7-464a-90c1-b460b216c755 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095311 Oct 31 15:25:01.141608 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1304/2519] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:01.153819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a557b46b-d211-4c2b-b0a6-48ff856115be tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca16151f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-179767802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC0sz9qm5F+4psndV00qlhNqN8P4VnaCxyl5PF1YKx1TOvSm9EPYdXYm5rfTpGFBOFiizgqgJuW/+Kp4BAZhw2I20KHjEdQqzV6BBFgI19PggxzAoRH6uSttt3ih8kdog=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:01.196651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a557b46b-d211-4c2b-b0a6-48ff856115be tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:01.212677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a557b46b-d211-4c2b-b0a6-48ff856115be tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:01.297231 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a557b46b-d211-4c2b-b0a6-48ff856115be tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.154233 Oct 31 15:25:01.301595 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1305/2520] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:25:01 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:25:01.316439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:01.320602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:01.341285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.342334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.342942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.346346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.347000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.347671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.755466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:01.767376 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-479c93e0-2f0c-4276-a593-4d3316cf30ef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1310 microversion: 2.1 time: 0.463446 Oct 31 15:25:01.767998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1306/2521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:01 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1310 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:01.790358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:01.790358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:01.798768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.799554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.799993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.800719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.801163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.802006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.827391 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 HTTP/1.1 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'aa22140e-0ab8-4cca-9dd5-469cbb78cd14'} Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:01.830005 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:25:01.834180 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.837240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:01.838304 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36a1651e-9c1f-4159-9e72-b83e392df168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 404 len: 111 microversion: 2.1 time: 0.055416 Oct 31 15:25:01.840135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1307/2522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:01 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:01.846816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:01.847645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:01.855285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.856214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.856827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.857692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.858293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.858880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.358864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:02.371206 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ec2c443-c4f6-43a6-944e-89be3e94ba38 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.529791 Oct 31 15:25:02.372232 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1308/2523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:01 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:02.377681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae04d974-c27d-4acc-9d32-dd62b4ee7491 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca162f3a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:02.385195 n-d-858383-17 devstack@n-api.service[120625]: WARNING oslo_db.sqlalchemy.utils [None req-ae04d974-c27d-4acc-9d32-dd62b4ee7491 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:25:02.393918 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae04d974-c27d-4acc-9d32-dd62b4ee7491 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.020261 Oct 31 15:25:02.394833 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1309/2524] 10.222.0.48 () {60 vars in 1177 bytes} [Mon Oct 31 15:25:02 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:02.401246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:02.402119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:02.416784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.417815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.419160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.424204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.425093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.426779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.788205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:02.805078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1bbebc01-ad60-4771-ab09-f2b4d1e21cb9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1699 microversion: 2.1 time: 0.403954 Oct 31 15:25:02.805885 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1310/2525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:02 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1699 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:02.849675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b744479f-ab74-4062-b9c1-47b64501a975 req-5de1d140-4a6a-4866-ac40-f80d4d2d5857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa22140e-0ab8-4cca-9dd5-469cbb78cd14", "name": "network-vif-deleted", "tag": "eaf8c73a-01f1-435c-95df-a26934141340"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:02.880688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b744479f-ab74-4062-b9c1-47b64501a975 req-5de1d140-4a6a-4866-ac40-f80d4d2d5857 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.881383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b744479f-ab74-4062-b9c1-47b64501a975 req-5de1d140-4a6a-4866-ac40-f80d4d2d5857 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.882100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b744479f-ab74-4062-b9c1-47b64501a975 req-5de1d140-4a6a-4866-ac40-f80d4d2d5857 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.902100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-b744479f-ab74-4062-b9c1-47b64501a975 req-5de1d140-4a6a-4866-ac40-f80d4d2d5857 service nova] Unable to find a host for instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14. Dropping event network-vif-deleted {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:25:02.903678 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b744479f-ab74-4062-b9c1-47b64501a975 req-5de1d140-4a6a-4866-ac40-f80d4d2d5857 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.080411 Oct 31 15:25:02.904910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1311/2526] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:25:02.910262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-156378805", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:03.025198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:03.935873 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-004757d1-802d-4301-bf90-4014304f010d tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.334251 Oct 31 15:25:03.936964 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1216/2527] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:25:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:03.942112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81d4a6f1-dad8-4b04-b622-2d092e901b61 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca18039d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:03.985042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81d4a6f1-dad8-4b04-b622-2d092e901b61 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-179767802" status: 204 len: 0 microversion: 2.2 time: 0.045599 Oct 31 15:25:03.993856 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1217/2528] 10.222.0.48 () {60 vars in 1318 bytes} [Mon Oct 31 15:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-179767802 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:04.004157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:04.005226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:04.012353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.023514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.024338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.026764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.027661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.028271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.285490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:04.286617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:04.287178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:04.288090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:04.288590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:04.306332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.309353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.310454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.311374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.313460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.315191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.317613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:04.326424 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b85e0b1c-3c0a-4b47-b609-be2524f8b405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1493 microversion: 2.1 time: 0.330918 Oct 31 15:25:04.327026 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1218/2529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:03 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1493 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:04.346709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5fb353e-1ba9-4464-9396-8f1d937d0c3e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:04.352004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:04.359663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5fb353e-1ba9-4464-9396-8f1d937d0c3e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.360474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5fb353e-1ba9-4464-9396-8f1d937d0c3e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.360883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:04.361112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5fb353e-1ba9-4464-9396-8f1d937d0c3e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.380187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:04.382542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:04.396360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b5fb353e-1ba9-4464-9396-8f1d937d0c3e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Going to try to start instance {{(pid=120626) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:25:04.402490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:04.457849 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7f91b05-41a7-4d62-9b9c-dc1ac97b379f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549380 Oct 31 15:25:04.458971 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1312/2530] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:25:04.471175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-928c7dfb-c4ae-418e-b535-7511766a1e73 req-4bdad193-c446-4b73-be6f-c3b9adc3b676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7", "name": "network-vif-plugged", "status": "completed", "tag": "f0d1929f-65e5-476a-9fe7-fbc1a9e0e4ea"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:04.478962 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5fb353e-1ba9-4464-9396-8f1d937d0c3e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action" status: 202 len: 0 microversion: 2.1 time: 0.150714 Oct 31 15:25:04.480215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1219/2531] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:04 2022] POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:04.498393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:04.498897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-928c7dfb-c4ae-418e-b535-7511766a1e73 req-4bdad193-c446-4b73-be6f-c3b9adc3b676 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.499704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:04.501418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-928c7dfb-c4ae-418e-b535-7511766a1e73 req-4bdad193-c446-4b73-be6f-c3b9adc3b676 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.503743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-928c7dfb-c4ae-418e-b535-7511766a1e73 req-4bdad193-c446-4b73-be6f-c3b9adc3b676 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.507373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.509044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.509765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.510717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.511546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.512227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.521230 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-928c7dfb-c4ae-418e-b535-7511766a1e73 req-4bdad193-c446-4b73-be6f-c3b9adc3b676 service nova] Creating event network-vif-plugged:f0d1929f-65e5-476a-9fe7-fbc1a9e0e4ea for instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 on n-h1-858383-17 Oct 31 15:25:04.528934 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-928c7dfb-c4ae-418e-b535-7511766a1e73 req-4bdad193-c446-4b73-be6f-c3b9adc3b676 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066390 Oct 31 15:25:04.529881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1313/2532] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:04.537431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.70"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:04.540745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:04.551449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.552299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.553000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.554779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.555561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.556689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.593819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:25:04.595148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquired lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:25:04.865284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:04.873809 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4791d61c-7dcd-4bf5-bbc5-6a5d64e5eb71 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.391998 Oct 31 15:25:04.885844 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1220/2533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:04 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:04.889205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-009d206d-8943-4109-9070-49a1731ff6ff tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca170ce50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:04.923395 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-009d206d-8943-4109-9070-49a1731ff6ff tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-126192891" status: 204 len: 0 microversion: 2.2 time: 0.043360 Oct 31 15:25:04.924739 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1221/2534] 10.222.0.48 () {60 vars in 1318 bytes} [Mon Oct 31 15:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-126192891 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:05.033406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8daf28cf-b7fc-4522-ad5f-3cecb8110395 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Action: 'create', calling method: .version_select at 0x7f5ca230cdc0>, body: {"keypair": {"name": "tempest-keypair-1077373032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLb5XL28TXLwVO1MUSR9y+Jd/Su34YeqQSilwr+RvDxPmpNhYc05Ja+13ZxlybzOSQ8mBNtPcfMEBjWn2AYL9wu/AkDwY0rd/GWu1yzvo/+M5QRO9NJfA0NhHXeftBSZuw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:05.066294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-8daf28cf-b7fc-4522-ad5f-3cecb8110395 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Getting quotas for project 26d9053f0dd94aff94d2a3cc4e2bd8e9. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:05.079644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-8daf28cf-b7fc-4522-ad5f-3cecb8110395 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Getting quotas for user ed3ce0057a4847b0931e51fb820f13df and project 26d9053f0dd94aff94d2a3cc4e2bd8e9. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:05.124457 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8daf28cf-b7fc-4522-ad5f-3cecb8110395 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194089 Oct 31 15:25:05.126888 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1222/2535] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:05.307737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.309317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307.", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:25:05.309761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:05.309960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Releasing lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:25:05.310517 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.310517 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Request method failure captured: Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action HTTP/1.1 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 45 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-im7FMxHH-w7r9omnNbWwvFh_XEIAiROT-fgoapU7V_UZU7pCCtDACLNkeraT6LjYrHDvE0q7SeVdtjbKBRcPE54hYVo8B-WIAPhLKHK8gg0c-Y0OwzWTbq9G-BNvOBeU4r1QInCYOYry6yejVFy3DVUBbZu-4ROr9ED6DWcVkirMo Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_571c0706237341a78eed8885e94bd7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 93317ff2aea5495e991052a36e3f0c5e Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: {"addFloatingIp": {"address": "172.25.7.70"}} Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a', 'body': {'addFloatingIp': {'address': '172.25.7.70'}}} Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:25:05.315322 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] Oct 31 15:25:05.319007 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.322925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Returning 400 to user: Cannot associate floating IP 172.25.7.70 (8e98bb61-d7de-42e1-a089-812ed281f689) with port 0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network ca869cd7-f8cf-416b-b96d-ecb055e8c307. Oct 31 15:25:05.322925 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-b223142f-cb21-492c-bce8-e51ed3800330'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:05.322925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-747bacfb-8771-41c3-b47d-481743203043 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action" status: 400 len: 381 microversion: 2.1 time: 0.786078 Oct 31 15:25:05.322925 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1314/2536] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:04 2022] POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action => generated 381 bytes in 787 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:05.323579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b67b6fcb-0190-41dc-b7e2-ce344bbdd5dc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.325120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b67b6fcb-0190-41dc-b7e2-ce344bbdd5dc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:05.328803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.329920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.330584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.333482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.335153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.337311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.424243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b67b6fcb-0190-41dc-b7e2-ce344bbdd5dc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:05.438375 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b67b6fcb-0190-41dc-b7e2-ce344bbdd5dc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1214 microversion: 2.1 time: 0.117936 Oct 31 15:25:05.439927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1315/2537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:05 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:05.455341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.458610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:05.467445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.472407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.473570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.478730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.479759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.480492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.709533 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8060f032-60f0-423d-b964-05bfd81ccd71 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1646 microversion: 2.1 time: 0.579901 Oct 31 15:25:05.713709 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1223/2538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:05 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1646 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:05.729320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2b3dbee-d1f5-4f4c-b4b8-08178b629a77 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca1708dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.748557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:05.761124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1395cb1c-4564-4024-bf4c-21225d16714c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1708 microversion: 2.1 time: 0.319711 Oct 31 15:25:05.778486 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1316/2539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:05 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1708 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:05.780996 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2b3dbee-d1f5-4f4c-b4b8-08178b629a77 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1381501698" status: 204 len: 0 microversion: 2.2 time: 0.063503 Oct 31 15:25:05.782111 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1224/2540] 10.222.0.48 () {60 vars in 1321 bytes} [Mon Oct 31 15:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1381501698 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:05.785451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e0fa307-71cc-4a51-a361-eee578d3b4f7 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '.version_select at 0x7f5ca1680a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.787970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.788799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:05.797000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.798576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.799467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.802528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.803030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.806939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.145977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb0b5aa6-ffb2-41ac-a575-8fe64fd29470 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1646 microversion: 2.1 time: 0.361634 Oct 31 15:25:06.160733 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1225/2541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:05 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1646 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:06.160733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9cc291a-1e7d-488e-b5d0-4f96d4395565 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca1757f70>, body: {"keypair": {"name": "tempest-keypair-1893681712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv74L+fqfV1QmXYNIKqxjAlLZ1a9tmOLRsqC+bjA/jIvZ4CUwvuNc9gBJ4FsqIF618qTNz5lXAPlImz4sZ8ueiXlZMuEQNLrlPrHmcr3WI/efS8jWqj/onqefbDHYcTlQ=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:06.176546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-c9cc291a-1e7d-488e-b5d0-4f96d4395565 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:06.186319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-c9cc291a-1e7d-488e-b5d0-4f96d4395565 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:06.249996 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9cc291a-1e7d-488e-b5d0-4f96d4395565 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.099759 Oct 31 15:25:06.257485 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1226/2542] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Oct 31 15:25:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:25:06.263058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:06.270443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:06.294596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.295975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.297312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.299373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.300804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.302318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.036665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:07.049473 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-874a0ac0-8d46-4e71-a68b-0fc25e5176a9 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1323 microversion: 2.1 time: 0.790633 Oct 31 15:25:07.050352 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1227/2543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:06 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1323 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:07.064521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.068522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.069274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.074081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.075058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.076260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.076894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.144831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a32a3410-7141-4494-b7cc-5754f2eceb7a tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.091839 Oct 31 15:25:07.146664 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1228/2544] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:07.154281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eaae892f-101a-4936-a6d8-da442eebb175 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca174f550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.193488 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eaae892f-101a-4936-a6d8-da442eebb175 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1893681712" status: 200 len: 513 microversion: 2.2 time: 0.041392 Oct 31 15:25:07.194198 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1229/2545] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1893681712 => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:07.205253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.206540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:07.219070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.231851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.232553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.233476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.234650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.235421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.350434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:07.361505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08fd8f4e-465d-4c60-93de-e44653244d20 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1272 microversion: 2.1 time: 0.166117 Oct 31 15:25:07.362115 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1230/2546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:07.377286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.377910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:07.393554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.394620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.394620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.395261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.395666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.396093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.784054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:07.798128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-057b469e-5e4f-4a3b-9abb-218e7e4c0b4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1712 microversion: 2.1 time: 0.428050 Oct 31 15:25:07.798817 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1231/2547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1712 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:07.814408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:07.817350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:07.831708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.832200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.832643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.839614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.840216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.840659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.903565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lazy-loading 'flavor' on Instance uuid f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:07.933820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Going to try to live migrate instance to n-h2-858383-17 {{(pid=120626) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:25:08.077211 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e0fa307-71cc-4a51-a361-eee578d3b4f7 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/8e98bb61-d7de-42e1-a089-812ed281f689" status: 202 len: 0 microversion: 2.1 time: 2.295598 Oct 31 15:25:08.082090 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1317/2548] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:25:05 2022] DELETE /compute/v2.1/os-floating-ips/8e98bb61-d7de-42e1-a089-812ed281f689 => generated 0 bytes in 2303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:08.087614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f920f568-8672-4bdc-8696-21007d5b5c84 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca1615a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:08.097699 n-d-858383-17 devstack@n-api.service[120625]: WARNING oslo_db.sqlalchemy.utils [None req-f920f568-8672-4bdc-8696-21007d5b5c84 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:25:08.108101 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f920f568-8672-4bdc-8696-21007d5b5c84 tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.024552 Oct 31 15:25:08.115988 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1318/2549] 10.222.0.48 () {60 vars in 1177 bytes} [Mon Oct 31 15:25:08 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:08.122100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:08.122988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:08.130935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.131857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.132622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.133645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.134698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.135909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.475768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:08.484104 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cfd5dab0-c627-4219-b699-d28f0b498e93 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1516 microversion: 2.1 time: 0.366614 Oct 31 15:25:08.497912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1319/2550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:08 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1516 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:08.507349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'action', calling method: .version_select at 0x7f5ca41ec280>, body: {"removeFloatingIp": {"address": "172.25.7.209"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:08.898959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:08.910274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.911349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.911803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.913758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.920575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.921712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.302420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:25:09.303032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquired lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:25:10.550003 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5de70723-d554-4a76-b44e-97a08a4b9bc2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e/action" status: 202 len: 0 microversion: 2.1 time: 2.749850 Oct 31 15:25:10.552009 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1232/2551] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:07 2022] POST /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e/action => generated 0 bytes in 2752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:10.559667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1054afff-61b6-4c09-82ef-71dbde59c86a tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca66c7d30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.632512 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1054afff-61b6-4c09-82ef-71dbde59c86a tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893681712" status: 204 len: 0 microversion: 2.2 time: 0.075280 Oct 31 15:25:10.633737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1233/2552] 10.222.0.48 () {60 vars in 1261 bytes} [Mon Oct 31 15:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893681712 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:10.639057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.641652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:10.653616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.654344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.655680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.656613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.657383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.657980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.799405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Building network info cache for instance {{(pid=120625) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:25:10.930327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:10.941202 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-95fb518f-c71e-4780-a17a-cb32de6ded9f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1314 microversion: 2.1 time: 0.304202 Oct 31 15:25:10.941767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1234/2553] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:10 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:10.948207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.956104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:10.971539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.973026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.973862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.974754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.975391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.975973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.206856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:11.222213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f2b9da7-2980-4797-82b5-c63c9e2f241b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 200 len: 1515 microversion: 2.1 time: 0.279203 Oct 31 15:25:11.222931 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1235/2554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:10 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:11.235723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "020ae7ae-7e9b-4323-9d0a-47fdafae656f"}], "security_groups": [{"name": "tempest-securitygroup--1722218705"}], "key_name": "tempest-keypair-1077373032", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:11.418032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] validate_networks() for [('020ae7ae-7e9b-4323-9d0a-47fdafae656f', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:11.931166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Updating instance_info_cache with network_info: [{"id": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1", "address": "fa:16:3e:ff:38:95", "network": {"id": "bedd7a33-4e02-41d8-bd84-cfb19551ccc2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2135612685-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "571c0706237341a78eed8885e94bd7aa", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0ceb3d27-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120625) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:25:11.957962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Releasing lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:25:11.958255 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77987dea-e035-4a35-b65e-42ac2787a7f5 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action" status: 202 len: 0 microversion: 2.1 time: 3.466038 Oct 31 15:25:11.959418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1320/2555] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:08 2022] POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action => generated 0 bytes in 3467 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:25:11.965173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-93747e5f-f984-4d42-9f7e-348ae8846306 req-4109d644-c77a-497e-97b8-370183141c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2", "tag": "2451a632-0a3f-4a68-b480-aaf338b2bd65"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:11.989949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-93747e5f-f984-4d42-9f7e-348ae8846306 req-4109d644-c77a-497e-97b8-370183141c98 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.990848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-93747e5f-f984-4d42-9f7e-348ae8846306 req-4109d644-c77a-497e-97b8-370183141c98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.991290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-93747e5f-f984-4d42-9f7e-348ae8846306 req-4109d644-c77a-497e-97b8-370183141c98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.009966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-93747e5f-f984-4d42-9f7e-348ae8846306 req-4109d644-c77a-497e-97b8-370183141c98 service nova] Creating event network-changed:2451a632-0a3f-4a68-b480-aaf338b2bd65 for instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 on n-h2-858383-17 Oct 31 15:25:12.015883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-93747e5f-f984-4d42-9f7e-348ae8846306 req-4109d644-c77a-497e-97b8-370183141c98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054929 Oct 31 15:25:12.017523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1321/2556] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:12.023895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.024818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.033942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.034804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.035467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.036340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.037154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.037764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.196094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:12.196576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:12.197003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:12.197460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:12.197820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:12.222583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.223094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.223537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.224271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.224996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.225634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.251827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Getting quotas for project 26d9053f0dd94aff94d2a3cc4e2bd8e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:12.261305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Getting quotas for user ed3ce0057a4847b0931e51fb820f13df and project 26d9053f0dd94aff94d2a3cc4e2bd8e9. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:12.266418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:12.278079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:12.281005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:12.352747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e04454db-3077-4eeb-889e-5c5b12a29dc2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.128370 Oct 31 15:25:12.360586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1236/2557] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:25:12.365976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Action: 'create', calling method: .version_select at 0x7f5ca1779280>, body: {"keypair": {"name": "tempest-keypair-871761380", "type": "x509"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:12.387612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:12.394438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:12.421740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.processutils [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1f57qr74/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1f57qr74/temp.key -subj /CN=2a75e0f9326749e0b064ec9353a3a00d -extensions v3_req_client {{(pid=120626) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 31 15:25:12.556384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:12.569419 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e68d27b-adbb-4ceb-a2d9-097cf4e9cb93 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.550480 Oct 31 15:25:12.571300 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1322/2558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:12 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:12.579997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0123a3f6-634a-4878-867d-f5c1e72cd901 req-55245bd8-e1bc-4ddc-8de2-de09207a84d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a", "tag": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:12.603930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0123a3f6-634a-4878-867d-f5c1e72cd901 req-55245bd8-e1bc-4ddc-8de2-de09207a84d2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.604731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0123a3f6-634a-4878-867d-f5c1e72cd901 req-55245bd8-e1bc-4ddc-8de2-de09207a84d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.605714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0123a3f6-634a-4878-867d-f5c1e72cd901 req-55245bd8-e1bc-4ddc-8de2-de09207a84d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.647038 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0123a3f6-634a-4878-867d-f5c1e72cd901 req-55245bd8-e1bc-4ddc-8de2-de09207a84d2 service nova] Creating event network-changed:0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 for instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a on n-h2-858383-17 Oct 31 15:25:12.662791 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0123a3f6-634a-4878-867d-f5c1e72cd901 req-55245bd8-e1bc-4ddc-8de2-de09207a84d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090072 Oct 31 15:25:12.665843 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1323/2559] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:12.682248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.685230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.700141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.702071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.704789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.705696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.707444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.708059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.783757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:12.864559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:UPDATE=14,nova_cell1:SELECT=81,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:12.917428 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b9d4eb1f-8fbc-4ee8-8439-dfc55059e40f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 204 len: 0 microversion: 2.1 time: 0.243628 Oct 31 15:25:12.918561 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1324/2560] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:12 2022] DELETE /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:12.927459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.928432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.936501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.938519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.940130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.941120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.941808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.942786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.092529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.processutils [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1f57qr74/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1f57qr74/temp.key -subj /CN=2a75e0f9326749e0b064ec9353a3a00d -extensions v3_req_client" returned: 0 in 0.672s {{(pid=120626) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 31 15:25:13.095264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.processutils [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1f57qr74/temp.key -password pass: {{(pid=120626) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 31 15:25:13.167862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.processutils [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1f57qr74/temp.key -password pass:" returned: 0 in 0.073s {{(pid=120626) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 31 15:25:13.246467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:13.265829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Getting quotas for user 2a75e0f9326749e0b064ec9353a3a00d and project 5bdcef5caa744b98a53a9024aadeebe5. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:13.295761 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9d8e1cc-0a18-48ef-a4ed-c0a46ea9212e tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.932405 Oct 31 15:25:13.296683 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1237/2561] 10.222.0.48 () {62 vars in 1198 bytes} [Mon Oct 31 15:25:12 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 935 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:13.308809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cf1a921-d87d-46c3-bf82-2e5f48a9a410 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '.version_select at 0x7f5ca1780820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:13.329980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.340332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7226319c-8d65-4856-a770-980511041b3b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1314 microversion: 2.1 time: 0.420010 Oct 31 15:25:13.344414 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1325/2562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:12 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:13.361054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c28a1d11-852d-43f8-bf05-497c97270ce6 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:13.363000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c28a1d11-852d-43f8-bf05-497c97270ce6 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:13.480951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c28a1d11-852d-43f8-bf05-497c97270ce6 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.494210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c28a1d11-852d-43f8-bf05-497c97270ce6 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1226 microversion: 2.1 time: 0.147743 Oct 31 15:25:13.495190 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1326/2563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:13 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:13.500378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:13.501816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:13.509757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.510253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.510687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.511985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.512504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.512963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.075819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.085944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8caf4fc5-729a-459d-8500-da883f75157c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 200 len: 1521 microversion: 2.1 time: 0.589725 Oct 31 15:25:14.100719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1327/2564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:13 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.107866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d73100ab-bfc9-4d8f-9909-9e92761df5ca tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca165e4c0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.127796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d73100ab-bfc9-4d8f-9909-9e92761df5ca tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-871761380" status: 200 len: 1533 microversion: 2.2 time: 0.038830 Oct 31 15:25:14.135896 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1328/2565] 10.222.0.48 () {60 vars in 1255 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-871761380 => generated 1533 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.141656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.142791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.149868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.150439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.151011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.151863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.152469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.153027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.412526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:14.590133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.598944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c91dde38-847d-4f6e-b1a5-cc6cc7caf417 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.462575 Oct 31 15:25:14.599702 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1329/2566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.604425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-56285bc9-85b9-4e3c-ae2f-a695e3c6f656 req-7c622766-5ed6-4e6b-8d43-66af66cfb330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2", "name": "network-vif-plugged", "status": "completed", "tag": "2451a632-0a3f-4a68-b480-aaf338b2bd65"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.614351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56285bc9-85b9-4e3c-ae2f-a695e3c6f656 req-7c622766-5ed6-4e6b-8d43-66af66cfb330 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.614830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56285bc9-85b9-4e3c-ae2f-a695e3c6f656 req-7c622766-5ed6-4e6b-8d43-66af66cfb330 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.615256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56285bc9-85b9-4e3c-ae2f-a695e3c6f656 req-7c622766-5ed6-4e6b-8d43-66af66cfb330 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.627490 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-56285bc9-85b9-4e3c-ae2f-a695e3c6f656 req-7c622766-5ed6-4e6b-8d43-66af66cfb330 service nova] Creating event network-vif-plugged:2451a632-0a3f-4a68-b480-aaf338b2bd65 for instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 on n-h2-858383-17 Oct 31 15:25:14.632516 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-56285bc9-85b9-4e3c-ae2f-a695e3c6f656 req-7c622766-5ed6-4e6b-8d43-66af66cfb330 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Oct 31 15:25:14.633213 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1330/2567] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:14.638258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e", "name": "network-vif-unplugged", "status": "completed", "tag": "9708d710-440d-457d-abcf-a70ea42adc02"}, {"name": "network-changed", "server_uuid": "f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e", "tag": "9708d710-440d-457d-abcf-a70ea42adc02"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.649013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.649492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.649921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.665129 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] Creating event network-vif-unplugged:9708d710-440d-457d-abcf-a70ea42adc02 for instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e on n-h1-858383-17 Oct 31 15:25:14.665129 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] Creating event network-changed:9708d710-440d-457d-abcf-a70ea42adc02 for instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e on n-h1-858383-17 Oct 31 15:25:14.668036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-12028c06-826c-4911-a720-9bc683998b71 req-a894c9e7-7e05-4567-bb8b-cb2c169c7c8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.033301 Oct 31 15:25:14.668859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1331/2568] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:14.674971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35d0043c-c4e7-4f83-87d9-82008fd5806f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca15e95e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.678856 n-d-858383-17 devstack@n-api.service[120625]: WARNING oslo_db.sqlalchemy.utils [None req-35d0043c-c4e7-4f83-87d9-82008fd5806f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:25:14.684508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35d0043c-c4e7-4f83-87d9-82008fd5806f tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.014463 Oct 31 15:25:14.685544 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1332/2569] 10.222.0.48 () {60 vars in 1177 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.697900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.698650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.706928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.707424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.707865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.708577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.709068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.709492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.727633 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cf1a921-d87d-46c3-bf82-2e5f48a9a410 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/ca2e68a8-93f4-451a-93bb-8620eea3b9a5" status: 202 len: 0 microversion: 2.1 time: 1.425440 Oct 31 15:25:14.733306 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1238/2570] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:25:13 2022] DELETE /compute/v2.1/os-floating-ips/ca2e68a8-93f4-451a-93bb-8620eea3b9a5 => generated 0 bytes in 1432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:14.738426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.739121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.746963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.747496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.747948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.748737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.749202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.749627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.841011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.852390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-66f64991-33c3-4e52-9578-f199ddfdea4e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1222 microversion: 2.1 time: 0.117767 Oct 31 15:25:14.864882 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1239/2571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.874062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64c41940-9806-484c-869e-368ea02b96eb tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] Calling method '.version_select at 0x7f5ca174f940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.899948 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64c41940-9806-484c-869e-368ea02b96eb tempest-KeyPairsV22TestJSON-1244388443 tempest-KeyPairsV22TestJSON-1244388443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871761380" status: 204 len: 0 microversion: 2.2 time: 0.033264 Oct 31 15:25:14.901164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1240/2572] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Oct 31 15:25:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871761380 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:14.909743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-201d5e78-0ef6-4440-8ed8-bd27ef4a53a0 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.910203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-201d5e78-0ef6-4440-8ed8-bd27ef4a53a0 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Request method failure captured: Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action HTTP/1.1 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 34 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-im7FMxHH-w7r9omnNbWwvFh_XEIAiROT-fgoapU7V_UZU7pCCtDACLNkeraT6LjYrHDvE0q7SeVdtjbKBRcPE54hYVo8B-WIAPhLKHK8gg0c-Y0OwzWTbq9G-BNvOBeU4r1QInCYOYry6yejVFy3DVUBbZu-4ROr9ED6DWcVkirMo Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_571c0706237341a78eed8885e94bd7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 93317ff2aea5495e991052a36e3f0c5e Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: {"addFloatingIp": {"address": ""}} Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a', 'body': {'addFloatingIp': {'address': ''}}} Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi '' Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:14.916149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 15:25:14.920962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.923543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-201d5e78-0ef6-4440-8ed8-bd27ef4a53a0 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:14.924567 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-201d5e78-0ef6-4440-8ed8-bd27ef4a53a0 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action" status: 400 len: 142 microversion: 2.1 time: 0.022208 Oct 31 15:25:14.924886 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec6b1d8a-f8a5-485a-acc2-ec2c6b6c7afb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1314 microversion: 2.1 time: 0.238284 Oct 31 15:25:14.925648 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1333/2573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.926133 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1241/2574] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:14.946400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.948822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.955223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.955786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.956288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.957162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.957691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.958171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.985750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:25:14.986470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquired lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:25:15.116668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.117475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.128149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.130532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.131446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.134203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.134782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.141018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Releasing lock "refresh_cache-148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:25:15.142158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] HTTP exception thrown: floating IP not found Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Request method failure captured: Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action HTTP/1.1 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 41 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-im7FMxHH-w7r9omnNbWwvFh_XEIAiROT-fgoapU7V_UZU7pCCtDACLNkeraT6LjYrHDvE0q7SeVdtjbKBRcPE54hYVo8B-WIAPhLKHK8gg0c-Y0OwzWTbq9G-BNvOBeU4r1QInCYOYry6yejVFy3DVUBbZu-4ROr9ED6DWcVkirMo Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_571c0706237341a78eed8885e94bd7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 93317ff2aea5495e991052a36e3f0c5e Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: exception: floating IP not found Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 31 15:25:15.144401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Returning 404 to user: floating IP not found {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.150409 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78993e5c-14ad-43db-8aa7-4e2f70af72d9 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action" status: 404 len: 67 microversion: 2.1 time: 0.207731 Oct 31 15:25:15.151155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.174638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1334/2575] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action => generated 67 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:15.189163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ba9bf9a-e9e0-421d-a31b-7e9cb95d76fb tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:15.270275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6ba9bf9a-e9e0-421d-a31b-7e9cb95d76fb tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ba9bf9a-e9e0-421d-a31b-7e9cb95d76fb tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Request method failure captured: Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action HTTP/1.1 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 44 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-im7FMxHH-w7r9omnNbWwvFh_XEIAiROT-fgoapU7V_UZU7pCCtDACLNkeraT6LjYrHDvE0q7SeVdtjbKBRcPE54hYVo8B-WIAPhLKHK8gg0c-Y0OwzWTbq9G-BNvOBeU4r1QInCYOYry6yejVFy3DVUBbZu-4ROr9ED6DWcVkirMo Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_571c0706237341a78eed8885e94bd7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 93317ff2aea5495e991052a36e3f0c5e Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: exception: Floating IP not found for address 0.0.0.0. Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 31 15:25:15.272128 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 31 15:25:15.276366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.277769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ba9bf9a-e9e0-421d-a31b-7e9cb95d76fb tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.278814 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ba9bf9a-e9e0-421d-a31b-7e9cb95d76fb tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action" status: 404 len: 88 microversion: 2.1 time: 0.103080 Oct 31 15:25:15.283502 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1335/2576] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:15 2022] POST /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a/action => generated 88 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:15.290443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.291094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.296332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:15.313679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.315005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.315005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.315694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.316399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.318928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.378825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:15.605349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:15.614223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2434869-b345-4854-b5fd-0a9073fadc97 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 200 len: 1521 microversion: 2.1 time: 0.502515 Oct 31 15:25:15.614862 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1242/2577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:15.621917 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e508349c-0c2d-4519-acfa-4faba1362ee8 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "DELETE /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 204 len: 0 microversion: 2.1 time: 0.334012 Oct 31 15:25:15.626381 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1336/2578] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:15 2022] DELETE /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:15.631289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.632116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.633802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.634498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.647211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.647923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.648518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.649420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.650075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.650642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.667476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.668446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.670418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.672729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.677447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.679928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.120746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.130548 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-969c0e8d-c356-4b1e-a46c-64f081844339 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1542 microversion: 2.1 time: 0.502764 Oct 31 15:25:16.131369 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1337/2579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1542 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:16.137354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.138765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:16.146463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.147703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.148140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.148904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.149533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.149958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.159517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.177121 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e03a77e5-e8fa-4890-acf1-0666ff248f92 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.549545 Oct 31 15:25:16.185866 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1243/2580] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:16.194742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.200641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:16.225803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.232887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.233551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.234491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.235185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.235869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.518838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.529381 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6390cdd-6a84-4baa-91a7-ef5e50c0f0da tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1296 microversion: 2.1 time: 0.395316 Oct 31 15:25:16.531828 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1338/2581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:16 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1296 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:16.641790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.642513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:16.654866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.655510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.657394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.661099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.661744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.666847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.858674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.862442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:16.873828 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e5bf579c-722a-464b-9ba0-78b8e15dd6bb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1314 microversion: 2.1 time: 0.685941 Oct 31 15:25:16.875771 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1244/2582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:16 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:17.160677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:17.179659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-005ea550-d625-4cae-84cc-cb48c40cf5b0 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 200 len: 1521 microversion: 2.1 time: 0.542115 Oct 31 15:25:17.180481 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1339/2583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:16 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:17.203786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:17.210685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:17.212036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:17.212899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:17.226081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.230609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.232554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.233592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.234323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.236793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.246724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.247236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.247988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.248762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.253526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.254289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.729454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:17.742604 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6dd5647-066d-459e-bb9a-0f82cf44e4f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.531641 Oct 31 15:25:17.745888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1340/2584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:17 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:17.749107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:17.761157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-dd4f6305-64b5-428c-bbca-8071f703444b req-8ae6609b-632b-4f4e-b34e-3ed1dc6e834a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0356675-eb87-40d1-9c1d-dcae31785320", "name": "network-vif-deleted", "tag": "7113a062-16ba-4d83-9e62-57a99016fee8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:17.765542 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a65eeb59-5f3c-490d-b20b-617c2da63ada tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1542 microversion: 2.1 time: 0.606848 Oct 31 15:25:17.767632 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1245/2585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:17 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1542 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:17.774300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:17.779609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:17.787667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dd4f6305-64b5-428c-bbca-8071f703444b req-8ae6609b-632b-4f4e-b34e-3ed1dc6e834a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.788486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dd4f6305-64b5-428c-bbca-8071f703444b req-8ae6609b-632b-4f4e-b34e-3ed1dc6e834a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.789227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dd4f6305-64b5-428c-bbca-8071f703444b req-8ae6609b-632b-4f4e-b34e-3ed1dc6e834a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.801263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.801762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.802204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.802921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.803385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.803814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.815321 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-dd4f6305-64b5-428c-bbca-8071f703444b req-8ae6609b-632b-4f4e-b34e-3ed1dc6e834a service nova] Creating event network-vif-deleted:7113a062-16ba-4d83-9e62-57a99016fee8 for instance b0356675-eb87-40d1-9c1d-dcae31785320 on n-h1-858383-17 Oct 31 15:25:17.828830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-dd4f6305-64b5-428c-bbca-8071f703444b req-8ae6609b-632b-4f4e-b34e-3ed1dc6e834a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080372 Oct 31 15:25:17.830118 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1341/2586] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:17.906998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:17.911277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:17.916655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:17.926674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.929765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.930125 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f3174d8-d2ee-4fa0-858d-fe002475633b tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1284 microversion: 2.1 time: 0.160641 Oct 31 15:25:17.931559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.932288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.932787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1246/2587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:17 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:17.935190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.935643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.185986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.217081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:18.218004 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c10837e6-1eb2-4f83-9ce1-21316d623b47 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1500 microversion: 2.1 time: 0.323337 Oct 31 15:25:18.220514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.230540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.231316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.232198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.232946 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1342/2588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:17 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1500 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:18.233797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.234413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.235980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.248350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2e48a64-6282-4fcb-b088-80d42884c99c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:18.254947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2e48a64-6282-4fcb-b088-80d42884c99c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.255680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2e48a64-6282-4fcb-b088-80d42884c99c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.256308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2e48a64-6282-4fcb-b088-80d42884c99c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.285853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2e48a64-6282-4fcb-b088-80d42884c99c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:25:18.375906 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2e48a64-6282-4fcb-b088-80d42884c99c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2/action" status: 202 len: 0 microversion: 2.1 time: 0.131950 Oct 31 15:25:18.376774 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1343/2589] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:18 2022] POST /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:25:18.391313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:18.394811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.408622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.409200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.409707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.410432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.412815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.412815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.765340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.766732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.767175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.767628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lazy-loading 'fault' on Instance uuid b0356675-eb87-40d1-9c1d-dcae31785320 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:18.772164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.783496 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7468e288-1e58-4e79-a886-e6bb863bd59a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.401269 Oct 31 15:25:18.784117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1344/2590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:18 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:18.795741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:18.801322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.819549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.820058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.821018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.821941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.822576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.823163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.831831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:18.877227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.886961 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8586213-f0e4-44cd-a665-205ec4bd01b8 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 200 len: 1313 microversion: 2.1 time: 0.681283 Oct 31 15:25:18.892181 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1247/2591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:18 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:18.915001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:18.916517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.942317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.943869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.944316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.947982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.951593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.954582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.226470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:19.239395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f6e9766-4793-435e-bb1f-0909c48d5a00 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.454193 Oct 31 15:25:19.240845 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1345/2592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:18 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:19.246634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:19.247510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:19.255626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.256455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.257039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.258125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.258737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.259170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.674379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93317ff2aea5495e991052a36e3f0c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c0706237341a78eed8885e94bd7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:19.683204 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a4064c3-3cef-4dfe-8fdd-39db39562efd tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 200 len: 1542 microversion: 2.1 time: 0.789903 Oct 31 15:25:19.693758 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1248/2593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:18 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 1542 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:19.698702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9cb4bdd5-8b00-4f6d-9731-fbf06da06b67 req-9e0ef57e-15a5-44ed-b20f-01b75d6acce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a", "name": "network-vif-deleted", "tag": "0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:19.718892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9cb4bdd5-8b00-4f6d-9731-fbf06da06b67 req-9e0ef57e-15a5-44ed-b20f-01b75d6acce4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.724472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9cb4bdd5-8b00-4f6d-9731-fbf06da06b67 req-9e0ef57e-15a5-44ed-b20f-01b75d6acce4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.725158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9cb4bdd5-8b00-4f6d-9731-fbf06da06b67 req-9e0ef57e-15a5-44ed-b20f-01b75d6acce4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.739263 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9cb4bdd5-8b00-4f6d-9731-fbf06da06b67 req-9e0ef57e-15a5-44ed-b20f-01b75d6acce4 service nova] Creating event network-vif-deleted:0ceb3d27-a78f-4c6c-bdd0-0f48108a1be1 for instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a on n-h2-858383-17 Oct 31 15:25:19.753570 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9cb4bdd5-8b00-4f6d-9731-fbf06da06b67 req-9e0ef57e-15a5-44ed-b20f-01b75d6acce4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058291 Oct 31 15:25:19.754555 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1249/2594] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:19.808858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:19.810063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:19.838899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.839531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.840076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.840954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.841555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.842297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.196248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.212619 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d8cd9d9-e47d-4781-85ca-64859d9725d3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.407844 Oct 31 15:25:20.230908 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1250/2595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:19 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:20.246661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.248451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.275541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.279569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.283209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.285339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.289509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.291185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.293424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.321963 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ac65058-e61c-4768-8dcc-65b47d8f72b1 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 1.074883 Oct 31 15:25:20.322922 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1346/2596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:19 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:20.336798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.337812 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] HTTP exception thrown: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:20.342960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 HTTP/1.1 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b0356675-eb87-40d1-9c1d-dcae31785320'} Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.347348 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:20.351897 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.353224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 404 to user: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:20.354034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.354564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.354989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.355705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.357147 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b17df61f-0701-4d30-83e2-5fada2863c4e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 404 len: 111 microversion: 2.1 time: 0.118036 Oct 31 15:25:20.357751 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1251/2597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:20.369077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.369702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.387520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.420689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.421866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:20.450434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.458064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.462500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.463523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.468252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.468951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.655713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67d51057-b284-4615-9912-e3c2d06a6421 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.289614 Oct 31 15:25:20.666525 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1252/2598] 10.222.0.48 () {58 vars in 1230 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:25:20.674313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d49d0e2-32fa-4b87-935f-5031824d9b6e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d49d0e2-32fa-4b87-935f-5031824d9b6e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: action_args: {} Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 15:25:20.683677 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d49d0e2-32fa-4b87-935f-5031824d9b6e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2d49d0e2-32fa-4b87-935f-5031824d9b6e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016203 Oct 31 15:25:20.688962 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1253/2599] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:25:20.697633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.703079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.704448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:20.714172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.714703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.715323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.716161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.717142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.717572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.749099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:25:20.791493 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df02f817-f71e-4f44-8390-a3cdc82f3ef6 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.097480 Oct 31 15:25:20.792882 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1254/2600] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers => generated 683 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:20.799566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.804756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] [instance: 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.814174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.814871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.815523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.816381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.817159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.817808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.834517 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] HTTP exception thrown: Instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a could not be found. Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Request method failure captured: Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a HTTP/1.1 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-im7FMxHH-w7r9omnNbWwvFh_XEIAiROT-fgoapU7V_UZU7pCCtDACLNkeraT6LjYrHDvE0q7SeVdtjbKBRcPE54hYVo8B-WIAPhLKHK8gg0c-Y0OwzWTbq9G-BNvOBeU4r1QInCYOYry6yejVFy3DVUBbZu-4ROr9ED6DWcVkirMo Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_571c0706237341a78eed8885e94bd7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/571c0706237341a78eed8885e94bd7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 571c0706237341a78eed8885e94bd7aa Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 93317ff2aea5495e991052a36e3f0c5e Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a could not be found. Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a'} Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a could not be found. Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a could not be found. Oct 31 15:25:20.837452 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a could not be found. Oct 31 15:25:20.841813 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.843289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] Returning 404 to user: Instance 148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:20.844510 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e051b56a-3cc5-410a-b5ca-166ab5e52a91 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639 tempest-FloatingIPsAssociationNegativeTestJSON-1770631639-project] 10.222.0.48 "GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a" status: 404 len: 111 microversion: 2.1 time: 0.050364 Oct 31 15:25:20.849187 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1255/2601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/148f6a37-73e2-4ed9-9d89-4d1fd78ebb7a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:20.854609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.861213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.861830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.compute.servers [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Removing options 'limit' from query {{(pid=120626) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:25:20.862647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:20.868583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.870015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.870608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.871549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.872180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.872951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.901576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:25:20.926452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.937699 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6036fb9-0f38-4983-a54f-a17d38185ec4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.613388 Oct 31 15:25:20.940733 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1347/2602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:20.962108 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd8e1ff0-5a6d-43bb-a31f-47086eecf798 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.111206 Oct 31 15:25:20.962801 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1256/2603] 10.222.0.48 () {58 vars in 1144 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:20.980150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-318b0500-9513-47a6-a4e3-b5b5cdaa6495 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-318b0500-9513-47a6-a4e3-b5b5cdaa6495 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: action_args: {} Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '-1' Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 15:25:20.988783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-318b0500-9513-47a6-a4e3-b5b5cdaa6495 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:20.993317 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-318b0500-9513-47a6-a4e3-b5b5cdaa6495 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014671 Oct 31 15:25:20.995120 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1348/2604] 10.222.0.48 () {58 vars in 1142 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:21.008077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a85d4a0-6639-4245-977b-77b5b7f79c58 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a85d4a0-6639-4245-977b-77b5b7f79c58 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: action_args: {} Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'testing' Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 15:25:21.017831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 15:25:21.022380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.029214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a85d4a0-6639-4245-977b-77b5b7f79c58 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:21.030378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a85d4a0-6639-4245-977b-77b5b7f79c58 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029716 Oct 31 15:25:21.031129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1257/2605] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:21.046191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78bd1e54-91e4-4898-968a-7781043710d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.056817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-78bd1e54-91e4-4898-968a-7781043710d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.057765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78bd1e54-91e4-4898-968a-7781043710d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:21.065792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.servers [None req-78bd1e54-91e4-4898-968a-7781043710d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Flavor 'non_existing_flavor' could not be found {{(pid=120625) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 31 15:25:21.071996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78bd1e54-91e4-4898-968a-7781043710d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.029313 Oct 31 15:25:21.077213 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1349/2606] 10.222.0.48 () {58 vars in 1178 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:25:21.091448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.110651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.111746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:21.124346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.129488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.130632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.142250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.145712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.146305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.246489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.247121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.254374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.270248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.271226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.272569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.274589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.275251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.331570 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e90f6791-6ae8-439e-93d7-c56f07828b2f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.245118 Oct 31 15:25:21.332834 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1258/2607] 10.222.0.48 () {58 vars in 1174 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:25:21.355786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.365321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.381814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.382318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.382744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.383449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.383906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.384337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.917313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.928045 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52e90703-dec6-4bee-99dd-1369673b6acf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.685854 Oct 31 15:25:21.928785 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1350/2608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:21.934442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.941841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.942729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:21.949065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.949716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.950295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.951184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.951820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.952673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.953191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.962328 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f52414cd-9849-4957-86e3-c52ad5ae5840 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 0.618267 Oct 31 15:25:21.977551 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1259/2609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:21.984394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d18d614d-73e2-4f1b-834b-22b1ed361d26 req-ba93e507-65d7-4481-a86d-8b89308df1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a57e42-12e5-4277-ab80-b73fbe60aeca", "tag": "3021e761-5234-40c9-ac5e-5480ddaf3010"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:21.995493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d18d614d-73e2-4f1b-834b-22b1ed361d26 req-ba93e507-65d7-4481-a86d-8b89308df1fd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.996219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d18d614d-73e2-4f1b-834b-22b1ed361d26 req-ba93e507-65d7-4481-a86d-8b89308df1fd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.996827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d18d614d-73e2-4f1b-834b-22b1ed361d26 req-ba93e507-65d7-4481-a86d-8b89308df1fd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.008421 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d18d614d-73e2-4f1b-834b-22b1ed361d26 req-ba93e507-65d7-4481-a86d-8b89308df1fd service nova] Creating event network-changed:3021e761-5234-40c9-ac5e-5480ddaf3010 for instance d9a57e42-12e5-4277-ab80-b73fbe60aeca on n-h1-858383-17 Oct 31 15:25:22.014037 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d18d614d-73e2-4f1b-834b-22b1ed361d26 req-ba93e507-65d7-4481-a86d-8b89308df1fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034979 Oct 31 15:25:22.014949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1260/2610] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:22.021545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.022415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:22.029718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.030376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.030963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.032399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.033040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.033615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.078418 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-989aec99-8d2e-431f-9751-ba30a37c8e1e tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.148353 Oct 31 15:25:22.087076 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1351/2611] 10.222.0.48 () {58 vars in 1184 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:25:22.095486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.107600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.109140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:22.128329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.128914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.129358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.130307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.131139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.131745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.180810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:25:22.227656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=31 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:22.231160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.259377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.261868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.264406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.441009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.451154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d65accd0-b1ab-4375-b748-e13210fe1afd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.434803 Oct 31 15:25:22.452571 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1261/2612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:22.659660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52579b88-ee08-420a-8dcd-ee27a850f0d7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.570705 Oct 31 15:25:22.661343 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1352/2613] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:22.693085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49876493-1fde-41e8-864f-78887c0e297b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.700069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49876493-1fde-41e8-864f-78887c0e297b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.701253 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49876493-1fde-41e8-864f-78887c0e297b tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014450 Oct 31 15:25:22.703275 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1262/2614] 10.222.0.48 () {58 vars in 1178 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:25:22.717453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.725309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.730205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Searching by: {'deleted': False, 'project_id': '8f774210319947aebe01e092c910c109'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:25:22.739723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.740202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.740631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.745729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.746520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.747138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.822032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:25:22.926981 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99233280-84ae-4f31-ada1-57b3f6840b15 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.212594 Oct 31 15:25:22.930431 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1353/2615] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers => generated 683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:22.943935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.944669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:22.963108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.963733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:22.971457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.972174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.972297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.972947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.973426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.973547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.974395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.975146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.975275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.975828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.976762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.979264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.013829 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] HTTP exception thrown: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 HTTP/1.1 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b0356675-eb87-40d1-9c1d-dcae31785320'} Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:23.017167 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.021757 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.025566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 404 to user: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:23.026709 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-48267202-fab6-46c1-abd3-2f323a130751 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 404 len: 111 microversion: 2.1 time: 0.087485 Oct 31 15:25:23.028083 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1263/2616] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:22 2022] DELETE /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:23.039024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.039648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.050465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.051163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.051909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.053387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.056145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.057160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.275733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=26 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:23.393814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.403515 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e97edd2-770a-41e1-852f-b852139f1071 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 0.373303 Oct 31 15:25:23.404500 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1264/2617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:23 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:23.409806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.410930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.418097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.418970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.419601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.420609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.421283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.421903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.461945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:23.506860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.523858 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c6bd697-0174-475a-bdcd-41cbe75b18b1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.571569 Oct 31 15:25:23.525646 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1354/2618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:23.537611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.538251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.562249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.563816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.566112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.569287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.570077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.571647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.593924 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e154f2c0-f4fe-4c2b-9394-41e3643fb19c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 204 len: 0 microversion: 2.1 time: 0.187747 Oct 31 15:25:23.598507 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1265/2619] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:23 2022] DELETE /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:23.620165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.621881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.643714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.643918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.644361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.645502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.645973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.646611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.729103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:23.739134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:23.825098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.842507 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e0039db-323b-42ba-ab0c-83f34734d7ca tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 0.315760 Oct 31 15:25:23.843661 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1355/2620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:23 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:23.905764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd935ef4-2728-4b8b-a582-170b37d30fa2 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 204 len: 0 microversion: 2.1 time: 0.305352 Oct 31 15:25:23.909728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1266/2621] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:23 2022] DELETE /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:23.926215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.927184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: b0356675-eb87-40d1-9c1d-dcae31785320] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.942263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.944424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.945079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.946104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.946769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.947344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.973229 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] HTTP exception thrown: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 HTTP/1.1 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b0356675-eb87-40d1-9c1d-dcae31785320'} Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.976214 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. Oct 31 15:25:23.979705 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.982254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 404 to user: Instance b0356675-eb87-40d1-9c1d-dcae31785320 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:23.982998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-795815bf-0d7f-4460-a9bb-91cb87e592c4 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320" status: 404 len: 111 microversion: 2.1 time: 0.069916 Oct 31 15:25:23.984414 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1356/2622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:23 2022] GET /compute/v2.1/servers/b0356675-eb87-40d1-9c1d-dcae31785320 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:23.994037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.995493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:24.026491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.030657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.031392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.033532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.034007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.036908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.323359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:24.333129 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae95062d-1ec7-4172-8ff4-45bc014fa8b7 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1522 microversion: 2.1 time: 0.344436 Oct 31 15:25:24.333736 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1267/2623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:23 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:24.428859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:24.429638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:24.452851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.453570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.454238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.455000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.455462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.455881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.552617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:24.553283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:24.564531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.565062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.565508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.571473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.572404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.572787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.802105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:24.814331 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35d8eea8-406e-4a0c-8684-bfb9ec1e2f55 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 0.390299 Oct 31 15:25:24.814936 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1357/2624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:24 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:24.837291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:24.846993 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-124a4ef6-5624-4d91-a890-e5a659092f43 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.298263 Oct 31 15:25:24.863504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1268/2625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:24 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:24.866358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:24.866981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:24.874465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.874894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.875400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.876121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.876584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.877038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:25.358007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:25.359414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:25.375013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:25.375970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:25.379384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:25.380314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:25.381086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:25.384023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:25.978657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:25.989531 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7fd303e0-924d-4bc5-a897-a6e2f787bb62 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1503 microversion: 2.1 time: 1.127012 Oct 31 15:25:25.990138 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1358/2626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:24 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1503 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:26.006466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:26.007295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:26.025896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.027452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.028024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.028917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.029685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.030231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.531419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.545142 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e160187-56be-4ee9-b10a-087f64aedfac tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1522 microversion: 2.1 time: 1.191446 Oct 31 15:25:26.564617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1269/2627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:25 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1522 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:26.573888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:26.575355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:26.585666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:26.589530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.593040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.594767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.596127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.597134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.599801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.833417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.851183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ce5b3fe-69b7-417e-93b8-6098c7fc01b9 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 0.858030 Oct 31 15:25:26.852109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1359/2628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:25 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:27.017025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:27.018444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.042380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.042878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.043318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.044037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.044493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.044966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.546229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:27.557452 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45ec4459-b032-4a71-bb70-301e6409c270 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.990866 Oct 31 15:25:27.560810 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1270/2629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:26 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:27.599870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:27.602081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.632856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.634424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.636054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.638275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.639473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.641910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.693047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:27.704266 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed264aae-f4e5-42e9-a500-efca32a2163e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1493 microversion: 2.1 time: 0.691156 Oct 31 15:25:27.713351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1360/2630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:27 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1493 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:27.736964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d70e37de-1610-4018-a7b0-86c53c75b535 req-7c55fee5-70dc-424f-9f5b-5fb08d86a9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ee1145-b3f9-4bb4-8929-85764de8935b", "name": "network-vif-deleted", "tag": "27437b5b-1e5e-4695-8cce-634cc55f4d4a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:27.769783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d70e37de-1610-4018-a7b0-86c53c75b535 req-7c55fee5-70dc-424f-9f5b-5fb08d86a9b9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.770270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d70e37de-1610-4018-a7b0-86c53c75b535 req-7c55fee5-70dc-424f-9f5b-5fb08d86a9b9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.770698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d70e37de-1610-4018-a7b0-86c53c75b535 req-7c55fee5-70dc-424f-9f5b-5fb08d86a9b9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.792486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d70e37de-1610-4018-a7b0-86c53c75b535 req-7c55fee5-70dc-424f-9f5b-5fb08d86a9b9 service nova] Creating event network-vif-deleted:27437b5b-1e5e-4695-8cce-634cc55f4d4a for instance d8ee1145-b3f9-4bb4-8929-85764de8935b on n-h2-858383-17 Oct 31 15:25:27.798178 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d70e37de-1610-4018-a7b0-86c53c75b535 req-7c55fee5-70dc-424f-9f5b-5fb08d86a9b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075575 Oct 31 15:25:27.798812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1361/2631] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:27.803715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63f26c10-df5d-47e0-88b6-27cbb685eb0e tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '.version_select at 0x7f5ca2349820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:27.807103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f26c10-df5d-47e0-88b6-27cbb685eb0e tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.807884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f26c10-df5d-47e0-88b6-27cbb685eb0e tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.808009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f26c10-df5d-47e0-88b6-27cbb685eb0e tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.839765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63f26c10-df5d-47e0-88b6-27cbb685eb0e tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.039719 Oct 31 15:25:27.840392 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1362/2632] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:25:27 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:27.860682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:27.861830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.875002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.876403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.876914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.878026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.878721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.879385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.042288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d61f32816347ef8ea82dde24d6549d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f774210319947aebe01e092c910c109', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:29.075823 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57a03f63-b767-4052-b20c-49118fb9516c tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 200 len: 1522 microversion: 2.1 time: 1.504062 Oct 31 15:25:29.076442 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1271/2633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:27 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 1522 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:29.081825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:29.082444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:29.088043 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3b6e8886-d38d-4703-acbe-c09a9ca5c4d5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1646 microversion: 2.1 time: 1.231232 Oct 31 15:25:29.091643 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1363/2634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:27 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1646 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:29.104623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:29.106281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:29.119274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.119881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.120476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.122428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.123176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.123603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.124125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.124827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.125160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.128233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.129816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.130265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.961107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:29.980387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92e35616-1e59-4d16-bedb-297b293086e5 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.887083 Oct 31 15:25:29.981021 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1364/2635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:29 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:29.998413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1497883256", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a894f4b9-7bb9-45b6-b49f-684d8b80987a"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:30.095205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] validate_networks() for [('a894f4b9-7bb9-45b6-b49f-684d8b80987a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:30.184153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:30.196663 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a09b0a4e-ee71-4042-8859-43a82f75711c tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 1.119047 Oct 31 15:25:30.209324 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1272/2636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:29 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:30.527816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-efb5e268-8fb4-4854-a3c5-c0e70aa83fc5 req-3bb3b4ed-4f2c-418b-b787-b513faafc4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a57e42-12e5-4277-ab80-b73fbe60aeca", "name": "network-vif-plugged", "status": "completed", "tag": "3021e761-5234-40c9-ac5e-5480ddaf3010"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:30.557712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-efb5e268-8fb4-4854-a3c5-c0e70aa83fc5 req-3bb3b4ed-4f2c-418b-b787-b513faafc4ef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.561186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-efb5e268-8fb4-4854-a3c5-c0e70aa83fc5 req-3bb3b4ed-4f2c-418b-b787-b513faafc4ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.561743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-efb5e268-8fb4-4854-a3c5-c0e70aa83fc5 req-3bb3b4ed-4f2c-418b-b787-b513faafc4ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.600147 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-efb5e268-8fb4-4854-a3c5-c0e70aa83fc5 req-3bb3b4ed-4f2c-418b-b787-b513faafc4ef service nova] Creating event network-vif-plugged:3021e761-5234-40c9-ac5e-5480ddaf3010 for instance d9a57e42-12e5-4277-ab80-b73fbe60aeca on n-h1-858383-17 Oct 31 15:25:30.606495 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-efb5e268-8fb4-4854-a3c5-c0e70aa83fc5 req-3bb3b4ed-4f2c-418b-b787-b513faafc4ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395750 Oct 31 15:25:30.613299 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1273/2637] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:30.627902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ecaa3a5f-87c5-4329-af4f-177d64473b93 req-a529f15f-006e-454f-92ce-548ec5d93111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7", "name": "network-vif-deleted", "tag": "f0d1929f-65e5-476a-9fe7-fbc1a9e0e4ea"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:30.662375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecaa3a5f-87c5-4329-af4f-177d64473b93 req-a529f15f-006e-454f-92ce-548ec5d93111 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.662874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecaa3a5f-87c5-4329-af4f-177d64473b93 req-a529f15f-006e-454f-92ce-548ec5d93111 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.663409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecaa3a5f-87c5-4329-af4f-177d64473b93 req-a529f15f-006e-454f-92ce-548ec5d93111 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.691191 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ecaa3a5f-87c5-4329-af4f-177d64473b93 req-a529f15f-006e-454f-92ce-548ec5d93111 service nova] Creating event network-vif-deleted:f0d1929f-65e5-476a-9fe7-fbc1a9e0e4ea for instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 on n-h1-858383-17 Oct 31 15:25:30.698076 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ecaa3a5f-87c5-4329-af4f-177d64473b93 req-a529f15f-006e-454f-92ce-548ec5d93111 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082843 Oct 31 15:25:30.702680 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1274/2638] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:30.726639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:30.727381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:30.734939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.737005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.737461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.738203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.738676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.739137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.761592 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] HTTP exception thrown: Instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 could not be found. Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 HTTP/1.1 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 could not be found. Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7'} Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 could not be found. Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 could not be found. Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.763310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 could not be found. Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 404 to user: Instance 2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0ee1444-8142-4caf-b3d4-52f7c4eb7430 tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7" status: 404 len: 111 microversion: 2.1 time: 0.047598 Oct 31 15:25:30.768837 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1275/2639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:30 2022] GET /compute/v2.1/servers/2ed59a0e-ff39-4ecd-9b8f-c3de616e4dc7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:30.772137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5fb0278d-2ebb-40a6-b7b1-6fab8f9468d7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Action: 'create', calling method: .version_select at 0x7f5ca2698ca0>, body: {"keypair": {"name": "tempest-keypair-405673413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH70DBzatqkZ2xY9SlWevXOCtnK9A8V+0xfA63l2pcFV4wRKynvhj+g7W4KzUAR/YyWF0Lhf4Wpg/szmFOsCVvMQAxLjeWdN2qEJKQdIjitC/pTA/QqyWILhzJ43kIm0vA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:30.797827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-5fb0278d-2ebb-40a6-b7b1-6fab8f9468d7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Getting quotas for project 7406ef89338d4685a4ff9c3889497d35. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:30.804434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-5fb0278d-2ebb-40a6-b7b1-6fab8f9468d7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Getting quotas for user 945f520b0ae244efa7a4e01cfa3018be and project 7406ef89338d4685a4ff9c3889497d35. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:30.846068 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5fb0278d-2ebb-40a6-b7b1-6fab8f9468d7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.077835 Oct 31 15:25:30.846602 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1276/2640] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:25:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:25:30.862033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:30.864141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] [instance: d8ee1145-b3f9-4bb4-8929-85764de8935b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:30.876797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.877515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.878624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.880078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.880778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.881401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.911893 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] HTTP exception thrown: Instance d8ee1145-b3f9-4bb4-8929-85764de8935b could not be found. Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Request method failure captured: Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b HTTP/1.1 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ifMaXFTa2Sj1OiIQz6DOgugRbcx6m6EYpb5VdawzZyGaRgrqyfqnBc9Vikio3heZ67iIYEqMYFupeHQP_WFm3_P9eokxXzhgL1j6v_dbP4rOU7qH5JVveJZ7kQst8Mcv1VYPE5lfVmOBOOLZiRclYEenXs2-a6Zt0v8USPl3Zd7Qw Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f774210319947aebe01e092c910c109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f774210319947aebe01e092c910c109"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f774210319947aebe01e092c910c109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f774210319947aebe01e092c910c109 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-658047601 Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d7d61f32816347ef8ea82dde24d6549d Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ListServersNegativeTestJSON-658047601-project Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d8ee1145-b3f9-4bb4-8929-85764de8935b could not be found. Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd8ee1145-b3f9-4bb4-8929-85764de8935b'} Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ee1145-b3f9-4bb4-8929-85764de8935b could not be found. Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ee1145-b3f9-4bb4-8929-85764de8935b could not be found. Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.913572 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ee1145-b3f9-4bb4-8929-85764de8935b could not be found. Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] Returning 404 to user: Instance d8ee1145-b3f9-4bb4-8929-85764de8935b could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:30.917417 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-581fe2d3-f1d8-4fad-89f7-653ad870429f tempest-ListServersNegativeTestJSON-658047601 tempest-ListServersNegativeTestJSON-658047601-project] 10.222.0.48 "GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b" status: 404 len: 111 microversion: 2.1 time: 0.057346 Oct 31 15:25:30.920648 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1277/2641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:30 2022] GET /compute/v2.1/servers/d8ee1145-b3f9-4bb4-8929-85764de8935b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:31.008071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:31.009183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:31.022473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:31.023314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:31.024116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:31.025806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:31.026679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:31.027380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:31.196020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:31.425508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:31.443087 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-35d2e57a-1191-4a89-a9d2-fa2d4e475b85 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.439677 Oct 31 15:25:31.459124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1278/2642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:31 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:31.459124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:31.459124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:31.482459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:31.483023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:31.483513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:31.484285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:31.484876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:31.485226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:31.977067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:31.977533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:31.978152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:31.978705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:31.979195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:31.995501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.003971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.004659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.005710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.006460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.007668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.054548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:32.063224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for user 847c3c51ceb3406eb86b222c4638fc59 and project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:32.085676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:32.089563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:32.129202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:32.139481 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63984ecd-a4c8-4ded-9b59-a58761ace0eb tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1352 microversion: 2.1 time: 0.694288 Oct 31 15:25:32.145170 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1279/2643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:31 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1352 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:32.209209 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e5f5fa0-4eb3-4cfd-8bef-cb0f0a97bd34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.220170 Oct 31 15:25:32.210545 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1365/2644] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:25:32.232978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67618044-1961-4bf0-988b-c7cb4332f10e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:32.233622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67618044-1961-4bf0-988b-c7cb4332f10e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:32.472816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:32.473726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:32.491715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-67618044-1961-4bf0-988b-c7cb4332f10e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:32.508435 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67618044-1961-4bf0-988b-c7cb4332f10e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1211 microversion: 2.1 time: 0.290048 Oct 31 15:25:32.510713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.513965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.514673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.515070 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1280/2645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:32 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1211 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:32.516184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.517214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.517804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.526113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:33.179307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:33.180149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:33.211362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.211862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.212568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.213349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.213812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.214245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.481101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:33.492883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a983f448-693a-460c-aaf8-77c99f645fcf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 1.028631 Oct 31 15:25:33.496178 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1366/2646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:32 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:33.542416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:33.543238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:33.558619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.560907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.561843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.566377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.568026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.571919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.202312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:34.215614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f16a8674-ca40-4f9c-aff2-d509dd88cb1c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1207 microversion: 2.1 time: 0.679883 Oct 31 15:25:34.216231 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1367/2647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:33 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1207 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:34.355917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:34.371204 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-65c170fa-afcd-4eaa-b23f-645fa12e5a57 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1542 microversion: 2.1 time: 1.199095 Oct 31 15:25:34.375943 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1281/2648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:33 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1542 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:34.403816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:34.404318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:34.413193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.413771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.414207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.414926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.426112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.426575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.525018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:34.525953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:34.538949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.539805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.542362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.549632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.550452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.551138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.670424 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cfb19878-9618-468e-b2a1-eb7f2fe94a11 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270540 Oct 31 15:25:34.671603 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1368/2649] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:25:34 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:35.243455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:35.243985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:35.255684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:35.256437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:35.257081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:35.261709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:35.262420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:35.263016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:35.459790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:35.462992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:35.477819 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d955919f-5f89-428f-8753-32abb3e79991 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.955856 Oct 31 15:25:35.479834 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1282/2650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:34 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:35.481275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ef84af3-26d2-41c9-a508-3d0bf3067658 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1269 microversion: 2.1 time: 0.242351 Oct 31 15:25:35.485204 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1369/2651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:35 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:36.504240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:36.508095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:36.511441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:36.512436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:36.524918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.525421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.530554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.532193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.534838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.537919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.542820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.550208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.553544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.561321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.562048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.564625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.890217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:36.905419 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f9b1fd2-2730-44bf-8bb7-4aa11e1d761b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1269 microversion: 2.1 time: 0.397683 Oct 31 15:25:36.907817 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1370/2652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:36 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1269 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:37.351710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.365477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b8bf3139-c7ef-4b35-a6ec-690166d2ca97 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.866154 Oct 31 15:25:37.369716 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1283/2653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:36 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:37.929496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:37.930138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:37.948457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.950801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.951554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.952521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.954715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.956411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:38.145001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-859069400", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "db7c0839-83e3-421c-b30e-04f285328a63"}, {"port": "10f655b8-38c5-4e9e-9f89-e6636a1238ae", "tag": "port-1"}, {"port": "d3956ef2-61dc-4b6a-84dd-c6a3da755bdf", "tag": "port-2"}, {"uuid": "b27c628e-22a9-4943-92cf-2dd70a82e676", "tag": "net-1"}, {"uuid": "b27c628e-22a9-4943-92cf-2dd70a82e676"}, {"uuid": "ca0a420a-7537-494b-99e7-1b4876b10e44", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ca0a420a-7537-494b-99e7-1b4876b10e44", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b7a736ca-ee3e-43e8-a2c8-53c2c580c0c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c0cdd76f-32c1-4f86-b40b-24cd0ddd606f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cd1dfc21-cd66-49a5-b0f8-09e0eaebbf0d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1857203258"}], "key_name": "tempest-keypair-405673413", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:38.738830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] validate_networks() for [('db7c0839-83e3-421c-b30e-04f285328a63', None, None, None, None, None), (None, None, '10f655b8-38c5-4e9e-9f89-e6636a1238ae', None, None, None), (None, None, 'd3956ef2-61dc-4b6a-84dd-c6a3da755bdf', None, None, None), ('b27c628e-22a9-4943-92cf-2dd70a82e676', None, None, None, None, None), ('b27c628e-22a9-4943-92cf-2dd70a82e676', None, None, None, None, None), ('ca0a420a-7537-494b-99e7-1b4876b10e44', '10.2.2.100', None, None, None, None), ('ca0a420a-7537-494b-99e7-1b4876b10e44', '10.2.2.200', None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:39.098903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:39.114280 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d06df1bf-7ab7-4d71-afeb-ea18d0fc3a34 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 1.189063 Oct 31 15:25:39.115484 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1371/2654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:37 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:39.120338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:39.121244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:39.134995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.135783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.136483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.137450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.138135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.138874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.545390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:39.559295 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21b4a142-a94b-4196-a618-8bdfadeebac8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.442394 Oct 31 15:25:39.561248 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1372/2655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:39 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:39.575182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6e6ddc39-3c7b-4654-a9e2-7b53df884b66 req-73e26cd4-e8a1-43d2-a648-790b7366fbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a57e42-12e5-4277-ab80-b73fbe60aeca", "tag": "3021e761-5234-40c9-ac5e-5480ddaf3010"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:39.599207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6e6ddc39-3c7b-4654-a9e2-7b53df884b66 req-73e26cd4-e8a1-43d2-a648-790b7366fbd1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.599708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6e6ddc39-3c7b-4654-a9e2-7b53df884b66 req-73e26cd4-e8a1-43d2-a648-790b7366fbd1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.600307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6e6ddc39-3c7b-4654-a9e2-7b53df884b66 req-73e26cd4-e8a1-43d2-a648-790b7366fbd1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.623343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6e6ddc39-3c7b-4654-a9e2-7b53df884b66 req-73e26cd4-e8a1-43d2-a648-790b7366fbd1 service nova] Creating event network-changed:3021e761-5234-40c9-ac5e-5480ddaf3010 for instance d9a57e42-12e5-4277-ab80-b73fbe60aeca on n-h1-858383-17 Oct 31 15:25:39.629643 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6e6ddc39-3c7b-4654-a9e2-7b53df884b66 req-73e26cd4-e8a1-43d2-a648-790b7366fbd1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065467 Oct 31 15:25:39.630575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1373/2656] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:40.140151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:40.141873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:40.161827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.167130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.167746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.168684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.172739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.176788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.893925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:40.907773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94f464f0-aff7-4439-8dc2-8942988a8ab3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 0.772960 Oct 31 15:25:40.908684 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1374/2657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:40 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:40.923958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:40.925076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:40.935121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.937513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.939180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.940513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.945272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.945961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.415425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:41.432369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d4ae6c5-4750-46fd-b49c-343bec61ced2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.522405 Oct 31 15:25:41.440101 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1375/2658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:40 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:41.712130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-bcaab5bd-e711-4e8d-9af4-be7d7e9a9379 req-65dd07bb-8d42-4c5f-9cb9-0dad685089e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bdba62-3915-4a6e-9e9a-e62816afbf43", "tag": "492b079c-3e8b-4cf0-abb8-9148ca51a365"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:41.733751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bcaab5bd-e711-4e8d-9af4-be7d7e9a9379 req-65dd07bb-8d42-4c5f-9cb9-0dad685089e1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.733751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bcaab5bd-e711-4e8d-9af4-be7d7e9a9379 req-65dd07bb-8d42-4c5f-9cb9-0dad685089e1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.733751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bcaab5bd-e711-4e8d-9af4-be7d7e9a9379 req-65dd07bb-8d42-4c5f-9cb9-0dad685089e1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.757384 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-bcaab5bd-e711-4e8d-9af4-be7d7e9a9379 req-65dd07bb-8d42-4c5f-9cb9-0dad685089e1 service nova] Creating event network-changed:492b079c-3e8b-4cf0-abb8-9148ca51a365 for instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 on n-h2-858383-17 Oct 31 15:25:41.769068 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-bcaab5bd-e711-4e8d-9af4-be7d7e9a9379 req-65dd07bb-8d42-4c5f-9cb9-0dad685089e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327637 Oct 31 15:25:41.769692 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1376/2659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:41.932348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:41.933084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:41.947642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:41.949766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.950338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.952917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.952917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.952917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.952917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.035115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:42.077717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=7 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:42.504953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:42.586960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:42.600860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-18ef151d-1194-46f2-b489-e9918359db58 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 0.670943 Oct 31 15:25:42.601908 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1377/2660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:41 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:42.611941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:42.613312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:42.628168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:42.628780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:42.629421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.630220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:42.630761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:42.631268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.010588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:43.020985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ebc1f076-669b-4716-8cd2-489b82edeb17 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.417765 Oct 31 15:25:43.022542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1378/2661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:42 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:43.669381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:43.671224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:43.692964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.693890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.694882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.695829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.696754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.697425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:44.210074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:44.222308 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a141f9a-b494-4c81-97a7-89cb27568273 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 0.594129 Oct 31 15:25:44.222910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1379/2662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:43 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:44.238852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:44.239488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:44.249551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:44.249551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:44.249551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:44.250334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:44.251114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:44.251559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.141611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:45.153365 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-209c29d4-45ad-4328-be4f-82f826b0f897 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.929373 Oct 31 15:25:45.153947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1380/2663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:44 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:45.250008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:45.252298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:45.263561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.264320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.265088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.266232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.266932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.267596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.877862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:45.896058 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a7738e5-2538-4bc7-bbce-ad420ef7d0f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 0.650409 Oct 31 15:25:45.918269 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1381/2664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:45 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:46.189528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:46.190900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:46.210729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.211229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.216275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.225927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.226821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.227628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.819184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:46.819749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:46.820096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:46.821225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:46.821662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:46.842947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.848864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.849541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.851572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.852075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.852519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.881484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:46.897575 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e878f6a3-ec9c-4678-b5c5-af98a1767c5a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.714743 Oct 31 15:25:46.900775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1382/2665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:46 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:46.927310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:46.927941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:46.946821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Getting quotas for project 7406ef89338d4685a4ff9c3889497d35. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:46.955913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.959302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.963577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.976484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.977061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.978711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.986462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Getting quotas for user 945f520b0ae244efa7a4e01cfa3018be and project 7406ef89338d4685a4ff9c3889497d35. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:47.339581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:47.346680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b7a736ca-ee3e-43e8-a2c8-53c2c580c0c0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c0cdd76f-32c1-4f86-b40b-24cd0ddd606f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd1dfc21-cd66-49a5-b0f8-09e0eaebbf0d',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:47.926966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d213a69b-c7bb-4480-a532-d8d148dfb45a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.786157 Oct 31 15:25:47.928564 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1284/2666] 10.222.0.48 () {62 vars in 1189 bytes} [Mon Oct 31 15:25:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 9789 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 31 15:25:47.940959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:47.941725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:47.955607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.956528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.965804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:47.984212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.989738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.990436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.991024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.991715 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46f4a51d-d16c-4c7d-8182-71310b7eb679 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 1.069332 Oct 31 15:25:48.021656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1383/2667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:46 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:48.048801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-cefd37d7-cd02-496e-a7fa-5e493616ccf9 req-06dcaafa-9344-4852-ba48-eee04ca8cd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bdba62-3915-4a6e-9e9a-e62816afbf43", "name": "network-vif-plugged", "status": "completed", "tag": "492b079c-3e8b-4cf0-abb8-9148ca51a365"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:48.085888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cefd37d7-cd02-496e-a7fa-5e493616ccf9 req-06dcaafa-9344-4852-ba48-eee04ca8cd07 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.086720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cefd37d7-cd02-496e-a7fa-5e493616ccf9 req-06dcaafa-9344-4852-ba48-eee04ca8cd07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.087174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cefd37d7-cd02-496e-a7fa-5e493616ccf9 req-06dcaafa-9344-4852-ba48-eee04ca8cd07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.136495 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-cefd37d7-cd02-496e-a7fa-5e493616ccf9 req-06dcaafa-9344-4852-ba48-eee04ca8cd07 service nova] Creating event network-vif-plugged:492b079c-3e8b-4cf0-abb8-9148ca51a365 for instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 on n-h2-858383-17 Oct 31 15:25:48.157676 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-cefd37d7-cd02-496e-a7fa-5e493616ccf9 req-06dcaafa-9344-4852-ba48-eee04ca8cd07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125764 Oct 31 15:25:48.158367 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1384/2668] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:48.166546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.169280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:48.195630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.197008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.198951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.199937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.202227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.203540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.222462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:48.378679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lazy-loading 'services' on Instance uuid b36cbe18-c310-412f-b545-20d7a7ba77b4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:48.680047 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e71a948-19af-46ec-8b84-4667bc53deba tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-volume_attachments/661cb803-288c-4a1e-991b-ced5278e477e" status: 202 len: 0 microversion: 2.1 time: 0.749768 Oct 31 15:25:48.682630 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1285/2669] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:25:47 2022] DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-volume_attachments/661cb803-288c-4a1e-991b-ced5278e477e => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:48.700955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d384543-405f-445b-9147-b28377fa8ba9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.713746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d384543-405f-445b-9147-b28377fa8ba9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:49.035986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d384543-405f-445b-9147-b28377fa8ba9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.046945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d384543-405f-445b-9147-b28377fa8ba9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.051301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d384543-405f-445b-9147-b28377fa8ba9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.059027 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d384543-405f-445b-9147-b28377fa8ba9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1284 microversion: 2.42 time: 0.373498 Oct 31 15:25:49.059638 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1286/2670] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:48 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1284 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:49.073236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:49.074204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:49.082284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.085242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.085951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.087754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.091181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.091851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.130547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:49.143608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.155130 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9feb5f66-e1f6-46c7-8cc4-ebcadb5832c1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1510 microversion: 2.1 time: 0.995368 Oct 31 15:25:49.156189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1385/2671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:48 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1510 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:49.400283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.412806 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e21f8e7-01bd-44b7-b0e9-71730769b311 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1311 microversion: 2.1 time: 0.351794 Oct 31 15:25:49.419630 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1287/2672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:49 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:50.092222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:50.092876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:50.119985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.120502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.122547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.123465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.128207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.129582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.184253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:50.191094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:50.210526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.211347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.213957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.216944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.217626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.220950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.681584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:50.703014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:50.727358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:50.728595 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f81e3fd3-faa7-4ea2-a2bd-c15420fc14dd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1518 microversion: 2.42 time: 0.640368 Oct 31 15:25:50.729196 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1386/2673] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:50 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1518 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:50.753938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:50.756525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:50.779914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.782970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.788250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.791879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.797286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.798784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.243003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:51.263819 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c774b54-f9bd-435d-99cf-11019fc3b1b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1487 microversion: 2.1 time: 1.079828 Oct 31 15:25:51.264406 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1288/2674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:50 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1487 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:51.308892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:51.310272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:51.339573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.340222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.340684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.341478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.341950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.342387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.422938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:51.625365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2bbad78f-9ae0-4bf1-908e-7ffa253e561e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 204 len: 0 microversion: 2.1 time: 0.333172 Oct 31 15:25:51.626608 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1289/2675] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:51 2022] DELETE /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:51.637681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:51.638739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:51.651681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.652587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.653270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.654775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.655449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.656100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.827950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:51.842281 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8693fb0a-ce31-42c0-af12-576c3edaa5ac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1494 microversion: 2.1 time: 1.110257 Oct 31 15:25:51.842880 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1387/2676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:50 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1494 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:51.870136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:51.874612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:51.895196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.895986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.896605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.897532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.899264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.903358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.147799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:52.171194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:52.173761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:52.179514 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11bec248-2faa-432c-b929-6f5264ea62e8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1592 microversion: 2.42 time: 0.326925 Oct 31 15:25:52.209097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1388/2677] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:51 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1592 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:52.214849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:52.220615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:52.231476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.232047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.243059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.244256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.244995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.245653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.754541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:52.770992 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a816ef62-a27a-4904-9b29-e7e12f07b65f tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1493 microversion: 2.1 time: 1.139560 Oct 31 15:25:52.774586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1290/2678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:51 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1493 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:53.214155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:53.215141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:53.227822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.231644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.232296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.233813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.234738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.235802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.843087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:53.863052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:53.865455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:53.874043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-787525a5-5ae6-4b62-9a50-8f4ae1707c43 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1592 microversion: 2.42 time: 0.665245 Oct 31 15:25:53.877021 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1291/2679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:53 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1592 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:53.895553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:53.897474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:53.913894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.914760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.915720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.919606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.920551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.921533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.973956 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c89ffd4-c4cc-44a3-a923-881b96961047 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1647 microversion: 2.1 time: 1.763293 Oct 31 15:25:53.977284 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1389/2680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:52 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1647 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:54.015162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-730a2f53-19fe-4085-884c-8d978e90e8dc req-18f412ed-4d84-4651-964b-17dc457ff30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2", "name": "network-vif-deleted", "tag": "2451a632-0a3f-4a68-b480-aaf338b2bd65"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:54.035637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-730a2f53-19fe-4085-884c-8d978e90e8dc req-18f412ed-4d84-4651-964b-17dc457ff30c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.036381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-730a2f53-19fe-4085-884c-8d978e90e8dc req-18f412ed-4d84-4651-964b-17dc457ff30c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.037005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-730a2f53-19fe-4085-884c-8d978e90e8dc req-18f412ed-4d84-4651-964b-17dc457ff30c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.061931 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-730a2f53-19fe-4085-884c-8d978e90e8dc req-18f412ed-4d84-4651-964b-17dc457ff30c service nova] Creating event network-vif-deleted:2451a632-0a3f-4a68-b480-aaf338b2bd65 for instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 on n-h2-858383-17 Oct 31 15:25:54.073937 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-730a2f53-19fe-4085-884c-8d978e90e8dc req-18f412ed-4d84-4651-964b-17dc457ff30c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094874 Oct 31 15:25:54.079792 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1390/2681] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:54.085578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:54.094930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:54.107298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.108104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.108770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.111098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.111980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.112634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.185717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:54.195848 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5642901c-390b-4995-9de1-575c3e4273e3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 200 len: 1451 microversion: 2.1 time: 0.317447 Oct 31 15:25:54.202141 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1292/2682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:53 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 1451 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:54.608288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a398471-52ab-4253-bf54-657c53522cce tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1647 microversion: 2.1 time: 0.526888 Oct 31 15:25:54.609588 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1391/2683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:54 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1647 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:54.633984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:54.638377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.639145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.639797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.641357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.642041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.642862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.690293 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afcfc9e0-591a-4065-8c94-f6703d5c7ebb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.059932 Oct 31 15:25:54.691655 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1293/2684] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:25:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:54.703846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:54.705244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:54.718460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.719594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.722466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.723258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.726363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.727020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.868145 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c39f0cd-3f3e-4506-810b-fb1405058ce5 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43/action" status: 202 len: 0 microversion: 2.1 time: 0.168505 Oct 31 15:25:54.871026 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1392/2685] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:54 2022] POST /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:54.887292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:54.888675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:54.900796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.902247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.904501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.906472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.908312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.910668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.915980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:54.916726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:54.954527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.957026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.961024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.964884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.965756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.968068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:55.193229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:55.226989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:55.234780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:55.236735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50473b26-8b51-4a1b-899c-1fd207e670dc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1592 microversion: 2.42 time: 0.335008 Oct 31 15:25:55.241139 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1393/2686] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:54 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1592 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:55.246250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:55.253905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:55.265371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:55.266975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:55.267656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:55.274038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:55.277821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:55.278427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:55.336665 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 HTTP/1.1 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2'} Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:55.342224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bfb5155c-6e8c-4cf8-af1e-8b15d8feff32 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 404 len: 111 microversion: 2.1 time: 0.101430 Oct 31 15:25:55.347600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1394/2687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:55 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:55.426589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-58855ec5-eb34-47b2-9ab4-c85c6b493982 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1652 microversion: 2.1 time: 0.550095 Oct 31 15:25:55.432604 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1294/2688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:54 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1652 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:55.580411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-482550870", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "22b89a26-dc00-4184-b059-6e0647a55008"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:55.710505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] validate_networks() for [('22b89a26-dc00-4184-b059-6e0647a55008', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:55.936923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2eb79ac-5d0f-47ba-b196-e4167aa67d0f tempest-FloatingIPDetailsNegativeTestJSON-2096614097 tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project] Calling method '.version_select at 0x7f5ca23f7c10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:56.117437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-b2eb79ac-5d0f-47ba-b196-e4167aa67d0f tempest-FloatingIPDetailsNegativeTestJSON-2096614097 tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 746527c9-01c6-4133-a92c-076456cfd99d could not be found", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:25:56.118174 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b2eb79ac-5d0f-47ba-b196-e4167aa67d0f tempest-FloatingIPDetailsNegativeTestJSON-2096614097 tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project] HTTP exception thrown: Floating IP not found for ID 746527c9-01c6-4133-a92c-076456cfd99d Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2eb79ac-5d0f-47ba-b196-e4167aa67d0f tempest-FloatingIPDetailsNegativeTestJSON-2096614097 tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project] Request method failure captured: Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-floating-ips/746527c9-01c6-4133-a92c-076456cfd99d HTTP/1.1 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-kDUof6N4BnNXaO_MIqo30DbM2222kKoqZ8ADmdxdm5g6kWTAB1fHY3c9ABhgeV8SCLVu7rIq8_jgAaNXdKMlLLrytvRkApK6X7vYVVecIZ7t6jQ2jDQ2fvxz9OQ5W7cW1jsjpvJ6NifS3h2n_MH86DjHjFuBUPYJJ-kumSJZjEcPQ Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 37e96262f12b416ba8bcd8345d310c91 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2096614097 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/37e96262f12b416ba8bcd8345d310c91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37e96262f12b416ba8bcd8345d310c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_37e96262f12b416ba8bcd8345d310c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37e96262f12b416ba8bcd8345d310c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2096614097 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 37e96262f12b416ba8bcd8345d310c91 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2096614097 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 64400302aed949fdb13f622538200bc5 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: exception: Floating IP not found for ID 746527c9-01c6-4133-a92c-076456cfd99d Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '746527c9-01c6-4133-a92c-076456cfd99d'} Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:25:56.120196 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 746527c9-01c6-4133-a92c-076456cfd99d could not be found Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8b6b018-0e6c-4fef-9b95-fc5e2004cd24'] Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 746527c9-01c6-4133-a92c-076456cfd99d. Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 746527c9-01c6-4133-a92c-076456cfd99d Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 746527c9-01c6-4133-a92c-076456cfd99d Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2eb79ac-5d0f-47ba-b196-e4167aa67d0f tempest-FloatingIPDetailsNegativeTestJSON-2096614097 tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project] Returning 404 to user: Floating IP not found for ID 746527c9-01c6-4133-a92c-076456cfd99d {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2eb79ac-5d0f-47ba-b196-e4167aa67d0f tempest-FloatingIPDetailsNegativeTestJSON-2096614097 tempest-FloatingIPDetailsNegativeTestJSON-2096614097-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/746527c9-01c6-4133-a92c-076456cfd99d" status: 404 len: 111 microversion: 2.1 time: 0.289659 Oct 31 15:25:56.130078 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1295/2689] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:25:55 2022] GET /compute/v2.1/os-floating-ips/746527c9-01c6-4133-a92c-076456cfd99d => generated 111 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:56.271333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:56.273387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:56.290164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.294863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.295548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.296491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.297767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.298457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.724882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:56.735605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:56.747542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:56.751990 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9637c09b-8be2-4985-a6d1-cfb51bf4e2f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1660 microversion: 2.42 time: 0.484875 Oct 31 15:25:56.757333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1296/2690] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:56 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1660 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:56.770141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:56.771015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:56.773634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:56.783363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.785279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.789049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.790082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.790714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.791309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.095954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b28164a6-921a-48d0-9b33-4610dd2c6258 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1632 microversion: 2.1 time: 0.337198 Oct 31 15:25:57.099406 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1297/2691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:56 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1632 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:57.120621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:57.123783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:57.141990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.142975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.144311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.149896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.153118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.153653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.159311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:57.178903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:57.179664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:57.180278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:57.180948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:57.192573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.193447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.194756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.195726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.196785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.197489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.238417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:57.246729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Getting quotas for user b3902aed18f6476e85a4c0c837403792 and project b0bb076112f34d5f895359bd4562a77f. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:57.258864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lazy-loading 'flavor' on Instance uuid c7bdba62-3915-4a6e-9e9a-e62816afbf43 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:57.265382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:57.270213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:57.278140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Going to try to live migrate instance to n-h1-858383-17 {{(pid=120626) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:25:57.369074 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35a0a00a-2112-4963-aca2-e58bb2ce108a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790442 Oct 31 15:25:57.376262 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1395/2692] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:25:57.382683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-262bb2e7-c971-4a47-b819-223ce979b0b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:57.384465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-262bb2e7-c971-4a47-b819-223ce979b0b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:57.930921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-262bb2e7-c971-4a47-b819-223ce979b0b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:57.941903 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-262bb2e7-c971-4a47-b819-223ce979b0b8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1214 microversion: 2.1 time: 0.563369 Oct 31 15:25:57.976582 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1396/2693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:57 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1214 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:57.993122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:57.994860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:58.025281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:58.032871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:58.033808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:58.035396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:58.053167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:58.059605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:58.766604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:58.805312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:58.815624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:58.818996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57a6d039-012c-4058-b729-a3d1b8e7b285 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1707 microversion: 2.42 time: 0.840374 Oct 31 15:25:58.821332 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1397/2694] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:57 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1707 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:58.971814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:58.972461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:59.000729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:59.001661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:59.006090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:59.010179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:59.010688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:59.011151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:59.044752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:59.237563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:59.254951 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3923fee-5427-4966-a899-c1b2008d49df tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1210 microversion: 2.1 time: 0.287866 Oct 31 15:25:59.260435 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1398/2695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:58 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1210 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:59.857995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:59.858695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:59.874072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:59.874586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:59.875092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:59.876348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:59.876950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:59.888736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:00.398832 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eae669e2-d128-439c-9de4-591c7531b257 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43/action" status: 202 len: 0 microversion: 2.1 time: 3.282767 Oct 31 15:26:00.405605 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1298/2696] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:57 2022] POST /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43/action => generated 0 bytes in 3290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:26:00.413104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:00.414036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:00.454729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:00.457115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:00.457803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:00.462145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:00.463071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:00.466997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.053906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:01.067966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee6ef052-0c36-4956-8485-f2dda6d7b506 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1272 microversion: 2.1 time: 0.659699 Oct 31 15:26:01.068601 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1299/2697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:00 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1272 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:01.094743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:01.100338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:01.154986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.156868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.157819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.159398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.196962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.197873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.257472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:01.274521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:01.286088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:01.288198 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9fe47088-25da-47ad-a52b-9e38ce03b0b7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1754 microversion: 2.42 time: 1.438574 Oct 31 15:26:01.304736 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1399/2698] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:59 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1754 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:01.304736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5058f421-14b9-4df3-bb41-853d517e2451 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:01.320151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5058f421-14b9-4df3-bb41-853d517e2451 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.320653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5058f421-14b9-4df3-bb41-853d517e2451 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.323710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5058f421-14b9-4df3-bb41-853d517e2451 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.388298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5058f421-14b9-4df3-bb41-853d517e2451 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:26:01.521611 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5058f421-14b9-4df3-bb41-853d517e2451 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action" status: 202 len: 0 microversion: 2.1 time: 0.225276 Oct 31 15:26:01.524059 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1400/2699] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:01 2022] POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:01.536921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:01.538088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:01.549206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.550752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.551763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.553332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.554910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.556057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:02.753000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:02.763468 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d781b42-1448-4df2-8975-21b6642c4c66 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 1.693714 Oct 31 15:26:02.768484 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1300/2700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:01 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:02.774367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:02.775225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:02.797992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:02.798942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:02.799707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:02.801366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:02.802910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:02.803599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:02.871149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:02.900796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09c20989-20a7-4c14-9581-6325fdeafee5 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1676 microversion: 2.1 time: 1.371485 Oct 31 15:26:02.913874 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1401/2701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:01 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1676 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:02.939310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:02.945819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:02.949090 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d997ebac-7f21-42ae-828a-8926adca80c0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1272 microversion: 2.1 time: 0.179200 Oct 31 15:26:02.965973 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1301/2702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:02 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:02.987176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:02.988004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:03.010837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.012891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.013544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.015985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.016644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.019788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.097077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-919154843", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "9873d7d2-87db-4da5-b204-7fd745ce22ee"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:03.267911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] validate_networks() for [('9873d7d2-87db-4da5-b204-7fd745ce22ee', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:03.952768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:03.972003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:03.974276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:03.975774 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de20ea4c-e5d2-4a0e-ae94-13de48a8f177 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1754 microversion: 2.42 time: 1.008461 Oct 31 15:26:03.979165 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1302/2703] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:02 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1754 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:03.992832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:03.993515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:04.006243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:04.007040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:04.007648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:04.008507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:04.010999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:04.011610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:04.653611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:04.990342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:05.001757 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c779fd0c-63d0-4ea0-80b1-db67241c61e3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 1.019332 Oct 31 15:26:05.019726 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1303/2704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:03 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:05.034307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.036508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:05.070920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.071690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.072277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.073202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.073813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.074391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.795615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:05.804039 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d59a9c38-68e6-44b4-b663-4c75b3c6a86b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1676 microversion: 2.1 time: 0.780452 Oct 31 15:26:05.808063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1304/2705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:05 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1676 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:05.813199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.821311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:05.841026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.841978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.842491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.843243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.844364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.845036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.113414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:06.114479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:06.115120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:06.115703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:06.116279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:06.131038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.133789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.135395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.137642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.141758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.142439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.198222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Getting quotas for project 64307ef169384231a2e9e38774c13285. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:06.215376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Getting quotas for user 0ae524b47b8e4a3c85c37baf9dfd3e76 and project 64307ef169384231a2e9e38774c13285. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:06.272440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:06.278786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:06.401572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2b37667-7f84-426d-982d-09957038a6c0 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.486457 Oct 31 15:26:06.413728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1402/2706] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:06.418721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:06.436492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:06.452612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.453769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.454287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.455123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.455594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.456029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.521698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:06.707676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:06.734484 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-790743b7-4e9f-435f-b6b8-7d33c976fb4c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.919093 Oct 31 15:26:06.736677 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1305/2707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:05 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:06.750262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:06.751266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:06.762299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.766406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.767346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.768859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.771068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.771667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:07.814503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:07.828730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:07.830543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:07.831998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d0cf8c2-cd29-4a17-8dc8-3970f2d6c92e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1754 microversion: 2.42 time: 1.417196 Oct 31 15:26:07.833226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1403/2708] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:06 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1754 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:07.855720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:07.856680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:07.879771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:07.880422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:07.881026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:07.882063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:07.882595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:07.883249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.033638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:08.043988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9bc8c65d-40c7-4de2-8d57-d82b37b0ce2b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1268 microversion: 2.1 time: 0.208231 Oct 31 15:26:08.048667 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1404/2709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:07 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:08.057172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:08.058304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:08.067355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.068252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.069183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.083614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.084658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.085362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.352469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:08.354132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:08.379763 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-671e4ed3-afcb-4473-bfda-8b0d9b05fe45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 1.641658 Oct 31 15:26:08.385481 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1306/2710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:06 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:08.390152 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af2d7dbb-a72e-4726-a584-957d6c0ca0ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1676 microversion: 2.1 time: 0.338432 Oct 31 15:26:08.398490 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1405/2711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:08 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1676 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:08.403940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:08.407543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:08.422596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.424024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.427319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.429289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.431040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.431870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.809325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:08.820902 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f86e861-cde8-4da6-82f2-1ddabc214e28 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.424586 Oct 31 15:26:08.823769 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1307/2712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:08 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:08.863308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:08.863932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:08.878373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.884088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.885202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.900413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.904305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.905743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.068980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:09.069610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:09.092361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.092891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.099654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.101345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.102642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.103910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.738725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:09.750971 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d78cfb0-668a-40a4-b0ac-c0351f179906 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1274 microversion: 2.1 time: 0.686193 Oct 31 15:26:09.751584 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1308/2713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:09 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1274 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:09.792206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-343427b1-a22a-4474-ae1b-cc37db4c5b80 req-0976cd04-3b91-4cdf-9aa5-2737a0f21689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bdba62-3915-4a6e-9e9a-e62816afbf43", "name": "network-vif-unplugged", "status": "completed", "tag": "492b079c-3e8b-4cf0-abb8-9148ca51a365"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:09.837238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-343427b1-a22a-4474-ae1b-cc37db4c5b80 req-0976cd04-3b91-4cdf-9aa5-2737a0f21689 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.840378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-343427b1-a22a-4474-ae1b-cc37db4c5b80 req-0976cd04-3b91-4cdf-9aa5-2737a0f21689 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.842991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-343427b1-a22a-4474-ae1b-cc37db4c5b80 req-0976cd04-3b91-4cdf-9aa5-2737a0f21689 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.881686 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-343427b1-a22a-4474-ae1b-cc37db4c5b80 req-0976cd04-3b91-4cdf-9aa5-2737a0f21689 service nova] Creating event network-vif-unplugged:492b079c-3e8b-4cf0-abb8-9148ca51a365 for instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 on n-h2-858383-17 Oct 31 15:26:09.895540 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-343427b1-a22a-4474-ae1b-cc37db4c5b80 req-0976cd04-3b91-4cdf-9aa5-2737a0f21689 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129128 Oct 31 15:26:09.897023 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1309/2714] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:09.911533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:09.916148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:09.927159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.927902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.928343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.929082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.929553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.930005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.010122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:10.033105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:10.034753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:10.055397 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08c6646b-4276-43cf-87f3-1b91a367acd1 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1801 microversion: 2.42 time: 1.180696 Oct 31 15:26:10.057566 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1406/2715] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:08 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1801 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:10.064624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:10.065994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:10.073892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:10.074812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:10.075670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.076884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:10.080129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:10.080907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.653688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:10.662860 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa4f149a-f9a1-4f77-8832-67fc0674811a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1676 microversion: 2.1 time: 0.762296 Oct 31 15:26:10.675508 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1310/2716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:09 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1676 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:10.680950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:10.684917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:10.710556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:10.711903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:10.712521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.714184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:10.719295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:10.720560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.760531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:10.774265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58d1493e-6a8f-4541-a96c-fc3712c1006b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 0.713849 Oct 31 15:26:10.778070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1407/2717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:10 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:10.786722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:10.793019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:10.799625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:10.800331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:10.800978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.802106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:10.802718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:10.803286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.316099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:11.324574 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2659849f-dbdf-4c6c-a68b-8a3fb6b08772 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1316 microversion: 2.1 time: 0.545020 Oct 31 15:26:11.362479 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1408/2718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:10 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:11.372083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:11.372850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:11.392162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.392681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.393157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.401557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.402161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.402496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.600472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:11.624161 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6625394b-ef54-48ee-9037-a695b1b8bc88 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.946954 Oct 31 15:26:11.625511 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1311/2719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:10 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:11.649806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-91e6169c-bc9a-432f-b910-7dfd3961d8e2 req-21cc50ad-f0e3-4c0e-a3dc-feade0f0428b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b06cdf2-6d35-42c1-859f-9113c91fe65e", "tag": "96f14a49-fda9-472f-8a9e-7f7fe1defda5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:11.668275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-91e6169c-bc9a-432f-b910-7dfd3961d8e2 req-21cc50ad-f0e3-4c0e-a3dc-feade0f0428b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.669197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-91e6169c-bc9a-432f-b910-7dfd3961d8e2 req-21cc50ad-f0e3-4c0e-a3dc-feade0f0428b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.670506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-91e6169c-bc9a-432f-b910-7dfd3961d8e2 req-21cc50ad-f0e3-4c0e-a3dc-feade0f0428b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.693201 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-91e6169c-bc9a-432f-b910-7dfd3961d8e2 req-21cc50ad-f0e3-4c0e-a3dc-feade0f0428b service nova] Creating event network-changed:96f14a49-fda9-472f-8a9e-7f7fe1defda5 for instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e on n-h2-858383-17 Oct 31 15:26:11.701405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-91e6169c-bc9a-432f-b910-7dfd3961d8e2 req-21cc50ad-f0e3-4c0e-a3dc-feade0f0428b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053770 Oct 31 15:26:11.702569 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1312/2720] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:11.709559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:11.710693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:11.721378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.722391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.722927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.723836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.724558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.726243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.882173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:11.893411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:11.903522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:11.917429 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c957c1d3-0e91-4ca5-8f8a-a08e4f79d5bc tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1801 microversion: 2.42 time: 0.553672 Oct 31 15:26:11.918717 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1409/2721] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:11 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1801 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:11.924350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:11.925281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:11.938963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.949278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.949737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.950503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.950976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.951411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.286260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:12.300311 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf376239-c878-4e91-b4c8-3fc239cde560 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1676 microversion: 2.1 time: 0.596256 Oct 31 15:26:12.319693 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1313/2722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:11 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1676 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:12.332268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f5d1522c-de77-44a0-ad13-07d3d800816d req-e3339613-33a9-4ba5-8ec6-b87345a82abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bdba62-3915-4a6e-9e9a-e62816afbf43", "tag": "492b079c-3e8b-4cf0-abb8-9148ca51a365"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:12.342892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f5d1522c-de77-44a0-ad13-07d3d800816d req-e3339613-33a9-4ba5-8ec6-b87345a82abd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.344189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f5d1522c-de77-44a0-ad13-07d3d800816d req-e3339613-33a9-4ba5-8ec6-b87345a82abd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.344907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f5d1522c-de77-44a0-ad13-07d3d800816d req-e3339613-33a9-4ba5-8ec6-b87345a82abd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.359966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f5d1522c-de77-44a0-ad13-07d3d800816d req-e3339613-33a9-4ba5-8ec6-b87345a82abd service nova] Creating event network-changed:492b079c-3e8b-4cf0-abb8-9148ca51a365 for instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 on n-h2-858383-17 Oct 31 15:26:12.365575 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f5d1522c-de77-44a0-ad13-07d3d800816d req-e3339613-33a9-4ba5-8ec6-b87345a82abd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044548 Oct 31 15:26:12.366655 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1314/2723] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:12.372212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4032e905-4ced-493a-9a2a-95a7602e04e0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca170c700>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.421343 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4032e905-4ced-493a-9a2a-95a7602e04e0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/6c534cf0-e710-4c2a-b931-bdef086df743" status: 200 len: 661 microversion: 2.1 time: 0.053321 Oct 31 15:26:12.423136 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1315/2724] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/images/6c534cf0-e710-4c2a-b931-bdef086df743 => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:12.435842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.436595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:12.455070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.456030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.456736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.458629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.459581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.460425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.532434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:12.540365 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72adc323-ad9f-4fbe-8474-3571a9809ca1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 0.620400 Oct 31 15:26:12.541602 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1410/2725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:11 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:12.546514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a9532d6-5396-46a7-89a9-1c2d86e5c996 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2707ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.601773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a9532d6-5396-46a7-89a9-1c2d86e5c996 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/6c534cf0-e710-4c2a-b931-bdef086df743" status: 200 len: 661 microversion: 2.1 time: 0.058846 Oct 31 15:26:12.611540 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1411/2726] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/images/6c534cf0-e710-4c2a-b931-bdef086df743 => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:12.653078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.653706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:12.659595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:12.662358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.663092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.663780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.664785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.665479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.666342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:13.187090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:13.199914 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-021459d7-d5fc-48fb-815a-75ae4d6377c6 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1316 microversion: 2.1 time: 0.775359 Oct 31 15:26:13.200849 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1316/2727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:13.217133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:13.217762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:13.227635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:13.228133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:13.233112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:13.233950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:13.234490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:13.235214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.020778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:14.036359 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-091b8f15-6b39-4f6b-a60d-d3c4a07eefbf tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 1.383855 Oct 31 15:26:14.037785 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1412/2728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:14.056272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:14.057099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:14.067049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:14.069316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:14.069966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.071635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:14.081768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:14.082479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.199203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:14.219928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:14.221570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:14.222778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-408c9b6a-1a4f-4507-ba90-b18233d17bd8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1848 microversion: 2.42 time: 1.018397 Oct 31 15:26:14.228269 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1317/2729] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:13 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1848 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:14.234936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:14.235566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:14.241914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:14.242404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:14.242842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.243544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:14.244000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:14.244472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.604145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:14.616260 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-792e3cc5-f60d-487f-aa78-00b77ee3b3ed tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1653 microversion: 2.1 time: 0.577148 Oct 31 15:26:14.620625 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1413/2730] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:14 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1653 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:14.649744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:14.650653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:14.664787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:14.665648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:14.669256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.670190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:14.670809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:14.671391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:14.983618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:14.996395 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab8eeec5-98a4-42e4-bee4-25460d5fa6a2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 0.766987 Oct 31 15:26:15.009926 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1318/2731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:14 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:15.022641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a49a1fb6-d78c-4672-bb23-4dc99f5a1824 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca68e4280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:15.085246 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a49a1fb6-d78c-4672-bb23-4dc99f5a1824 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/63d4f102-a0e8-4175-9a51-c2cde9dc196d" status: 200 len: 662 microversion: 2.1 time: 0.073655 Oct 31 15:26:15.085940 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1319/2732] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:15 2022] GET /compute/v2.1/images/63d4f102-a0e8-4175-9a51-c2cde9dc196d => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:15.108722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6135dcf9-927a-4435-a80b-82ed05e54e1c req-7133b512-c9b3-4bbb-94dd-5bc00d0596c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b4430f-598a-45ab-b4a5-8b93800c6ad3", "tag": "5bdd5779-b43d-4193-9bb7-7ae6bac61735"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:15.116784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6135dcf9-927a-4435-a80b-82ed05e54e1c req-7133b512-c9b3-4bbb-94dd-5bc00d0596c8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.119350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6135dcf9-927a-4435-a80b-82ed05e54e1c req-7133b512-c9b3-4bbb-94dd-5bc00d0596c8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.119809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6135dcf9-927a-4435-a80b-82ed05e54e1c req-7133b512-c9b3-4bbb-94dd-5bc00d0596c8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.135034 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6135dcf9-927a-4435-a80b-82ed05e54e1c req-7133b512-c9b3-4bbb-94dd-5bc00d0596c8 service nova] Creating event network-changed:5bdd5779-b43d-4193-9bb7-7ae6bac61735 for instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 on n-h1-858383-17 Oct 31 15:26:15.142165 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6135dcf9-927a-4435-a80b-82ed05e54e1c req-7133b512-c9b3-4bbb-94dd-5bc00d0596c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042727 Oct 31 15:26:15.143405 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1320/2733] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:15.151485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57aa4202-1dbc-43f8-a5dc-41254fd7621d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:15.180348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57aa4202-1dbc-43f8-a5dc-41254fd7621d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.180904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57aa4202-1dbc-43f8-a5dc-41254fd7621d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.181351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57aa4202-1dbc-43f8-a5dc-41254fd7621d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.211684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57aa4202-1dbc-43f8-a5dc-41254fd7621d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Going to try to start instance {{(pid=120626) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:26:15.216631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:15.235832 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2dfa1e46-4423-4f2c-a451-eb8026b0d9de tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1316 microversion: 2.1 time: 0.601532 Oct 31 15:26:15.236446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1414/2734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:14 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:15.248677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:15.249356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:15.274568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.275526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.276200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.280548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.282661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.284144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.301785 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57aa4202-1dbc-43f8-a5dc-41254fd7621d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action" status: 202 len: 0 microversion: 2.1 time: 0.154259 Oct 31 15:26:15.303414 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1321/2735] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:15 2022] POST /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:15.311564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bebdd94-93c3-4daa-8a78-449768de58a4 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67494c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:15.374754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bebdd94-93c3-4daa-8a78-449768de58a4 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/63d4f102-a0e8-4175-9a51-c2cde9dc196d" status: 200 len: 662 microversion: 2.1 time: 0.070082 Oct 31 15:26:15.376251 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1322/2736] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:15 2022] GET /compute/v2.1/images/63d4f102-a0e8-4175-9a51-c2cde9dc196d => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:15.390095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:15.392126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:15.403109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.405073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.408324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.409554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.410112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.410644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.417420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:15.844667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:15.854492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:15.858764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:15.865038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f33acd2-194a-4ec1-846e-1f480fbbaf65 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1848 microversion: 2.42 time: 0.487295 Oct 31 15:26:15.869329 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1323/2737] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:15 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1848 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:15.893201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:15.901763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:15.912529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.915630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.916155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.918123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:15.920419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:15.921030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:15.925937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:15.941743 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-585aac87-c304-4292-b728-95a7a978a738 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.704159 Oct 31 15:26:15.942833 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1415/2738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:15 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:16.025990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:16.026926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:16.043062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.048031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.048460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.049240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.049704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.050128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.170482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:16.234707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:16.243135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=14 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:16.248232 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8713f0b-1823-422f-99e3-5f81b0fbbb11 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1662 microversion: 2.1 time: 0.359334 Oct 31 15:26:16.251744 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1324/2739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:15 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1662 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:16.264368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:16.265039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:16.287081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.287606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.288155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.289016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.289591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.290124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.399499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:16.410840 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3876ff5b-a717-432b-9003-eef5e00e9e13 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 0.389555 Oct 31 15:26:16.412178 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1416/2740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:16 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:16.425171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-88c36375-1502-416b-bdbb-617e155f4c33 req-31b24fdb-a257-4cc1-9fd0-4917d22f358d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b06cdf2-6d35-42c1-859f-9113c91fe65e", "name": "network-vif-plugged", "status": "completed", "tag": "96f14a49-fda9-472f-8a9e-7f7fe1defda5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:16.448082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-88c36375-1502-416b-bdbb-617e155f4c33 req-31b24fdb-a257-4cc1-9fd0-4917d22f358d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.451623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-88c36375-1502-416b-bdbb-617e155f4c33 req-31b24fdb-a257-4cc1-9fd0-4917d22f358d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.452425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-88c36375-1502-416b-bdbb-617e155f4c33 req-31b24fdb-a257-4cc1-9fd0-4917d22f358d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.483178 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-88c36375-1502-416b-bdbb-617e155f4c33 req-31b24fdb-a257-4cc1-9fd0-4917d22f358d service nova] Creating event network-vif-plugged:96f14a49-fda9-472f-8a9e-7f7fe1defda5 for instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e on n-h2-858383-17 Oct 31 15:26:16.496472 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-88c36375-1502-416b-bdbb-617e155f4c33 req-31b24fdb-a257-4cc1-9fd0-4917d22f358d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081287 Oct 31 15:26:16.500577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1417/2741] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:16.722845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:16.741573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2fb9f118-f723-4c52-b3be-1a8d49c17cea tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1316 microversion: 2.1 time: 0.481698 Oct 31 15:26:16.743489 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1325/2742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:16 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:16.903767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:16.904794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:16.924603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.925356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.926007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.926919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.927557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.928141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.969675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:16.970641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:16.986961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.987768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.988422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:16.989435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:16.990080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:16.990695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.419637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:17.421106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:17.430852 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1078fc1e-479c-4182-b09c-e4b6124b1aae tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.465342 Oct 31 15:26:17.432125 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1326/2743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:16 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:17.435602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:17.437160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:17.438192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b917eb56-455d-4d3e-9193-dc88481fb28d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca6739790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:17.438337 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3a5e2ed-3035-4b73-8e6d-5dc8ba5fa7c7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1848 microversion: 2.42 time: 0.544241 Oct 31 15:26:17.453224 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1418/2744] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:16 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1848 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:17.459468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d326c1d0-68db-49ee-9d66-a688c62f691c req-ad43cd57-fc73-439a-92ed-7ef89856f84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "735fab76-f84c-4805-84d4-37b8dceb5040"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:17.472242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d326c1d0-68db-49ee-9d66-a688c62f691c req-ad43cd57-fc73-439a-92ed-7ef89856f84c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.473195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d326c1d0-68db-49ee-9d66-a688c62f691c req-ad43cd57-fc73-439a-92ed-7ef89856f84c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.473894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d326c1d0-68db-49ee-9d66-a688c62f691c req-ad43cd57-fc73-439a-92ed-7ef89856f84c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.498938 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b917eb56-455d-4d3e-9193-dc88481fb28d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/0eb3e4b5-3f8c-4671-9882-7482d8fa53e6" status: 200 len: 662 microversion: 2.1 time: 0.065413 Oct 31 15:26:17.499517 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1327/2745] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:17 2022] GET /compute/v2.1/images/0eb3e4b5-3f8c-4671-9882-7482d8fa53e6 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:17.506118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:17.507006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:17.517273 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d326c1d0-68db-49ee-9d66-a688c62f691c req-ad43cd57-fc73-439a-92ed-7ef89856f84c service nova] Creating event network-changed:735fab76-f84c-4805-84d4-37b8dceb5040 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:17.526312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.527184 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d326c1d0-68db-49ee-9d66-a688c62f691c req-ad43cd57-fc73-439a-92ed-7ef89856f84c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070589 Oct 31 15:26:17.528012 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1419/2746] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:17.529049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.534699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.535901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.536664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.537127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.541029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:17.541747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:17.560058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.560888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.561501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.563290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.564004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.564609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.780628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:17.793653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91e75681-ec3f-4764-8b4c-7e64cebdda77 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 0.262932 Oct 31 15:26:17.797706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:17.798118 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1420/2747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:17 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:17.811101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45bc2875-2a46-4d68-a94a-89e7cff3da8a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2de5e50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:17.825111 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b3900c2a-6cdb-419e-9459-cfe5981166fc tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1662 microversion: 2.1 time: 0.322483 Oct 31 15:26:17.826485 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1328/2748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:17 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:17.833331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:17.840569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:17.851325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.852152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.852870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.854004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:17.854354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:17.854853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:17.905907 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45bc2875-2a46-4d68-a94a-89e7cff3da8a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/0eb3e4b5-3f8c-4671-9882-7482d8fa53e6" status: 200 len: 662 microversion: 2.1 time: 0.106243 Oct 31 15:26:17.907676 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1421/2749] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:17 2022] GET /compute/v2.1/images/0eb3e4b5-3f8c-4671-9882-7482d8fa53e6 => generated 662 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:18.017943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1707987625", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:18.112325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:18.119487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:18.134217 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7c3ccf6-f1bc-4eb9-832d-911960e4b578 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1316 microversion: 2.1 time: 0.305493 Oct 31 15:26:18.138585 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1329/2750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:17 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:18.809287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:18.810630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:18.819942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.820738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.821358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:18.822507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.823124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.823714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.223482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:19.224622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:19.225307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:19.225902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:19.226532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:19.251489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.251991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.252430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.253378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.253999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.254604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.291431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Getting quotas for project bb4e304f612849cd8e1d9fffd33d1f57. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:19.298970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Getting quotas for user 00e603ece6c843c1a3ba0b0febb2221e and project bb4e304f612849cd8e1d9fffd33d1f57. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:19.319431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:19.323035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:19.386989 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b7a5200-bf67-4084-a90f-556f7fbbab12 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374712 Oct 31 15:26:19.399706 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1422/2751] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:19.399706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:19.407220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:19.447457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.448343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.448818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.454245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.454745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.455194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.593642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:19.606067 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38f4ecf9-5cc6-465d-8540-c8f51c050de3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 1.147122 Oct 31 15:26:19.608604 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1330/2752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:18 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:19.619207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:19.621213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:19.637589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.639757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.642189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.644945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.645596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.647106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.400209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.412503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.414350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.416551 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6bda7e6-089c-45ba-9fa3-a2a1782652bd tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1848 microversion: 2.42 time: 1.027227 Oct 31 15:26:20.417415 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1423/2753] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:19 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1848 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:20.427656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:20.429393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:20.440912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:20.441415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:20.441947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.442846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:20.443503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:20.444091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.448844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:20.475938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.487876 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3df691b7-6fa0-4789-9819-afdf665e41d6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1504 microversion: 2.1 time: 0.874668 Oct 31 15:26:20.505066 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1331/2754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:19 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:20.511983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:20.513039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:20.523177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:20.523761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:20.524637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.525426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:20.526060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:20.526658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.928867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.937052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.959534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9b2e977-6c19-4cc2-ad2e-6b6f45c6bc96 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1666 microversion: 2.1 time: 0.540473 Oct 31 15:26:20.960031 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1db2875-cc27-461d-8d56-40fc620fd7f3 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1505 microversion: 2.1 time: 0.452119 Oct 31 15:26:20.962010 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1424/2756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:20 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1666 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:20.962787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1332/2756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:20 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:20.997271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:21.001069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-677529368", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:21.002146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:21.020905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.021664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.022311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.023400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.024043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.024642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.158017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:21.719558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:21.731394 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-794acb6f-8cba-4d3d-94aa-cfbb20edc168 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.765461 Oct 31 15:26:21.748583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1333/2757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:20 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:21.753973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:21.754469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:21.761932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.762351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.762786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.763552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.764012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.764435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.797486 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b38b62a-faf4-4e70-8246-6a80bfe277ce tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e/ips" status: 200 len: 109 microversion: 2.1 time: 0.046473 Oct 31 15:26:21.823488 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1334/2758] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:26:21 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e/ips => generated 109 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:21.831454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d2777189-0860-4485-ae68-bac77170f78a req-cd19023f-eefb-46de-a89a-e18def219cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "10f655b8-38c5-4e9e-9f89-e6636a1238ae"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:21.862130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d2777189-0860-4485-ae68-bac77170f78a req-cd19023f-eefb-46de-a89a-e18def219cdc service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.864298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d2777189-0860-4485-ae68-bac77170f78a req-cd19023f-eefb-46de-a89a-e18def219cdc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.865343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d2777189-0860-4485-ae68-bac77170f78a req-cd19023f-eefb-46de-a89a-e18def219cdc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.881428 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d2777189-0860-4485-ae68-bac77170f78a req-cd19023f-eefb-46de-a89a-e18def219cdc service nova] Creating event network-changed:10f655b8-38c5-4e9e-9f89-e6636a1238ae for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:21.891608 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d2777189-0860-4485-ae68-bac77170f78a req-cd19023f-eefb-46de-a89a-e18def219cdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065279 Oct 31 15:26:21.894405 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1335/2759] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:21.909532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b88081b5-425c-4fe8-b4b6-30d724fc0a4e req-6391852b-09a4-4fb8-974c-1ceda646e114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b4430f-598a-45ab-b4a5-8b93800c6ad3", "name": "network-vif-plugged", "status": "completed", "tag": "5bdd5779-b43d-4193-9bb7-7ae6bac61735"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:21.932457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b88081b5-425c-4fe8-b4b6-30d724fc0a4e req-6391852b-09a4-4fb8-974c-1ceda646e114 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.936438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b88081b5-425c-4fe8-b4b6-30d724fc0a4e req-6391852b-09a4-4fb8-974c-1ceda646e114 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.937152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b88081b5-425c-4fe8-b4b6-30d724fc0a4e req-6391852b-09a4-4fb8-974c-1ceda646e114 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.958963 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b88081b5-425c-4fe8-b4b6-30d724fc0a4e req-6391852b-09a4-4fb8-974c-1ceda646e114 service nova] Creating event network-vif-plugged:5bdd5779-b43d-4193-9bb7-7ae6bac61735 for instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 on n-h1-858383-17 Oct 31 15:26:21.967187 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b88081b5-425c-4fe8-b4b6-30d724fc0a4e req-6391852b-09a4-4fb8-974c-1ceda646e114 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070146 Oct 31 15:26:21.969636 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1336/2760] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:21.977632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:21.978553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:21.979187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:21.979775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:21.980350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:21.984003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:21.986290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.003311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.003864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.004252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.004876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.005802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.006458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.007112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.007235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.007603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.008367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.010815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.013805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.053343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Getting quotas for project bb4e304f612849cd8e1d9fffd33d1f57. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:22.060005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Getting quotas for user 00e603ece6c843c1a3ba0b0febb2221e and project bb4e304f612849cd8e1d9fffd33d1f57. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:22.108024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:22.114571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:22.198249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e64ef90-964b-4dfd-ad23-a2b55d4f5fc6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231922 Oct 31 15:26:22.199518 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1425/2761] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:22.206033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.206934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.213959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.214690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.215559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.216434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.217078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.217682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.282168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.289754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.311345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee9be8b0-509b-4c93-ab99-501a70982606 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1479 microversion: 2.1 time: 1.106924 Oct 31 15:26:23.312185 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1426/2762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1479 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:23.317359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.321242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.323022 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-892fcad7-5717-406b-a62d-5672b84458a7 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1869 microversion: 2.42 time: 1.351930 Oct 31 15:26:23.323148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.323862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.324139 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1337/2763] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:21 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1869 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:23.330339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.331608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.339439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.340688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.341220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.342174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.342366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.342947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.344287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.344569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.345211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.346269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.347012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.348493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.395922 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2128eab2-22fa-4585-94c4-2a66f5dc677e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e/ips" status: 200 len: 109 microversion: 2.1 time: 0.080188 Oct 31 15:26:23.403636 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1427/2764] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e/ips => generated 109 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:23.414229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.415353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.431938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.434454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.435162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.437202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.437946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.438596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.576430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.633955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3de8f728-66f6-483f-b260-4500ab7abbcc tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1269 microversion: 2.1 time: 0.308512 Oct 31 15:26:23.634588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1338/2765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:23.653096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-acabf730-cc14-41b3-8a3f-820da097b31f tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '.version_select at 0x7f5ca680f430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.673739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acabf730-cc14-41b3-8a3f-820da097b31f tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.674121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acabf730-cc14-41b3-8a3f-820da097b31f tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.676220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acabf730-cc14-41b3-8a3f-820da097b31f tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.709017 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-acabf730-cc14-41b3-8a3f-820da097b31f tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.066228 Oct 31 15:26:23.709645 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1339/2766] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:23.725564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.727370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.743519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.744257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.745718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.747196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.753494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.754763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.815334 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d1152d8-7394-4cf4-8222-a69626ef3f3f tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e/ips/tempest-ServerAddressesTestJSON-1517320828-network" status: 200 len: 94 microversion: 2.1 time: 0.099783 Oct 31 15:26:23.820390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1340/2767] 10.222.0.48 () {58 vars in 1401 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e/ips/tempest-ServerAddressesTestJSON-1517320828-network => generated 94 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:26:23.827281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.827849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.844719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.845484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.846101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.846815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.847548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.847897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.964476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.975084 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07be1b57-f380-4c44-9a1a-89db01d90dfb tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1314 microversion: 2.1 time: 0.568361 Oct 31 15:26:23.990054 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1428/2768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:23.997740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.998443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.005875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.006685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.007315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.008187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.008921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.009506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.037369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:26:24.187250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42bd9493-becf-4454-8f4a-9984117645b2 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 204 len: 0 microversion: 2.1 time: 0.195377 Oct 31 15:26:24.188356 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1429/2769] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:23 2022] DELETE /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:24.198604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.199700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.207536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.208497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.209151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.211202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.211708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.212167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.477086 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f415afb8-f15f-4f03-8a0d-bf30fe9d4220 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1632 microversion: 2.1 time: 0.655086 Oct 31 15:26:24.478688 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1341/2770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1632 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:24.485304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.486272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.495526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.496371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.497010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.498840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.499684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.501287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.796482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.806348 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7da2d36c-377f-470e-9dcf-726f24f35b3e tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1511 microversion: 2.1 time: 0.613432 Oct 31 15:26:24.807575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1430/2771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1511 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:24.813540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39cfed60-a037-40fb-b088-fe49bcfeff0f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Action: 'create', calling method: .version_select at 0x7f5ca22afaf0>, body: {"keypair": {"name": "tempest-keypair-1397679655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcbxKPVO1xpgQovQeZ29Iu9THOsTkQxT6m6L5brn5VHvWZpsRNpodYctrNqzfquk0JgCw6IlwFwCOvIugVqNwrpNyEdMPseygSLJoKpPhIcTuwcYtUAHhGbgmj0tM5g1g=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:24.833435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-39cfed60-a037-40fb-b088-fe49bcfeff0f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:24.839996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-39cfed60-a037-40fb-b088-fe49bcfeff0f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for user 847c3c51ceb3406eb86b222c4638fc59 and project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:24.874066 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39cfed60-a037-40fb-b088-fe49bcfeff0f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064800 Oct 31 15:26:24.882904 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1431/2772] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:26:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:24.887823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3c821234-5d43-41c1-806d-27dda7eccc3a req-22282130-7adc-4f82-a444-8542ac8d3ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "d3956ef2-61dc-4b6a-84dd-c6a3da755bdf"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:24.900802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3c821234-5d43-41c1-806d-27dda7eccc3a req-22282130-7adc-4f82-a444-8542ac8d3ce2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.901673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3c821234-5d43-41c1-806d-27dda7eccc3a req-22282130-7adc-4f82-a444-8542ac8d3ce2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.902942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3c821234-5d43-41c1-806d-27dda7eccc3a req-22282130-7adc-4f82-a444-8542ac8d3ce2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.917359 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3c821234-5d43-41c1-806d-27dda7eccc3a req-22282130-7adc-4f82-a444-8542ac8d3ce2 service nova] Creating event network-changed:d3956ef2-61dc-4b6a-84dd-c6a3da755bdf for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:24.925482 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3c821234-5d43-41c1-806d-27dda7eccc3a req-22282130-7adc-4f82-a444-8542ac8d3ce2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041041 Oct 31 15:26:24.928278 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1432/2773] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:24.939921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.940813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.948061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.948820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.949261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.950002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.950543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.950974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.157488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:25.184873 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec9e97dd-9f4e-4f93-8770-72737ec8572f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1275 microversion: 2.1 time: 0.253743 Oct 31 15:26:25.185733 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1433/2774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:25.190669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:25.191555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.199395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.199395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.199395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.200430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.201080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.201712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.403979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:25.429795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:25.432524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:25.434924 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09e85464-6d85-4417-9a64-dcefedcb8a4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1890 microversion: 2.42 time: 0.953942 Oct 31 15:26:25.495445 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1342/2775] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1890 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:25.766860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:25.777463 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d028616c-f4e0-4fba-90f7-6addbad8285d tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1500 microversion: 2.1 time: 0.590048 Oct 31 15:26:25.793171 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1434/2776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:25 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1500 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:25.801492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:25.803184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.813706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.815251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.815898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.816831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.817585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.818537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.832275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:25.832921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.839378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.839867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.840301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.841036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.841490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.841902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.843665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:25.859482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lazy-loading 'flavor' on Instance uuid 89b4430f-598a-45ab-b4a5-8b93800c6ad3 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:25.948958 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-411ba4f1-8980-47a5-bd2f-73186b763b89 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "POST /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.152354 Oct 31 15:26:25.953856 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1343/2777] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:25 2022] POST /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:25.960168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:25.962026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.969556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.970481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.971081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.971978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.972604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.973219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.785449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae524b47b8e4a3c85c37baf9dfd3e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64307ef169384231a2e9e38774c13285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.803187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95f2ec8d-709b-489c-b3fd-1f4f56806602 tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 200 len: 1511 microversion: 2.1 time: 0.975890 Oct 31 15:26:26.810496 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1435/2778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:25 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 1511 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:26.817199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:26.825656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:26.852517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.855006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.855461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.856196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.872833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.874583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.035697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.046549 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd90f0ba-dd5a-4e04-b81f-64a1cff7e042 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1508 microversion: 2.1 time: 1.091174 Oct 31 15:26:27.047952 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1344/2779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:25 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1508 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:27.053169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:27.063777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:27.070472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=88 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:27.072670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.073790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.074615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.075607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.076319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.077096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.097601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.111520 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f7edf92-d049-4ca8-9070-47f7d9e6b508 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1275 microversion: 2.1 time: 0.298581 Oct 31 15:26:27.113100 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1436/2780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:26 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1275 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:27.118517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4a220379-2fd6-4dad-9926-22240bbc8ede req-20388c9a-dc7b-4b5d-b58b-e35fc6914ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b06cdf2-6d35-42c1-859f-9113c91fe65e", "name": "network-vif-deleted", "tag": "96f14a49-fda9-472f-8a9e-7f7fe1defda5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:27.129690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4a220379-2fd6-4dad-9926-22240bbc8ede req-20388c9a-dc7b-4b5d-b58b-e35fc6914ef3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.130234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4a220379-2fd6-4dad-9926-22240bbc8ede req-20388c9a-dc7b-4b5d-b58b-e35fc6914ef3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.130678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4a220379-2fd6-4dad-9926-22240bbc8ede req-20388c9a-dc7b-4b5d-b58b-e35fc6914ef3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.142709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4a220379-2fd6-4dad-9926-22240bbc8ede req-20388c9a-dc7b-4b5d-b58b-e35fc6914ef3 service nova] Creating event network-vif-deleted:96f14a49-fda9-472f-8a9e-7f7fe1defda5 for instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e on n-h2-858383-17 Oct 31 15:26:27.147727 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4a220379-2fd6-4dad-9926-22240bbc8ede req-20388c9a-dc7b-4b5d-b58b-e35fc6914ef3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033155 Oct 31 15:26:27.148539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1437/2781] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:27.193706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-994493720", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a894f4b9-7bb9-45b6-b49f-684d8b80987a"}], "security_groups": [{"name": "tempest-securitygroup--557792645"}], "key_name": "tempest-keypair-1397679655", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:27.586650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] validate_networks() for [('a894f4b9-7bb9-45b6-b49f-684d8b80987a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:27.773479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.783394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.785098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.786548 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-acb9a5ac-fbaf-4048-af0e-d25864843520 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.737491 Oct 31 15:26:27.787605 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1345/2782] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:27 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:27.834853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:27.835732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] [instance: 5b06cdf2-6d35-42c1-859f-9113c91fe65e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:27.850050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.852419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.853122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.853879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.854345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.854783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.869539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] HTTP exception thrown: Instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e could not be found. Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Request method failure captured: Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e HTTP/1.1 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-kKnkyEskTQ7QyrH14RL5DQyXK0_8b5DeIiiL_kl--8dsxmjBgMIJo5XMfuVaShLX4tvzIUYbeXo00rJzYCdAOw_Uiw5G4vM14WBbUH_jzuExaIIxee24CkGVuposKnuy1Fr4E86IbALqUMSVgW5ZNtnk4_ffRkGAL6HZ2ATETQB14 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 64307ef169384231a2e9e38774c13285 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerAddressesTestJSON-1990449081 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64307ef169384231a2e9e38774c13285"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64307ef169384231a2e9e38774c13285"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64307ef169384231a2e9e38774c13285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64307ef169384231a2e9e38774c13285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerAddressesTestJSON-1990449081 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 64307ef169384231a2e9e38774c13285 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1990449081 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerAddressesTestJSON-1990449081-project Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 0ae524b47b8e4a3c85c37baf9dfd3e76 Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerAddressesTestJSON-1990449081-project Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e could not be found. Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5b06cdf2-6d35-42c1-859f-9113c91fe65e'} Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e could not be found. Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e could not be found. Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:27.871216 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e could not be found. Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] Returning 404 to user: Instance 5b06cdf2-6d35-42c1-859f-9113c91fe65e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0cfbe54-0372-4f24-9291-363c16cf8d1b tempest-ServerAddressesTestJSON-1990449081 tempest-ServerAddressesTestJSON-1990449081-project] 10.222.0.48 "GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e" status: 404 len: 111 microversion: 2.1 time: 0.041778 Oct 31 15:26:27.876120 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1346/2783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:27 2022] GET /compute/v2.1/servers/5b06cdf2-6d35-42c1-859f-9113c91fe65e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:28.073834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:28.075415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:28.085897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.089095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.090245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.091240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.091958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.097768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.870430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:28.891626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f230ef7c-65ad-4276-b5d0-332e35b7c686 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1491 microversion: 2.1 time: 0.820497 Oct 31 15:26:28.894947 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1347/2784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:28 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1491 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:28.903270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:28.904468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:28.915217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.916407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.919300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.922379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.924447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.926149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.263561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:29.265570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:29.268284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:29.269041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:29.270605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:29.291016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.291745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.292327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.293442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.294079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.294934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.323628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:29.344954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:29.353343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for user 847c3c51ceb3406eb86b222c4638fc59 and project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:29.427168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:29.431236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:29.536174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9f3a9db-55c3-469b-9dfd-82b4c944bd3e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.346762 Oct 31 15:26:29.544319 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1438/2785] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:26:29.550303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6c7d033d-1f3f-4aa8-9699-7587fada9bb1 req-acc4e24a-3f3a-4e95-89bf-86ce15054c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "7d1dfbb7-be68-41e6-861f-2714c16eeda6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:29.563348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c7d033d-1f3f-4aa8-9699-7587fada9bb1 req-acc4e24a-3f3a-4e95-89bf-86ce15054c5b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.564553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c7d033d-1f3f-4aa8-9699-7587fada9bb1 req-acc4e24a-3f3a-4e95-89bf-86ce15054c5b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.569329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c7d033d-1f3f-4aa8-9699-7587fada9bb1 req-acc4e24a-3f3a-4e95-89bf-86ce15054c5b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.605752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6c7d033d-1f3f-4aa8-9699-7587fada9bb1 req-acc4e24a-3f3a-4e95-89bf-86ce15054c5b service nova] Creating event network-changed:7d1dfbb7-be68-41e6-861f-2714c16eeda6 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:29.615705 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6c7d033d-1f3f-4aa8-9699-7587fada9bb1 req-acc4e24a-3f3a-4e95-89bf-86ce15054c5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069519 Oct 31 15:26:29.619794 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1439/2786] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:29.628229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.630427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.638510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.639424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.640237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.641833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.642534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.643121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.338405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.349942 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57e77961-c9b5-48cd-a2e8-ba69fad1139e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 1.453457 Oct 31 15:26:30.351727 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1348/2787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:28 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:30.361059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.371964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.379110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.379606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.380045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.380773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.381236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.381658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.451152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:26:30.479123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.490663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.492110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.504668 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e0d65ec-50c3-4ee0-843a-69af0b237a28 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.882340 Oct 31 15:26:30.527524 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1440/2788] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:30.546375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.547390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.563919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.566228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.574425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.575153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.578924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.579631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.629342 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-140f7876-814d-410a-a412-88168ef5abb2 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 204 len: 0 microversion: 2.1 time: 0.276195 Oct 31 15:26:30.630333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1349/2789] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:30 2022] DELETE /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:30.661109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.662227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.671465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.673171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.673839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.674937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.675665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.676314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.768980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.787075 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b151fa5-4faa-4ce7-b409-795bb0dba009 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1230 microversion: 2.1 time: 0.258345 Oct 31 15:26:30.809221 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1441/2790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:30 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1230 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:31.212471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.220922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-65ce7ffb-55a5-4f7b-9dd3-e0670a906ef0 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1497 microversion: 2.1 time: 0.578087 Oct 31 15:26:31.221581 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1350/2791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:30 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1497 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:31.377082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:31.378054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:31.396382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.397052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.397592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.398624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.399446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.400097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.535664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:31.537064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:31.549105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.559598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.560438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.561443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.562129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.564245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.006431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.021771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2cf43265-9d32-43ad-8551-38e2fbceeb0d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 0.648677 Oct 31 15:26:32.024966 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1442/2792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:31 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:32.033536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.034369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.044874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.045633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.046440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.047546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.048232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.049151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.222679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.228866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:32.244633 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-814051b7-af0a-4b74-8df5-ea61de13cf81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1292 microversion: 2.1 time: 0.218338 Oct 31 15:26:32.245508 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1443/2793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1292 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:32.253376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6c65fd5b-cd4f-4ab4-a165-5fafae1c9964 req-34103ffb-26fa-4095-8859-bc8f935cecaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:32.270216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c65fd5b-cd4f-4ab4-a165-5fafae1c9964 req-34103ffb-26fa-4095-8859-bc8f935cecaf service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.270994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c65fd5b-cd4f-4ab4-a165-5fafae1c9964 req-34103ffb-26fa-4095-8859-bc8f935cecaf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.272244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c65fd5b-cd4f-4ab4-a165-5fafae1c9964 req-34103ffb-26fa-4095-8859-bc8f935cecaf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.291742 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6c65fd5b-cd4f-4ab4-a165-5fafae1c9964 req-34103ffb-26fa-4095-8859-bc8f935cecaf service nova] Creating event network-changed:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:26:32.303998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6c65fd5b-cd4f-4ab4-a165-5fafae1c9964 req-34103ffb-26fa-4095-8859-bc8f935cecaf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056421 Oct 31 15:26:32.306219 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1444/2794] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:32.319409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.320499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.324117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.335142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.336089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.336232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.337488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.337641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.339035 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5ba32342-4083-4222-9d3c-62a83d578753 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.807723 Oct 31 15:26:32.339663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.340554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.341181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.345192 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1351/2795] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:31 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:32.771880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.785157 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a69c0c8e-a02e-489f-a443-cb2089640bc8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1497 microversion: 2.1 time: 0.474876 Oct 31 15:26:32.787035 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1445/2796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1497 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:33.048486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.049748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.067560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.069195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.069644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.072361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.073070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.073504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.276628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.279157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.292097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.293601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.294043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.298785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.299360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.299815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.902809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.938820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-197b16c1-01f5-4667-aa1c-e5f9f5b2029b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1292 microversion: 2.1 time: 0.668015 Oct 31 15:26:33.941043 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1446/2797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1292 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:33.954377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.955161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.964357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.965575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.966321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.967341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.968030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.970053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.988033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.996336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afba8f1c-75ad-4fcc-8ed1-30479485fafb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 0.952696 Oct 31 15:26:34.000690 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1352/2798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:34.008938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:34.014665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:34.029593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.030569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.032053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.032791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.033519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.033949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.583854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.614558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.618110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.618110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-386ce102-77bb-4c7c-b477-edfa8dc0410b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.672288 Oct 31 15:26:34.618110 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1447/2799] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:34.631456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.642263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223f7809-62b7-489b-ae8f-2ce34fbe3438", "tag": "8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d"}, {"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "699d5e32-b18a-41a1-8fd2-752d4710602c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:34.649421 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4425e18-09bd-4e28-9c55-6067a403b42e tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1497 microversion: 2.1 time: 0.639208 Oct 31 15:26:34.650082 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1353/2800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:34 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1497 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:34.668076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.668567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.670147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.684730 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] Creating event network-changed:8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d for instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 on n-h2-858383-17 Oct 31 15:26:34.685519 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] Creating event network-changed:699d5e32-b18a-41a1-8fd2-752d4710602c for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:34.694494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9585d7e6-c20b-47be-866a-7de15126d3ed req-ffbd9db1-6077-4017-bfd3-3b623816322c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075389 Oct 31 15:26:34.695665 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1448/2801] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:34.950144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a97596c3-1131-42a8-92a6-2417d6135b78 req-609d91dd-6ff0-4149-8d28-33914cb8d028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b4430f-598a-45ab-b4a5-8b93800c6ad3", "name": "network-vif-deleted", "tag": "5bdd5779-b43d-4193-9bb7-7ae6bac61735"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:34.966205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:34.966920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a97596c3-1131-42a8-92a6-2417d6135b78 req-609d91dd-6ff0-4149-8d28-33914cb8d028 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.967153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:34.967756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a97596c3-1131-42a8-92a6-2417d6135b78 req-609d91dd-6ff0-4149-8d28-33914cb8d028 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.968353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a97596c3-1131-42a8-92a6-2417d6135b78 req-609d91dd-6ff0-4149-8d28-33914cb8d028 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.983399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.988108 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a97596c3-1131-42a8-92a6-2417d6135b78 req-609d91dd-6ff0-4149-8d28-33914cb8d028 service nova] Creating event network-vif-deleted:5bdd5779-b43d-4193-9bb7-7ae6bac61735 for instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 on n-h1-858383-17 Oct 31 15:26:34.989530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.990111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.991023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.994425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.995358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.002975 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a97596c3-1131-42a8-92a6-2417d6135b78 req-609d91dd-6ff0-4149-8d28-33914cb8d028 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063375 Oct 31 15:26:35.009335 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1354/2802] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:35.024803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:35.025536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:35.034495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.039446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.039902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.042406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.043068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.044481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.495386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:35.504530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:35.505161 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f6e5f56-d720-41b9-8558-5e95fb2a08cf tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1359 microversion: 2.1 time: 0.544442 Oct 31 15:26:35.505760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1449/2803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:34 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1359 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:35.518521 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2bcc9b9c-d7e7-4ec3-91f7-464dad34514e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 0.498013 Oct 31 15:26:35.524219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c2890ff-5740-48e1-b5ff-562b53ce512c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Action: 'create', calling method: .version_select at 0x7f5ca256d4c0>, body: {"keypair": {"name": "tempest-keypair-815098709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/XsFGh1mvd3PQvocps0aeOjfDE7uaMD8OGChhkshCszk4b4gufQxUwNmxy2JvCz4wc77NQHKv+deR9xKbmHojQXSAKgqiNLvNttqME6qu1GUKw4uwyYLGW8lffbfr/uw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:35.533924 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1355/2804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:35 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:35.542218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8c2890ff-5740-48e1-b5ff-562b53ce512c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Getting quotas for project fd520540ecfc445c8fd4db77895713d1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:35.550169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8c2890ff-5740-48e1-b5ff-562b53ce512c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Getting quotas for user ebc162776e60407ab14cc14a454f9b88 and project fd520540ecfc445c8fd4db77895713d1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:35.582692 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c2890ff-5740-48e1-b5ff-562b53ce512c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.075279 Oct 31 15:26:35.584428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1450/2805] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:26:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:26:35.665807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:35.666929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:35.678217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:35.678848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:35.695194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.698449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.698903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.699711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.700639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.701437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.702711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.703546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.705552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.706328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.708183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.711290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.838053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3902aed18f6476e85a4c0c837403792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bb076112f34d5f895359bd4562a77f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:35.852185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d571d4da-465d-431f-a528-fa61a8329296 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 200 len: 1455 microversion: 2.1 time: 0.177588 Oct 31 15:26:35.853890 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1451/2806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:35 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:36.509726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.521962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.523813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.525729 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-322a65cb-27df-4138-9ee2-26325621f87f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.883023 Oct 31 15:26:36.535030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.535911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.541409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1356/2807] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:35 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:36.543992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.544773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.545464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.546407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.547635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.548305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.551786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.552410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.558562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.559057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.559495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.560457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.560941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.561604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.825957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.842195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0ea22a1-fc23-4d84-a10d-19fb2b0b6353 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 0.299518 Oct 31 15:26:36.843913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1357/2808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:36.853609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9484a1e3-27fe-4bcf-b978-f0b39269599d req-2129c59b-2cdc-45c6-a291-7a65da6acf37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "c32bc1a8-8026-4831-9ece-c08bbcaf39c1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:36.889288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9484a1e3-27fe-4bcf-b978-f0b39269599d req-2129c59b-2cdc-45c6-a291-7a65da6acf37 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.890318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9484a1e3-27fe-4bcf-b978-f0b39269599d req-2129c59b-2cdc-45c6-a291-7a65da6acf37 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.891057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9484a1e3-27fe-4bcf-b978-f0b39269599d req-2129c59b-2cdc-45c6-a291-7a65da6acf37 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.900162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:36.923637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9484a1e3-27fe-4bcf-b978-f0b39269599d req-2129c59b-2cdc-45c6-a291-7a65da6acf37 service nova] Creating event network-changed:c32bc1a8-8026-4831-9ece-c08bbcaf39c1 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:36.931727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9484a1e3-27fe-4bcf-b978-f0b39269599d req-2129c59b-2cdc-45c6-a291-7a65da6acf37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086106 Oct 31 15:26:36.933928 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1358/2809] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:36.941841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.942646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.950865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.951359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.951792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.952647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.953565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.954002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.975301 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 HTTP/1.1 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '89b4430f-598a-45ab-b4a5-8b93800c6ad3'} Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:36.977165 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:36.981039 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2ee00f78-2b11-4d54-b8cc-ca28887ad958 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 404 len: 111 microversion: 2.1 time: 0.042784 Oct 31 15:26:36.985082 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1359/2810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.005458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.005983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.014305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.014922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.015373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.016103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.016568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.018559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.037168 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 HTTP/1.1 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '89b4430f-598a-45ab-b4a5-8b93800c6ad3'} Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.038412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e0db9e0e-cd2a-435f-b949-d78f232f2807 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 404 len: 111 microversion: 2.1 time: 0.056520 Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1360/2811] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:36 2022] DELETE /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.053668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.058458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 89b4430f-598a-45ab-b4a5-8b93800c6ad3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.061850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.062553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.063207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.064221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.064986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.065993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.083599 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 HTTP/1.1 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '89b4430f-598a-45ab-b4a5-8b93800c6ad3'} Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.085724 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. Oct 31 15:26:37.089827 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.092533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 89b4430f-598a-45ab-b4a5-8b93800c6ad3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.094286 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52282b0e-b76b-40c2-a3d4-3e0bc96d21f8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3" status: 404 len: 111 microversion: 2.1 time: 0.044673 Oct 31 15:26:37.099818 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1361/2812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/89b4430f-598a-45ab-b4a5-8b93800c6ad3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:26:37.105967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.106707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.116030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.116030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.116434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.118609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.118988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.119430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.135535 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 HTTP/1.1 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2'} Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.137838 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.141745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.143976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.145038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84d9a3d8-9af7-4dec-8d9c-76c7a14596f4 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 404 len: 111 microversion: 2.1 time: 0.043593 Oct 31 15:26:37.145784 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1362/2813] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:37 2022] DELETE /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.154927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.156456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.163836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.164660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.165448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.166363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.167029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.167827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.177940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:37.190684 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5690e817-9638-4153-94d2-f65eb59dbe5c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1359 microversion: 2.1 time: 0.661648 Oct 31 15:26:37.193368 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1452/2814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1359 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:37.204364 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 HTTP/1.1 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2'} Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.206746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. Oct 31 15:26:37.210526 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.212847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.214348 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08df051b-db2c-483b-811e-9639a24dbdea tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2" status: 404 len: 111 microversion: 2.1 time: 0.063654 Oct 31 15:26:37.224515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.225050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.228463 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1363/2815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/2d1c70ac-bb2c-42f8-b1c2-67c9265c98c2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.231904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.232571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.233030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.233732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.234530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.234942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.254135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 HTTP/1.1 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'aa22140e-0ab8-4cca-9dd5-469cbb78cd14'} Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.255904 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.259773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-552c2cf2-5083-4dbd-aa2e-5416a4f20df8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 404 len: 111 microversion: 2.1 time: 0.037448 Oct 31 15:26:37.266897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.267760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: aa22140e-0ab8-4cca-9dd5-469cbb78cd14] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.272398 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1453/2816] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:37 2022] DELETE /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.274822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.275316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.275747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.279674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.280207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.280658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.298052 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 HTTP/1.1 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'aa22140e-0ab8-4cca-9dd5-469cbb78cd14'} Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.300044 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance aa22140e-0ab8-4cca-9dd5-469cbb78cd14 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.304443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-558c2a60-a64f-4c68-8021-b605767e152a tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14" status: 404 len: 111 microversion: 2.1 time: 0.039222 Oct 31 15:26:37.311435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.311994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.315623 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1364/2817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/aa22140e-0ab8-4cca-9dd5-469cbb78cd14 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.319499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.320296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.321135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.321935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.322446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.322961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.340091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 HTTP/1.1 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '97916142-5b3c-4189-ac6b-b2069733c992'} Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.342212 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.346878 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d404c0ba-56f1-4873-b106-600d89e620fc tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 404 len: 111 microversion: 2.1 time: 0.037234 Oct 31 15:26:37.353507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.354122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 97916142-5b3c-4189-ac6b-b2069733c992] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.359520 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1454/2818] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:37 2022] DELETE /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.361121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.361629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.362429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.363129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.363587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.364056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.390322 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 HTTP/1.1 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '97916142-5b3c-4189-ac6b-b2069733c992'} Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.396780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. Oct 31 15:26:37.402207 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.404146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 97916142-5b3c-4189-ac6b-b2069733c992 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.405258 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2d56f3f7-4bfe-4c8e-960c-038c78af9981 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992" status: 404 len: 111 microversion: 2.1 time: 0.056357 Oct 31 15:26:37.406229 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1365/2819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/97916142-5b3c-4189-ac6b-b2069733c992 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.414957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.415616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.423409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.424620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.425305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.426221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.426900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.427520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.447374 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 HTTP/1.1 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '8da8b385-efbb-4651-b650-78b0127cec23'} Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.449175 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.455959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8418e07-76c8-4158-a603-e230b62d0cf1 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23" status: 404 len: 111 microversion: 2.1 time: 0.042791 Oct 31 15:26:37.458347 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1455/2820] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:37 2022] DELETE /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:37.464344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.465212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: 8da8b385-efbb-4651-b650-78b0127cec23] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.472062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.473011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.473472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.474360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.474973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.475800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.492943 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 HTTP/1.1 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '8da8b385-efbb-4651-b650-78b0127cec23'} Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:37.494753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. Oct 31 15:26:37.498557 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:26:37.503598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance 8da8b385-efbb-4651-b650-78b0127cec23 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:37.505930 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc994787-cf71-4bd0-8bba-241726275af3 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23" status: 404 len: 111 microversion: 2.1 time: 0.047853 Oct 31 15:26:37.506979 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1366/2821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/8da8b385-efbb-4651-b650-78b0127cec23 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:26:37.557724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.558348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.565628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.566116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.566556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.567321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.567795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.568227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.870493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.871032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.877530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.878288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.878879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.879739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.880348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.880947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.513910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.526879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.538373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.540086 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51304492-ab95-46af-a652-6e8775338efe tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.986390 Oct 31 15:26:38.553236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1456/2822] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:38.571170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0df4ed46-7dc3-47a7-9129-97d97a88c1e1 req-96197837-20d8-40c1-ad20-ae3f5a701531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d996a123-2a37-4dc3-b750-55fcde7248df", "tag": "b96b709b-0d7f-4c3d-9c98-89e9cac4f272"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:38.593025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0df4ed46-7dc3-47a7-9129-97d97a88c1e1 req-96197837-20d8-40c1-ad20-ae3f5a701531 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.595906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0df4ed46-7dc3-47a7-9129-97d97a88c1e1 req-96197837-20d8-40c1-ad20-ae3f5a701531 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.596685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0df4ed46-7dc3-47a7-9129-97d97a88c1e1 req-96197837-20d8-40c1-ad20-ae3f5a701531 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.608735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.619319 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8020bdf0-6745-445a-a157-2f24fa219cc1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 0.753037 Oct 31 15:26:38.623461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1367/2823] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:38.626079 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0df4ed46-7dc3-47a7-9129-97d97a88c1e1 req-96197837-20d8-40c1-ad20-ae3f5a701531 service nova] Creating event network-changed:b96b709b-0d7f-4c3d-9c98-89e9cac4f272 for instance d996a123-2a37-4dc3-b750-55fcde7248df on n-h2-858383-17 Oct 31 15:26:38.637971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0df4ed46-7dc3-47a7-9129-97d97a88c1e1 req-96197837-20d8-40c1-ad20-ae3f5a701531 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082267 Oct 31 15:26:38.639576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1457/2824] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:38.639704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:38.640881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:38.649661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.650584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.651231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.652100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.652827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.653461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.661184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-22d8bc58-3d23-48be-87cd-f5d5b694f5ba req-9ee4fcb0-835b-4477-ab53-b80ca267b8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223f7809-62b7-489b-ae8f-2ce34fbe3438", "name": "network-vif-plugged", "status": "completed", "tag": "8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:38.691059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22d8bc58-3d23-48be-87cd-f5d5b694f5ba req-9ee4fcb0-835b-4477-ab53-b80ca267b8ff service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.694605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22d8bc58-3d23-48be-87cd-f5d5b694f5ba req-9ee4fcb0-835b-4477-ab53-b80ca267b8ff service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.695860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22d8bc58-3d23-48be-87cd-f5d5b694f5ba req-9ee4fcb0-835b-4477-ab53-b80ca267b8ff service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.733810 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-22d8bc58-3d23-48be-87cd-f5d5b694f5ba req-9ee4fcb0-835b-4477-ab53-b80ca267b8ff service nova] Creating event network-vif-plugged:8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d for instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 on n-h2-858383-17 Oct 31 15:26:38.746603 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-22d8bc58-3d23-48be-87cd-f5d5b694f5ba req-9ee4fcb0-835b-4477-ab53-b80ca267b8ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098102 Oct 31 15:26:38.755471 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1458/2825] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:39.128523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.139864 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d295b205-62f0-48ad-bf03-4632c34d7b45 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1359 microversion: 2.1 time: 0.515006 Oct 31 15:26:39.141388 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1368/2826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:38 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1359 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:39.530172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:39.572350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.573416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.585904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.587445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.588347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.591235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.591783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.592427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.715955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68a1a980-d2c4-4c1f-83fd-2fe4182cc7bd tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] Calling method '.version_select at 0x7f5ca26e4dc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.848585 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68a1a980-d2c4-4c1f-83fd-2fe4182cc7bd tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865/defaults" status: 200 len: 371 microversion: 2.1 time: 0.325764 Oct 31 15:26:39.850664 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1459/2827] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865/defaults => generated 371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:39.861376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.864831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.878609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.880780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.881392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.883886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.884533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.885557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.914500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.928376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.929866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.931056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6143bb11-a535-4a59-9c2b-b02bad598c4b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.362783 Oct 31 15:26:39.939890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1369/2828] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:39.944997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc77bffa-7cfa-4ed9-9d0e-3bdcc97aa527 tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] Calling method '.version_select at 0x7f5ca26a9ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.120278 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc77bffa-7cfa-4ed9-9d0e-3bdcc97aa527 tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865" status: 200 len: 371 microversion: 2.1 time: 0.177596 Oct 31 15:26:40.127392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1370/2829] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:40.137762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-105411869", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1e270517-3ac5-47bd-b84c-f266ca20d70e"}, {"port": "7bb6f1c7-9823-4930-a400-bec14caa72e0", "tag": "port-1"}, {"port": "64f6e43a-08b5-4220-aac7-f1577cd96e63", "tag": "port-2"}, {"uuid": "64ca798d-10f1-4919-b7b0-c07e9de6111f", "tag": "net-1"}, {"uuid": "64ca798d-10f1-4919-b7b0-c07e9de6111f"}, {"uuid": "d2d30f15-8e5b-4c82-934a-6c6682084a41", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d2d30f15-8e5b-4c82-934a-6c6682084a41", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1d1acb48-dc7f-4b9c-a122-28551bf30f81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f2b7ae6e-43b9-4b07-99c8-4d75f2a7b2db", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7957054b-692b-4fef-bd38-9235fe679762", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1327816035"}], "key_name": "tempest-keypair-815098709", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:40.261912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.270180 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d227e2f-47bd-4fcc-9fd3-014ef74630c9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1317 microversion: 2.1 time: 0.413363 Oct 31 15:26:40.270769 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1460/2830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:40.288908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07fd27e2-597a-474b-981d-b6bbcaca063c tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] Calling method '.version_select at 0x7f5ca23e6c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.372130 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07fd27e2-597a-474b-981d-b6bbcaca063c tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865/defaults" status: 200 len: 371 microversion: 2.1 time: 0.099168 Oct 31 15:26:40.372994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1461/2831] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865/defaults => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:40.378565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.379518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:40.385914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.386668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.387283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.388180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.388851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.389285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.488378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] validate_networks() for [('1e270517-3ac5-47bd-b84c-f266ca20d70e', None, None, None, None, None), (None, None, '7bb6f1c7-9823-4930-a400-bec14caa72e0', None, None, None), (None, None, '64f6e43a-08b5-4220-aac7-f1577cd96e63', None, None, None), ('64ca798d-10f1-4919-b7b0-c07e9de6111f', None, None, None, None, None), ('64ca798d-10f1-4919-b7b0-c07e9de6111f', None, None, None, None, None), ('d2d30f15-8e5b-4c82-934a-6c6682084a41', '10.2.2.100', None, None, None, None), ('d2d30f15-8e5b-4c82-934a-6c6682084a41', '10.2.2.200', None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:40.746283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.756541 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-542ffb4a-0346-4c77-9a7f-829fdf8cbc8d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1359 microversion: 2.1 time: 0.382088 Oct 31 15:26:40.757546 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1462/2832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1359 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:40.779444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93de5062-1181-4681-a08e-65bc47a053e9 tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] Calling method '.version_select at 0x7f5ca67ec9d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.848264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93de5062-1181-4681-a08e-65bc47a053e9 tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865" status: 200 len: 371 microversion: 2.1 time: 0.077121 Oct 31 15:26:40.849177 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1463/2833] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:40.854725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f8ae94b0-dd8c-4165-b57b-590ec61e7167 req-94d161f3-adf5-4dd5-bfb3-6f2eb85aa12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "5673ce77-3331-415e-911c-8827eeed1fec"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:40.866963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8ae94b0-dd8c-4165-b57b-590ec61e7167 req-94d161f3-adf5-4dd5-bfb3-6f2eb85aa12f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.867709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8ae94b0-dd8c-4165-b57b-590ec61e7167 req-94d161f3-adf5-4dd5-bfb3-6f2eb85aa12f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.868969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8ae94b0-dd8c-4165-b57b-590ec61e7167 req-94d161f3-adf5-4dd5-bfb3-6f2eb85aa12f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.882174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f8ae94b0-dd8c-4165-b57b-590ec61e7167 req-94d161f3-adf5-4dd5-bfb3-6f2eb85aa12f service nova] Creating event network-changed:5673ce77-3331-415e-911c-8827eeed1fec for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:26:40.887554 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f8ae94b0-dd8c-4165-b57b-590ec61e7167 req-94d161f3-adf5-4dd5-bfb3-6f2eb85aa12f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036838 Oct 31 15:26:40.888480 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1464/2834] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:40.895920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c64c7fb3-68c9-4322-ab4e-7a438b19568e tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] Calling method '.version_select at 0x7f5ca278a700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:41.017028 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c64c7fb3-68c9-4322-ab4e-7a438b19568e tempest-QuotasTestJSON-282425382 tempest-QuotasTestJSON-282425382-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865?user_id=b3b0af007bfc4637a61c6c374b463bf0" status: 200 len: 371 microversion: 2.1 time: 0.127018 Oct 31 15:26:41.017957 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1465/2835] 10.222.0.48 () {58 vars in 1323 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/os-quota-sets/5befe128f76c4b7ab2e49e0483bde865?user_id=b3b0af007bfc4637a61c6c374b463bf0 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:41.022848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:41.023607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:41.030370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.030909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.031358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.032097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.032903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.033507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.490265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.502938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.505736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.507174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a673c213-d751-4fa3-aa20-9f783b4056f5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.488251 Oct 31 15:26:41.507934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1466/2836] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:41 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:41.538192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2742efbb-02f9-465f-8a79-727e0c956861 req-7424eee0-e05b-445a-bcea-dd67c64f48b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "name": "network-vif-plugged", "status": "completed", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:41.549152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2742efbb-02f9-465f-8a79-727e0c956861 req-7424eee0-e05b-445a-bcea-dd67c64f48b8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.549942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2742efbb-02f9-465f-8a79-727e0c956861 req-7424eee0-e05b-445a-bcea-dd67c64f48b8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.550568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2742efbb-02f9-465f-8a79-727e0c956861 req-7424eee0-e05b-445a-bcea-dd67c64f48b8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.566110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2742efbb-02f9-465f-8a79-727e0c956861 req-7424eee0-e05b-445a-bcea-dd67c64f48b8 service nova] Creating event network-vif-plugged:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:26:41.571238 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2742efbb-02f9-465f-8a79-727e0c956861 req-7424eee0-e05b-445a-bcea-dd67c64f48b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058655 Oct 31 15:26:41.571994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1467/2837] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:41.580010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:41.581000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:41.588645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.589747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.590374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.591364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.592124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.592570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.035166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:42.051776 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2afdb58-ca25-446a-81f5-aa1f19c1a049 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1466 microversion: 2.1 time: 0.478574 Oct 31 15:26:42.052374 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1468/2838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:41 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1466 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:42.057091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:42.057703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:42.070982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.071806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.072436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.073363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.073836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.076308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.356850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:42.367853 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-289adf85-f976-42ae-b81e-4d5ed4354382 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1359 microversion: 2.1 time: 0.314320 Oct 31 15:26:42.383725 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1469/2839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:42 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:42.389726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:42.390478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:42.402139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.402839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.403599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.404479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.405752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.406754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.442536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:26:42.486649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:42.566422 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5eea23df-6e8d-4356-8dce-ac979eeb3c17 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 204 len: 0 microversion: 2.1 time: 0.180096 Oct 31 15:26:42.567304 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1470/2840] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:42 2022] DELETE /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:42.574298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:42.574891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:42.582584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.583086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.583658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.584392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.584915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.585425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.603290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 HTTP/1.1 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e13dab01-1cb3-43d8-ae38-9a881eb387e8'} Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:42.605611 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:42.611563 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:42.613220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:42.615750 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7bd1c5c1-2b7e-4393-97b2-3a9d43f0f35b tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 404 len: 111 microversion: 2.1 time: 0.046365 Oct 31 15:26:42.616862 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1471/2841] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:42 2022] DELETE /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:42.623084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:42.623868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:42.630606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:42.632406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.633188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.633849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.634726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.635338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.636067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.146806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:43.155458 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2618f19-40e7-4304-8fb1-2fcf7ecdd6e8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1318 microversion: 2.1 time: 0.537291 Oct 31 15:26:43.173366 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1472/2842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:42 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:43.180065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:43.180935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:43.191420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.192193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.192846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.193725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.194555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.195321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.543199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:43.553322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:43.555568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:43.556825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-adde3ec6-17ce-47d5-9b19-32081626470a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.382111 Oct 31 15:26:43.557548 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1473/2843] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:43 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:43.562860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:43.563690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:43.571490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.572065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.572875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.574605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.575075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.575503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.873800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:43.883139 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83f03788-d9fc-48e5-b2d6-411e58f55a16 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1666 microversion: 2.1 time: 0.324513 Oct 31 15:26:43.883754 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1474/2844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:43 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1666 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:43.888410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:43.889407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: e13dab01-1cb3-43d8-ae38-9a881eb387e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:43.897792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.898802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.899430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.900297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.900954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.901530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.918242 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 HTTP/1.1 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e13dab01-1cb3-43d8-ae38-9a881eb387e8'} Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:43.919818 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance e13dab01-1cb3-43d8-ae38-9a881eb387e8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb4dd41e-7896-4ec0-9a18-2ff2cdc86fa8 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8" status: 404 len: 111 microversion: 2.1 time: 0.036707 Oct 31 15:26:43.925070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1475/2845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:43 2022] GET /compute/v2.1/servers/e13dab01-1cb3-43d8-ae38-9a881eb387e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:43.930042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:43.930909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:43.937933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.938523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.939033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.939740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.940194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.940618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.214231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.223914 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00f8655b-2c8f-4a29-84f8-13c6ab082256 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1359 microversion: 2.1 time: 0.300085 Oct 31 15:26:44.227938 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1476/2846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:43 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:44.232609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0e5eee4f-2184-4d91-a717-2a42f3332d8f req-d082b725-81b2-4776-8a7a-0f8d309351b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d996a123-2a37-4dc3-b750-55fcde7248df", "name": "network-vif-plugged", "status": "completed", "tag": "b96b709b-0d7f-4c3d-9c98-89e9cac4f272"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:44.242950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e5eee4f-2184-4d91-a717-2a42f3332d8f req-d082b725-81b2-4776-8a7a-0f8d309351b4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.243764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e5eee4f-2184-4d91-a717-2a42f3332d8f req-d082b725-81b2-4776-8a7a-0f8d309351b4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.244440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e5eee4f-2184-4d91-a717-2a42f3332d8f req-d082b725-81b2-4776-8a7a-0f8d309351b4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.258843 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0e5eee4f-2184-4d91-a717-2a42f3332d8f req-d082b725-81b2-4776-8a7a-0f8d309351b4 service nova] Creating event network-vif-plugged:b96b709b-0d7f-4c3d-9c98-89e9cac4f272 for instance d996a123-2a37-4dc3-b750-55fcde7248df on n-h2-858383-17 Oct 31 15:26:44.264886 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0e5eee4f-2184-4d91-a717-2a42f3332d8f req-d082b725-81b2-4776-8a7a-0f8d309351b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035642 Oct 31 15:26:44.266133 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1477/2847] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:44.273083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:44.277055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:44.288663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.289485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.289684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.295980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.303013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.303757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.324507 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 HTTP/1.1 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd2579483-111a-48e6-a19a-15446b83f3c5'} Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:44.327201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.331022 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.333474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:44.334564 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95171eea-40bd-4c0e-a1c2-766c4ebfb56c tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 404 len: 111 microversion: 2.1 time: 0.067067 Oct 31 15:26:44.338725 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1478/2848] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:44 2022] DELETE /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:44.344878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:44.345832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:44.352437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.353255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.354077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.355035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.355700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.356320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.769201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.784601 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bb9b6eb-ebf6-49f2-ba50-3ccdc4b3ea4d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1318 microversion: 2.1 time: 0.443001 Oct 31 15:26:44.786478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1479/2849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:44 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:44.792726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:44.793541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] [instance: d2579483-111a-48e6-a19a-15446b83f3c5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:44.802104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.802874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.803433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.805018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.805409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.805845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.824077 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] HTTP exception thrown: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Request method failure captured: Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 HTTP/1.1 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-fsHzXsy9AeljwXgIV53Gm7a3mdOpHqucStZsNQ9W6q6o3Ax7hByjxcIhTwvpCS-pbxX78eg4xCfKpdes_JfiGWTkkc2fgnjCfBhY5_Ug_39SU5FwKixsqAMrfSCXlv6V9B8d0Y1NrgEZgijQ9FeAYSlays52EdrCFUeN4CACutoqI Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0bb076112f34d5f895359bd4562a77f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b0bb076112f34d5f895359bd4562a77f Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424227912 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b3902aed18f6476e85a4c0c837403792 Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1424227912-project Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd2579483-111a-48e6-a19a-15446b83f3c5'} Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:44.825677 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] Returning 404 to user: Instance d2579483-111a-48e6-a19a-15446b83f3c5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:44.830599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a2af751-3aa3-4cb9-a645-18dfb91ee589 tempest-DeleteServersTestJSON-1424227912 tempest-DeleteServersTestJSON-1424227912-project] 10.222.0.48 "GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5" status: 404 len: 111 microversion: 2.1 time: 0.039056 Oct 31 15:26:44.831884 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1480/2850] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:44 2022] GET /compute/v2.1/servers/d2579483-111a-48e6-a19a-15446b83f3c5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:44.836677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:44.837318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:44.844309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.844524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.844955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.845672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.846135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.846561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.467065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.487993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.490042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.492722 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40d6b9c7-10ed-4174-a2cf-c0e69e517e8b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.659735 Oct 31 15:26:45.493669 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1481/2851] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:44 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:45.511404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:45.515077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:45.525955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.526463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.527245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.529076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.529567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.533520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.945508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.955084 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9436ccc-99af-4ec6-b8b6-641511b1ebf0 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1666 microversion: 2.1 time: 0.460115 Oct 31 15:26:45.955888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1482/2852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:45 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1666 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:45.960659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:45.961515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:45.967953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.969305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.969929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.970831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.971492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.972134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.619090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:46.621202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:46.622264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:46.623615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:46.628572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:46.650217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.651188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.651328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.658683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.659477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.659937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.691440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:46.704293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Getting quotas for project fd520540ecfc445c8fd4db77895713d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:46.717390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Getting quotas for user ebc162776e60407ab14cc14a454f9b88 and project fd520540ecfc445c8fd4db77895713d1. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:46.731431 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a5e778a-00e7-4d91-9ac8-2317a9bbf0f7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1542 microversion: 2.1 time: 0.773966 Oct 31 15:26:46.732992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1483/2853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:45 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1542 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:46.761463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:46.769633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:46.785583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.786032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.786720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.789594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.790494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.793310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.134474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:47.141594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1d1acb48-dc7f-4b9c-a122-28551bf30f81',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f2b7ae6e-43b9-4b07-99c8-4d75f2a7b2db',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7957054b-692b-4fef-bd38-9235fe679762',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:47.212506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.224957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fdb3d70-471e-42e4-afa5-1b56caefa4ae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1468 microversion: 2.1 time: 0.490429 Oct 31 15:26:47.242810 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1484/2854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:46 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:47.260019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:47.261081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:47.270249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.271500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.272253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.273429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.274145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.274821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.752818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.772543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.775144 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0fff2c1-1cea-4d5e-9c66-6d6616fdec40 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.646500 Oct 31 15:26:47.775774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.776725 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65a206f8-5592-4b5f-a835-0824a49f80e3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.530959 Oct 31 15:26:47.777611 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1371/2855] 10.222.0.48 () {62 vars in 1189 bytes} [Mon Oct 31 15:26:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 7650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:26:47.782766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:47.786391 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1485/2856] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:47 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:47.788812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:47.801261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:47.802175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:47.819022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.819531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.819981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.820197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.821181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.821805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.822692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.823241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.823374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.823746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.824308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.825430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.930726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.940749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7f1f2e24-c896-45b4-b855-90d10c2d226e tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1598 microversion: 2.1 time: 0.153100 Oct 31 15:26:47.941344 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1486/2857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:47 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:47.967315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-108831096"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:47.971848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:47.981629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.982132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.982778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.983729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.984229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.984661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.991664 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b9d8603-3524-4497-b373-d1cad86b3baa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212766 Oct 31 15:26:47.992870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1372/2858] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:26:47 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:48.000472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3064d821-dc00-4c69-8f88-e7910f53029a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.001385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3064d821-dc00-4c69-8f88-e7910f53029a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:48.257331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3064d821-dc00-4c69-8f88-e7910f53029a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.279429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3064d821-dc00-4c69-8f88-e7910f53029a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.288943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3064d821-dc00-4c69-8f88-e7910f53029a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.293066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3064d821-dc00-4c69-8f88-e7910f53029a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1284 microversion: 2.32 time: 0.298968 Oct 31 15:26:48.293888 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1373/2859] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:47 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:48.316687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-78a5af0d-d08e-4aef-8c2d-a664811e2a4f req-ec6ed27d-e604-4828-b7b8-3b5da6f43f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a57e42-12e5-4277-ab80-b73fbe60aeca", "name": "network-vif-deleted", "tag": "3021e761-5234-40c9-ac5e-5480ddaf3010"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:48.336245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-78a5af0d-d08e-4aef-8c2d-a664811e2a4f req-ec6ed27d-e604-4828-b7b8-3b5da6f43f9a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.337156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-78a5af0d-d08e-4aef-8c2d-a664811e2a4f req-ec6ed27d-e604-4828-b7b8-3b5da6f43f9a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.337802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-78a5af0d-d08e-4aef-8c2d-a664811e2a4f req-ec6ed27d-e604-4828-b7b8-3b5da6f43f9a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.351408 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-78a5af0d-d08e-4aef-8c2d-a664811e2a4f req-ec6ed27d-e604-4828-b7b8-3b5da6f43f9a service nova] Creating event network-vif-deleted:3021e761-5234-40c9-ac5e-5480ddaf3010 for instance d9a57e42-12e5-4277-ab80-b73fbe60aeca on n-h1-858383-17 Oct 31 15:26:48.357488 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-78a5af0d-d08e-4aef-8c2d-a664811e2a4f req-ec6ed27d-e604-4828-b7b8-3b5da6f43f9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058444 Oct 31 15:26:48.358771 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1374/2860] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:48.529219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e337e41-79ef-4bbc-829a-dbd45116c222 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "POST /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.570492 Oct 31 15:26:48.529892 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1487/2861] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:47 2022] POST /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:26:48.546190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6129d6d8-3caf-4912-85ed-ceab3a79971f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1d88550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.643707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6129d6d8-3caf-4912-85ed-ceab3a79971f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.106760 Oct 31 15:26:48.645596 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1375/2862] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:48 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:48.808567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.810011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:48.836561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.837095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.839686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.842222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.842705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.845781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.893877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:48.973090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.973947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:48.988013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.992556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.993130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.993897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.999455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.000021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.088220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.090964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.092247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.093758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lazy-loading 'fault' on Instance uuid d9a57e42-12e5-4277-ab80-b73fbe60aeca {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:49.630801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed3ce0057a4847b0931e51fb820f13df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d9053f0dd94aff94d2a3cc4e2bd8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.655220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9da8c592-f622-49a2-adb1-36dbef6ba2f3 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 200 len: 1316 microversion: 2.1 time: 0.691338 Oct 31 15:26:49.656540 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1376/2863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:48 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:49.676238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:49.676930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:49.688398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.705381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.705917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.708582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.708946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.711090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.711784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.712254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.715094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.716857 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93a5185e-12b1-429f-ad12-409885b71d7b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.913202 Oct 31 15:26:49.736912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1488/2864] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:48 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:49.750401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44f17aa6-190f-45cf-b66e-90618c0d543f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca20e2dc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:49.845647 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44f17aa6-190f-45cf-b66e-90618c0d543f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.106067 Oct 31 15:26:49.847489 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1489/2865] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:49 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:49.991168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.002248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.010092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.011640 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ab844be-4c6c-416f-9e27-50e7504556bb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1526 microversion: 2.32 time: 0.352744 Oct 31 15:26:50.012927 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1377/2866] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:49 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1526 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:50.679654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:50.680768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] [instance: d9a57e42-12e5-4277-ab80-b73fbe60aeca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:50.698188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.700564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.703879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.705252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.708240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.708961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.741645 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] HTTP exception thrown: Instance d9a57e42-12e5-4277-ab80-b73fbe60aeca could not be found. Oct 31 15:26:50.744244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:50.745000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Request method failure captured: Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca HTTP/1.1 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-jQfWocPLc6is-KDkj1DEE4VgJgyK38fvoZ4RtR0xipGnVRC61vbiXXLI6YG4jorZpssiv4r9ze1bej-Tj7h80zeUGV7ef28YCqG6Ym2lL6TXbM3Io_IFY1FMTuRoWmAKqwKm1nlKT0hOl2RSfZO1XNigArT8CgpVGm0aS7EhqmhLs Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26d9053f0dd94aff94d2a3cc4e2bd8e9 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestFqdnHostnames-1952310159 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26d9053f0dd94aff94d2a3cc4e2bd8e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26d9053f0dd94aff94d2a3cc4e2bd8e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26d9053f0dd94aff94d2a3cc4e2bd8e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26d9053f0dd94aff94d2a3cc4e2bd8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestFqdnHostnames-1952310159 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26d9053f0dd94aff94d2a3cc4e2bd8e9 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1952310159 Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestFqdnHostnames-1952310159-project Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ed3ce0057a4847b0931e51fb820f13df Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestFqdnHostnames-1952310159-project Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d9a57e42-12e5-4277-ab80-b73fbe60aeca could not be found. Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd9a57e42-12e5-4277-ab80-b73fbe60aeca'} Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a57e42-12e5-4277-ab80-b73fbe60aeca could not be found. Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a57e42-12e5-4277-ab80-b73fbe60aeca could not be found. Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:50.746160 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a57e42-12e5-4277-ab80-b73fbe60aeca could not be found. Oct 31 15:26:50.750449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:26:50.754125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Returning 404 to user: Instance d9a57e42-12e5-4277-ab80-b73fbe60aeca could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:50.755255 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13354bc0-2b15-464f-b6c6-cc0c872254a2 tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca" status: 404 len: 111 microversion: 2.1 time: 0.080320 Oct 31 15:26:50.756934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.758147 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1490/2867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:50 2022] GET /compute/v2.1/servers/d9a57e42-12e5-4277-ab80-b73fbe60aeca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:50.758752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.761246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.763486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.764068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.766442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.768922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a1c1111-a6b2-43a5-8fc2-fc446edf67ca tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] Calling method '.version_select at 0x7f5ca682e9d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:50.820257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a1c1111-a6b2-43a5-8fc2-fc446edf67ca tempest-ServersTestFqdnHostnames-1952310159 tempest-ServersTestFqdnHostnames-1952310159-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077373032" status: 202 len: 0 microversion: 2.1 time: 0.057599 Oct 31 15:26:50.821285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1491/2868] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077373032 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:50.862609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d76fbd3-9adc-4556-b90b-fc8959c0c05a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca23c4550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:50.947546 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d76fbd3-9adc-4556-b90b-fc8959c0c05a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.089433 Oct 31 15:26:50.949057 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1492/2869] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:50 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:50.958906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-7fca3236-0ea6-4e3f-a189-790e5eeea74c req-e6104546-6d15-444c-86b4-7a6ebd352ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d996a123-2a37-4dc3-b750-55fcde7248df", "tag": "b96b709b-0d7f-4c3d-9c98-89e9cac4f272"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:50.984756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7fca3236-0ea6-4e3f-a189-790e5eeea74c req-e6104546-6d15-444c-86b4-7a6ebd352ca6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.985680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7fca3236-0ea6-4e3f-a189-790e5eeea74c req-e6104546-6d15-444c-86b4-7a6ebd352ca6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.986409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7fca3236-0ea6-4e3f-a189-790e5eeea74c req-e6104546-6d15-444c-86b4-7a6ebd352ca6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.010735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-7fca3236-0ea6-4e3f-a189-790e5eeea74c req-e6104546-6d15-444c-86b4-7a6ebd352ca6 service nova] Creating event network-changed:b96b709b-0d7f-4c3d-9c98-89e9cac4f272 for instance d996a123-2a37-4dc3-b750-55fcde7248df on n-h2-858383-17 Oct 31 15:26:51.020623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:51.029494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-7fca3236-0ea6-4e3f-a189-790e5eeea74c req-e6104546-6d15-444c-86b4-7a6ebd352ca6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074284 Oct 31 15:26:51.040798 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1493/2870] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:51.053066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:51.062855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:51.075199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.079019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.081960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.084949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.085670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.087028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.138074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.154907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.160115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.164960 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1afcec1a-c412-494a-8d08-61fd958a13d5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.421986 Oct 31 15:26:51.166305 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1378/2871] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:50 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:51.213542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.228234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.230559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.231976 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3b06aae9-220a-4324-a791-b868a94813f7 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1518 microversion: 2.32 time: 0.187762 Oct 31 15:26:51.233107 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1494/2872] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:51 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:51.963822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-adba850f-0f8e-41d1-90ef-fc1ddb40506d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca66c75e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.042420 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-adba850f-0f8e-41d1-90ef-fc1ddb40506d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.082369 Oct 31 15:26:52.043346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1379/2873] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:51 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:52.194948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.196209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:52.208303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.209259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.210606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.212824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.215220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.216267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.266932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.267765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:52.275979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.277317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.277444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.280063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.281306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.283212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.533895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.557736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.565409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.567898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-95bf0370-5f5b-4421-a790-17954e58f626 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1582 microversion: 2.32 time: 0.309381 Oct 31 15:26:52.569893 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1380/2874] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:52 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1582 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:52.735173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.748464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.753755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.759676 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13a21b6f-ec2e-46a9-8087-342e4af6bad3 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.569409 Oct 31 15:26:52.768157 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1495/2875] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:52 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:52.787317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.789950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:52.806003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.806467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.806929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.807672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.810605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.811065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.904647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-11f89581-a9c4-4f17-ab34-7055b8385d71 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118013 Oct 31 15:26:52.906633 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1381/2876] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:26:52 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:26:53.023514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.024352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.047886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.048806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.049487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.050482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.055558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.056987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.058887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-708edf78-4ee5-400f-9097-1ae5c2d54196 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67e2c10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.124882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:26:53.164318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-708edf78-4ee5-400f-9097-1ae5c2d54196 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.109175 Oct 31 15:26:53.175494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1382/2877] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:53.311811 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcd3dc31-0482-4a67-8261-341a064affe8 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 204 len: 0 microversion: 2.1 time: 0.296167 Oct 31 15:26:53.315702 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1496/2878] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:53 2022] DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:53.321500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.322165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.334960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.335783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.339693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.340734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.342525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.344953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.598124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.598360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.599334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.613239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.615017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.617939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.618338 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f1f64b57-4d22-450f-8868-726f52ba74d9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1672 microversion: 2.1 time: 0.299437 Oct 31 15:26:53.619242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.621053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.621719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.641233 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1383/2879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1672 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:53.779189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.799969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.801144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.803814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:53.810787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.819735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.835016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e75684a-80f8-4c95-8950-5d330cd41cb1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1592 microversion: 2.32 time: 0.230931 Oct 31 15:26:53.836519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.838201 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1497/2880] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1592 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:53.840092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.841503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.846331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.848306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.850224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.186646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af02f061-fc57-425b-9ae1-cb51ee06a315 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2ce6940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:54.259525 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af02f061-fc57-425b-9ae1-cb51ee06a315 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.079961 Oct 31 15:26:54.271129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.272951 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1498/2881] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:54 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:54.285734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.287339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.292607 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50f7cd41-e97e-48aa-b84f-d390d6f7a477 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.498379 Oct 31 15:26:54.295531 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1384/2882] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:54.648494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:54.649246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:54.675068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.678606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.679403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.682424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.683155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.685769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.868258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:54.869499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:54.883574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.884434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.885126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.886082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.886757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.887397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.469897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.492675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.498126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.501722 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d2075fc-bf12-4f4a-8c2c-72c96bfed9dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1660 microversion: 2.32 time: 0.635579 Oct 31 15:26:55.504471 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1385/2883] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:54 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1660 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:55.521430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cca3431-d3f8-45e1-95d1-5f90ffdc6d63 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1d883a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:55.570599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.606751 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6f6bc21-56d1-495e-a151-cde302585570 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1672 microversion: 2.1 time: 0.962758 Oct 31 15:26:55.632298 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1499/2884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:54 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1672 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:55.637724 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cca3431-d3f8-45e1-95d1-5f90ffdc6d63 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.131438 Oct 31 15:26:55.643453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:55.644542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:55.644971 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1386/2885] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:55 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:55.660489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-56c82820-c3aa-4507-800b-51e739cb67b7 req-5256738d-f507-4670-a932-6f9609830f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "name": "network-vif-plugged", "status": "completed", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:55.674768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.678367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.679277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.679501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-56c82820-c3aa-4507-800b-51e739cb67b7 req-5256738d-f507-4670-a932-6f9609830f77 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.679996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-56c82820-c3aa-4507-800b-51e739cb67b7 req-5256738d-f507-4670-a932-6f9609830f77 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.680432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-56c82820-c3aa-4507-800b-51e739cb67b7 req-5256738d-f507-4670-a932-6f9609830f77 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.683244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.684490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.697707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-56c82820-c3aa-4507-800b-51e739cb67b7 req-5256738d-f507-4670-a932-6f9609830f77 service nova] Creating event network-vif-plugged:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:26:55.704644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-56c82820-c3aa-4507-800b-51e739cb67b7 req-5256738d-f507-4670-a932-6f9609830f77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058129 Oct 31 15:26:55.705580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1387/2886] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:55.711605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:56.207361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-11840d59-a5b0-4d88-b192-9b815e4a9c3d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'create', calling method: .version_select at 0x7f5ca67e2c10>, body: {"keypair": {"name": "tempest-keypair-813852773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdZJji8yCmw+3aNRWzO+ESyrj+QUz3rsgYASSSpVhCceCj8O7NkYjU/KBh6rDrk2tqEg6mHUiQBUhxy1aT2YZmgH5g4YSykU/P0G1oWJXxlBjosfouLJyXQF39jkXr2LA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:56.251978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-11840d59-a5b0-4d88-b192-9b815e4a9c3d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:56.265524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-11840d59-a5b0-4d88-b192-9b815e4a9c3d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for user 58b6ccb6f0514e0991864ec6a6417b45 and project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:56.333910 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-11840d59-a5b0-4d88-b192-9b815e4a9c3d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.626903 Oct 31 15:26:56.334854 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1388/2887] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:26:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 628 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:26:56.529588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:56.531434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:56.543552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:56.545283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:56.546847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:56.549087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:56.551040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:56.551992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:56.675081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:57.009954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:57.034361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:57.037109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:57.066627 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f17ce0b3-1015-4a42-b760-b15a73410f4f tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.405019 Oct 31 15:26:57.092166 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1500/2888] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:55 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:57.111499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:57.123628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:57.155823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:57.172667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:57.173300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:57.174184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:57.174906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:57.175673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.867975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.871339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:58.889304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.892951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.898182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9353a072-dd9e-4f5e-a7e4-6301351c5f19 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1707 microversion: 2.32 time: 2.373182 Oct 31 15:26:58.912724 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1389/2889] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:56 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1707 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:58.918890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73cc45ba-adc6-4c6a-9258-b8797dde7bde tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1780f70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:59.023539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73cc45ba-adc6-4c6a-9258-b8797dde7bde tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.119750 Oct 31 15:26:59.025812 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1390/2890] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:26:58 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:59.048289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:59.051991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:59.057988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:59.060101 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e539d80-48e5-4b8d-a2c8-10177cfd23bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1672 microversion: 2.1 time: 1.966229 Oct 31 15:26:59.078193 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1501/2891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:57 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1672 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:59.100140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.101155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.102052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9eb4cc42-0af0-4ffa-a1ab-67df8ee56404 req-c7eea0c1-f437-4778-98a9-8effca806006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36cbe18-c310-412f-b545-20d7a7ba77b4", "name": "network-vif-unplugged", "status": "completed", "tag": "e2c86d50-98ee-4ccd-8632-f7be7a5b24dd"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:59.102764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.107341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.108641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.110210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.141713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9eb4cc42-0af0-4ffa-a1ab-67df8ee56404 req-c7eea0c1-f437-4778-98a9-8effca806006 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.149424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9eb4cc42-0af0-4ffa-a1ab-67df8ee56404 req-c7eea0c1-f437-4778-98a9-8effca806006 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.150190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9eb4cc42-0af0-4ffa-a1ab-67df8ee56404 req-c7eea0c1-f437-4778-98a9-8effca806006 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.182561 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9eb4cc42-0af0-4ffa-a1ab-67df8ee56404 req-c7eea0c1-f437-4778-98a9-8effca806006 service nova] Creating event network-vif-unplugged:e2c86d50-98ee-4ccd-8632-f7be7a5b24dd for instance b36cbe18-c310-412f-b545-20d7a7ba77b4 on n-h2-858383-17 Oct 31 15:26:59.202325 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9eb4cc42-0af0-4ffa-a1ab-67df8ee56404 req-c7eea0c1-f437-4778-98a9-8effca806006 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119780 Oct 31 15:26:59.211186 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1502/2892] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:59.954717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1234248443", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22185265-e8f0-4ca5-8245-2f62f6302878"}], "security_groups": [{"name": "tempest-securitygroup--1054871548"}], "key_name": "tempest-keypair-813852773", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:00.151098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.175600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.184127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.185550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2d7d66c-49f5-49ec-9cb1-a3a9432105e0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.158517 Oct 31 15:27:00.186253 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1391/2893] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:59 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:00.201504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:00.202995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:00.226722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.227563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.228175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.230238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.244404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.245281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.866323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] validate_networks() for [('22185265-e8f0-4ca5-8245-2f62f6302878', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:01.237371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.256774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.258386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.259706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa83b356-a838-4ad8-aa04-d6ff8b9896e5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1707 microversion: 2.32 time: 1.072188 Oct 31 15:27:01.262661 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1392/2894] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:00 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1707 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:01.277744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9c103e28-8390-41f2-9548-999544d9099d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca17801f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.379897 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9c103e28-8390-41f2-9548-999544d9099d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.105199 Oct 31 15:27:01.381841 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1393/2895] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:01.388829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.389792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.403964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.405047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.406558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.407634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.408323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.409637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.735729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.765714 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4fe689b-280b-45b6-87ce-f48c6d7c5c43 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 200 len: 1605 microversion: 2.1 time: 0.377553 Oct 31 15:27:01.773362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1394/2896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 1605 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:01.787801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.791056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.815765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.817407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.818754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.822948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.825131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.828345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.872966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.888968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.890501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.891701 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1100847f-89ec-49a1-bd7c-98633ea21960 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.114897 Oct 31 15:27:02.901006 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1395/2897] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:02.913081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7f4fe7b9-c30c-4fec-8516-b42680ccfbdc req-d38e6a38-8b30-4766-ad08-b576c8f58694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36cbe18-c310-412f-b545-20d7a7ba77b4", "name": "network-vif-deleted", "tag": "e2c86d50-98ee-4ccd-8632-f7be7a5b24dd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:02.934625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7f4fe7b9-c30c-4fec-8516-b42680ccfbdc req-d38e6a38-8b30-4766-ad08-b576c8f58694 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.935887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7f4fe7b9-c30c-4fec-8516-b42680ccfbdc req-d38e6a38-8b30-4766-ad08-b576c8f58694 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.936481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7f4fe7b9-c30c-4fec-8516-b42680ccfbdc req-d38e6a38-8b30-4766-ad08-b576c8f58694 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.018277 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7f4fe7b9-c30c-4fec-8516-b42680ccfbdc req-d38e6a38-8b30-4766-ad08-b576c8f58694 service nova] Creating event network-vif-deleted:e2c86d50-98ee-4ccd-8632-f7be7a5b24dd for instance b36cbe18-c310-412f-b545-20d7a7ba77b4 on n-h2-858383-17 Oct 31 15:27:03.034579 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7f4fe7b9-c30c-4fec-8516-b42680ccfbdc req-d38e6a38-8b30-4766-ad08-b576c8f58694 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131293 Oct 31 15:27:03.039689 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1396/2898] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:03.053473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:03.054239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.070660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.071162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.071599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.077026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.078340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.078822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.950357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.969470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.973930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.975166 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-628c289a-f8f3-4896-976c-472fc24dcdf8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1754 microversion: 2.32 time: 0.934040 Oct 31 15:27:03.991709 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1397/2899] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1754 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:04.009882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c00a4a1-9d5c-4eeb-917e-c5a219bc7d0f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1640160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.049263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:04.049815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:04.050400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:04.050917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:04.051445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:04.072211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.073004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.074561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.074561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.078619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.079150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.100777 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c00a4a1-9d5c-4eeb-917e-c5a219bc7d0f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.107822 Oct 31 15:27:04.103427 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1398/2900] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:04.112638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:04.120756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for user 58b6ccb6f0514e0991864ec6a6417b45 and project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:04.124953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.126653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.146955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:04.149222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.150106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:04.151007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.152646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.155371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.158025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.161105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.231411 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] HTTP exception thrown: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Request method failure captured: Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 HTTP/1.1 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-hcrAkXEBIlg7Xu2_GzaS03lxxL3bOkq0s0Sj4eQgeW6Ie8PHLwL1P9Tqm-bDIvoZHmgNc1oWabNtbOZnIKL3BXp7mG5f6DiNp9fPLwEcv_2KOkFHE3X6eWr8r1MFLsNi01zhKzGufVxmIEJCutAA5-GPoY_QxxDTBwaeZQJS8xFjA Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bf304336d1f2420db7a197a36036ccab Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b36cbe18-c310-412f-b545-20d7a7ba77b4'} Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:04.240607 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:27:04.245708 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:27:04.250130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Returning 404 to user: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:04.253571 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0181cf4-1d79-41a0-a70f-6a5f3e061dfd tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 404 len: 111 microversion: 2.1 time: 0.148122 Oct 31 15:27:04.255765 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1399/2901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:04.277622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.278287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.278610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95cb2557-e517-4523-bed5-b0a362d163ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.341496 Oct 31 15:27:04.281109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1503/2902] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:26:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 4348 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 31 15:27:04.297948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-efc92a36-9ad2-4ede-84ab-2eb686139da7 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '.version_select at 0x7f5ca682e280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.308309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.308844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.309295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.310025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.310487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.310922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.354271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-efc92a36-9ad2-4ede-84ab-2eb686139da7 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295268686" status: 202 len: 0 microversion: 2.1 time: 0.071818 Oct 31 15:27:04.355448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1504/2903] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:27:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295268686 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:04.368488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2f688b2-e666-4eb2-ada7-1ca7ce1f2049 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.372006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2f688b2-e666-4eb2-ada7-1ca7ce1f2049 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.808204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2f688b2-e666-4eb2-ada7-1ca7ce1f2049 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.818528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2f688b2-e666-4eb2-ada7-1ca7ce1f2049 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.819999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2f688b2-e666-4eb2-ada7-1ca7ce1f2049 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.821200 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2f688b2-e666-4eb2-ada7-1ca7ce1f2049 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1281 microversion: 2.20 time: 0.464543 Oct 31 15:27:04.821777 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1505/2904] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1281 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:05.006648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.007512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.032222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.044013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.046785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.047749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.048381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.053079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.597235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.626561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.630352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.644233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b8a1d8b-2425-41e5-9eae-670fe54b301b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.379312 Oct 31 15:27:05.645095 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1400/2905] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:05.668962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-40a731da-599d-4d97-bc86-e1e414f28740 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca24254c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.768184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.789996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.791075 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-40a731da-599d-4d97-bc86-e1e414f28740 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.141535 Oct 31 15:27:05.792391 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1401/2906] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:05.793132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.797964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-697e71db-090a-462f-9c1f-7efe756e412a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1754 microversion: 2.32 time: 0.795321 Oct 31 15:27:05.798832 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1506/2907] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1754 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:05.855396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.857016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.874972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.877077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.878202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.882263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.884574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.885913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.286726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=14 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:06.495875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:06.515525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:06.521077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:06.522273 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a8776df-51c5-44f3-b0ba-07871a947502 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1277 microversion: 2.20 time: 0.674375 Oct 31 15:27:06.522852 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1402/2908] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1277 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:06.625559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f43e8449-4a5f-4bc8-b8f2-7b4b04b2d63c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: .version_select at 0x7f5ca1b8b1f0>, body: {"keypair": {"name": "tempest-keypair-1351931166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD1VmAx6S7kYQyiugT0I8ZlG0TssRjPcOhZrhtHA1xzhkn8HZ0KKqZB60Nrn+uaAhHE4+9Mb0KiRaq9Yh5GzbvcqvwneYowa29xne/bYpZ4Xxi6D247ne4mBGh6EuqONw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:06.666715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f43e8449-4a5f-4bc8-b8f2-7b4b04b2d63c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:06.677930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:06.678558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:06.680208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f43e8449-4a5f-4bc8-b8f2-7b4b04b2d63c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for user bf304336d1f2420db7a197a36036ccab and project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:06.695059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.705019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.705744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.706520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.707197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.707797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.709997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:06.751534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f43e8449-4a5f-4bc8-b8f2-7b4b04b2d63c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136791 Oct 31 15:27:06.760033 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1507/2909] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:27:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:06.809739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67d59835-da32-4461-b2b7-f30a4bab9d9e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1b5e430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:06.885707 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67d59835-da32-4461-b2b7-f30a4bab9d9e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.080006 Oct 31 15:27:06.890767 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1508/2910] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:06 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:06.900560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:06.903584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:06.919917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.920739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.921400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.923081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.925204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.926332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:09.281509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.302611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.320084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.346938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.350941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.355263 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14086d69-1899-4d65-a849-0436b15f79ca tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1754 microversion: 2.32 time: 2.462151 Oct 31 15:27:09.363607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.366847 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1509/2911] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:06 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1754 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:09.380723 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f3b5680-78c0-4642-affd-921f252c8dd2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 2.700430 Oct 31 15:27:09.383283 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1403/2912] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:06 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:09.398493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:09.403817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:09.419435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9e276c5-1957-4003-9042-06bb804d3b64 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca26a9ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:09.438230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:09.438775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:09.439420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:09.443864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:09.444858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:09.445462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:09.561382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9e276c5-1957-4003-9042-06bb804d3b64 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.170655 Oct 31 15:27:09.561999 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1404/2913] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:09 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:09.930927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.954547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.961816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:09.963005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6aa023e1-d4e5-4855-b822-f3ca23df4975 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1339 microversion: 2.20 time: 0.592224 Oct 31 15:27:09.963567 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1510/2914] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:09 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1339 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:10.409082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:10.409781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:10.419870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:10.421693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:10.432274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.434844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.438810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.439275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.442396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.442884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.443324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.443642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.444260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.445200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.445821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.447973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.607507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.629670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.643173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.651990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8ecf74f-cc1c-4ef8-b57f-0a42d2a2c398 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 2.229321 Oct 31 15:27:12.653101 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1511/2915] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:10 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:12.676602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-287d3e59-9538-4d0a-be59-a05b33334600 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1ba3b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:12.775406 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-287d3e59-9538-4d0a-be59-a05b33334600 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.117409 Oct 31 15:27:12.778772 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1512/2916] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:12 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:12.793019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:12.803633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:12.832796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.833417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.833763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.834501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.834972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.845119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.237653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.252505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.254448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.258564 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a3c7a9bf-d8a6-4b1d-9d40-d0bc81c95feb tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1801 microversion: 2.32 time: 2.857463 Oct 31 15:27:13.262519 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1405/2917] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:10 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1801 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:13.284308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-869605996", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e78089d-afe3-4c24-b00f-32f46e5b5900"}], "security_groups": [{"name": "tempest-securitygroup--267427872"}], "key_name": "tempest-keypair-1351931166", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:14.094523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] validate_networks() for [('8e78089d-afe3-4c24-b00f-32f46e5b5900', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:14.101206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:14.168463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:14.215816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:14.220874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:14.226823 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-314436e9-84c9-4268-a339-711aae210845 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 1.443566 Oct 31 15:27:14.231523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1513/2918] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:12 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:14.253953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:14.254382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:14.274475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:14.275752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:14.277412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:14.278659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:14.280112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:14.282224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.181923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.205427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.210992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.224409 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c91aa36-d979-4072-a0e9-c02e8556ad3c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.991616 Oct 31 15:27:15.236061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1514/2919] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:14 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:15.268282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0eb6c90-fc3a-4e7a-9db2-d903a69ebcc0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1ba3820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.394917 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0eb6c90-fc3a-4e7a-9db2-d903a69ebcc0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.132598 Oct 31 15:27:15.397511 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1515/2920] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:15.409746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.411261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:15.426694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.428596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.432069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.434167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.435299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.436325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.465972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:16.646970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.665505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.666955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.668150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-373ecc77-a1f9-47d2-9ba4-4a75b54e31a3 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1848 microversion: 2.32 time: 1.269501 Oct 31 15:27:16.680730 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1516/2921] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1848 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:16.692584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:16.692584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:16.695223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.697036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.697512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.701601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.702093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.703206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.703751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:16.996358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:16.996960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:16.997272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:16.997682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:16.998095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:17.023299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.023801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.024247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.025050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.025610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.026435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.130005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:17.146546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Getting quotas for user bf304336d1f2420db7a197a36036ccab and project 04a6d9faf79449b7bdd9b287186c792e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:17.193201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:17.200984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:17.340265 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f83ddfe-b113-4b7c-b389-f08c716111bf tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.065422 Oct 31 15:27:17.347065 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1406/2922] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:27:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 4075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:27:17.879233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:17.898330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:17.901724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:17.905737 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-602dd834-96e2-4995-a8fe-3ae57afc97c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 1.234187 Oct 31 15:27:17.908812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1517/2923] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:16 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:17.919894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9eed619a-780c-42ca-8e3c-9e48d41cd200 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'create', calling method: .version_select at 0x7f5ca67265e0>, body: {"keypair": {"name": "tempest-keypair-1045729152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC2z/1fFAvPc2fNYeuo/NLB2GVWYodhLw3Jf44jqfMlQA//4XCwXbOLKx4JXs6S6IeEoIs35WRKD9U5jeIkQpfBXbS6CcHFu7CWvX+nrPEjAn/HEyN+WJVs2660UknhFg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:17.923406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:17.924229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:17.938499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.941195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.942519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.946476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.948681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.949500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.990655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9eed619a-780c-42ca-8e3c-9e48d41cd200 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for project 2b75b127e3924430bc27f7f311747382. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:18.004653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9eed619a-780c-42ca-8e3c-9e48d41cd200 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for user 6b1695b4d61d40de8272561b0cf3362e and project 2b75b127e3924430bc27f7f311747382. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:18.083368 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9eed619a-780c-42ca-8e3c-9e48d41cd200 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.739296 Oct 31 15:27:18.084934 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1407/2924] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:27:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:18.097705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1380e180-f7d0-441e-9bd5-bec28a680a50 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca27055e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.170992 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1380e180-f7d0-441e-9bd5-bec28a680a50 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.084653 Oct 31 15:27:18.172430 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1408/2925] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:18 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:18.185580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-82f05937-7a6d-47c2-a968-650078c81650 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.206868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-82f05937-7a6d-47c2-a968-650078c81650 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:18.387393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-82f05937-7a6d-47c2-a968-650078c81650 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.417856 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-82f05937-7a6d-47c2-a968-650078c81650 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1237 microversion: 2.1 time: 0.230774 Oct 31 15:27:18.422915 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1409/2926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:18 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1237 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:18.465243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.466023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:18.494333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.494852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.499471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.504930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.505563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.506089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.618286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.642301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.645758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.648173 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69c6e6a6-b416-4054-aab1-fad76c58188c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.736148 Oct 31 15:27:18.649781 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1518/2927] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:17 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:18.659000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d4744f2a-7a71-4e45-af22-6c0ace86801e req-3f5df6da-eefb-4a48-b4e3-622d53bc0a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:18.699088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d4744f2a-7a71-4e45-af22-6c0ace86801e req-3f5df6da-eefb-4a48-b4e3-622d53bc0a11 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.699576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d4744f2a-7a71-4e45-af22-6c0ace86801e req-3f5df6da-eefb-4a48-b4e3-622d53bc0a11 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.702700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d4744f2a-7a71-4e45-af22-6c0ace86801e req-3f5df6da-eefb-4a48-b4e3-622d53bc0a11 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.747742 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d4744f2a-7a71-4e45-af22-6c0ace86801e req-3f5df6da-eefb-4a48-b4e3-622d53bc0a11 service nova] Creating event network-changed:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:27:18.770490 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d4744f2a-7a71-4e45-af22-6c0ace86801e req-3f5df6da-eefb-4a48-b4e3-622d53bc0a11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118866 Oct 31 15:27:18.771751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1519/2928] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:18.934433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.936408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:18.954925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.960398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.962092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.963616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.966787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.967430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.573682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.589370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.596555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.598071 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc0dad69-184f-4b57-869c-d91c44b00eb6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1848 microversion: 2.32 time: 1.173959 Oct 31 15:27:19.617177 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1410/2929] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:18 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1848 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:19.630197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b782f120-dfbe-4663-a2de-2fceaabba86b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1640700>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:19.722497 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b782f120-dfbe-4663-a2de-2fceaabba86b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.103826 Oct 31 15:27:19.729105 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1411/2930] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:19 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:19.735336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:19.735965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:19.751688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.755488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.761424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.762214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.762714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.763154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.832227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.847944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.849585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.850774 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5b6cbb4-72d6-4c6c-b4fe-84c50e2d2093 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 0.920645 Oct 31 15:27:19.851339 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1520/2931] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:18 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:19.862007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:19.881358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:19.894513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.899649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.900118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.908630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.908630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.908630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.450668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:20.462037 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc470ab1-6cf1-4eed-b1d8-f9301e596e00 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1289 microversion: 2.1 time: 0.731737 Oct 31 15:27:20.474576 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1412/2932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:19 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1289 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:20.633801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:20.634438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:20.643519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.644032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.644479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.645237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.645704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.646136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.014641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.024593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.030325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.031905 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fbe395fa-c64b-48c7-9c5e-7447e00a7501 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.174364 Oct 31 15:27:21.032482 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1521/2933] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:19 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:21.060315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0dc47332-ac8f-4d2a-9afa-47d303e14cc3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1ba3b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:21.196241 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0dc47332-ac8f-4d2a-9afa-47d303e14cc3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.139737 Oct 31 15:27:21.197174 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1522/2934] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:21 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:21.201786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:21.202995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:21.226235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.226740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.229312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.230312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.230961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.237412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.702321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.728158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.732870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.734746 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dea9f46e-a204-44ab-89d0-168b91478cf1 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1848 microversion: 2.32 time: 1.104915 Oct 31 15:27:21.746710 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1413/2935] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:20 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1848 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:21.779374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-425ce3ac-bbd2-4a62-98ed-330cf002cb5c req-e2585c5d-e33c-4298-802b-abb71decb30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "fe825c21-039d-4e7e-85a3-44e44830203b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:21.802217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-425ce3ac-bbd2-4a62-98ed-330cf002cb5c req-e2585c5d-e33c-4298-802b-abb71decb30d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.803563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-425ce3ac-bbd2-4a62-98ed-330cf002cb5c req-e2585c5d-e33c-4298-802b-abb71decb30d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.805057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-425ce3ac-bbd2-4a62-98ed-330cf002cb5c req-e2585c5d-e33c-4298-802b-abb71decb30d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.829253 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-425ce3ac-bbd2-4a62-98ed-330cf002cb5c req-e2585c5d-e33c-4298-802b-abb71decb30d service nova] Creating event network-changed:fe825c21-039d-4e7e-85a3-44e44830203b for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:21.847210 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-425ce3ac-bbd2-4a62-98ed-330cf002cb5c req-e2585c5d-e33c-4298-802b-abb71decb30d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083476 Oct 31 15:27:21.848494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1414/2936] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:21.857498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:21.859209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:21.873038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.873768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.887025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.888248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.889435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.891477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.025592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.041722 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7ebfa2b-c922-47a9-a785-a3f98e3f199e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1295 microversion: 2.1 time: 0.189911 Oct 31 15:27:22.043665 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1415/2937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:21 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1295 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:22.063799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.067739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.094642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.098263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.099268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.100275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.102657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.103341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.618072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.628953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.634204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.642251 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-366677a0-8519-45af-afca-0cd381804ac8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 1.442731 Oct 31 15:27:22.648365 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1523/2938] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:21 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:22.665849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40a714f3-72c8-4e5f-b0a7-06e8444d43a2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca675ce50>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.806500 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40a714f3-72c8-4e5f-b0a7-06e8444d43a2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.156671 Oct 31 15:27:22.808234 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1524/2939] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:22.813806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.830329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.864729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.871018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.874165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.879322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.882772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.887615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.583616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.606183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.611375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.612619 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1edc62c6-2b97-40af-9b21-daf214c437ad tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.553283 Oct 31 15:27:23.613215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1416/2940] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:23.636231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.637277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.658452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.666952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.667746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.672097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.672825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.676991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.007461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.019954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42f92427-697a-4cfe-b9fc-d619b513f129 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1295 microversion: 2.1 time: 0.401992 Oct 31 15:27:24.030782 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1417/2941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:23 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1295 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:24.036608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.037584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.057932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:24.060135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.060945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.062249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.063233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.064311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.065976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.071384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:24.313642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.324190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.346010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.353219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3f9006b-caeb-4a56-a82f-c49931b7798f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1869 microversion: 2.32 time: 1.543540 Oct 31 15:27:24.358850 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1525/2942] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1869 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:24.372561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b8d0f00-29ce-4fe4-8a61-8d3858f1758b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca6710790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.481484 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b8d0f00-29ce-4fe4-8a61-8d3858f1758b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1452 microversion: 2.1 time: 0.121235 Oct 31 15:27:24.482291 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1526/2943] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:24.641602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.642586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.651143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.651838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.652579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.653760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.654386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.655008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.063369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.081072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.082991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.090713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-032cd117-300c-4451-b902-6869b2181791 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 2.058002 Oct 31 15:27:26.091633 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1418/2944] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:26.104033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.117562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.136424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.142795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.143860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.159442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.160221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.161717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.763254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.783845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.792477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.803246 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-430b8cf7-9b3f-46ec-be76-bb1bc4e766d2 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 2.157024 Oct 31 15:27:26.819084 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1527/2945] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:26.849072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.850013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.859431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.860305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.861009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.862059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.862722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.863415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.109126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:27.272243 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5ac0ab82-f90e-4e68-9e17-b156e460cf59 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1814 microversion: 2.1 time: 1.179156 Oct 31 15:27:27.273201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1419/2946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1814 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:27.290017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-444137039", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c999eef-3ab4-4489-9119-8b9357d0c054"}], "security_groups": [{"name": "tempest-securitygroup--1993795128"}], "key_name": "tempest-keypair-1045729152", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:27.709815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] validate_networks() for [('8c999eef-3ab4-4489-9119-8b9357d0c054', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:27.776623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.786529 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d0c8b58-db8c-454d-a513-6b0271e4da25 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 0.965999 Oct 31 15:27:27.792201 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1528/2947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:27.808926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:27.809953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:27.824157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.825662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.826840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.829529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.830998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.833120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.409582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:28.772784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.784949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.789670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.791337 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02857f19-d294-4bc1-b3cd-fb15e017a161 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1857 microversion: 2.32 time: 0.997531 Oct 31 15:27:28.812234 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1529/2948] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:27 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1857 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:28.824752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a150773-4742-42e0-9558-0ce98c68d450 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca678dca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:28.900256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a150773-4742-42e0-9558-0ce98c68d450 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1461 microversion: 2.1 time: 0.086384 Oct 31 15:27:28.913020 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1530/2949] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:28.928127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:28.929075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:28.959333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.960973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.962227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.964162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.965773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.966303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.440958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.458296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.464239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.466455 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bc75bb6a-7489-465d-8d32-44be9093a75a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 0.547899 Oct 31 15:27:29.484300 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1531/2950] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:29.498732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.504108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.504664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.505313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.507855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.509322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.509777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.543907 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0a0720f-9b60-40f6-acbe-03ad8c06a0d0 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.050257 Oct 31 15:27:29.544998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1532/2951] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:29.550613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-60d09b62-3b9f-4708-946e-0c20a0362da8 req-22a1d1d2-0e0a-4bfd-9be9-e00d67050c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "7bb6f1c7-9823-4930-a400-bec14caa72e0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:29.579254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60d09b62-3b9f-4708-946e-0c20a0362da8 req-22a1d1d2-0e0a-4bfd-9be9-e00d67050c9c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.580579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60d09b62-3b9f-4708-946e-0c20a0362da8 req-22a1d1d2-0e0a-4bfd-9be9-e00d67050c9c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.585250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:29.585829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:29.586281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60d09b62-3b9f-4708-946e-0c20a0362da8 req-22a1d1d2-0e0a-4bfd-9be9-e00d67050c9c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.587432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:29.588352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:29.589815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:29.602097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.603375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.604729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.605946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.606715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.607593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.609495 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-60d09b62-3b9f-4708-946e-0c20a0362da8 req-22a1d1d2-0e0a-4bfd-9be9-e00d67050c9c service nova] Creating event network-changed:7bb6f1c7-9823-4930-a400-bec14caa72e0 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:29.624143 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-60d09b62-3b9f-4708-946e-0c20a0362da8 req-22a1d1d2-0e0a-4bfd-9be9-e00d67050c9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074522 Oct 31 15:27:29.625863 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1533/2952] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:29.641019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.642090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.653187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.667885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.668351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.669165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.669622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.670058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.691381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:29.714577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for user 6b1695b4d61d40de8272561b0cf3362e and project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:29.764264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:29.767781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:29.938531 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52058882-0431-4864-bf2d-143f3acfb0f7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.660310 Oct 31 15:27:29.939504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1420/2953] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:27:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 2665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:27:29.944503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bb69f40e-1117-4d13-a68d-149c542c0916 req-3a6af318-a99f-4fcd-8e1c-ff2120a84c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "name": "network-vif-plugged", "status": "completed", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:29.969459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bb69f40e-1117-4d13-a68d-149c542c0916 req-3a6af318-a99f-4fcd-8e1c-ff2120a84c85 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.970231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bb69f40e-1117-4d13-a68d-149c542c0916 req-3a6af318-a99f-4fcd-8e1c-ff2120a84c85 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.970830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bb69f40e-1117-4d13-a68d-149c542c0916 req-3a6af318-a99f-4fcd-8e1c-ff2120a84c85 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.985496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bb69f40e-1117-4d13-a68d-149c542c0916 req-3a6af318-a99f-4fcd-8e1c-ff2120a84c85 service nova] Creating event network-vif-plugged:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:27:29.993095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bb69f40e-1117-4d13-a68d-149c542c0916 req-3a6af318-a99f-4fcd-8e1c-ff2120a84c85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051921 Oct 31 15:27:29.995862 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1421/2954] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:30.006959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:30.008261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.019747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.023205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.024019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.024974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.025632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.026280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.986369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.998143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.003313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.004649 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a8785ed-ede3-4bab-bf06-cafb34205eb9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.377573 Oct 31 15:27:31.019550 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1534/2955] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:31.036301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d4dfaf8-7abe-4f53-961c-39bc33ac8c8d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1b5ef70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.066271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.095649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ced00d63-398c-4e80-99da-da4937dbf0da tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 1.091298 Oct 31 15:27:31.099586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1422/2956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:31.118840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.119920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.136489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.147988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.152719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.155864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.158702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.159366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.163294 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d4dfaf8-7abe-4f53-961c-39bc33ac8c8d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 200 len: 1461 microversion: 2.1 time: 0.156425 Oct 31 15:27:31.169534 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1535/2957] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 1461 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:31.181042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.182755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.205767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.210315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.211047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.213615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.216914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.218338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.409669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.418252 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9968fc03-01a8-4c71-b3fa-7ddfb994b547 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1290 microversion: 2.1 time: 0.247379 Oct 31 15:27:31.422406 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1536/2958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1290 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:31.429695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.437725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.449147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.449962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.450932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.451793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.452585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.453724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.021864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.024750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.038676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.040557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.042135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dce03ac8-02d7-4504-9854-f0bdfe22b67f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1407 microversion: 2.20 time: 0.618398 Oct 31 15:27:32.043378 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1537/2959] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1407 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:32.045225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.047973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.049494 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60274145-3df4-463a-bb26-b51e483f6a33 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.947503 Oct 31 15:27:32.049917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.050535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.063258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.063976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.065191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.066861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.067874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.068548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.070824 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1423/2960] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:32.076930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-163a0ebb-0b88-4665-aa6c-0e26c24cf6bd req-2fd8fdfe-2dce-4ccf-b672-5046e7b858ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd6e134c-8818-4583-85a2-0b63c8516203", "tag": "5703f7d4-20c1-4300-8fe7-704ac6c4c6e0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:32.092981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-163a0ebb-0b88-4665-aa6c-0e26c24cf6bd req-2fd8fdfe-2dce-4ccf-b672-5046e7b858ab service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.093839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-163a0ebb-0b88-4665-aa6c-0e26c24cf6bd req-2fd8fdfe-2dce-4ccf-b672-5046e7b858ab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.094595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-163a0ebb-0b88-4665-aa6c-0e26c24cf6bd req-2fd8fdfe-2dce-4ccf-b672-5046e7b858ab service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.110272 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-163a0ebb-0b88-4665-aa6c-0e26c24cf6bd req-2fd8fdfe-2dce-4ccf-b672-5046e7b858ab service nova] Creating event network-changed:5703f7d4-20c1-4300-8fe7-704ac6c4c6e0 for instance dd6e134c-8818-4583-85a2-0b63c8516203 on n-h1-858383-17 Oct 31 15:27:32.119036 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-163a0ebb-0b88-4665-aa6c-0e26c24cf6bd req-2fd8fdfe-2dce-4ccf-b672-5046e7b858ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044281 Oct 31 15:27:32.119938 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1424/2961] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:32.127473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.128186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.135167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.135974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.136818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.137740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.138389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.138977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.809224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.821902 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57e381f8-9701-4b43-9dc3-9b6803c441e2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1468 microversion: 2.1 time: 0.777251 Oct 31 15:27:32.822768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1538/2962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1468 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:32.828401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.829079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.835085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.835929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.836408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.837598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.838530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.838979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.850300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.861204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.863769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.865535 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f7eb16cd-77dc-46a1-a904-6787e9b167ca tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.744195 Oct 31 15:27:32.877237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1425/2963] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:32.891241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f0e2a0-3fc6-4e96-9955-55fc83e7c5f5", "device": "/dev/xvdb"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:32.894268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.900494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.901369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.901893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.902652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.903300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.903936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.260769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08fb660b-7cf3-41e7-8e99-c31b9d3ee344 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "POST /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381472 Oct 31 15:27:33.261492 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1426/2964] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:27:32 2022] POST /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:33.276687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.277433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.297686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.298442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.300135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.301510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.303542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.304714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.305831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.308254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:33.313985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b365ef5f-5cf1-460b-8b76-ce03ba84d250 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 0.489839 Oct 31 15:27:33.314574 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1539/2965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:33.324209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f737fe00-bf2c-48ee-8ee5-decc8a1a3c7e req-0d99ca5b-2d5b-4ed1-9cda-ad861554c0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "5673ce77-3331-415e-911c-8827eeed1fec"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:33.335690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f737fe00-bf2c-48ee-8ee5-decc8a1a3c7e req-0d99ca5b-2d5b-4ed1-9cda-ad861554c0e5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.336416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f737fe00-bf2c-48ee-8ee5-decc8a1a3c7e req-0d99ca5b-2d5b-4ed1-9cda-ad861554c0e5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.337073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f737fe00-bf2c-48ee-8ee5-decc8a1a3c7e req-0d99ca5b-2d5b-4ed1-9cda-ad861554c0e5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.351591 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f737fe00-bf2c-48ee-8ee5-decc8a1a3c7e req-0d99ca5b-2d5b-4ed1-9cda-ad861554c0e5 service nova] Creating event network-vif-plugged:5673ce77-3331-415e-911c-8827eeed1fec for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:33.357755 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f737fe00-bf2c-48ee-8ee5-decc8a1a3c7e req-0d99ca5b-2d5b-4ed1-9cda-ad861554c0e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037394 Oct 31 15:27:33.359905 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1540/2966] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:33.366352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-678671287"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:33.369405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.377965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.378654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.379640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.380541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.381323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.382054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.487661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.524775 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-07250a26-b993-4e14-b6e0-ab1aa6fe3776 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1296 microversion: 2.1 time: 0.261346 Oct 31 15:27:33.531344 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1427/2967] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1296 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:33.548461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.552587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.559826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.561139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.561782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.563333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.564476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.565359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.712594 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-475e2220-78f4-42ec-a973-2c414aa3aa25 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "POST /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438/action" status: 202 len: 0 microversion: 2.1 time: 0.349243 Oct 31 15:27:33.715819 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1541/2968] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:33 2022] POST /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:27:33.734523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.735444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.754523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.755241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.756424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.760280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.761113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.763257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.239988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.248958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.256339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.257853 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bcb1153-1e8d-40b9-8fab-18c64656c30c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1599 microversion: 2.20 time: 0.724857 Oct 31 15:27:34.261226 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1428/2969] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1599 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:34.299055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c3ec8fd-1c94-405a-b458-db756659d87b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15f43a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.323168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.338114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.345919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.347599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4acaab3b-df4a-4ed9-87a4-9f26d5ca8188 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.630283 Oct 31 15:27:34.350900 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1542/2970] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:34.361506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.367739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.386382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c3ec8fd-1c94-405a-b458-db756659d87b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.111873 Oct 31 15:27:34.396721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1429/2971] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:34.396721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4d89127e-46b3-43ce-8097-d56bf8b954a6 req-759f613a-6bb0-4670-aa3f-3802ded1667c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "64f6e43a-08b5-4220-aac7-f1577cd96e63"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:34.399458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.400228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.400921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.402350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.403041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.407307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.438763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4d89127e-46b3-43ce-8097-d56bf8b954a6 req-759f613a-6bb0-4670-aa3f-3802ded1667c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.443717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4d89127e-46b3-43ce-8097-d56bf8b954a6 req-759f613a-6bb0-4670-aa3f-3802ded1667c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.444514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4d89127e-46b3-43ce-8097-d56bf8b954a6 req-759f613a-6bb0-4670-aa3f-3802ded1667c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.478714 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4d89127e-46b3-43ce-8097-d56bf8b954a6 req-759f613a-6bb0-4670-aa3f-3802ded1667c service nova] Creating event network-changed:64f6e43a-08b5-4220-aac7-f1577cd96e63 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:34.501016 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4d89127e-46b3-43ce-8097-d56bf8b954a6 req-759f613a-6bb0-4670-aa3f-3802ded1667c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110106 Oct 31 15:27:34.501969 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1430/2972] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:34.508387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.513564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.528264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.529967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.530775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.531973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.532824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.534275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.782584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bb8f4d9-fd01-4aa5-85ba-eb6dcf53d2d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.279384 Oct 31 15:27:34.800433 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1431/2973] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:27:34.823736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.826795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.838164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.839833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.841026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.843645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.844628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.845447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.877017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.902481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.912054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.915741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b806c36-31a6-4d35-8874-82cbaecf45ce tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.562495 Oct 31 15:27:34.918527 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1543/2974] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:34.933326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.934175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.941511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.942838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.943459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.944329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.944993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.945856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.787564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.801861 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc83ee41-f12f-4873-80ae-7be6d52971d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 0.881927 Oct 31 15:27:35.808203 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1544/2975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:35.824477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-781748239", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "1d858e38-2526-4283-885b-e323db6ad508"}, {"uuid": "b4583c89-3b75-4108-b269-e4e8ce5f8fc0"}, {"uuid": "1d858e38-2526-4283-885b-e323db6ad508"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:35.919807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] validate_networks() for [('1d858e38-2526-4283-885b-e323db6ad508', None, None, None, None, None), ('b4583c89-3b75-4108-b269-e4e8ce5f8fc0', None, None, None, None, None), ('1d858e38-2526-4283-885b-e323db6ad508', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:36.169117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.182823 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c14f5490-fc06-4c41-98fd-334b1192e208 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 1.378093 Oct 31 15:27:36.183635 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1432/2976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:36.198091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.206180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.214608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.215666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.216281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.217232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.219024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.219717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:38.318668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.336472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.345810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.353481 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b3902dc-6510-41fd-baf3-1aa737c8ab58 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 2.158550 Oct 31 15:27:38.357182 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1433/2977] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:38.383894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd1d1495-3470-4415-aed1-cf2ba29e1e6f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca66c7d30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:38.504873 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd1d1495-3470-4415-aed1-cf2ba29e1e6f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.145864 Oct 31 15:27:38.510271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1434/2978] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:38 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:38.539566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "735fab76-f84c-4805-84d4-37b8dceb5040"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "d3956ef2-61dc-4b6a-84dd-c6a3da755bdf"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:38.606562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:38.610592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:38.616338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:38.651548 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] Creating event network-vif-plugged:735fab76-f84c-4805-84d4-37b8dceb5040 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:38.660221 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] Creating event network-vif-plugged:d3956ef2-61dc-4b6a-84dd-c6a3da755bdf for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:38.678487 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-31e48cbc-1910-4211-a0ac-d0c87c477a87 req-99690e8e-79b1-4d99-9b4f-3b34b4273c94 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.155826 Oct 31 15:27:38.682809 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1435/2979] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:38.695710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:38.697251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:38.718969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:38.720582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:38.721894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:38.723876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:38.729170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:38.730545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.520166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:39.630230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:39.748918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:39.959450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.001213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.005043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.011663 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-936dc9aa-3fc1-4f39-9ee5-471fb0ba90ea tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.323691 Oct 31 15:27:40.039663 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1436/2980] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:38 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:40.048680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-fcb582db-7823-4547-83a1-f3619ed69333 req-c81923af-aa6e-4338-b1ba-4b34af8b0a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "0ceeb89c-6a35-4331-9ec3-a58e16847f0d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:40.059009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fcb582db-7823-4547-83a1-f3619ed69333 req-c81923af-aa6e-4338-b1ba-4b34af8b0a68 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.059740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fcb582db-7823-4547-83a1-f3619ed69333 req-c81923af-aa6e-4338-b1ba-4b34af8b0a68 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.060337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-fcb582db-7823-4547-83a1-f3619ed69333 req-c81923af-aa6e-4338-b1ba-4b34af8b0a68 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.075304 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-fcb582db-7823-4547-83a1-f3619ed69333 req-c81923af-aa6e-4338-b1ba-4b34af8b0a68 service nova] Creating event network-changed:0ceeb89c-6a35-4331-9ec3-a58e16847f0d for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:40.098900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-fcb582db-7823-4547-83a1-f3619ed69333 req-c81923af-aa6e-4338-b1ba-4b34af8b0a68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054642 Oct 31 15:27:40.105876 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1437/2981] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:40.112620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:40.113567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.121205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.124320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.125518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.126576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.127216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.127824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:41.878701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:41.890313 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03452758-c8e5-4ac3-af0c-9205d3f607f0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 1.782594 Oct 31 15:27:41.892558 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1438/2982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:40 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:41.897549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c62d881a-14e0-48e8-8d79-c757e66b96ba req-cd38daf4-4f55-4e64-ab32-8ee927ae8736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "db867e96-da3d-4e64-9050-b6856d593f29"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:41.947214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c62d881a-14e0-48e8-8d79-c757e66b96ba req-cd38daf4-4f55-4e64-ab32-8ee927ae8736 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:41.953254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c62d881a-14e0-48e8-8d79-c757e66b96ba req-cd38daf4-4f55-4e64-ab32-8ee927ae8736 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:41.958922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c62d881a-14e0-48e8-8d79-c757e66b96ba req-cd38daf4-4f55-4e64-ab32-8ee927ae8736 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.010025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c62d881a-14e0-48e8-8d79-c757e66b96ba req-cd38daf4-4f55-4e64-ab32-8ee927ae8736 service nova] Creating event network-changed:db867e96-da3d-4e64-9050-b6856d593f29 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:42.032844 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c62d881a-14e0-48e8-8d79-c757e66b96ba req-cd38daf4-4f55-4e64-ab32-8ee927ae8736 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138677 Oct 31 15:27:42.043288 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1439/2983] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:42.075213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.077632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:42.093085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.093834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.097042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.100478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.101337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.103317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.133633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:42.380167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:42.381400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:42.382123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:42.383090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:42.383741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:42.388834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:42.414939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.419735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.420204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.424796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.425384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.425831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.479277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Getting quotas for project 3c4875ff17224133b4aa6a9b189dd744. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:42.487705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Getting quotas for user b330dfc8915b46f5a5bfee6ac6ba9b54 and project 3c4875ff17224133b4aa6a9b189dd744. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:42.511282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:42.515239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:42.628154 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-901ad11e-7f70-439b-97c2-4e9e6cfe32e5 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.818685 Oct 31 15:27:42.630972 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1545/2984] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 6822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:27:42.657175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.664471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:42.678732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.685373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.685844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.687310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.687986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.688432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.710436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.726402 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-222a3d01-85f1-4bd8-960c-150e80aa3913 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 0.678771 Oct 31 15:27:42.727297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1440/2985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:42.747394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f360356b-eee5-4d39-9182-86cbafb4d2e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca66c79d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.870485 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f360356b-eee5-4d39-9182-86cbafb4d2e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.141299 Oct 31 15:27:42.872005 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1441/2986] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:42.887373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "699d5e32-b18a-41a1-8fd2-752d4710602c"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "c32bc1a8-8026-4831-9ece-c08bbcaf39c1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:42.923571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.927447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.928482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.960071 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] Creating event network-vif-plugged:699d5e32-b18a-41a1-8fd2-752d4710602c for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:42.960594 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] Creating event network-vif-plugged:c32bc1a8-8026-4831-9ece-c08bbcaf39c1 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:42.973898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e2376192-6694-4056-8f8c-f6adecf4ba05 req-a158e421-591b-4267-833a-b39e20fd652f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099698 Oct 31 15:27:42.975047 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1442/2987] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:42.992386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.993393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.014735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.016114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.017228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.020979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.022924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.024663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.470641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.482580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.503218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.506043 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f56823d2-88e6-4175-895c-29a4269cf2a5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.872639 Oct 31 15:27:43.506808 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1546/2988] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:43.524743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6c591384-e564-4a0a-ba48-236654ef238a req-1775bfea-59ce-48cf-b766-c48cd2cf7da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:43.550648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c591384-e564-4a0a-ba48-236654ef238a req-1775bfea-59ce-48cf-b766-c48cd2cf7da6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.554179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c591384-e564-4a0a-ba48-236654ef238a req-1775bfea-59ce-48cf-b766-c48cd2cf7da6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.554633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6c591384-e564-4a0a-ba48-236654ef238a req-1775bfea-59ce-48cf-b766-c48cd2cf7da6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.572011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6c591384-e564-4a0a-ba48-236654ef238a req-1775bfea-59ce-48cf-b766-c48cd2cf7da6 service nova] Creating event network-changed:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:27:43.593229 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6c591384-e564-4a0a-ba48-236654ef238a req-1775bfea-59ce-48cf-b766-c48cd2cf7da6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084080 Oct 31 15:27:43.604765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1547/2989] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:43.618390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.619135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.637050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.647324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.648111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.653893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.659019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.660223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.660879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.669933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.674916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.676421 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3016701b-1c3a-41b0-bd8f-3f445ee9a1be tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.699978 Oct 31 15:27:43.677698 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1443/2990] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:43.688656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.689746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.704294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.705216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.706699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.708406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.712141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.713052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.784357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.798719 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fabb93cf-05a1-44b2-b750-6afcb52144a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1216 microversion: 2.1 time: 0.192046 Oct 31 15:27:43.799501 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1548/2991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:43.818043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.833962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.850187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.856237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.856775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.857906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.859149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.859849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.341118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.364189 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-74b363c6-4fc2-4e8a-9588-b0d5cbf415c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 0.680367 Oct 31 15:27:44.372743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1444/2992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:44.378377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67f52144-2394-406b-abbe-732e627778ba tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca66c78b0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.475679 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67f52144-2394-406b-abbe-732e627778ba tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.107592 Oct 31 15:27:44.476778 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1445/2993] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:44.498303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}, {"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "66eea34d-40d4-4732-bad1-6c0d1884aa11"}, {"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "d733579d-e266-4f5a-84c0-90ffc337e6e0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:44.516988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.517887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.518601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.535146 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Creating event network-changed:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:27:44.536009 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Creating event network-changed:66eea34d-40d4-4732-bad1-6c0d1884aa11 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:44.537027 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] Creating event network-changed:d733579d-e266-4f5a-84c0-90ffc337e6e0 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:27:44.557092 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-20f2f220-c6e0-498a-9093-ef463a4093d8 req-c208d7a0-9995-4826-93ce-1aa7ac715f30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.067144 Oct 31 15:27:44.558440 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1446/2994] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:44.574731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.575562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:44.583912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.584959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.585743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.586839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.587750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.588415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.877143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.888077 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4ff9423-334e-4549-b2cd-92e2a37dc842 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 1.086722 Oct 31 15:27:44.891628 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1549/2995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:44.901265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.904682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:44.920487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.921534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.922251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.923408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.926509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.927124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.593095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.619500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.622060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.623655 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bdc27f86-5dc9-4659-8c91-75545876b187 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 1.061280 Oct 31 15:27:45.627672 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1447/2996] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:45.638220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:45.639879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:45.662958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.663631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.664859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.681824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.682669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.687674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.788145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.809990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.811776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.813892 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39d71eb6-a005-49e8-bcaa-fa68b5af9981 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.921039 Oct 31 15:27:45.829442 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1550/2997] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:45.844617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "10f655b8-38c5-4e9e-9f89-e6636a1238ae"}, {"server_uuid": "223f7809-62b7-489b-ae8f-2ce34fbe3438", "name": "network-vif-plugged", "status": "completed", "tag": "8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-plugged", "status": "completed", "tag": "7d1dfbb7-be68-41e6-861f-2714c16eeda6"}, {"server_uuid": "dd6e134c-8818-4583-85a2-0b63c8516203", "name": "network-vif-plugged", "status": "completed", "tag": "5703f7d4-20c1-4300-8fe7-704ac6c4c6e0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:45.876017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.877047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.877842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.906447 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Creating event network-vif-plugged:10f655b8-38c5-4e9e-9f89-e6636a1238ae for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:45.907276 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Creating event network-vif-plugged:8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d for instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 on n-h2-858383-17 Oct 31 15:27:45.907942 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Creating event network-vif-plugged:7d1dfbb7-be68-41e6-861f-2714c16eeda6 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:45.908656 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] Creating event network-vif-plugged:5703f7d4-20c1-4300-8fe7-704ac6c4c6e0 for instance dd6e134c-8818-4583-85a2-0b63c8516203 on n-h1-858383-17 Oct 31 15:27:45.925035 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c17efd31-b48e-443d-a50f-1edcafdf6716 req-3a95e57a-47e3-49b0-b17c-902ed672abc6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.093746 Oct 31 15:27:45.928156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1551/2998] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:45.941709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:45.942827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:45.948458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.953249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.954043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.955061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.956192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.956902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.957525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.963445 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89cd1b77-735d-4621-80d6-21283c727911 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1270 microversion: 2.1 time: 0.329383 Oct 31 15:27:45.964230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1448/2999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:45 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1270 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:45.974437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ab0e0cb-e6cc-4abd-bbcd-f7e7b78a8607 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca27f6a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:46.096461 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ab0e0cb-e6cc-4abd-bbcd-f7e7b78a8607 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.130765 Oct 31 15:27:46.099137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1449/3000] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:45 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:46.121536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:46.130120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:46.157071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.180488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.187410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.188654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.194424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.197357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.535559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.564587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67baf8bc-ffe0-49d2-98bf-e82de4806c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 0.624743 Oct 31 15:27:46.565573 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1552/3001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:45 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:46.663751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:46.664868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:46.691498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.692000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.692445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.693220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.693685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.694116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.797981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.818530 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e04a3f1a-de78-4f47-9575-bfca53371463 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 0.717337 Oct 31 15:27:46.819356 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1450/3002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:46 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:46.847963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:46.848621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:46.876635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.877327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.877729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.878471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.879332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.879918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.459180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.464778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.472722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.478264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.480380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.482036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99280f81-6f99-48bc-aba6-6fbe0bbf03c5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.825530 Oct 31 15:27:47.496760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.496760 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8fe66b30-aa02-41a3-a5d9-f4b8a5a15a30 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 0.645028 Oct 31 15:27:47.496760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1451/3003] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:46 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:47.497676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:47.497997 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1553/3004] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:46 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:47.499382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:47.508609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b0b555e-091d-4f5d-b7cd-f0b543c787de tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67fc550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:47.530449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.530956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.531400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.532127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.532593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.533056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.568002 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b0b555e-091d-4f5d-b7cd-f0b543c787de tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.068031 Oct 31 15:27:47.568790 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1554/3005] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:47 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:47.593471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:47.594213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:47.601471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.601981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.602434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.603174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.603645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.604080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.741511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.755781 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e64aef64-a54b-48a6-b583-128c4031f21e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1312 microversion: 2.1 time: 0.266281 Oct 31 15:27:47.756838 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1452/3006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:47 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:47.825358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.834690 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bae28b5a-fcad-430f-bbcf-e370e2305ef3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 0.249261 Oct 31 15:27:47.847424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:47.848024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:47.848600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1555/3007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:47 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:47.856187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.856990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.857606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.859028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.859647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.860290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.127142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.136803 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1411eb4a-3f32-4eff-b13d-4dffb778123b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1362 microversion: 2.1 time: 0.293188 Oct 31 15:27:48.137680 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1453/3008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:47 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:48.164506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a2e3f91d-2ffc-4728-a2c3-6822015ed144 req-e38ea9d9-9d78-4109-bbe2-233f59bd9157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:48.180843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a2e3f91d-2ffc-4728-a2c3-6822015ed144 req-e38ea9d9-9d78-4109-bbe2-233f59bd9157 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.181534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a2e3f91d-2ffc-4728-a2c3-6822015ed144 req-e38ea9d9-9d78-4109-bbe2-233f59bd9157 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.182146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a2e3f91d-2ffc-4728-a2c3-6822015ed144 req-e38ea9d9-9d78-4109-bbe2-233f59bd9157 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.195321 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a2e3f91d-2ffc-4728-a2c3-6822015ed144 req-e38ea9d9-9d78-4109-bbe2-233f59bd9157 service nova] Creating event network-vif-unplugged:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:27:48.200642 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a2e3f91d-2ffc-4728-a2c3-6822015ed144 req-e38ea9d9-9d78-4109-bbe2-233f59bd9157 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041483 Oct 31 15:27:48.201846 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1556/3009] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:48.519491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:48.520207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:48.520685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:48.521354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:48.538121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.538707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.539225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.539670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.540395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.540794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.541209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.541694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.542286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.543223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.545212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.547169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.763470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:49.777205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:49.782097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:49.791867 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9d426af-e8e9-487b-8522-3e975020aadd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 1.284149 Oct 31 15:27:49.792848 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1454/3010] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:48 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:49.801571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cca58860-3b14-4225-bc86-bdfd06d6a8b4 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15fe940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:49.835603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:49.870830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:49.873942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:49.875511 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f29c832e-9a33-4f53-ac23-db794c145fde tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1878 microversion: 2.42 time: 1.364794 Oct 31 15:27:49.876151 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1557/3011] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:48 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1878 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:49.881696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:49.883010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:49.883417 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cca58860-3b14-4225-bc86-bdfd06d6a8b4 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.082954 Oct 31 15:27:49.891382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.892160 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1455/3012] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:49 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:49.892926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.893646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.894779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.895512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.896165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.903495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:49.906426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:49.918431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.919266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.924665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.925653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.926288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.927433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.414200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.423318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-535a3759-17b3-430a-adcd-6ea6d294f2f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 0.529767 Oct 31 15:27:50.428449 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1456/3013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:49 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:50.433416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:50.442412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:50.453045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.456166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.456896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.457885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.459394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.461185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.554008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.565222 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d798642f-30cb-41f0-87fb-1a66cb9741af tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.687738 Oct 31 15:27:50.568169 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1558/3014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:49 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:50.574290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-927ac941-3e89-40a9-b983-bd426c577a3f req-6cd4deaa-bd74-4865-91e3-2de7c199a695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:50.590061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-927ac941-3e89-40a9-b983-bd426c577a3f req-6cd4deaa-bd74-4865-91e3-2de7c199a695 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.590968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-927ac941-3e89-40a9-b983-bd426c577a3f req-6cd4deaa-bd74-4865-91e3-2de7c199a695 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.591524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-927ac941-3e89-40a9-b983-bd426c577a3f req-6cd4deaa-bd74-4865-91e3-2de7c199a695 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.606437 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-927ac941-3e89-40a9-b983-bd426c577a3f req-6cd4deaa-bd74-4865-91e3-2de7c199a695 service nova] Creating event network-vif-plugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:27:50.613747 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-927ac941-3e89-40a9-b983-bd426c577a3f req-6cd4deaa-bd74-4865-91e3-2de7c199a695 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044045 Oct 31 15:27:50.620301 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1559/3015] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:50.631386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:50.633641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:50.649717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.650650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.651092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.651952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.652422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.655269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.661265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:50.911782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.920259 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-742728ed-30ec-4170-8dff-1bff55fc553a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1548 microversion: 2.1 time: 0.490474 Oct 31 15:27:50.926929 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1457/3016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:50 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1548 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:50.948264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-000e8014-7245-4062-a190-3098086dc650 req-bbac563e-f20c-448d-8948-57bb32b627ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "tag": "953c028c-9525-4a0e-8ac1-5bcb72b65bb9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:50.958651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-000e8014-7245-4062-a190-3098086dc650 req-bbac563e-f20c-448d-8948-57bb32b627ca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.959664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-000e8014-7245-4062-a190-3098086dc650 req-bbac563e-f20c-448d-8948-57bb32b627ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.960255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-000e8014-7245-4062-a190-3098086dc650 req-bbac563e-f20c-448d-8948-57bb32b627ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.984236 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-000e8014-7245-4062-a190-3098086dc650 req-bbac563e-f20c-448d-8948-57bb32b627ca service nova] Creating event network-changed:953c028c-9525-4a0e-8ac1-5bcb72b65bb9 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:27:50.992208 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-000e8014-7245-4062-a190-3098086dc650 req-bbac563e-f20c-448d-8948-57bb32b627ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062387 Oct 31 15:27:50.993863 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1458/3017] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:51.002180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.003126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.011229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.012009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.013045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.014053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.015461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.016104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.078062 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd2697d6-1551-4d86-a7f9-07960118c9eb tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1860 microversion: 2.1 time: 0.454869 Oct 31 15:27:51.080265 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1560/3018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:50 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1860 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:51.085717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14ed2e06-393d-4d89-b68f-6413538a98c6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67c9040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.136278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14ed2e06-393d-4d89-b68f-6413538a98c6 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.054682 Oct 31 15:27:51.146153 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1561/3019] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:51.152773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.153652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.161108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.161861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.162521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.163727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.164406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.165080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.609284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.627061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.628525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.645706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e0954ce2-16ab-46d4-96ca-8833ce305b6f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.650195 Oct 31 15:27:51.646626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1459/3020] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:50 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:51.651915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.652861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.660460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.661253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.661906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.662796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.663437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.664045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.734652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.746445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.749700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.751053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2aae9476-4099-4329-831c-1623b5580384 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2838 microversion: 2.42 time: 0.603463 Oct 31 15:27:51.755082 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1562/3021] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2838 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:51.761715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:51.767149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.790324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.790954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.791496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.792391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.792977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.796123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.860424 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea38c344-cabb-4412-a3ae-ac20178244c9 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.212441 Oct 31 15:27:51.861300 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1460/3022] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:51.866029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.866886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.878980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.879825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.880584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.881557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.882240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.882885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.979308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lazy-loading 'flavor' on Instance uuid d996a123-2a37-4dc3-b750-55fcde7248df {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:52.001784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Going to try to live migrate instance to n-h1-858383-17 {{(pid=120625) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:27:52.289472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.302449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aca6e016-d095-408b-ad6c-b7d345c4396c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1364 microversion: 2.1 time: 0.439826 Oct 31 15:27:52.318140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1461/3023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1364 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:52.324980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:52.325852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:52.334070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.335341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.335968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.336944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.341345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.342875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.458675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:52.505959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:52.716363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.725822 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8aa65f23-4236-4b62-a005-27030d13200a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.406458 Oct 31 15:27:52.730624 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1462/3024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:52 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:52.740930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:52.742888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:52.756644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.757448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.758047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.780571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.781363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.782055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.812544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:52.999989 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ad2b369-e065-45d2-9723-0913dc52560c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.267115 Oct 31 15:27:53.000976 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1463/3025] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:27:52 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4/os-interface => generated 1832 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:53.005669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b04411d1-5dcc-4cec-8429-f1253fbc45bb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15d7280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:53.079539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b04411d1-5dcc-4cec-8429-f1253fbc45bb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.077218 Oct 31 15:27:53.080450 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1464/3026] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:53 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:53.093219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:53.094284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:53.110006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.111064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.111714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.112685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.113377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.114044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.823453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.833358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.845961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.847310 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e9c85cb-2eef-4886-90d7-dee861578cb9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.761855 Oct 31 15:27:53.847964 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1465/3027] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:53 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:53.853342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-80b00ee5-29f8-43f7-a60a-bed8bc01e4fb req-81f0f9e4-2a36-4d72-b522-077589132fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "tag": "9f61fedf-01d0-4dd8-b49d-d7dfe866c7f0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:53.883105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-80b00ee5-29f8-43f7-a60a-bed8bc01e4fb req-81f0f9e4-2a36-4d72-b522-077589132fe8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.883915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-80b00ee5-29f8-43f7-a60a-bed8bc01e4fb req-81f0f9e4-2a36-4d72-b522-077589132fe8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.884367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-80b00ee5-29f8-43f7-a60a-bed8bc01e4fb req-81f0f9e4-2a36-4d72-b522-077589132fe8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.908555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-80b00ee5-29f8-43f7-a60a-bed8bc01e4fb req-81f0f9e4-2a36-4d72-b522-077589132fe8 service nova] Creating event network-changed:9f61fedf-01d0-4dd8-b49d-d7dfe866c7f0 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:27:53.916040 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-80b00ee5-29f8-43f7-a60a-bed8bc01e4fb req-81f0f9e4-2a36-4d72-b522-077589132fe8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066032 Oct 31 15:27:53.917719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1466/3028] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:53.924686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:53.925445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:53.933368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:53.934887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.935382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.935824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.938789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.939431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.940253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.782910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.792949 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf3f88be-64a9-4bbf-a92f-aec7cffdda96 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1551 microversion: 2.1 time: 0.872456 Oct 31 15:27:54.809438 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1467/3029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:53 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1551 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:54.815804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:54.816436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:54.823103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.823602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.824205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.824767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.825398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.825998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.943812 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8a48d34-0e99-4c2e-8452-93d066d26311 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/action" status: 202 len: 0 microversion: 2.1 time: 3.187038 Oct 31 15:27:54.944764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1563/3030] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:51 2022] POST /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/action => generated 0 bytes in 3189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:54.950386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b034bbe2-cc44-475c-9d2a-6674e889c19b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67c9040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.091147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b034bbe2-cc44-475c-9d2a-6674e889c19b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.144942 Oct 31 15:27:55.094523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1564/3031] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:54 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:55.107058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.113956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.133251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.135943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.136420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.137712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.139430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.147640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.439345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0449c20b-9e15-4db8-bb9d-a93a80115b3a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343678 Oct 31 15:27:55.440332 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1565/3032] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:27:55 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:55.451460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.453186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.465102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.465870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.466316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.467042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.468109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.469231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.561417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:55.574236 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55e8e644-bf22-4522-b78e-be4584231126 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.762690 Oct 31 15:27:55.577513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1468/3033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:54 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:55.586370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.587016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.600271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.600789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.611664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.612457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.619401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.619904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.186255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.196171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.208949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.210339 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-516c0a7e-87e1-43a8-9c31-7ae0156a33d4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.768803 Oct 31 15:27:56.224729 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1566/3034] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:55 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:56.224729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd6e134c-8818-4583-85a2-0b63c8516203", "tag": "5703f7d4-20c1-4300-8fe7-704ac6c4c6e0"}, {"name": "network-changed", "server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "tag": "aa54ec17-6f5b-42b5-b7c3-9c73db859374"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:56.241552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.242108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.242776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.256725 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] Creating event network-changed:5703f7d4-20c1-4300-8fe7-704ac6c4c6e0 for instance dd6e134c-8818-4583-85a2-0b63c8516203 on n-h1-858383-17 Oct 31 15:27:56.257598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] Creating event network-changed:aa54ec17-6f5b-42b5-b7c3-9c73db859374 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:27:56.270117 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5ca5269a-8322-4b31-8135-f942e4bb120f req-6560065f-5767-472b-bae3-f6b525f34c49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056394 Oct 31 15:27:56.271056 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1567/3035] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:56.276190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-279a9491-8441-4985-99a2-0afe6af42a8a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca6738160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.325537 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-279a9491-8441-4985-99a2-0afe6af42a8a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.053319 Oct 31 15:27:56.327360 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1568/3036] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:56.516658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.525938 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-990a7851-6d4b-4df0-a35b-74a95e3c03f4 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.947273 Oct 31 15:27:56.526932 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1469/3037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:55 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:56.609312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.610515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:56.638150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.639665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.640389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.642244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.643015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.643837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.115742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-94ef27ff-47ef-4c9e-9bba-b25177f50050 req-439002ee-e769-4936-bbd4-01c8b2382d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "tag": "735fab76-f84c-4805-84d4-37b8dceb5040"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:57.133395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-94ef27ff-47ef-4c9e-9bba-b25177f50050 req-439002ee-e769-4936-bbd4-01c8b2382d7e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.134414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-94ef27ff-47ef-4c9e-9bba-b25177f50050 req-439002ee-e769-4936-bbd4-01c8b2382d7e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.135117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-94ef27ff-47ef-4c9e-9bba-b25177f50050 req-439002ee-e769-4936-bbd4-01c8b2382d7e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.151309 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-94ef27ff-47ef-4c9e-9bba-b25177f50050 req-439002ee-e769-4936-bbd4-01c8b2382d7e service nova] Creating event network-changed:735fab76-f84c-4805-84d4-37b8dceb5040 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:27:57.180056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-94ef27ff-47ef-4c9e-9bba-b25177f50050 req-439002ee-e769-4936-bbd4-01c8b2382d7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066882 Oct 31 15:27:57.181419 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1470/3038] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:57.241512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:57.242588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:57.251280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.252045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.252729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.253689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.255002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.258059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.011710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.022836 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a82cfa3e-1fb2-414d-9b30-b2a5ef7a1fe1 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 1.425163 Oct 31 15:27:58.046773 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1569/3039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:58.053957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2843f671-9ac4-458f-a6d6-f9a3445043ac tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca6738700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:58.132797 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2843f671-9ac4-458f-a6d6-f9a3445043ac tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1452 microversion: 2.1 time: 0.084530 Oct 31 15:27:58.135224 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1570/3040] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:58 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:58.142502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:58.145409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:58.156037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.156947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.157648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.160136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.160974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.161635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.189129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.201363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.204330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.206307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6978b50-c0e1-477b-93b4-a382b403409d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.970145 Oct 31 15:27:58.207797 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1471/3041] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:57 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:58.797078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.811769 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8350144b-18f4-4b26-8431-670e403d9d4a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.674224 Oct 31 15:27:58.831995 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1571/3042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:58 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:59.052976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.053752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:59.059817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.060392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.060980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.061846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.062372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.062916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.150982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9401f97-065d-495c-b0ad-91bde8795a29 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca16d63a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.212949 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9401f97-065d-495c-b0ad-91bde8795a29 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1461 microversion: 2.1 time: 0.065564 Oct 31 15:27:59.214228 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1572/3043] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1461 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:59.235190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a69c60d1-0641-40b7-b82b-3af230ffd2c3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca155aca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.299899 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a69c60d1-0641-40b7-b82b-3af230ffd2c3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 200 len: 1461 microversion: 2.1 time: 0.073511 Oct 31 15:27:59.300775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1573/3044] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 1461 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:59.306639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.307494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:59.314534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.315108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.315618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.317511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.318857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.319364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.895096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.903118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b945c4f4-d885-49d5-aa62-cfe01852e213 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.854000 Oct 31 15:27:59.903852 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1472/3045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:59.920344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.925262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:59.936196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.937009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.937545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.938346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.938984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.939588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.049560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.064574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.066996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.069265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4cbd3571-a00a-4eaf-81ea-e9cf3382363f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.767267 Oct 31 15:28:00.070094 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1574/3046] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:00.082485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.083668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.097469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.098754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.099605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.100572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.101358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.102027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.328847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.337951 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d344820-c378-45e0-93f6-d3c295bfc724 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1466 microversion: 2.1 time: 0.423718 Oct 31 15:28:00.349682 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1473/3047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1466 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:00.364250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b7ea8c0e-8cc7-4de0-aed6-cb0fe9ca45ec req-0c192e91-031e-4eab-87a0-dcaa4b0694b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:00.376131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.379577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7ea8c0e-8cc7-4de0-aed6-cb0fe9ca45ec req-0c192e91-031e-4eab-87a0-dcaa4b0694b7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.386946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7ea8c0e-8cc7-4de0-aed6-cb0fe9ca45ec req-0c192e91-031e-4eab-87a0-dcaa4b0694b7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.387619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7ea8c0e-8cc7-4de0-aed6-cb0fe9ca45ec req-0c192e91-031e-4eab-87a0-dcaa4b0694b7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.391550 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e92af509-3478-4bfb-ace2-c5d4ad6bcb20 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.320162 Oct 31 15:28:00.392873 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1575/3048] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:00.405599 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b7ea8c0e-8cc7-4de0-aed6-cb0fe9ca45ec req-0c192e91-031e-4eab-87a0-dcaa4b0694b7 service nova] Creating event network-changed:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:28:00.406998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-775685966"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:00.413090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.413720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b7ea8c0e-8cc7-4de0-aed6-cb0fe9ca45ec req-0c192e91-031e-4eab-87a0-dcaa4b0694b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055432 Oct 31 15:28:00.419962 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1474/3049] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:00.427188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.428404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.429233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.430207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.430885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.431531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.751350 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c457509f-cbc3-4983-9883-b66a3f0925db tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "POST /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1/action" status: 202 len: 0 microversion: 2.1 time: 0.353708 Oct 31 15:28:00.752910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1576/3050] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:28:00 2022] POST /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:28:00.774522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f791d24c-0f57-4252-8f96-3f28c23eba3b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2424310>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.878493 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f791d24c-0f57-4252-8f96-3f28c23eba3b tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.103365 Oct 31 15:28:00.879767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1475/3051] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:00.930077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.930794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.941602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.942133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.942565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.943326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.943782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.944207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.100221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.101838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.114714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.115474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.116107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.119146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.121835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.122499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.470804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.481046 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92ac5228-81ee-4f07-ab4a-b9acd5a4e915 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.554985 Oct 31 15:28:01.481919 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1577/3052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:01.499177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.499962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.512417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.517380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.519669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.522882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.524959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.525335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.547273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.565863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.569886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.573247 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ad1ccf0-a2f0-4c2f-bf84-7043c52d0bd0 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.476945 Oct 31 15:28:01.575149 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1476/3053] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:01.789609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.799143 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40b6b57f-188c-4914-9159-5e00d9041f10 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.316061 Oct 31 15:28:01.800327 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1578/3054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:01.894778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b1c706c-f1ad-461f-8bf0-fb8962a6c2b3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a3dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.941328 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b1c706c-f1ad-461f-8bf0-fb8962a6c2b3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.050283 Oct 31 15:28:01.941908 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1477/3055] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:02.508999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:02.510303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:02.516722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.517212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.517656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.518367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.518957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.519427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.603410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:02.604023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:02.613049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.613782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.614292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.615056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.615716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.616320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.746678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.755465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1733eee4-a372-43e9-9e40-6c9ad79ec6de tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.250492 Oct 31 15:28:02.756200 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1579/3056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:02 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:02.823040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:02.823811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:02.830825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.831412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.831923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.832725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.833264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.833766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.859327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:02.934451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.945449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.947037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.948197 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-35023828-8914-476d-8b24-8697b1e0938a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.348668 Oct 31 15:28:02.948808 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1478/3057] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:02 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:02.969060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9197989-86b0-4ab7-828f-e04b92f02f43 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a3ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:03.016449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9197989-86b0-4ab7-828f-e04b92f02f43 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.062066 Oct 31 15:28:03.024753 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1479/3058] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:02 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:03.088806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.097736 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9b35429-5ebb-4607-ad96-547cf7185762 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.278907 Oct 31 15:28:03.098341 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1580/3059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:02 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:03.780751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:03.781436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:03.788530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.789050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.789485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.790178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.790634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.791058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.951748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.960121 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85cc96c4-7f83-4d82-aed6-09ca7e04ed47 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.184771 Oct 31 15:28:03.960941 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1480/3060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:03 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:03.978821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:03.979456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:03.987088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.987587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.988028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.988793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.989256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.989685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.031777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49209db3-eebc-4edc-be08-7aceb1fffa72 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca24259d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:04.080443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49209db3-eebc-4edc-be08-7aceb1fffa72 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.052864 Oct 31 15:28:04.081600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1481/3061] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:04 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:04.121120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:04.121742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:04.128166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.128602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.129103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.129809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.130272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.130705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.216640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.227662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.229273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.230429 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10336dd8-86de-413f-aa22-d0eef2868a7e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.257336 Oct 31 15:28:04.231182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1581/3062] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:03 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:04.285329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.293816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bb63b47a-e104-47dc-a204-b188b09cb975 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.176656 Oct 31 15:28:04.294512 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1482/3063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:04 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:04.596622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3b99f976-bfdb-4bf8-b822-69e57b27007d req-9a09ce1a-0936-4a78-b00a-944b2645f22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "name": "network-vif-plugged", "status": "completed", "tag": "aa54ec17-6f5b-42b5-b7c3-9c73db859374"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:04.608358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b99f976-bfdb-4bf8-b822-69e57b27007d req-9a09ce1a-0936-4a78-b00a-944b2645f22e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.608358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b99f976-bfdb-4bf8-b822-69e57b27007d req-9a09ce1a-0936-4a78-b00a-944b2645f22e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.608358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b99f976-bfdb-4bf8-b822-69e57b27007d req-9a09ce1a-0936-4a78-b00a-944b2645f22e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.621214 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3b99f976-bfdb-4bf8-b822-69e57b27007d req-9a09ce1a-0936-4a78-b00a-944b2645f22e service nova] Creating event network-vif-plugged:aa54ec17-6f5b-42b5-b7c3-9c73db859374 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:28:04.627070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3b99f976-bfdb-4bf8-b822-69e57b27007d req-9a09ce1a-0936-4a78-b00a-944b2645f22e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035148 Oct 31 15:28:04.629618 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1582/3064] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:04.985539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:04.986482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:04.994164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.994674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.995095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.995790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.996242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.996672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.099545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c4040dc-2f5c-4283-b6ef-1a3528534e11 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca155a700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:05.153609 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c4040dc-2f5c-4283-b6ef-1a3528534e11 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.059864 Oct 31 15:28:05.154598 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1583/3065] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:05 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:05.178270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.187898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a35a4a8-386c-4fd3-a475-ca3236fab2bf tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.207775 Oct 31 15:28:05.188491 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1483/3066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:04 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:05.255986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:05.256800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:05.266189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.266678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.267114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.267957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.268549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.269082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.317852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:05.318484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:05.324550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.325077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.325525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.326230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.327006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.327658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.519915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.529099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.531538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.532739 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af3e2794-629e-4dea-a171-e90ea5dc09f9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.280895 Oct 31 15:28:05.533318 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1584/3067] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:05 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:05.546818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.554975 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f3efa9f-f2ba-4adf-b174-55af090c846c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.240945 Oct 31 15:28:05.555487 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1484/3068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:05 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:06.169773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4dcd41e-ac40-48da-b2ef-05de6a7b8aff tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2435b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:06.211355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:06.211974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:06.218610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4dcd41e-ac40-48da-b2ef-05de6a7b8aff tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.052948 Oct 31 15:28:06.219000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.219205 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1585/3069] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:06 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:06.226854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.226854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.226854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.226854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.226854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.370265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.378535 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4147778-7444-4516-ba03-f21f13a0f3ae tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.171166 Oct 31 15:28:06.379110 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1485/3070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:06 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:06.559610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:06.560138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:06.568106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.568594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.569051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.569745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.570202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.570632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.577955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:06.578606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:06.584484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.585023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.585463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.586187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.586649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.587072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.827578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.830825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.837812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.839244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.839372 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a60865e1-c609-4e6e-9ff0-d7aef5786c57 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.265284 Oct 31 15:28:06.840075 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1486/3071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:06 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:06.840389 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95413b70-f813-47b7-b68b-668535b4e696 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.284957 Oct 31 15:28:06.841443 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1586/3072] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:06 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:06.845457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "name": "network-vif-plugged", "status": "completed", "tag": "953c028c-9525-4a0e-8ac1-5bcb72b65bb9"}, {"server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "name": "network-vif-plugged", "status": "completed", "tag": "9f61fedf-01d0-4dd8-b49d-d7dfe866c7f0"}, {"server_uuid": "223f7809-62b7-489b-ae8f-2ce34fbe3438", "name": "network-vif-unplugged", "status": "completed", "tag": "8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:06.855816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.856296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.856747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.870480 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Creating event network-vif-plugged:953c028c-9525-4a0e-8ac1-5bcb72b65bb9 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:28:06.870990 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Creating event network-vif-plugged:9f61fedf-01d0-4dd8-b49d-d7dfe866c7f0 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:28:06.871492 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] Creating event network-vif-unplugged:8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d for instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 on n-h2-858383-17 Oct 31 15:28:06.878099 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5aebce33-7ebf-4ab1-81cc-404aeef8036d req-bf0a0bd9-4520-464d-b9f3-153758502e11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.036925 Oct 31 15:28:06.878689 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1487/3073] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:07.234329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2ec0aef-b087-4c73-8e64-60eea6b12887 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2435b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:07.277793 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2ec0aef-b087-4c73-8e64-60eea6b12887 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.047330 Oct 31 15:28:07.278446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1587/3074] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:07 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:07.403219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:07.403968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:07.410777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.411280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.411713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.412390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.412875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.413306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.415875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:07.554225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:07.562509 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-14f84fc9-49c2-4fba-a604-8fb68d21dd75 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1354 microversion: 2.1 time: 0.164274 Oct 31 15:28:07.563067 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1488/3075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:07 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:07.864140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:07.864914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:07.867561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:07.868513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:07.872857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.874346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.874971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.875858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.876529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.877012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.877381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.878219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.878742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.879532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.880079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.880831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.128831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.137064 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c073eb3-57b4-4895-b93c-9fec1e46fd67 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.277352 Oct 31 15:28:08.137650 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1588/3076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:07 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:08.144038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.153545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.155221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.156420 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9431c4b1-da7a-4eff-9303-3be610998b12 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.293403 Oct 31 15:28:08.157067 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1489/3077] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:07 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:08.294350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69178942-776c-46f3-9d90-ad593e226aa8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67fcc10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.341355 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69178942-776c-46f3-9d90-ad593e226aa8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.051052 Oct 31 15:28:08.341964 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1589/3078] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:08.585718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.586344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.593391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.594430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.594865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.595544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.595994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.596411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.740807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.748673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-848feb5b-5d92-44fd-83cd-f84e349bf314 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1803 microversion: 2.1 time: 0.166823 Oct 31 15:28:08.749332 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1490/3079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:08.771821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.772329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.779154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.779644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.780072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.780804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.781945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.782373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.804908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de3d12f7-1fd6-451d-85e1-e5a9ded18b3b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1/ips" status: 200 len: 217 microversion: 2.1 time: 0.036846 Oct 31 15:28:08.805409 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1590/3080] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1/ips => generated 217 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:08.817281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.817779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.823740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.824222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.824664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.825373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.825826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.826247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.852237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:08.894279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9f797a3b-ad60-43b1-82a0-64d46e9541bd req-c95437db-94ac-4429-a255-a7f78fd6e42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "name": "network-vif-plugged", "status": "completed", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:08.903643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9f797a3b-ad60-43b1-82a0-64d46e9541bd req-c95437db-94ac-4429-a255-a7f78fd6e42d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.904152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9f797a3b-ad60-43b1-82a0-64d46e9541bd req-c95437db-94ac-4429-a255-a7f78fd6e42d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.904569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9f797a3b-ad60-43b1-82a0-64d46e9541bd req-c95437db-94ac-4429-a255-a7f78fd6e42d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.916237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9f797a3b-ad60-43b1-82a0-64d46e9541bd req-c95437db-94ac-4429-a255-a7f78fd6e42d service nova] Creating event network-vif-plugged:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:28:08.921404 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9f797a3b-ad60-43b1-82a0-64d46e9541bd req-c95437db-94ac-4429-a255-a7f78fd6e42d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Oct 31 15:28:08.925462 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1591/3081] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:08.927866 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9b15cc0-cf74-45da-befb-49eccad3ebef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 204 len: 0 microversion: 2.1 time: 0.114049 Oct 31 15:28:08.928449 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1491/3082] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:08 2022] DELETE /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:08.937558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.938293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.944383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.944920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.945357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.946042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.946498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.946918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.091370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.099310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a69debb7-cfc3-4820-9d27-0ebe951811c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1809 microversion: 2.1 time: 0.166229 Oct 31 15:28:09.099875 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1592/3083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:09.160972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:09.161811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:09.167832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:09.168328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:09.168797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.169498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:09.169962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:09.170390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.182925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:09.183537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:09.190516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:09.191067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:09.191564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.192382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:09.192887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:09.193311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.397760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.406174 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-921b1451-f001-47a5-a535-7353870bf3da tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.249683 Oct 31 15:28:09.406761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1492/3084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:09 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:09.411243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8bf483c-15bf-49c5-ae43-d9444492a973 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca157f940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:09.431239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.441961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.443542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.444838 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-638b1c49-0dd6-4e3d-a2c7-3dc116d4287e tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.265809 Oct 31 15:28:09.445406 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1593/3085] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:09 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:09.455295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8bf483c-15bf-49c5-ae43-d9444492a973 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.047511 Oct 31 15:28:09.456031 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1493/3086] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:09 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:10.123384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:10.124205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:10.130865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.131360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.131797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.132611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.133129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.134109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.291461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.300265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44751f7c-b486-49a5-b470-14b221bd67ef tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1809 microversion: 2.1 time: 0.180916 Oct 31 15:28:10.301096 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1594/3087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:10 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:10.431123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:10.431729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:10.441139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.441659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.442158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.442863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.443316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.443754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.471672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:10.472286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:10.479903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.480366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.481003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.481722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.482186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.482607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.727300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.742042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd576a41-9397-4024-aa56-13a2d1c07405 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.315275 Oct 31 15:28:10.742925 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1494/3088] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:10 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:10.764617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-362dc5b6-81d8-4481-9bd8-fb4915c5ed2d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca66c74c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:10.778486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.809496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.813695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.815683 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-362dc5b6-81d8-4481-9bd8-fb4915c5ed2d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.057319 Oct 31 15:28:10.816019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ae7f6f7-67f6-4b0e-a0d1-aa646b1e2544 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.348685 Oct 31 15:28:10.816708 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1495/3089] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:10 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:10.825040 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1595/3090] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:10 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:11.159278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ecf6fe83-4a7d-469f-8e9b-c2395328d18c req-96690138-d05c-4104-8c65-bbe31683320d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "name": "network-vif-deleted", "tag": "953c028c-9525-4a0e-8ac1-5bcb72b65bb9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:11.201634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecf6fe83-4a7d-469f-8e9b-c2395328d18c req-96690138-d05c-4104-8c65-bbe31683320d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.202279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecf6fe83-4a7d-469f-8e9b-c2395328d18c req-96690138-d05c-4104-8c65-bbe31683320d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.202822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecf6fe83-4a7d-469f-8e9b-c2395328d18c req-96690138-d05c-4104-8c65-bbe31683320d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.269393 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ecf6fe83-4a7d-469f-8e9b-c2395328d18c req-96690138-d05c-4104-8c65-bbe31683320d service nova] Creating event network-vif-deleted:953c028c-9525-4a0e-8ac1-5bcb72b65bb9 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:28:11.285656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ecf6fe83-4a7d-469f-8e9b-c2395328d18c req-96690138-d05c-4104-8c65-bbe31683320d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133947 Oct 31 15:28:11.292334 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1496/3091] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:11.326071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.327039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:11.341852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.345025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.345704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.349989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.350550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.351047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.570837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.583238 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ccb2700-9fa4-4400-9bcc-33ed3d893f85 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1674 microversion: 2.1 time: 0.261765 Oct 31 15:28:11.587459 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1596/3092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1674 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:11.593899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.594931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:11.601866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.602639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.603540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.606967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.607451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.607889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.636336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c35027a2-8123-410e-868c-c7abfde1a7c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/ips" status: 200 len: 151 microversion: 2.20 time: 0.048296 Oct 31 15:28:11.637257 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1497/3093] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:28:11.768790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.769420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:11.777464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.781578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.782037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.785298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.785828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.786265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.835894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a161c033-0aa0-4aa8-b042-544bdbae7e59 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a3b80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.929184 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a161c033-0aa0-4aa8-b042-544bdbae7e59 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.099479 Oct 31 15:28:11.931042 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1498/3094] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:11.947135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.948133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:11.956615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.957477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.958206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.959415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.961012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.961724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.467401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.484148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.489674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.495898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-779f930a-fa27-42df-8fb2-5dbc63ddb8ab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.554525 Oct 31 15:28:12.496911 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1499/3095] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:12.502672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.512365 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8d97f2e-d87d-401e-ac56-bd7563bcad50 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.747398 Oct 31 15:28:12.525236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1597/3096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:12.610845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:12.611468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:12.620120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.624499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.627159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.628322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.631379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.631992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.946374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6336a93-1853-4365-b3e4-5ff636560219 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca2435700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:13.023131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.032747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d35e6a99-99b5-4488-91c2-e3a2036d2036 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 200 len: 1653 microversion: 2.1 time: 0.425901 Oct 31 15:28:13.034038 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6336a93-1853-4365-b3e4-5ff636560219 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.088959 Oct 31 15:28:13.035605 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1598/3097] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:12 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:13.037214 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1500/3098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:12 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 1653 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:13.129216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0ee6ab5b-82be-480a-bb78-2a91207d117b req-3474e5fa-c484-4b71-a63d-1ae989fa8ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d996a123-2a37-4dc3-b750-55fcde7248df", "name": "network-vif-unplugged", "status": "completed", "tag": "b96b709b-0d7f-4c3d-9c98-89e9cac4f272"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:13.142967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:13.163356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0ee6ab5b-82be-480a-bb78-2a91207d117b req-3474e5fa-c484-4b71-a63d-1ae989fa8ae7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.164035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0ee6ab5b-82be-480a-bb78-2a91207d117b req-3474e5fa-c484-4b71-a63d-1ae989fa8ae7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.167876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0ee6ab5b-82be-480a-bb78-2a91207d117b req-3474e5fa-c484-4b71-a63d-1ae989fa8ae7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.231610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0ee6ab5b-82be-480a-bb78-2a91207d117b req-3474e5fa-c484-4b71-a63d-1ae989fa8ae7 service nova] Creating event network-vif-unplugged:b96b709b-0d7f-4c3d-9c98-89e9cac4f272 for instance d996a123-2a37-4dc3-b750-55fcde7248df on n-h2-858383-17 Oct 31 15:28:13.256881 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0ee6ab5b-82be-480a-bb78-2a91207d117b req-3474e5fa-c484-4b71-a63d-1ae989fa8ae7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126382 Oct 31 15:28:13.257945 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1599/3099] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:13.525725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:13.526761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:13.534153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.534643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.535260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.536155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.536831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.537453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.552062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:13.553203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:13.570920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.571795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.572460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.573432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.574144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.574777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.938697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.956437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.966847 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e38b9bef-6e04-479d-bba0-6e84df2e0a42 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.417236 Oct 31 15:28:13.972226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1600/3100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:13 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:13.979390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "name": "network-vif-deleted", "tag": "9f61fedf-01d0-4dd8-b49d-d7dfe866c7f0"}, {"server_uuid": "4eb3a959-2c67-4b24-bc6b-7d5f499763e1", "name": "network-vif-deleted", "tag": "aa54ec17-6f5b-42b5-b7c3-9c73db859374"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:13.994145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.996732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.999094 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e824776-2cd7-44a9-a15b-5d391b3e3447 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.476658 Oct 31 15:28:14.000284 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1501/3101] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:13 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:14.004056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.004878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.005543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.032975 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] Creating event network-vif-deleted:9f61fedf-01d0-4dd8-b49d-d7dfe866c7f0 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:28:14.040287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] Creating event network-vif-deleted:aa54ec17-6f5b-42b5-b7c3-9c73db859374 for instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 on n-h2-858383-17 Oct 31 15:28:14.048654 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-621b7f8a-8998-448c-8813-9ae6231498e0 req-55ba49fb-8449-402b-849e-07bacf8b522c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074001 Oct 31 15:28:14.051207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-657cd8a8-28b0-4ab2-bf74-40e748a50836 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1509160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:14.052027 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1601/3102] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:14.068067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:14.069194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:14.085049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.088745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.089481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.095395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.096377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.097118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.140613 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-657cd8a8-28b0-4ab2-bf74-40e748a50836 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.094126 Oct 31 15:28:14.142412 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1502/3103] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:14 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:14.164850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] HTTP exception thrown: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Request method failure captured: Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 HTTP/1.1 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-lifYBZ5A9DInYS4IbrF8DtSVmsg0Ba78EPMjIzKMj7nqdoXnaAjN2LfbwhObWAYBaV5sIrZfF0AbEIob4VVAvDae42Y4J8XpFcAHc_MquuPfXuVlr5bfXBv6Et6jVW_8OSFzcDzyEl3K-4rmZW5hfs8hpsoXTrDojSKzKlAzC46zE Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestMultiNic-490233297 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestMultiNic-490233297-project Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b330dfc8915b46f5a5bfee6ac6ba9b54 Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestMultiNic-490233297-project Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '4eb3a959-2c67-4b24-bc6b-7d5f499763e1'} Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:14.169574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Returning 404 to user: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae08fd54-5c9d-44af-a0a3-ccb93194189d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 404 len: 111 microversion: 2.1 time: 0.107366 Oct 31 15:28:14.179985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1602/3104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:14 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:28:14.998081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.001177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.015425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:15.016792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.040298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.041680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.043283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.043935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.044922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.045590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.049558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.050338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.051116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.051283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.051917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.052513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.101577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lazy-loading 'flavor' on Instance uuid b15880e4-0725-4b00-bb5d-99fea0b93694 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:15.232442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:15.504189 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dddf53bd-6750-41ae-97b8-7db9d9c07e02 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/action" status: 202 len: 0 microversion: 2.20 time: 0.491300 Oct 31 15:28:15.510169 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1603/3105] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:28:15 2022] POST /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:28:15.526274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.528075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.546747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.550607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.551189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.552381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.554031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.554532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.616208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:15.625682 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0913ce9a-efc4-4353-af88-5d7313654cef tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.631865 Oct 31 15:28:15.626934 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1503/3106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:14 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:15.631714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a631656-696f-4950-8167-8aa358c02778 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1509dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.695667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a631656-696f-4950-8167-8aa358c02778 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.064692 Oct 31 15:28:15.696910 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1504/3107] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:15 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:15.703919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8922aba3-4878-470f-b252-9d2b1eaa5e4a req-aba985ae-e090-432c-b7f8-a1d830f44ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d996a123-2a37-4dc3-b750-55fcde7248df", "tag": "b96b709b-0d7f-4c3d-9c98-89e9cac4f272"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:15.722042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8922aba3-4878-470f-b252-9d2b1eaa5e4a req-aba985ae-e090-432c-b7f8-a1d830f44ea8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.722470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8922aba3-4878-470f-b252-9d2b1eaa5e4a req-aba985ae-e090-432c-b7f8-a1d830f44ea8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.722907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8922aba3-4878-470f-b252-9d2b1eaa5e4a req-aba985ae-e090-432c-b7f8-a1d830f44ea8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.738769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8922aba3-4878-470f-b252-9d2b1eaa5e4a req-aba985ae-e090-432c-b7f8-a1d830f44ea8 service nova] Creating event network-changed:b96b709b-0d7f-4c3d-9c98-89e9cac4f272 for instance d996a123-2a37-4dc3-b750-55fcde7248df on n-h2-858383-17 Oct 31 15:28:15.744562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8922aba3-4878-470f-b252-9d2b1eaa5e4a req-aba985ae-e090-432c-b7f8-a1d830f44ea8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046177 Oct 31 15:28:15.745678 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1505/3108] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:15.753741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.754455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.775973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.776493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.776957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.777801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.778262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.778689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:16.076593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.098974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.101534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.102938 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dd925af-feb1-4150-8ac6-299cac2e95cc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.356062 Oct 31 15:28:16.103995 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1506/3109] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:15 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:16.223471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.239328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.244902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.246973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0722b7c-e60c-4921-bb18-310bd10bc83a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.735554 Oct 31 15:28:16.248025 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1604/3110] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:15 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:16.664996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:16.665878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:16.673337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:16.673854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:16.674313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:16.675076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:16.675570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:16.676013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:16.713330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a1b4012-9ade-4e6d-833e-283344c3f266 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1512ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:16.761217 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a1b4012-9ade-4e6d-833e-283344c3f266 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.051731 Oct 31 15:28:16.771932 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1605/3111] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:16 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:16.895799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.929474 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-61468a58-569a-48da-be33-3bc9c2f66b7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.261267 Oct 31 15:28:16.948177 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1507/3112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:16 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:17.140196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:17.151324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:17.160104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.160978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.161600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.162500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.163124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.163698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.276211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:17.276926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:17.295346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.296658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.302150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.303141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.308343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.309195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.354507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.366952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.371807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.373518 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55acecff-7c9d-4893-9c66-198051a5c009 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.239018 Oct 31 15:28:17.385351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1606/3113] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:17 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:17.659989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.669879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.672944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.674982 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-877dd895-0833-4bc4-9755-e39787947ab9 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.402728 Oct 31 15:28:17.675560 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1508/3114] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:17 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:17.778667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdbd314e-63bf-40ec-a9cb-f756c11d0efb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca150eb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:17.852481 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdbd314e-63bf-40ec-a9cb-f756c11d0efb tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.078627 Oct 31 15:28:17.854793 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1607/3115] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:17 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:17.960868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:17.961502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:17.970666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.971162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.971597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.972343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.975862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.976380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.149518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:18.154126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:18.167303 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b93cebb-0d12-4eb8-aa03-b8d256c708f2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.210531 Oct 31 15:28:18.168466 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1509/3116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:17 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:18.405863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:18.408076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:18.414933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:18.415643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:18.416879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.417774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:18.418436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:18.419149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.672375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:18.688417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:18.693358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:18.694957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b18dce8e-ebf6-441c-960e-45c2675c87fd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.293825 Oct 31 15:28:18.701987 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1608/3117] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:18 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:18.707074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:18.707711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:18.719533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:18.719968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:18.722073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.724661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:18.725392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:18.726016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.871016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81e46ec6-1a84-4d60-bc46-2bbd0944d756 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca66a8ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:18.975347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81e46ec6-1a84-4d60-bc46-2bbd0944d756 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.109708 Oct 31 15:28:18.977031 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1609/3118] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:18 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:19.067679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:19.078674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:19.080428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:19.082454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-43d50ac5-9239-4c6a-9506-08c48e9ab34f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.379687 Oct 31 15:28:19.083721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1510/3119] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:18 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:19.197467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:19.198233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:19.212436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.214139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.215698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.217636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.218360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.219086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.439097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:19.451149 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2333050b-adb1-4866-8f51-3cf54e65deac tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.261072 Oct 31 15:28:19.452314 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1610/3120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:19 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:19.728098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:19.729049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:19.735825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.736316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.736781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.737489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.737944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.749507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.959346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1782647990", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "b017ef2a-e69e-47f4-be85-15daed1d4be0"}, {"uuid": "7b4e3124-e206-40b8-85bb-8b62b2bd3d31"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:19.984835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.003296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.005159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.012626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8bf06a9-fc2c-486e-95d3-c64b7cb76cd8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.287340 Oct 31 15:28:20.013732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1511/3121] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:19 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:20.019178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab33a864-10fb-43e0-b246-b793e9f1044e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca155d430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:20.131661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] validate_networks() for [('b017ef2a-e69e-47f4-be85-15daed1d4be0', None, None, None, None, None), ('7b4e3124-e206-40b8-85bb-8b62b2bd3d31', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:20.155269 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab33a864-10fb-43e0-b246-b793e9f1044e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.140271 Oct 31 15:28:20.164849 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1512/3122] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:20 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:20.170589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:20.171490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:20.180492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.181311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.181973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.182916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.183592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.184256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.749801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.769606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.776326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.780050 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c7c70bb-c399-45c6-86b2-df5c5027605d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.611601 Oct 31 15:28:20.781411 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1513/3123] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:20 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:20.793455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:20.795442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:20.825390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.826075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.826545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.832376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.832907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.834270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.136874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.161219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1045cc0-bdf1-41a2-8412-5ee8d4fb8ac1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.368911 Oct 31 15:28:21.183798 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1514/3124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:20 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:21.204251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:21.207038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:21.214219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.215074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.215766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.217031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.217741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.218751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.527557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.541874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.543475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.544758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb6fe1a0-ec43-4af2-9495-6aa76ee7c884 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.357784 Oct 31 15:28:21.545343 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1515/3125] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:21 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:21.568522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b68b0f0d-56a3-4762-9199-caf3a6dabcd4 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a55e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:21.629711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:21.631041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:21.632061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:21.632715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:21.634732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:21.651143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.652367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.653097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.657934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.658836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.659827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.662798 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b68b0f0d-56a3-4762-9199-caf3a6dabcd4 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.116388 Oct 31 15:28:21.671144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1516/3126] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:21 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:21.709677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Getting quotas for project 3c4875ff17224133b4aa6a9b189dd744. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:21.716600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Getting quotas for user b330dfc8915b46f5a5bfee6ac6ba9b54 and project 3c4875ff17224133b4aa6a9b189dd744. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:21.733530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:21.736206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:21.798675 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33f7bcb0-bce6-4317-9d4b-3cd2541d5d64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.843080 Oct 31 15:28:21.800400 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1611/3127] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:21.809341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:21.810623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:21.812136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-255ab305-aa7b-4502-a9ab-3493bfe9287a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:21.813339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-255ab305-aa7b-4502-a9ab-3493bfe9287a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:21.835243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.837032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.837032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.837692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.838149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.843571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.892639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-255ab305-aa7b-4502-a9ab-3493bfe9287a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.902249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-255ab305-aa7b-4502-a9ab-3493bfe9287a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1213 microversion: 2.1 time: 0.095200 Oct 31 15:28:21.903881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1612/3128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:21 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:22.192154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:22.193137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:22.200983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.201822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.202479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.204070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.205019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.205676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.333308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:22.350666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:22.354382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:22.356970 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea8414c6-7a62-49dd-883b-fd42f0caeee4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.551018 Oct 31 15:28:22.380504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1517/3129] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:21 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:22.478494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:22.507492 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-638ecfbe-f247-4517-ad3a-b6799dbfbc7f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.319633 Oct 31 15:28:22.534545 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1613/3130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:22 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:22.581242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:22.582234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:22.593225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.594009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.594751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.595583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.596256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.596934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.690917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b173eda4-c3fa-448e-8bb9-49e84b8df65d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca6738550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:22.837530 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b173eda4-c3fa-448e-8bb9-49e84b8df65d tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.157102 Oct 31 15:28:22.846228 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1614/3131] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:22 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:22.930993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:22.931706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:22.957532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.964404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.968188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.971635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.980515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.981834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.001920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.026819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.029989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.034172 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c485e94-7990-431a-9452-beff32fd0b3b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.461431 Oct 31 15:28:23.059160 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1518/3132] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:22 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:23.134462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.152173 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23dbd18c-e5d8-4539-bec4-c7a33bf50b64 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1209 microversion: 2.1 time: 0.225629 Oct 31 15:28:23.154334 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1615/3133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:22 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1209 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:23.388660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:23.389630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:23.405530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.407935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.408412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.409199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.411715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.413436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.535231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:23.535883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:23.550889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.551770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.552375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.553297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.554064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.554855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.065622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.075040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.076477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.077714 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89e14759-8a83-4d6e-a2dc-700da187b499 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.693699 Oct 31 15:28:24.113826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1519/3134] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:23 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:24.129089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fd2cdc2a-1d88-43e6-9af6-8a11775f0cf7 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15094c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:24.152943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.188956 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1af061ef-e336-41c0-9f4b-9936794bd0fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.659189 Oct 31 15:28:24.190342 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1616/3135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:23 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:24.195363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:24.196909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:24.206252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:24.208262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:24.209064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.210364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:24.211073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:24.211857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.217043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fd2cdc2a-1d88-43e6-9af6-8a11775f0cf7 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.101545 Oct 31 15:28:24.218685 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1520/3136] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:24 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:24.225360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:24.226861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:24.235137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:24.238076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:24.238807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:24.239429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.240409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:24.241061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:24.241643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.377996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.386178 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e4aacd1-fdd2-4048-812c-b85e0237d54e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1273 microversion: 2.1 time: 0.165883 Oct 31 15:28:24.409262 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1521/3137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:24 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:24.672360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.687940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.689403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.690628 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-447cf06b-b10e-4eed-832d-70e6fc5f5ff3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.499120 Oct 31 15:28:24.691202 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1617/3138] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:24 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:25.107662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.109087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.117288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.118113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.118784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.119662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.120421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.121115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.218536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.222129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.232472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.233874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.234562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.235695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.236315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.236924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.517233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.527102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.535478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.538125 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9099c84a-c4cc-4a68-8d8c-9d10b0a8667a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.434447 Oct 31 15:28:25.551667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.553069 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1522/3139] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:25.568263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5a8edd4-ad07-4442-9ca3-58caddf7cab0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15f4af0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.568422 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5524b734-09fc-4940-913b-14869bc8b5f6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.354053 Oct 31 15:28:25.585158 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1618/3140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:25.590668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.593084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.604172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.604960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.605557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.607093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.607743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.608440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.630104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5a8edd4-ad07-4442-9ca3-58caddf7cab0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.075867 Oct 31 15:28:25.630691 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1523/3141] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:25.721028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.721656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.728976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.729471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.729960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.730585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.731036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.731460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.880898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.892245 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f6b0cef-a8af-470e-ba1b-f55fe2762ef4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1313 microversion: 2.1 time: 0.303854 Oct 31 15:28:25.893066 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1619/3142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:26.104802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.115912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.120439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.123808 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dcd6baaf-fa9c-48f6-b876-a3edda2684d6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.407884 Oct 31 15:28:26.124553 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1524/3143] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:26.572561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:26.573455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:26.595348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.595847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.596167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:26.596322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.597011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.597129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:26.597479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.597910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.609182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.610284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.610722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.611460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.611891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.621616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.026549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.042516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.047384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.051776 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f13bf28-26d8-448f-afec-6cd5432bb24a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.485874 Oct 31 15:28:27.056647 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1620/3144] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:26 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:27.069769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be330489-6ae0-4a9f-9a88-7dd205e18fe8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67fcc10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:27.131834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.141263 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e391e828-4625-49f0-bf1c-f107a3b9fcec tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.553533 Oct 31 15:28:27.143380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be330489-6ae0-4a9f-9a88-7dd205e18fe8 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.085370 Oct 31 15:28:27.144866 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1621/3145] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:27 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:27.162423 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1525/3146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:26 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:27.167609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:27.175932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:27.176134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:27.176806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:27.190102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.190855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.191493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.193427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.194320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.195005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.201578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.204733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.205190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.205922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.210079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.212574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.646535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.659604 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56b0cde5-a99c-4b11-8156-7fdb29b59dec tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.513362 Oct 31 15:28:27.681085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1622/3147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:27 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:27.702873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.714270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.717868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.722078 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5feff491-c006-4512-85fe-10e71751ae0d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.558281 Oct 31 15:28:27.722662 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1526/3148] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:27 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:28.086445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.087391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:28.099920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.101195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.101793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.102755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.104169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.104917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.160063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-213d435d-6249-47e4-97f1-f4a2e453f2b3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15d9a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.252650 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-213d435d-6249-47e4-97f1-f4a2e453f2b3 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1452 microversion: 2.1 time: 0.096807 Oct 31 15:28:28.260783 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1527/3149] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:28.264748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.265896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:28.275629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.276648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.277254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.277983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.279157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.279895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.546935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.560832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.566438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.568274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6bda76e-ef7b-401b-ac44-d424ce2dd925 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.485772 Oct 31 15:28:28.569120 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1623/3150] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:28.674806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.684376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-74a2a770-d1d8-4953-bd65-6c0399a017fe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.425009 Oct 31 15:28:28.685277 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1528/3151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:28.688673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.689945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:28.708333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.709278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.709930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.710881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.711597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.712283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.748452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.751629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:28.764876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.766914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.767465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.770383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.780039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.781031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.379699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.388433 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b4e42c53-5706-4fe0-a2cc-9e2eb1ec66fe tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.704824 Oct 31 15:28:29.389321 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1624/3152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:29.394600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35a625e6-f976-4ac1-b249-847aa56ffab1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1512940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.411391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.423280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.426484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.429285 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe222a61-50f0-46ca-9aa4-f7f824f52e48 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.684560 Oct 31 15:28:29.454550 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1529/3153] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:29.456240 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35a625e6-f976-4ac1-b249-847aa56ffab1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1461 microversion: 2.1 time: 0.065677 Oct 31 15:28:29.457278 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1625/3154] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1461 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:29.472472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-efc6a775-5dcd-4626-82d5-cbffd4defe37 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15f4dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.476499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-94a9f827-982d-4e8a-b076-21929c4f6efb req-f160c193-d06b-41f8-af72-82137510655a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b97e45b-a968-4969-8ecb-064377ce0c48", "tag": "b3bfed84-1fb9-4593-86ad-fd481ef9c497"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:29.491423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-94a9f827-982d-4e8a-b076-21929c4f6efb req-f160c193-d06b-41f8-af72-82137510655a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.492914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-94a9f827-982d-4e8a-b076-21929c4f6efb req-f160c193-d06b-41f8-af72-82137510655a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.493583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-94a9f827-982d-4e8a-b076-21929c4f6efb req-f160c193-d06b-41f8-af72-82137510655a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.511338 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-94a9f827-982d-4e8a-b076-21929c4f6efb req-f160c193-d06b-41f8-af72-82137510655a service nova] Creating event network-changed:b3bfed84-1fb9-4593-86ad-fd481ef9c497 for instance 0b97e45b-a968-4969-8ecb-064377ce0c48 on n-h1-858383-17 Oct 31 15:28:29.524100 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-94a9f827-982d-4e8a-b076-21929c4f6efb req-f160c193-d06b-41f8-af72-82137510655a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053478 Oct 31 15:28:29.525464 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1626/3155] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:29.570889 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-efc6a775-5dcd-4626-82d5-cbffd4defe37 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 200 len: 1461 microversion: 2.1 time: 0.103312 Oct 31 15:28:29.572522 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1530/3156] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 1461 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:29.587074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.587947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:29.594826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.597191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.597767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.598768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.599460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.600195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.603504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.604572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:29.613304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.614131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.614584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.616587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.617085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.617716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.123805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.133947 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e4911fd-880d-4166-ad61-64e11f20f562 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1481 microversion: 2.1 time: 0.551304 Oct 31 15:28:30.134650 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1627/3157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1481 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:30.139862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.141292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.149029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.149029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.149029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.149546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.150289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.150819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.225944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.235390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.236856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.238008 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73f3ff2b-f34a-4d5e-ba73-6ed471e515a6 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.639548 Oct 31 15:28:30.238576 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1531/3158] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:30.422216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.422845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.432488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.433014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.433454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.434156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.434614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.435043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.450724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:30.556179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.565411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:30.569738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5daaf5ff-08d5-4f3c-9fd5-4d77355407f5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.434025 Oct 31 15:28:30.571319 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1628/3159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:30 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:30.576900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.577786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.584844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.585339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.585775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.586503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.586965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.587390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.863501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.871304 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ed9e265-d5ae-4274-8258-079bc40c7667 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.453401 Oct 31 15:28:30.872227 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1532/3160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:30 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:30.954313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.967388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.970399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.972174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8869ecc-9026-4e46-ad08-c4b90abab05b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.399972 Oct 31 15:28:30.991539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1629/3161] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:30 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:31.172821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.173578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.182216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.182507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.183933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.185021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.185226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.185631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.266314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.267728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.275092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.275585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.276390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.277357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.277816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.278457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.619966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.628376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e5cf8b10-6db4-4bd4-90a9-4feb1ed46fdd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1468 microversion: 2.1 time: 0.472670 Oct 31 15:28:31.628975 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1533/3162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1468 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:31.649528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8fcb4450-04c1-423a-995c-34c5faa5c0b5 req-f67f83fa-bd04-4555-a500-012053c64e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b97e45b-a968-4969-8ecb-064377ce0c48", "tag": "6806ab03-91dc-44fa-9a4f-00b0ad5f8acf"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:31.662431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8fcb4450-04c1-423a-995c-34c5faa5c0b5 req-f67f83fa-bd04-4555-a500-012053c64e81 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.663068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8fcb4450-04c1-423a-995c-34c5faa5c0b5 req-f67f83fa-bd04-4555-a500-012053c64e81 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.664013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8fcb4450-04c1-423a-995c-34c5faa5c0b5 req-f67f83fa-bd04-4555-a500-012053c64e81 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.676881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8fcb4450-04c1-423a-995c-34c5faa5c0b5 req-f67f83fa-bd04-4555-a500-012053c64e81 service nova] Creating event network-changed:6806ab03-91dc-44fa-9a4f-00b0ad5f8acf for instance 0b97e45b-a968-4969-8ecb-064377ce0c48 on n-h1-858383-17 Oct 31 15:28:31.679632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:31.682249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8fcb4450-04c1-423a-995c-34c5faa5c0b5 req-f67f83fa-bd04-4555-a500-012053c64e81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036274 Oct 31 15:28:31.683212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1534/3163] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:31.689908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.690898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.697845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.698630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.698762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.699625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.700079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.700503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.726466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.736968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.738523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.739687 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6919ffd5-78ff-4de2-974d-19b861695fab tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.478649 Oct 31 15:28:31.740258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1630/3164] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:31.761670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a77f0f2-e178-49a1-94c7-08c38d4aa3e9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca150ea60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.872588 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a77f0f2-e178-49a1-94c7-08c38d4aa3e9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?changes-since=2022-10-31T15%3A26%3A15Z" status: 200 len: 1901 microversion: 2.1 time: 0.114740 Oct 31 15:28:31.873393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.874179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1631/3165] 10.222.0.48 () {58 vars in 1199 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/images?changes-since=2022-10-31T15%3A26%3A15Z => generated 1901 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:31.883529 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa976dcd-9a15-47b1-842d-9471253a9e82 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1717 microversion: 2.1 time: 0.198382 Oct 31 15:28:31.884442 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1535/3166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1717 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:31.888900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d0d8d65-466c-4099-a447-ca2d40c81be1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67c9940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.905905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.907163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.907838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:31.914487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.915732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.916237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.917041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.918089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.918539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.975779 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d0d8d65-466c-4099-a447-ca2d40c81be1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-216475040" status: 200 len: 484 microversion: 2.1 time: 0.090891 Oct 31 15:28:31.976500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1632/3167] 10.222.0.48 () {58 vars in 1229 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-216475040 => generated 484 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:31.991109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46b1ef34-4d60-496e-9f5d-326919b1c4af tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca28e6ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.088203 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46b1ef34-4d60-496e-9f5d-326919b1c4af tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?server=6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 956 microversion: 2.1 time: 0.102007 Oct 31 15:28:32.088954 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1633/3168] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/images?server=6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 956 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:32.094495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.095350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:32.102556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.103207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.103711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.104577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.105100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.105631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.288376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.297602 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9fecc4d-617d-4352-a446-fb5675df47b2 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.399296 Oct 31 15:28:32.298235 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1536/3169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:32.309027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3882f16a-2b92-4210-b508-70e6552844be tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a55e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.360472 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3882f16a-2b92-4210-b508-70e6552844be tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 484 microversion: 2.1 time: 0.061097 Oct 31 15:28:32.361100 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1537/3170] 10.222.0.48 () {58 vars in 1317 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 484 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:32.375248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-06948161-982e-441d-a901-648e89d5f7f0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a3ee0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.430119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.434755 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-06948161-982e-441d-a901-648e89d5f7f0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 484 microversion: 2.1 time: 0.064583 Oct 31 15:28:32.435338 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1538/3171] 10.222.0.48 () {58 vars in 1303 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 484 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:32.449278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.451227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.452565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd658731-4911-42c6-ad96-318d8459b123 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15a3160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.455272 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8043c0f-d2af-4797-8f4a-bf3806973db1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1744 microversion: 2.20 time: 0.364782 Oct 31 15:28:32.456156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1634/3172] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1744 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:32.595156 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd658731-4911-42c6-ad96-318d8459b123 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.147798 Oct 31 15:28:32.605950 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1539/3173] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:32.611468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab81e327-5d00-419f-a5b5-781a10edf8ba tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1512940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.683163 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab81e327-5d00-419f-a5b5-781a10edf8ba tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.075806 Oct 31 15:28:32.683924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1635/3174] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:32.699615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13f24e7e-3098-4af0-9e0f-b63f1f65fa6f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca157f0d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.769832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.770529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:32.777905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.778720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.779518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.780305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.780832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.781446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.794881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13f24e7e-3098-4af0-9e0f-b63f1f65fa6f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.100218 Oct 31 15:28:32.800982 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1540/3175] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:32.810309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4c9321d-1bc0-4a9e-93a1-34e411692145 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1529b80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.904153 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4c9321d-1bc0-4a9e-93a1-34e411692145 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?changes-since=2022-10-31T15%3A26%3A10Z" status: 200 len: 6326 microversion: 2.1 time: 0.098601 Oct 31 15:28:32.913786 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1541/3176] 10.222.0.48 () {58 vars in 1220 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-31T15%3A26%3A10Z => generated 6326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:32.913786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.913786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:32.921014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.921014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.921014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.921014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.921014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.921014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.342335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.358887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.360533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.362457 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52d9acf6-95a5-4edd-bd20-0e53620e036b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.599229 Oct 31 15:28:33.381622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1636/3177] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:33.390043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7510e2b0-8f6e-4256-b7bd-dd28a30972c1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1512af0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.454469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7510e2b0-8f6e-4256-b7bd-dd28a30972c1 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-216475040" status: 200 len: 664 microversion: 2.1 time: 0.071402 Oct 31 15:28:33.457927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1637/3178] 10.222.0.48 () {58 vars in 1250 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-216475040 => generated 664 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:33.459012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.475765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3f3e75cb-e676-40ef-807d-24df93583b2d req-2425764e-85fb-49d7-b768-e06291c8ee2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "66eea34d-40d4-4732-bad1-6c0d1884aa11"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:33.477600 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe466089-5c29-42de-a608-502cb4875b6e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1707 microversion: 2.1 time: 0.572107 Oct 31 15:28:33.478370 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1542/3179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1707 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:33.487393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.488549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.495892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3f3e75cb-e676-40ef-807d-24df93583b2d req-2425764e-85fb-49d7-b768-e06291c8ee2a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.496858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3f3e75cb-e676-40ef-807d-24df93583b2d req-2425764e-85fb-49d7-b768-e06291c8ee2a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.497087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.497634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.498280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.499004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3f3e75cb-e676-40ef-807d-24df93583b2d req-2425764e-85fb-49d7-b768-e06291c8ee2a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.499471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.500195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.500955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.532966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3f3e75cb-e676-40ef-807d-24df93583b2d req-2425764e-85fb-49d7-b768-e06291c8ee2a service nova] Creating event network-vif-plugged:66eea34d-40d4-4732-bad1-6c0d1884aa11 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:33.539423 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3f3e75cb-e676-40ef-807d-24df93583b2d req-2425764e-85fb-49d7-b768-e06291c8ee2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079909 Oct 31 15:28:33.541303 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1638/3180] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:33.548462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d6d9d8a-27cc-44b8-a908-fae112a24cae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca67c95e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.689014 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d6d9d8a-27cc-44b8-a908-fae112a24cae tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1464 microversion: 2.1 time: 0.145849 Oct 31 15:28:33.693857 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1639/3181] 10.222.0.48 () {58 vars in 1338 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:33.699229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.700194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.714876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.715813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.715813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.716189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.717319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.717883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.718553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.729289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9715f869-bb4e-4283-9b67-e793ef73d9f4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.245497 Oct 31 15:28:33.738699 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1543/3182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:33.754639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa68f02d-eddb-499a-9455-f2198eedc2ea tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '.version_select at 0x7f5ca15574c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.765147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa68f02d-eddb-499a-9455-f2198eedc2ea tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.766853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa68f02d-eddb-499a-9455-f2198eedc2ea tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.767694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa68f02d-eddb-499a-9455-f2198eedc2ea tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.778300 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa68f02d-eddb-499a-9455-f2198eedc2ea tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1182 microversion: 2.1 time: 0.038445 Oct 31 15:28:33.780424 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1544/3183] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/os-migrations => generated 1182 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:33.786579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab4017af-8a17-4938-ae56-70e739bc9665 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca153c820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.882799 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab4017af-8a17-4938-ae56-70e739bc9665 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1464 microversion: 2.1 time: 0.100427 Oct 31 15:28:33.883378 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1545/3184] 10.222.0.48 () {58 vars in 1324 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:33.901099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.901959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.911407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.911983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.912457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.913302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.913899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.914405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.948041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.959674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.961886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.963384 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-17cce1fe-63ba-48da-b3d9-9ff48c1f8eb3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.268296 Oct 31 15:28:33.964212 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1640/3185] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:33.983430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.984579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.994217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.995079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.995753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.996766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.997503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.998071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.194573 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6749aec-bb6e-49cf-8520-9e30702d43e2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1860 microversion: 2.1 time: 0.228984 Oct 31 15:28:34.195506 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1641/3186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1860 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.206693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b93446bf-1185-483d-98c7-3424b6118db2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1512f70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.234360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.242801 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa634926-b4a5-4a0a-899b-c3c018e57bbf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.346295 Oct 31 15:28:34.257230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1546/3187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.269001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.269727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.275968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.276553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.277088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.277871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.278404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.278908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.418208 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b93446bf-1185-483d-98c7-3424b6118db2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.221209 Oct 31 15:28:34.421398 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1642/3188] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.434492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.435367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.454231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.456995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.459034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.460673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.462406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.463914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.505707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-630f1913-70fb-445b-b276-eb93fe6e5f45 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1860 microversion: 2.1 time: 0.246676 Oct 31 15:28:34.506787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1547/3189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1860 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.515739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.516726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.535119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.535865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.536357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.537217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.553410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.553989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.723718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.737301 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b9375a15-ffcc-4389-be57-d4a56937c77b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.311989 Oct 31 15:28:34.738358 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1643/3190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.761798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f98a819-aab0-4ee2-83ca-325ebe5786d7 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca28e6700>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.850991 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f98a819-aab0-4ee2-83ca-325ebe5786d7 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.096371 Oct 31 15:28:34.851859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1644/3191] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.868634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.869498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.877916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.878753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.879360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.880272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.881277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.881989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.885348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.897858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.899264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.900456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a88c9f7-9213-44d4-90ea-1ee233df22ea tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.392571 Oct 31 15:28:34.905045 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1548/3192] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:34.912976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.914232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.925564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.926356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.927014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.928205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.929459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.930261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.982932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lazy-loading 'services' on Instance uuid d996a123-2a37-4dc3-b750-55fcde7248df {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:35.083533 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2324cd68-3edf-4a90-9e9e-8f4064a549e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments/00f0e2a0-3fc6-4e96-9955-55fc83e7c5f5" status: 202 len: 0 microversion: 2.1 time: 0.230253 Oct 31 15:28:35.085016 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1645/3193] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:28:34 2022] DELETE /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments/00f0e2a0-3fc6-4e96-9955-55fc83e7c5f5 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:28:35.092774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.094895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.102524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.103377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.104066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.105269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.105978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.106725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.114825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.133117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1d7a64d-a6fa-431a-a6dd-3a3d5688e00e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.224719 Oct 31 15:28:35.151889 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1549/3194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:35.177716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fecf83f0-4489-4381-80ae-861bbf4417a2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15d93a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.252987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fecf83f0-4489-4381-80ae-861bbf4417a2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/967f19e9-45bc-4d95-8300-59f1ed239b9a" status: 200 len: 784 microversion: 2.1 time: 0.099627 Oct 31 15:28:35.270059 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1550/3195] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/images/967f19e9-45bc-4d95-8300-59f1ed239b9a => generated 784 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:35.275071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.275699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.284339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.284905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.285605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.286558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.287183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.287774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.348399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.357086 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30dd55b7-43cb-4be3-994e-f9000e36532b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.270511 Oct 31 15:28:35.371526 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1646/3196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:35.384903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.387589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.394264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.395099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.395846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.396836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.397520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.398172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.444269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f12082e-f5ff-4794-b05f-17d9bcd1d229 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071287 Oct 31 15:28:35.445827 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1647/3197] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:35.451539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe830c2a-8497-46f1-a81b-184fde7db7d9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca1518040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.496735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.510686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.512142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.515301 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4ea5481-7eec-4af7-b7d5-435edf7d6598 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.243181 Oct 31 15:28:35.516953 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1551/3198] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:35.522207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-306973782"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:35.526269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.563853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.564196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.564638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.565378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.566091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.566227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.567950 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe830c2a-8497-46f1-a81b-184fde7db7d9 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.120387 Oct 31 15:28:35.572940 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1648/3199] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:35.587637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "db867e96-da3d-4e64-9050-b6856d593f29"}, {"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "7bb6f1c7-9823-4930-a400-bec14caa72e0"}, {"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "0ceeb89c-6a35-4331-9ec3-a58e16847f0d"}, {"server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "name": "network-vif-plugged", "status": "completed", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:35.608291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.608783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.610303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.627290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Creating event network-vif-plugged:db867e96-da3d-4e64-9050-b6856d593f29 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:35.627850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Creating event network-vif-plugged:7bb6f1c7-9823-4930-a400-bec14caa72e0 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:35.628323 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Creating event network-vif-plugged:0ceeb89c-6a35-4331-9ec3-a58e16847f0d for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:35.628889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] Creating event network-vif-plugged:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:28:35.651298 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-270addcd-0ecb-4e75-b892-3684e8f9a214 req-e8e46754-1410-4665-bd58-9065abcaac07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.071434 Oct 31 15:28:35.652595 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1649/3200] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:35.660390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10b4f571-1579-46f5-950d-1f89f470c8a0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca15184c0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.894758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8221a022-bbbe-4c29-afdf-2d9ada071c63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.376225 Oct 31 15:28:35.896339 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1552/3201] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:28:35 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 15:28:35.932740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.933652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.941653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.943238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.944014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.945025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.946068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.947205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.186130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.204730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.206418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.207686 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f3daa79-d5f7-4edb-9162-a566792aeba8 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.283003 Oct 31 15:28:36.221649 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1553/3202] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:36.235576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.236224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.242791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.243288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.243781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.244503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.245058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.245513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.567559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10b4f571-1579-46f5-950d-1f89f470c8a0 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97" status: 204 len: 0 microversion: 2.1 time: 0.913367 Oct 31 15:28:36.569250 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1650/3203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:35 2022] DELETE /compute/v2.1/images/74b1ee01-2fe5-43b0-9082-f610ef197f97 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:36.576388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.581477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.597189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.598000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.598676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.599770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.600724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.601599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.640008 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92bbaf4d-4c46-486b-a0bb-4a99b7303444 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068124 Oct 31 15:28:36.646384 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1651/3204] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:36 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:36.651308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.652149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.662567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.663305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.663766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.664525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.667738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.669371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.670070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.682558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-37f56619-0051-419d-9df0-619c0d6596c0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.459556 Oct 31 15:28:36.683714 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1554/3205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:36 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:36.705466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1974f677-ce17-4a2c-8eab-a6c8c0624ea5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca16073a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.998614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.019902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.022358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.024033 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15de30a9-d785-4e55-91e3-79445f11bb32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.376488 Oct 31 15:28:37.025011 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1652/3206] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:36 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:37.241892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.242639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:37.257673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.260025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.260480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.261226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.261692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.262115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.458744 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1974f677-ce17-4a2c-8eab-a6c8c0624ea5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541" status: 204 len: 0 microversion: 2.1 time: 0.773815 Oct 31 15:28:37.459362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1555/3207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:36 2022] DELETE /compute/v2.1/images/bb0f1529-f9b7-40d4-8ee1-f56292501541 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:37.469111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f3c9be9-71c4-472d-b29a-e4a3f13f9621 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca24259d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.576280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.592175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.603576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.605435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1b55bc1-1381-4441-9130-b8fa196808ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.371606 Oct 31 15:28:37.623789 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1653/3208] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:37 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:37.654013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.660179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:37.667332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.668020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.668869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.670039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.670345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.670899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.713492 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52d79886-109a-469f-8ee8-456932694c7b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063742 Oct 31 15:28:37.719764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1654/3209] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:37 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:37.725015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.725643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:37.732139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.732640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.733119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.733831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.734829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.735286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.016906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.028984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f5be3e4-033e-4fc0-8b30-611a5c09ac7e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.306942 Oct 31 15:28:38.030179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1655/3210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:37 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:38.042648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b05425bd-5bea-4dea-a45a-9e5cf59be852 req-0604198f-4972-49d1-a647-0cfa6ded315c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "fe825c21-039d-4e7e-85a3-44e44830203b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:38.066746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b05425bd-5bea-4dea-a45a-9e5cf59be852 req-0604198f-4972-49d1-a647-0cfa6ded315c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.067266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b05425bd-5bea-4dea-a45a-9e5cf59be852 req-0604198f-4972-49d1-a647-0cfa6ded315c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.075961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b05425bd-5bea-4dea-a45a-9e5cf59be852 req-0604198f-4972-49d1-a647-0cfa6ded315c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.095845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:38.108571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b05425bd-5bea-4dea-a45a-9e5cf59be852 req-0604198f-4972-49d1-a647-0cfa6ded315c service nova] Creating event network-vif-plugged:fe825c21-039d-4e7e-85a3-44e44830203b for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:38.116726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b05425bd-5bea-4dea-a45a-9e5cf59be852 req-0604198f-4972-49d1-a647-0cfa6ded315c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083700 Oct 31 15:28:38.118734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1656/3211] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:38.125540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.126632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.133151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:38.135045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.135919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.136583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.137755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.138501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.139268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.366733 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f3c9be9-71c4-472d-b29a-e4a3f13f9621 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035" status: 204 len: 0 microversion: 2.1 time: 0.903121 Oct 31 15:28:38.378116 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1556/3212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:37 2022] DELETE /compute/v2.1/images/5d734810-b5c1-4115-93c1-93a391583035 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:28:38.395023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.395621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.409833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.428550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.434842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.435668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.436243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.437053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.462164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.475935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.478079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.479757 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f357794b-cbb3-4b47-8941-02b8ce8fb8d9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.359444 Oct 31 15:28:38.480840 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1657/3213] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:38 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:38.501296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:38.539223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:38.637694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.641153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.652323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.653092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.654468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.655362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.657235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.657827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.731694 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d240903-756a-41a8-bc85-2c19b338951c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 204 len: 0 microversion: 2.1 time: 0.347275 Oct 31 15:28:38.732267 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1557/3214] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:38 2022] DELETE /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:38.739149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.741481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.748017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.748895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.749487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.750942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.751555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.752205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.811101 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90dc157f-c726-4849-9fa5-9bb000fa35f1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077396 Oct 31 15:28:38.811773 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1558/3215] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:38 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:38.821967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.823034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.830238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.831158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.832029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.833238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.833889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.834504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.945662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.955588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.960647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:38.970310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38a61eb2-1cf7-4fe7-ae16-4dae1b4258f2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.340326 Oct 31 15:28:38.984743 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1658/3216] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:38 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:39.037838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.050279 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf5c3d3a-6bfd-4765-ae26-d071799362d2 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1472 microversion: 2.1 time: 0.232847 Oct 31 15:28:39.050279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1559/3217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:38 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:39.054197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:39.054818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:39.067524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.068093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.068521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.069297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.069758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.070184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.314418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.323379 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6bf2328-b163-4a36-bc9d-839fc0f62e2a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.272927 Oct 31 15:28:39.325656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1659/3218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:39.511848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:39.512468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:39.520612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.521498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.522172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.523118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.523799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.524445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.720051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.729231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.730991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.733070 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b99c5a98-01ca-4794-977a-2a87f04a94c6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.224595 Oct 31 15:28:39.734041 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1560/3219] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:39.825435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:39.829603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:39.851471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.852230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.853808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.856465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.857781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.859651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.898133 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-faa5cf4c-befc-4319-acdb-e4e5aa0c020f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077873 Oct 31 15:28:39.899200 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1660/3220] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:40.002201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:40.003291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:40.010470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.011367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.012052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.013309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.014163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.014882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.072550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:40.073622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:40.101959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.107149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.107883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.108980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.111218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.112048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.452746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:40.470849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:40.472580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:40.474717 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-70ff6c87-b1e6-4567-9683-f708ee8a7400 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.476908 Oct 31 15:28:40.478757 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1561/3221] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:40.485248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "d733579d-e266-4f5a-84c0-90ffc337e6e0"}, {"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-plugged", "status": "completed", "tag": "64f6e43a-08b5-4220-aac7-f1577cd96e63"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:40.511333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.513465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.515045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.540776 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] Creating event network-vif-plugged:d733579d-e266-4f5a-84c0-90ffc337e6e0 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:40.545365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] Creating event network-vif-plugged:64f6e43a-08b5-4220-aac7-f1577cd96e63 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:40.552382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:40.561179 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7bae1feb-4a30-4a9f-85c5-b1c66a075470 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1472 microversion: 2.1 time: 0.493571 Oct 31 15:28:40.567741 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1661/3222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:40 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:40.572968 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f4efeb35-1ad1-4cb4-a176-81a4c253b21b req-c3af7e09-3a93-4f77-9185-d27a3785b3dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091486 Oct 31 15:28:40.573844 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1562/3223] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:40.576645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:40.577493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:40.583877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.584631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.585463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.587016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.587669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.588280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.761614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:40.762997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:40.782314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.793832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.800291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.814566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.818242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.823476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.931168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:40.943041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae600c78-a56a-46f6-997e-16995d91b334 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.373848 Oct 31 15:28:40.943650 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1662/3224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:40 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:40.974962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:40.979118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:40.992676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.993388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.993997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.994875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.995497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.996135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.040588 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02e17a88-74b4-4dc0-b4f2-b21c084aca81 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076567 Oct 31 15:28:41.041817 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1663/3225] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:40 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:41.209363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.225211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.233039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.236103 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da8893d0-7ce0-41f8-8158-54415262c90a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.480202 Oct 31 15:28:41.238524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1563/3226] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:40 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:41.355178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-207fb30e-c567-482f-a95e-81dd74e65abb req-b4589075-1815-4ad0-b5c1-ea03c55c6da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223f7809-62b7-489b-ae8f-2ce34fbe3438", "name": "network-vif-deleted", "tag": "8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:41.388640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-207fb30e-c567-482f-a95e-81dd74e65abb req-b4589075-1815-4ad0-b5c1-ea03c55c6da1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.389547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-207fb30e-c567-482f-a95e-81dd74e65abb req-b4589075-1815-4ad0-b5c1-ea03c55c6da1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.391129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-207fb30e-c567-482f-a95e-81dd74e65abb req-b4589075-1815-4ad0-b5c1-ea03c55c6da1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.448144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-207fb30e-c567-482f-a95e-81dd74e65abb req-b4589075-1815-4ad0-b5c1-ea03c55c6da1 service nova] Creating event network-vif-deleted:8ba21a3a-5a27-46b6-ba9f-e62f28d9b13d for instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 on n-h2-858383-17 Oct 31 15:28:41.466936 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-207fb30e-c567-482f-a95e-81dd74e65abb req-b4589075-1815-4ad0-b5c1-ea03c55c6da1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116842 Oct 31 15:28:41.476528 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1664/3227] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:41.508482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:41.509382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:41.523273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.525414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.526393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.529893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.530564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.531814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.592423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:41.594604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:41.621167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.624426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.632247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.633403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.634054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.637456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.746691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.750278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.752532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.753200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lazy-loading 'fault' on Instance uuid 223f7809-62b7-489b-ae8f-2ce34fbe3438 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:41.985921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.001109 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c35db6e-fe37-4f0a-b526-41b2ea4399e5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 200 len: 1307 microversion: 2.1 time: 0.414153 Oct 31 15:28:42.017479 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1665/3228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:41 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:42.023109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.023990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.031338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.032181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.033237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.034160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.034793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.035400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.121009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.135651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.158225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.159520 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ee7a6a8-90db-4fe6-927f-241a5bc0c370 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.655915 Oct 31 15:28:42.160113 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1564/3229] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:41 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:42.193401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.198343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.215872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.217002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.218257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.221978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.225969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.226573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.320507 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dcba7f48-c86a-4c15-892e-6aa976834ea6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157128 Oct 31 15:28:42.323339 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1565/3230] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:42.341141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.342521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.381513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.383948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.385080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.386931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.389907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.391671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.404998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.418476 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e83196e0-3e92-4c82-ac5b-3795c9ff2f7d tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.399529 Oct 31 15:28:42.423645 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1666/3231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:42.633979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6311cdb2-ce63-4ead-a87f-e3a56c3e4f24 req-55ae1ee9-b03c-499e-b306-66eef721699e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:42.654094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6311cdb2-ce63-4ead-a87f-e3a56c3e4f24 req-55ae1ee9-b03c-499e-b306-66eef721699e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.657597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6311cdb2-ce63-4ead-a87f-e3a56c3e4f24 req-55ae1ee9-b03c-499e-b306-66eef721699e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.658287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6311cdb2-ce63-4ead-a87f-e3a56c3e4f24 req-55ae1ee9-b03c-499e-b306-66eef721699e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.692923 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6311cdb2-ce63-4ead-a87f-e3a56c3e4f24 req-55ae1ee9-b03c-499e-b306-66eef721699e service nova] Creating event network-vif-plugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:28:42.701743 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6311cdb2-ce63-4ead-a87f-e3a56c3e4f24 req-55ae1ee9-b03c-499e-b306-66eef721699e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079157 Oct 31 15:28:42.703860 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1667/3232] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:42.773507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.785571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.787967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.789479 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45cc1afa-730c-4a1c-b655-6f8f57760fda tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.464075 Oct 31 15:28:42.790285 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1566/3233] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:43.032089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.032869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 223f7809-62b7-489b-ae8f-2ce34fbe3438] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.067194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.070897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.071532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.073931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.073931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.074288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.138751 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] HTTP exception thrown: Instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 could not be found. Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Request method failure captured: Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 HTTP/1.1 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-kRJQdk3VY_IBESoeyhxUSP34j7KWqlpq_T4L8InO0yJfW8gE9cgxF-UmthkOriHiN70SraNrk-kOnAJgZiE3D1XxypH_oA6B4YnE6p2Hpo5UYZ20aTpwE_muQX_gdKaEZyyWAcA-KcRJhDvvv1TFoGgR99ikIwYUEDi8vaOh_7cjA Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bb4e304f612849cd8e1d9fffd33d1f57 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListImageFiltersTestJSON-527975699 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListImageFiltersTestJSON-527975699 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bb4e304f612849cd8e1d9fffd33d1f57 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-527975699 Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListImageFiltersTestJSON-527975699-project Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 00e603ece6c843c1a3ba0b0febb2221e Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListImageFiltersTestJSON-527975699-project Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 could not be found. Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '223f7809-62b7-489b-ae8f-2ce34fbe3438'} Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 could not be found. Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 could not be found. Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:43.145957 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 could not be found. Oct 31 15:28:43.150407 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.152984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Returning 404 to user: Instance 223f7809-62b7-489b-ae8f-2ce34fbe3438 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:43.163720 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21aa17e7-788b-4914-9ae2-5c287875514c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438" status: 404 len: 111 microversion: 2.1 time: 0.137914 Oct 31 15:28:43.165411 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1668/3234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/223f7809-62b7-489b-ae8f-2ce34fbe3438 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:28:43.186793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.188107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.208631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.214821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.215347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.215791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.216816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.217478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.227588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.231140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.235365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.244486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.245298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.248006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.250135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.255859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.333180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:43.557261 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5726c8aa-79a1-4727-b5e0-8eb805bcd609 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 204 len: 0 microversion: 2.1 time: 0.387187 Oct 31 15:28:43.560924 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1567/3235] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:43 2022] DELETE /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:43.567308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.573935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.592976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.593780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.594430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.595365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.595986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.598702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.659376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-887841ea-62a6-4bef-94fe-760baf14c6ad tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097116 Oct 31 15:28:43.669497 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1568/3236] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:43.675144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.676037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.685162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.691909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.692678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.693373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.694306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.696243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.697025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.697708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.697951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.699027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a2266c2-ff69-4f16-8940-12adf281688b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1878 microversion: 2.32 time: 0.502767 Oct 31 15:28:43.699958 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1669/3237] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1878 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:43.718108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.718814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.731610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.732355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.735806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.736563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.737246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.737688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.033232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.036582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.042765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-209379cb-ad1c-40d7-b23b-e5771d92ef4a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1474 microversion: 2.1 time: 0.341686 Oct 31 15:28:44.043576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1670/3238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:44.055002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:44.055644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:44.064738 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33247262-e9c2-4718-a182-f387cdfb9035 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.390218 Oct 31 15:28:44.065301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.065801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.066324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.067047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.067502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.067931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.088788 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1569/3239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:44.327139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.338578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.340225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.341782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76ceb149-4c60-4319-8bf3-09e46eb55d27 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.297241 Oct 31 15:28:44.342376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1671/3240] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:44 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:44.682346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:44.684905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:44.707370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.708193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.708846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.709771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.710465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.711105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.725991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:44.726599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:44.739105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.740963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.743457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.746361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.746923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.747287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.759044 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e0d374c3-41c0-45ec-8184-aeaf43a34014 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080658 Oct 31 15:28:44.764549 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1570/3241] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:44 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:44.992415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-53ac8a4a-1143-45df-9388-414ef962831b req-f6f95586-20a6-420d-929d-d97f9cd7ec5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:45.014342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-53ac8a4a-1143-45df-9388-414ef962831b req-f6f95586-20a6-420d-929d-d97f9cd7ec5e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.016162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-53ac8a4a-1143-45df-9388-414ef962831b req-f6f95586-20a6-420d-929d-d97f9cd7ec5e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.016911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-53ac8a4a-1143-45df-9388-414ef962831b req-f6f95586-20a6-420d-929d-d97f9cd7ec5e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.029075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.057098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.059504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.060155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-53ac8a4a-1143-45df-9388-414ef962831b req-f6f95586-20a6-420d-929d-d97f9cd7ec5e service nova] Creating event network-vif-unplugged:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:28:45.069662 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-593216a5-eb2a-4fd0-9934-0817dc6311dd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2830 microversion: 2.32 time: 0.345779 Oct 31 15:28:45.072357 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1672/3242] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:44 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2830 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:45.076528 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-53ac8a4a-1143-45df-9388-414ef962831b req-f6f95586-20a6-420d-929d-d97f9cd7ec5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087776 Oct 31 15:28:45.078263 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1571/3243] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:45.087299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.089058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.099056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.100253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.102135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.102628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.103060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.103772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.104234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.105211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.109524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.110484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.111156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.115570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.117928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.119027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.540302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.551096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:45.563386 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-83807f16-6035-4eb9-9663-cc7bfb139d62 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.463742 Oct 31 15:28:45.566677 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1572/3244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:45.574914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.576778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.589939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.613494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4834c3de-ff3e-49e3-974b-00cf98b3308a tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1474 microversion: 2.1 time: 0.537374 Oct 31 15:28:45.617408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1673/3245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1474 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:45.619493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.621846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.622952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.627806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.628228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.629048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.629691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.631009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.646837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.647847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.648832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.649984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.652288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.654017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.918649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-16890eb3-42cd-43d1-b6ac-e6ab68107b5d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.350484 Oct 31 15:28:45.938282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1573/3246] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1/os-interface => generated 1831 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:45.954810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.967135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.983983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.994033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.996673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.998477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba31e340-2fc9-4536-b49f-b1f1ac5219ec tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.379674 Oct 31 15:28:45.998733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.999978 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1674/3247] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:46.000337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.001455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.005977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.013604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.014174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.080985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2ee4516-e45b-43a4-a0ea-ab9201523478 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139429 Oct 31 15:28:46.087106 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1574/3248] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:28:46.596801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:46.602869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:46.633651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.634959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.638518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.639839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.640513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.643950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:46.644600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:46.644999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.666614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.672134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.672823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.674145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.674638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.677570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.714527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:47.444253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:47.457856 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6674ba45-0a5b-4903-bf80-6f051cb1570e tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1432 microversion: 2.1 time: 0.819633 Oct 31 15:28:47.480482 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1575/3249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:46 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1432 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:47.487845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:47.492006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:47.503811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.506909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.507595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.508534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.509995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.510969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.641573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:47.661801 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1a57319-0446-4cc2-be12-0f63e62e3be4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 1.073226 Oct 31 15:28:47.664994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1675/3250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:46 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:47.675306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a84f377a-500a-42f3-8c99-36e7e97ffbf3 req-36d1a28c-949a-4d8a-826a-c70d977397da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b97e45b-a968-4969-8ecb-064377ce0c48", "name": "network-vif-plugged", "status": "completed", "tag": "6806ab03-91dc-44fa-9a4f-00b0ad5f8acf"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:47.726056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a84f377a-500a-42f3-8c99-36e7e97ffbf3 req-36d1a28c-949a-4d8a-826a-c70d977397da service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.726806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a84f377a-500a-42f3-8c99-36e7e97ffbf3 req-36d1a28c-949a-4d8a-826a-c70d977397da service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.727462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a84f377a-500a-42f3-8c99-36e7e97ffbf3 req-36d1a28c-949a-4d8a-826a-c70d977397da service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.751204 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a84f377a-500a-42f3-8c99-36e7e97ffbf3 req-36d1a28c-949a-4d8a-826a-c70d977397da service nova] Creating event network-vif-plugged:6806ab03-91dc-44fa-9a4f-00b0ad5f8acf for instance 0b97e45b-a968-4969-8ecb-064377ce0c48 on n-h1-858383-17 Oct 31 15:28:47.774939 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a84f377a-500a-42f3-8c99-36e7e97ffbf3 req-36d1a28c-949a-4d8a-826a-c70d977397da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107423 Oct 31 15:28:47.779134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1676/3251] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:48.151671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b9d7185d-2220-447b-b702-876037890550 req-e3c6b63b-3c60-4d20-b1ad-818538d22cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcb3e97-9969-46b1-9119-7fc6d7705ea1", "name": "network-vif-deleted", "tag": "cc73f2b5-9e4a-41c6-8c7c-825967573f38"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:48.194955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9d7185d-2220-447b-b702-876037890550 req-e3c6b63b-3c60-4d20-b1ad-818538d22cd6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.195490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9d7185d-2220-447b-b702-876037890550 req-e3c6b63b-3c60-4d20-b1ad-818538d22cd6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.195933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b9d7185d-2220-447b-b702-876037890550 req-e3c6b63b-3c60-4d20-b1ad-818538d22cd6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.237653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b9d7185d-2220-447b-b702-876037890550 req-e3c6b63b-3c60-4d20-b1ad-818538d22cd6 service nova] Creating event network-vif-deleted:cc73f2b5-9e4a-41c6-8c7c-825967573f38 for instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 on n-h1-858383-17 Oct 31 15:28:48.242279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.254654 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b9d7185d-2220-447b-b702-876037890550 req-e3c6b63b-3c60-4d20-b1ad-818538d22cd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106206 Oct 31 15:28:48.256906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1677/3252] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:48.269194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.275846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.278561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73900c65-e77f-4bec-a0b2-f9950339b8f9 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 0.796566 Oct 31 15:28:48.298573 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1576/3253] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:47 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:48.488197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:48.488722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6e174829-636d-49b4-aaf0-2af3a085bb6b req-9259613b-1471-4a84-b1dc-30a7c2e59a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "tag": "fe825c21-039d-4e7e-85a3-44e44830203b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:48.489239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:48.506975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6e174829-636d-49b4-aaf0-2af3a085bb6b req-9259613b-1471-4a84-b1dc-30a7c2e59a42 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.507697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6e174829-636d-49b4-aaf0-2af3a085bb6b req-9259613b-1471-4a84-b1dc-30a7c2e59a42 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.507957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.508464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.508935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.509213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6e174829-636d-49b4-aaf0-2af3a085bb6b req-9259613b-1471-4a84-b1dc-30a7c2e59a42 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.509659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.510122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.510555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.542550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6e174829-636d-49b4-aaf0-2af3a085bb6b req-9259613b-1471-4a84-b1dc-30a7c2e59a42 service nova] Creating event network-changed:fe825c21-039d-4e7e-85a3-44e44830203b for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:28:48.557667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6e174829-636d-49b4-aaf0-2af3a085bb6b req-9259613b-1471-4a84-b1dc-30a7c2e59a42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072991 Oct 31 15:28:48.567902 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1577/3254] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:28:48.648898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.649511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.649810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.658905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lazy-loading 'fault' on Instance uuid 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:48.692944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:48.693819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:48.705038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:48.707406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.709726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.710963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.713448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.714232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.716984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.033451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e603ece6c843c1a3ba0b0febb2221e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4e304f612849cd8e1d9fffd33d1f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:49.041785 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b62f5796-ded8-47cf-a851-03a284c26fb5 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 200 len: 1308 microversion: 2.1 time: 0.558018 Oct 31 15:28:49.053297 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1678/3255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:48 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 1308 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:49.263305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:49.285482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4615c1df-1b9c-4c0f-9cdb-103fadb7ef09 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.586035 Oct 31 15:28:49.286830 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1578/3256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:48 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:49.315675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:49.316838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:49.332237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.332754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.338947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.339760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.340323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.340826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.486097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:49.486880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:49.496279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.496970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.501475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.502578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.503229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.503872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.485850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.497321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.498764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.500071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1c172d1-d6e5-4d47-9703-e50b13c47470 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1739 microversion: 2.20 time: 1.190151 Oct 31 15:28:50.500638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1679/3257] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:49 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1739 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:50.521486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-80480396-98e0-45b7-92f8-3cc708448473 req-08f86573-c157-4751-9db7-a81422d2b545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b97e45b-a968-4969-8ecb-064377ce0c48", "name": "network-vif-plugged", "status": "completed", "tag": "b3bfed84-1fb9-4593-86ad-fd481ef9c497"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:50.536018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-80480396-98e0-45b7-92f8-3cc708448473 req-08f86573-c157-4751-9db7-a81422d2b545 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.537354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-80480396-98e0-45b7-92f8-3cc708448473 req-08f86573-c157-4751-9db7-a81422d2b545 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.539313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-80480396-98e0-45b7-92f8-3cc708448473 req-08f86573-c157-4751-9db7-a81422d2b545 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.567870 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-80480396-98e0-45b7-92f8-3cc708448473 req-08f86573-c157-4751-9db7-a81422d2b545 service nova] Creating event network-vif-plugged:b3bfed84-1fb9-4593-86ad-fd481ef9c497 for instance 0b97e45b-a968-4969-8ecb-064377ce0c48 on n-h1-858383-17 Oct 31 15:28:50.578216 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-80480396-98e0-45b7-92f8-3cc708448473 req-08f86573-c157-4751-9db7-a81422d2b545 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061648 Oct 31 15:28:50.584281 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1680/3258] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:50.601111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:50.602528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] [instance: 6dcb3e97-9969-46b1-9119-7fc6d7705ea1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:50.610134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.610976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.612097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.613111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.613759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.614663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.651458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.658249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] HTTP exception thrown: Instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 could not be found. Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Request method failure captured: Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 HTTP/1.1 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-kRJQdk3VY_IBESoeyhxUSP34j7KWqlpq_T4L8InO0yJfW8gE9cgxF-UmthkOriHiN70SraNrk-kOnAJgZiE3D1XxypH_oA6B4YnE6p2Hpo5UYZ20aTpwE_muQX_gdKaEZyyWAcA-KcRJhDvvv1TFoGgR99ikIwYUEDi8vaOh_7cjA Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bb4e304f612849cd8e1d9fffd33d1f57 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ListImageFiltersTestJSON-527975699 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bb4e304f612849cd8e1d9fffd33d1f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ListImageFiltersTestJSON-527975699 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bb4e304f612849cd8e1d9fffd33d1f57 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-527975699 Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ListImageFiltersTestJSON-527975699-project Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 00e603ece6c843c1a3ba0b0febb2221e Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ListImageFiltersTestJSON-527975699-project Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 could not be found. Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '6dcb3e97-9969-46b1-9119-7fc6d7705ea1'} Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 could not be found. Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 could not be found. Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:50.660588 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 could not be found. Oct 31 15:28:50.666865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:28:50.669981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.675413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.678199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3bb4e9c7-b29d-4e98-a409-1c0e4fd0f138 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2956 microversion: 2.42 time: 1.195069 Oct 31 15:28:50.692809 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1579/3259] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:49 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2956 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:50.692809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:50.692809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:50.696498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.698449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.700043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.701056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.701740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.702412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.706477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Returning 404 to user: Instance 6dcb3e97-9969-46b1-9119-7fc6d7705ea1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:50.707814 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00790e38-3600-4559-9783-71d30aa29c69 tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1" status: 404 len: 111 microversion: 2.1 time: 0.121171 Oct 31 15:28:50.709608 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1681/3260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:50 2022] GET /compute/v2.1/servers/6dcb3e97-9969-46b1-9119-7fc6d7705ea1 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:28:50.722891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:50.723443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:50.742847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.743344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.743948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.744672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.745237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.745664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.989128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f51daf1-cadd-4164-a858-5cc222886b7c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.274798 Oct 31 15:28:50.989642 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1682/3261] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:28:50 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4/os-interface => generated 1832 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:51.003261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c4657144-2174-4c47-aefc-bf41f9cc7a8f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca14e7a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:51.400483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.412737 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7780f4f2-9051-49d7-a4f1-164a2f0a264a tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.730300 Oct 31 15:28:51.414054 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1580/3262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:50 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:51.459288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c4657144-2174-4c47-aefc-bf41f9cc7a8f tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/images/0eb3e4b5-3f8c-4671-9882-7482d8fa53e6" status: 204 len: 0 microversion: 2.1 time: 0.468271 Oct 31 15:28:51.459821 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1683/3263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:50 2022] DELETE /compute/v2.1/images/0eb3e4b5-3f8c-4671-9882-7482d8fa53e6 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:51.469542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03c7139e-28f6-43a3-905a-374979f7cddd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca157fb80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:51.533497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:51.534911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:51.544715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.547478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.547915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.552215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.552728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.553166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.717239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.729445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.731384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.733794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3b023b58-20b0-4eec-90ea-6fb52fe4f08c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1721 microversion: 2.20 time: 0.205346 Oct 31 15:28:51.735420 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1684/3264] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:51 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:51.832989 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03c7139e-28f6-43a3-905a-374979f7cddd tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/images/63d4f102-a0e8-4175-9a51-c2cde9dc196d" status: 204 len: 0 microversion: 2.1 time: 0.368927 Oct 31 15:28:51.834535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1581/3265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:51 2022] DELETE /compute/v2.1/images/63d4f102-a0e8-4175-9a51-c2cde9dc196d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:51.845483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26642488-ab54-420f-b1c1-3e7591f0ef8c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] Calling method '.version_select at 0x7f5ca14f35e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:52.165398 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26642488-ab54-420f-b1c1-3e7591f0ef8c tempest-ListImageFiltersTestJSON-527975699 tempest-ListImageFiltersTestJSON-527975699-project] 10.222.0.48 "DELETE /compute/v2.1/images/6c534cf0-e710-4c2a-b931-bdef086df743" status: 204 len: 0 microversion: 2.1 time: 0.326464 Oct 31 15:28:52.166036 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1685/3266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:51 2022] DELETE /compute/v2.1/images/6c534cf0-e710-4c2a-b931-bdef086df743 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:52.439487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:52.440432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:52.448806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.449989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.450858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.451894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.452746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.453636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.762655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:52.763421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:52.764048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:52.781407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.781975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.782398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.783299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.783761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.784384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.798257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-609ef1a3-5120-4f39-a7b2-be82137d4ec9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1334 microversion: 2.1 time: 0.362903 Oct 31 15:28:52.800174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1582/3267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:52 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:53.044899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.060946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.063553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.064998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8286d982-2916-4277-be2c-2b8666439df3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1721 microversion: 2.20 time: 0.306342 Oct 31 15:28:53.066023 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1686/3268] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:52 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:53.472963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-96b5ae15-0547-4d38-9840-f7e71c1b4a14 req-d5621661-4307-475d-96cb-d49545d48818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "name": "network-vif-unplugged", "status": "completed", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:53.496751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-96b5ae15-0547-4d38-9840-f7e71c1b4a14 req-d5621661-4307-475d-96cb-d49545d48818 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.498618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-96b5ae15-0547-4d38-9840-f7e71c1b4a14 req-d5621661-4307-475d-96cb-d49545d48818 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.499390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-96b5ae15-0547-4d38-9840-f7e71c1b4a14 req-d5621661-4307-475d-96cb-d49545d48818 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.531160 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-96b5ae15-0547-4d38-9840-f7e71c1b4a14 req-d5621661-4307-475d-96cb-d49545d48818 service nova] Creating event network-vif-unplugged:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:28:53.544605 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-96b5ae15-0547-4d38-9840-f7e71c1b4a14 req-d5621661-4307-475d-96cb-d49545d48818 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077576 Oct 31 15:28:53.549036 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1583/3269] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:53.823952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:53.825203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:53.835884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.836380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.836844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.837554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.838012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.838431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.022036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.032305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72d4cfd2-dca5-4472-8e6b-28c7910d836b tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1667 microversion: 2.1 time: 0.212286 Oct 31 15:28:54.033830 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1687/3270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:53 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1667 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:54.060499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.061225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.069444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.070136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.070776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.071636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.072248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.072864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.094436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.095308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.130024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.130523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.135383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.136903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.137933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.139032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.142728 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d601da1b-52f3-4774-bdf0-b4b69ba79434 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48/ips" status: 200 len: 177 microversion: 2.1 time: 0.086628 Oct 31 15:28:54.144053 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1584/3271] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48/ips => generated 177 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:54.162852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.163632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.177543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.178032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.178698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.179160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.179620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.180038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.237252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:54.379934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.386463 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f0778da-14e5-4bd8-936a-8d5a5ab8c1a3 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 204 len: 0 microversion: 2.1 time: 0.231195 Oct 31 15:28:54.388989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1585/3272] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:54 2022] DELETE /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:54.397639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.399407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.400650 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b38a9c64-9638-4e22-a79f-fc35019238e8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1664 microversion: 2.20 time: 0.311120 Oct 31 15:28:54.412961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1688/3273] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1664 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.413828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.414424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.437905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "894d1c99-a718-4d70-8a8d-92e954a73387"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:54.440752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.456604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.472366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.472872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.473637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.474113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.474545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.688673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.698058 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7af0aa60-e207-4d31-92e9-01df0c4faef6 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1673 microversion: 2.1 time: 0.304881 Oct 31 15:28:54.712721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1586/3274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:54.885503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ecbe10aa-6948-4a6a-8d48-eed2a6168247 tempest-ListImagesTestJSON-1228790187 tempest-ListImagesTestJSON-1228790187-project] Calling method '.version_select at 0x7f5ca14e2820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.974094 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5482d58a-c285-4406-9002-2b2e5b5e2649 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.547841 Oct 31 15:28:54.974775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1689/3275] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Oct 31 15:28:54 2022] POST /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 188 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:28:55.201192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:55.202106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.211373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.212154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.212800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.213684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.214400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.214988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.250452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:28:55.354859 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3b453964-0c1f-4cf3-ac04-9d27ff471412 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/action" status: 202 len: 0 microversion: 2.20 time: 0.157148 Oct 31 15:28:55.360219 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1690/3276] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:28:55 2022] POST /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:55.367047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:55.367886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.375867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.376975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.377643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.378594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.379290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.379874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.567253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.577155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.579692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.581098 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d09da48-1550-4df2-97a7-8deef2487691 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1750 microversion: 2.20 time: 0.219643 Oct 31 15:28:55.597962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1691/3277] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:55 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:55.725125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:55.725379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.731794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.732375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.732908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.733743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.734333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.734905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.952885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.957499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:55.965699 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7af09d0-a4ef-476a-89f4-32bd919b643f tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1673 microversion: 2.1 time: 0.245658 Oct 31 15:28:55.968738 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1692/3278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:55 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1673 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:56.614717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.615426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:56.625867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.627889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.629288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.630818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.632214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.633486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.851006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.861770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.863222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.864457 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bbdfb3d4-ebce-4612-be3e-6e592d0eb0c4 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1750 microversion: 2.20 time: 0.258579 Oct 31 15:28:56.877033 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1693/3279] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:56.998333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.999148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:57.007566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.008225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.008857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.009590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.010039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.010471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.400998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.411868 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3551518b-4ccf-4e78-94e1-e0cdb584bde4 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1652 microversion: 2.1 time: 0.423364 Oct 31 15:28:57.424741 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1694/3280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1652 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:57.432005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d99c78bf-4e83-4676-80e1-66b3825ebf37 req-47182a49-2d09-49dc-b482-77851173dee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b97e45b-a968-4969-8ecb-064377ce0c48", "name": "network-vif-deleted", "tag": "b3bfed84-1fb9-4593-86ad-fd481ef9c497"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:57.448538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d99c78bf-4e83-4676-80e1-66b3825ebf37 req-47182a49-2d09-49dc-b482-77851173dee3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.449125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d99c78bf-4e83-4676-80e1-66b3825ebf37 req-47182a49-2d09-49dc-b482-77851173dee3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.449615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d99c78bf-4e83-4676-80e1-66b3825ebf37 req-47182a49-2d09-49dc-b482-77851173dee3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.483957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d99c78bf-4e83-4676-80e1-66b3825ebf37 req-47182a49-2d09-49dc-b482-77851173dee3 service nova] Creating event network-vif-deleted:b3bfed84-1fb9-4593-86ad-fd481ef9c497 for instance 0b97e45b-a968-4969-8ecb-064377ce0c48 on n-h1-858383-17 Oct 31 15:28:57.497940 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d99c78bf-4e83-4676-80e1-66b3825ebf37 req-47182a49-2d09-49dc-b482-77851173dee3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083229 Oct 31 15:28:57.498075 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1695/3281] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:57.666255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:57.667047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:57.678132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.679013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.679645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.681589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.683514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.684935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.767222 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ecbe10aa-6948-4a6a-8d48-eed2a6168247 tempest-ListImagesTestJSON-1228790187 tempest-ListImagesTestJSON-1228790187-project] 10.222.0.48 "GET /compute/v2.1/images/967f19e9-45bc-4d95-8300-59f1ed239b9a" status: 200 len: 784 microversion: 2.1 time: 3.066848 Oct 31 15:28:57.768497 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1587/3282] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/images/967f19e9-45bc-4d95-8300-59f1ed239b9a => generated 784 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:57.785923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-731cb2bb-cf82-4c48-8e58-ebd55e27f741 tempest-ListImagesTestJSON-1228790187 tempest-ListImagesTestJSON-1228790187-project] Calling method '.version_select at 0x7f5ca15d9a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:57.871045 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-731cb2bb-cf82-4c48-8e58-ebd55e27f741 tempest-ListImagesTestJSON-1228790187 tempest-ListImagesTestJSON-1228790187-project] 10.222.0.48 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.091058 Oct 31 15:28:57.872204 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1588/3283] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Oct 31 15:28:57 2022] GET /compute/v2.1/images => generated 445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:57.887940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b57d79a-ba05-4eb9-8dff-a8eb52cc8461 tempest-ListImagesTestJSON-1228790187 tempest-ListImagesTestJSON-1228790187-project] Calling method '.version_select at 0x7f5ca14d0ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:57.974754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.982608 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b57d79a-ba05-4eb9-8dff-a8eb52cc8461 tempest-ListImagesTestJSON-1228790187 tempest-ListImagesTestJSON-1228790187-project] 10.222.0.48 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.100837 Oct 31 15:28:57.984129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1589/3284] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:28:57 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:57.989933 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fabd0a3c-dfc4-45df-ab99-43c18d490c9a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.327962 Oct 31 15:28:57.991095 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1696/3285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:57 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:58.014247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:58.015811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:58.023718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.025156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.025156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.026616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.027207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.027962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.256354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.266688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.268235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.269403 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b82e46fc-baae-4317-b680-aa56bf3ec4fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1750 microversion: 2.20 time: 0.284347 Oct 31 15:28:58.272760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1590/3286] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:57 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1750 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:58.439178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:58.439799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:58.453921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.455428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.455891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.456831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.459963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.460645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.527908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.528865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.529811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.531194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lazy-loading 'fault' on Instance uuid 0b97e45b-a968-4969-8ecb-064377ce0c48 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:58.579302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330dfc8915b46f5a5bfee6ac6ba9b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4875ff17224133b4aa6a9b189dd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.599809 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48b69ed6-e400-4d9f-b680-a4041f6b6c0e tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 200 len: 1303 microversion: 2.1 time: 0.164600 Oct 31 15:28:58.600405 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1697/3287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:58 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:59.031954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:59.032589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.052476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.052952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.053592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.054556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.055238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.055889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.258840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.267735 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db6da7d4-49a5-4774-bd0c-63af5278b749 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.253081 Oct 31 15:28:59.270810 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1591/3288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:59 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:59.292130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-793907324"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:59.294806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.301648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:59.302262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.311156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.312190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.312722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.313423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.315029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.315470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.323906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.324399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.324857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.325747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.326415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.326960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.543909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.572382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.583708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.590809 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa5f9c4e-f7fe-4942-bdb9-090fcedda8dd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1752 microversion: 2.20 time: 0.291624 Oct 31 15:28:59.600849 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1592/3289] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:59 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1752 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:59.613072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b3d46b1f-6a44-47ce-a932-833d495982ea req-18b122eb-79b6-468b-9d1b-f31e27d018f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b97e45b-a968-4969-8ecb-064377ce0c48", "name": "network-vif-deleted", "tag": "6806ab03-91dc-44fa-9a4f-00b0ad5f8acf"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:59.628549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b3d46b1f-6a44-47ce-a932-833d495982ea req-18b122eb-79b6-468b-9d1b-f31e27d018f5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.629364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b3d46b1f-6a44-47ce-a932-833d495982ea req-18b122eb-79b6-468b-9d1b-f31e27d018f5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.630021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b3d46b1f-6a44-47ce-a932-833d495982ea req-18b122eb-79b6-468b-9d1b-f31e27d018f5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.646440 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b3d46b1f-6a44-47ce-a932-833d495982ea req-18b122eb-79b6-468b-9d1b-f31e27d018f5 service nova] Creating event network-vif-deleted:6806ab03-91dc-44fa-9a4f-00b0ad5f8acf for instance 0b97e45b-a968-4969-8ecb-064377ce0c48 on n-h1-858383-17 Oct 31 15:28:59.652623 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b3d46b1f-6a44-47ce-a932-833d495982ea req-18b122eb-79b6-468b-9d1b-f31e27d018f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049942 Oct 31 15:28:59.653902 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1593/3290] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:59.662372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:59.663449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.670752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.671834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.672527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.673488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.674170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.674830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.690041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ac94e73-978e-4a48-9e12-b7a0265260ea tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.401927 Oct 31 15:28:59.692048 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1698/3291] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:28:59 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 15:28:59.693230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] HTTP exception thrown: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Request method failure captured: Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 HTTP/1.1 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lifYBZ5A9DInYS4IbrF8DtSVmsg0Ba78EPMjIzKMj7nqdoXnaAjN2LfbwhObWAYBaV5sIrZfF0AbEIob4VVAvDae42Y4J8XpFcAHc_MquuPfXuVlr5bfXBv6Et6jVW_8OSFzcDzyEl3K-4rmZW5hfs8hpsoXTrDojSKzKlAzC46zE Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestMultiNic-490233297 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestMultiNic-490233297-project Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b330dfc8915b46f5a5bfee6ac6ba9b54 Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestMultiNic-490233297-project Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0b97e45b-a968-4969-8ecb-064377ce0c48'} Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:59.695979 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:28:59.700219 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:28:59.704572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Returning 404 to user: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:59.705900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e63ddf67-cc73-4775-a985-80b16f5d76a9 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 404 len: 111 microversion: 2.1 time: 0.050514 Oct 31 15:28:59.709617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1594/3292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:59 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:00.308151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-429a2737-7a60-409b-bdfd-d9c6ad121555 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca14fb700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWMLM8UKa6rktgtzBK4+xfqRa6ZweIoFPjDxoixWDmCmIFckaarOIbc3eOUpkMJX8kCbGNfjgNrE77dDa3LKlhRyFtUxJvIDLq6AZr7X4+iohO8ylHjkdTSvx4ZtgsJsw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-429a2737-7a60-409b-bdfd-d9c6ad121555 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 257 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWMLM8UKa6rktgtzBK4+xfqRa6ZweIoFPjDxoixWDmCmIFckaarOIbc3eOUpkMJX8kCbGNfjgNrE77dDa3LKlhRyFtUxJvIDLq6AZr7X4+iohO8ylHjkdTSvx4ZtgsJsw=="}} Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWMLM8UKa6rktgtzBK4+xfqRa6ZweIoFPjDxoixWDmCmIFckaarOIbc3eOUpkMJX8kCbGNfjgNrE77dDa3LKlhRyFtUxJvIDLq6AZr7X4+iohO8ylHjkdTSvx4ZtgsJsw=='}}} Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 31 15:29:00.312865 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.317960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-429a2737-7a60-409b-bdfd-d9c6ad121555 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.321011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-429a2737-7a60-409b-bdfd-d9c6ad121555 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.240396 Oct 31 15:29:00.321622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1699/3293] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:29:00.332135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca153c670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1792238507", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.358057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:00.366751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 and project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:00.386617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 2167 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1792238507", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:00.408784 n-d-858383-17 devstack@n-api.service[120626]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1792238507', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.411034 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.413650 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.416969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.418099 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-966bdc2c-11b2-43e0-a70e-14c8efe18b43 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.091048 Oct 31 15:29:00.418926 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1595/3294] 10.222.0.48 () {60 vars in 1160 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:29:00.435095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb71927f-ef59-4876-901e-04e4eeefb812 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca2e01dc0>, body: {"keypair": {"name": "tempest-keypair-959932744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/iR+pp231wIXWld4FSAa61a0RNRiBaI2U0Rm56McHlLuWmAtzENfIH1wPuHAtMh1w0sE9wyjXBnfZKsN9Yh+ymPDDNtsCFUzEOhYK28tNev+KJRKgIk3RogGrsdMGI5A=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.461214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-eb71927f-ef59-4876-901e-04e4eeefb812 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:00.473489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-eb71927f-ef59-4876-901e-04e4eeefb812 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 and project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:00.488370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:00.511927 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb71927f-ef59-4876-901e-04e4eeefb812 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083418 Oct 31 15:29:00.513228 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1700/3295] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:00.531493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca15d9430>, body: {"keypair": {"name": "tempest-keypair-959932744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs/shfjzLjq3XKl0VyrMgOCYWjP63lWNtDWQZkLx7zdiW8hmFrTXWF6fvsQALjMTa6Q2Om8QOZeUDWKU1areJGXJE2fOfeSJeCScw0YojWpJqejIhGtWyd7t+SFnkQ53g=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.571647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:00.590006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 and project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:00.623229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:00.624917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:00.637319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.638295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.640389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.641554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.642342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.642970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.653827 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] HTTP exception thrown: Key pair 'tempest-keypair-959932744' already exists. Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 272 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: {"keypair": {"name": "tempest-keypair-959932744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs/shfjzLjq3XKl0VyrMgOCYWjP63lWNtDWQZkLx7zdiW8hmFrTXWF6fvsQALjMTa6Q2Om8QOZeUDWKU1areJGXJE2fOfeSJeCScw0YojWpJqejIhGtWyd7t+SFnkQ53g=="}} Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: exception: Key pair 'tempest-keypair-959932744' already exists. Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-959932744', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs/shfjzLjq3XKl0VyrMgOCYWjP63lWNtDWQZkLx7zdiW8hmFrTXWF6fvsQALjMTa6Q2Om8QOZeUDWKU1areJGXJE2fOfeSJeCScw0YojWpJqejIhGtWyd7t+SFnkQ53g=='}}} Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '8f3d1a531f5a4ceaa173ec1d6f486bd6-tempest-keypair-959932744' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 31 15:29:00.688298 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:29:00.692404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '8f3d1a531f5a4ceaa173ec1d6f486bd6-tempest-keypair-959932744' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 15, 29, 0, 640086), 'updated_at': None, 'name': 'tempest-keypair-959932744', 'user_id': '8f3d1a531f5a4ceaa173ec1d6f486bd6', 'fingerprint': 'e2:43:3b:27:1f:e0:05:d4:42:64:73:b4:1d:41:3e:43', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs/shfjzLjq3XKl0VyrMgOCYWjP63lWNtDWQZkLx7zdiW8hmFrTXWF6fvsQALjMTa6Q2Om8QOZeUDWKU1areJGXJE2fOfeSJeCScw0YojWpJqejIhGtWyd7t+SFnkQ53g==', 'type': 'ssh'}] Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6779, in import_key_pair Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi keypair.create() Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._create() Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-959932744' already exists. Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 31 15:29:00.696774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-959932744' already exists. Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-959932744' already exists. Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 409 to user: Key pair 'tempest-keypair-959932744' already exists. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.704742 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12a5ae06-02ca-4a51-84eb-8fb5008db713 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.176987 Oct 31 15:29:00.707013 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1596/3296] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:29:00.718669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21a6db09-5d99-4e28-a371-9982605cb893 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Calling method '.version_select at 0x7f5ca12d4040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:00.747632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21a6db09-5d99-4e28-a371-9982605cb893 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959932744" status: 202 len: 0 microversion: 2.1 time: 0.033322 Oct 31 15:29:00.749870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1597/3297] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959932744 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:29:00.762937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78a5ca3a-6187-4501-bdf7-929fcb5b6be5 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca12d45e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoyvHwk6UGwOCgVuI7VR80JKJhvX2PwURuojoHr2DFV9iEGYEMxSaiRrK12Dy35UAIvgeZ+skZBijKYD5rJGnocx5ediiHDh+LI5lLbO8TjjhjWnSSUShWbSLFZwJZJ1Q=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78a5ca3a-6187-4501-bdf7-929fcb5b6be5 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 247 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoyvHwk6UGwOCgVuI7VR80JKJhvX2PwURuojoHr2DFV9iEGYEMxSaiRrK12Dy35UAIvgeZ+skZBijKYD5rJGnocx5ediiHDh+LI5lLbO8TjjhjWnSSUShWbSLFZwJZJ1Q=="}} Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoyvHwk6UGwOCgVuI7VR80JKJhvX2PwURuojoHr2DFV9iEGYEMxSaiRrK12Dy35UAIvgeZ+skZBijKYD5rJGnocx5ediiHDh+LI5lLbO8TjjhjWnSSUShWbSLFZwJZJ1Q=='}}} Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi '' Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:29:00.768877 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:29:00.774060 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.781753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78a5ca3a-6187-4501-bdf7-929fcb5b6be5 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.783297 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78a5ca3a-6187-4501-bdf7-929fcb5b6be5 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.026123 Oct 31 15:29:00.784412 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1598/3298] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:29:00.794870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca15a3c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1976764174", "public_key": " "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.819629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:00.836087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 and project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:00.856461 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 95 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1976764174", "public_key": " "}} Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1976764174', 'public_key': ' '}}} Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.859387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea7ce370-dc53-4fe4-b8e8-c25056919356 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071374 Oct 31 15:29:00.863552 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1599/3299] 10.222.0.48 () {60 vars in 1158 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:29:00.882644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-343150dc-5dbb-4bcd-b376-ff35b78b1bb4 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca14911f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaTjv7qb40jdqqvt273lSVKu7IOz7WjeKUpkXpizfZQYjqU/RH1SBZz7LaMfoS5WMATRhCbQSdsVHc7KwKyjhayCmJy0xtP9pvrVpGbcNFHmz1HWMy4hm5+pPN2kIR8wg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-343150dc-5dbb-4bcd-b376-ff35b78b1bb4 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 507 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaTjv7qb40jdqqvt273lSVKu7IOz7WjeKUpkXpizfZQYjqU/RH1SBZz7LaMfoS5WMATRhCbQSdsVHc7KwKyjhayCmJy0xtP9pvrVpGbcNFHmz1HWMy4hm5+pPN2kIR8wg=="}} Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaTjv7qb40jdqqvt273lSVKu7IOz7WjeKUpkXpizfZQYjqU/RH1SBZz7LaMfoS5WMATRhCbQSdsVHc7KwKyjhayCmJy0xtP9pvrVpGbcNFHmz1HWMy4hm5+pPN2kIR8wg=='}}} Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 31 15:29:00.895800 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-343150dc-5dbb-4bcd-b376-ff35b78b1bb4 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-343150dc-5dbb-4bcd-b376-ff35b78b1bb4 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.025594 Oct 31 15:29:00.899668 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1600/3300] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:29:00.910483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Action: 'create', calling method: .version_select at 0x7f5ca12d4f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-733597514", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.941786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:00.950120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Getting quotas for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 and project b6acb694feef455f9cf45c7be8684bf6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:00.980753 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 117 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-733597514", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-733597514', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 31 15:29:00.982885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6fce3b4b-ac43-4bf8-89a2-7b9ed2a7c589 tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.079925 Oct 31 15:29:00.987555 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1601/3301] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:29:01.000041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.011454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6da0d59-1ed3-45bf-9de9-2fccb711793f tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Calling method '.version_select at 0x7f5ca14e2040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:01.014561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.016515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.022351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63fbe1af-68ca-4b19-b39e-e1f5de983afe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1752 microversion: 2.20 time: 0.403752 Oct 31 15:29:01.035458 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1701/3302] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:00 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1752 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:29:01.036786 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a6da0d59-1ed3-45bf-9de9-2fccb711793f tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-211686717 not found for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6da0d59-1ed3-45bf-9de9-2fccb711793f tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Request method failure captured: Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-211686717 HTTP/1.1 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-m73M2ksq76akD-IFxogGCCDZE33RDYQT04TqMcZD_6QbW_yrU15OLjWyyy0B3b42n0VYUwVoiLHDUL6E_2nguxcwXeRP0X2jHzbUPfiw5Ok-cj7FFC0b4xLDFgPxp--2SPs1eW5inu8_0ipubZPZssswYFZhjuc0iv_KEB8WvKw-o Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6acb694feef455f9cf45c7be8684bf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b6acb694feef455f9cf45c7be8684bf6 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383978999 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383978999-project Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: exception: Keypair tempest-keypair-non-existent-211686717 not found for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'tempest-keypair-non-existent-211686717'} Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6863, in delete_key_pair Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6884, in get_key_pair Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-211686717 not found for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:01.039065 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-211686717 not found for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-211686717 not found for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:01.044353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6da0d59-1ed3-45bf-9de9-2fccb711793f tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] Returning 404 to user: Keypair tempest-keypair-non-existent-211686717 not found for user 8f3d1a531f5a4ceaa173ec1d6f486bd6 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:01.048799 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6da0d59-1ed3-45bf-9de9-2fccb711793f tempest-KeyPairsNegativeTestJSON-1383978999 tempest-KeyPairsNegativeTestJSON-1383978999-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-211686717" status: 404 len: 144 microversion: 2.1 time: 0.048105 Oct 31 15:29:01.048799 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1602/3303] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 15:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-211686717 => generated 144 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:01.457829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-05be6c9f-5ab7-44b2-b129-145913c374d7 req-7a60bf2a-055b-4097-bacf-8e6c39f2bfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:01.478031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-05be6c9f-5ab7-44b2-b129-145913c374d7 req-7a60bf2a-055b-4097-bacf-8e6c39f2bfa1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.480585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-05be6c9f-5ab7-44b2-b129-145913c374d7 req-7a60bf2a-055b-4097-bacf-8e6c39f2bfa1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.485878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-05be6c9f-5ab7-44b2-b129-145913c374d7 req-7a60bf2a-055b-4097-bacf-8e6c39f2bfa1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.519465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-05be6c9f-5ab7-44b2-b129-145913c374d7 req-7a60bf2a-055b-4097-bacf-8e6c39f2bfa1 service nova] Creating event network-vif-unplugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:29:01.534690 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-05be6c9f-5ab7-44b2-b129-145913c374d7 req-7a60bf2a-055b-4097-bacf-8e6c39f2bfa1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080929 Oct 31 15:29:01.538468 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1702/3304] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:02.055063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.055786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.067670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.068145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.068581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.073499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.073991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.074425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.083977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:02.336525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:02.349126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:02.351501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:02.353875 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9f167bb-1bb0-476b-845e-8f9340f21012 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1752 microversion: 2.20 time: 0.305790 Oct 31 15:29:02.354434 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1603/3305] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:02 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1752 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:02.922443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.924049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.934387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.935100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.935837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.937359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.937980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.938802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.974897 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] HTTP exception thrown: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Request method failure captured: Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 HTTP/1.1 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-lifYBZ5A9DInYS4IbrF8DtSVmsg0Ba78EPMjIzKMj7nqdoXnaAjN2LfbwhObWAYBaV5sIrZfF0AbEIob4VVAvDae42Y4J8XpFcAHc_MquuPfXuVlr5bfXBv6Et6jVW_8OSFzcDzyEl3K-4rmZW5hfs8hpsoXTrDojSKzKlAzC46zE Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b330dfc8915b46f5a5bfee6ac6ba9b54 Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '0b97e45b-a968-4969-8ecb-064377ce0c48'} Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:02.976932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Returning 404 to user: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-296ce92a-7aad-4cbc-a5a6-b664f1e87440 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 404 len: 111 microversion: 2.1 time: 0.062577 Oct 31 15:29:02.983770 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1703/3306] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:02 2022] DELETE /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:02.987907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.988423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 0b97e45b-a968-4969-8ecb-064377ce0c48] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.999226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.999718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.000156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.000893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.001353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.001774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.042540 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] HTTP exception thrown: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Request method failure captured: Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 HTTP/1.1 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lifYBZ5A9DInYS4IbrF8DtSVmsg0Ba78EPMjIzKMj7nqdoXnaAjN2LfbwhObWAYBaV5sIrZfF0AbEIob4VVAvDae42Y4J8XpFcAHc_MquuPfXuVlr5bfXBv6Et6jVW_8OSFzcDzyEl3K-4rmZW5hfs8hpsoXTrDojSKzKlAzC46zE Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b330dfc8915b46f5a5bfee6ac6ba9b54 Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0b97e45b-a968-4969-8ecb-064377ce0c48'} Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:03.044125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Returning 404 to user: Instance 0b97e45b-a968-4969-8ecb-064377ce0c48 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d18ef35-e06f-47db-baa0-7ba042791ff0 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48" status: 404 len: 111 microversion: 2.1 time: 0.062360 Oct 31 15:29:03.050017 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1604/3307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:02 2022] GET /compute/v2.1/servers/0b97e45b-a968-4969-8ecb-064377ce0c48 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:03.055568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:03.056073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:03.068645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.069179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.071033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.072525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.074015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.075413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.108477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] HTTP exception thrown: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Request method failure captured: Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 HTTP/1.1 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-lifYBZ5A9DInYS4IbrF8DtSVmsg0Ba78EPMjIzKMj7nqdoXnaAjN2LfbwhObWAYBaV5sIrZfF0AbEIob4VVAvDae42Y4J8XpFcAHc_MquuPfXuVlr5bfXBv6Et6jVW_8OSFzcDzyEl3K-4rmZW5hfs8hpsoXTrDojSKzKlAzC46zE Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: b330dfc8915b46f5a5bfee6ac6ba9b54 Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '4eb3a959-2c67-4b24-bc6b-7d5f499763e1'} Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:03.112767 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Returning 404 to user: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a750933-c1bb-4952-9dc2-7428dc982e59 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 404 len: 111 microversion: 2.1 time: 0.062546 Oct 31 15:29:03.118027 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1704/3308] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:03 2022] DELETE /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:03.122961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:03.123576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] [instance: 4eb3a959-2c67-4b24-bc6b-7d5f499763e1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:03.137474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.137968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.138408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.139117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.139578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.140663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.198930 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] HTTP exception thrown: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Request method failure captured: Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 HTTP/1.1 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lifYBZ5A9DInYS4IbrF8DtSVmsg0Ba78EPMjIzKMj7nqdoXnaAjN2LfbwhObWAYBaV5sIrZfF0AbEIob4VVAvDae42Y4J8XpFcAHc_MquuPfXuVlr5bfXBv6Et6jVW_8OSFzcDzyEl3K-4rmZW5hfs8hpsoXTrDojSKzKlAzC46zE Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3c4875ff17224133b4aa6a9b189dd744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3c4875ff17224133b4aa6a9b189dd744 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestMultiNic-490233297 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: b330dfc8915b46f5a5bfee6ac6ba9b54 Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestMultiNic-490233297-project Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4eb3a959-2c67-4b24-bc6b-7d5f499763e1'} Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:03.200509 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] Returning 404 to user: Instance 4eb3a959-2c67-4b24-bc6b-7d5f499763e1 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a70df06d-f707-4e68-a3fb-904b5d8aedc7 tempest-ServersTestMultiNic-490233297 tempest-ServersTestMultiNic-490233297-project] 10.222.0.48 "GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1" status: 404 len: 111 microversion: 2.1 time: 0.082848 Oct 31 15:29:03.210781 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1605/3309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:03 2022] GET /compute/v2.1/servers/4eb3a959-2c67-4b24-bc6b-7d5f499763e1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:03.381219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:03.381929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:03.394427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.395857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.397210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.401084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.401607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.402040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.647656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-98103d09-ecc3-487c-a4e5-0dbe075500b0 req-51940575-b3e9-493c-bc04-1bae98065857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:03.668677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-98103d09-ecc3-487c-a4e5-0dbe075500b0 req-51940575-b3e9-493c-bc04-1bae98065857 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.671723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-98103d09-ecc3-487c-a4e5-0dbe075500b0 req-51940575-b3e9-493c-bc04-1bae98065857 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.673209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-98103d09-ecc3-487c-a4e5-0dbe075500b0 req-51940575-b3e9-493c-bc04-1bae98065857 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.699852 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-98103d09-ecc3-487c-a4e5-0dbe075500b0 req-51940575-b3e9-493c-bc04-1bae98065857 service nova] Creating event network-vif-plugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:29:03.715758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-98103d09-ecc3-487c-a4e5-0dbe075500b0 req-51940575-b3e9-493c-bc04-1bae98065857 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071951 Oct 31 15:29:03.718928 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1606/3310] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:03.739011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.749639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.752118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.753556 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02ec10f8-f42d-43a0-90b7-575c26790f8d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1752 microversion: 2.20 time: 0.376468 Oct 31 15:29:03.754626 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1705/3311] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:03 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1752 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:04.789777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:04.792320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:04.818047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.820568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.821261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.822334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.822999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.823638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:05.286889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:05.298847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:05.312546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:05.314145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e051776-aa98-4015-a4b4-64498ce5a528 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1752 microversion: 2.20 time: 0.536119 Oct 31 15:29:05.314895 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1607/3312] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:04 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1752 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:06.352685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:06.353318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:06.370518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.371023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.371475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.372215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.372793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.383283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.945640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.982489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.995200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.004669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9db08ba6-366b-4bd5-91b5-f3e2953d192a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1752 microversion: 2.20 time: 0.652345 Oct 31 15:29:07.006798 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1706/3313] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:06 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1752 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:08.040837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:08.041479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:08.059130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.059637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.060085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.060843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.061311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.062455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.036956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.065471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.068739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.070927 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cdd86d0f-814e-4957-a715-3769d9f4e784 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.035139 Oct 31 15:29:09.080004 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1608/3314] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:08 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:10.114012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.115618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.140851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.142045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.142969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.146465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.147122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.149731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.489003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:10.666853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.691678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.693242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.716118 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92c3f269-c6c1-4095-b0bd-e9b5f82e9287 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.588711 Oct 31 15:29:10.718788 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1707/3315] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:10.815435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.816962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.827223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.829338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.830726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.831905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.832542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.833162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.933861 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5dc40a96-4c9a-4767-937e-9a408ce7eff6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/ips" status: 200 len: 146 microversion: 2.1 time: 0.706260 Oct 31 15:29:10.945890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1609/3316] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/ips => generated 146 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:11.747490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:11.748269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:11.762251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.769600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.770527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.774653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.775424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.779428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.545214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.565135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.566654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.586311 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cfd7883c-a860-45af-b0d8-7f9c0a835101 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.843449 Oct 31 15:29:12.587102 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1708/3317] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:11 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:13.621924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:13.623544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:13.637519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=16 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:13.644645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.649487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.651155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.653223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.654920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.656078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.553016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:14.593606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:14.605880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:14.605880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee4bf15a-1f25-4ff5-9619-a58773a6f97b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.987445 Oct 31 15:29:14.616844 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1610/3318] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:13 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:15.164949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "101b1226-0ead-4495-bd1d-0ee412652f4f"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:15.168317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:15.188983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.189901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.191508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.192574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.195703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.196493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.641772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:15.642584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:15.665284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.666205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.668331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.669500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.674420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.681440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.951249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b92065ca-4335-4435-9b9e-19883d1c78ce tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790275 Oct 31 15:29:15.964986 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1709/3319] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:29:15 2022] POST /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:16.790727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:16.812993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:16.825849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:16.828602 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db9d865b-59ba-4741-ab0f-8107385db98e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.191505 Oct 31 15:29:16.839365 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1611/3320] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:15 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:17.880617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:17.882346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:17.891942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.892830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.893530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.894485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.895169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.895943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.185638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Calling method '.version_select at 0x7f5ca14ffb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:18.280604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:29:18.281246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Neutron security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:29:18.281772 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] HTTP exception thrown: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.281772 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Request method failure captured: Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-security-groups/09510d0f-c191-4e78-9ffa-d1d7495ada3f HTTP/1.1 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-nNppzrF0DdEsqJAVwBLjcIc57Pnn4j-HLNaP9M0bF6krSuFEjtBJKi6cMz01acD6_0fP18xsy5UvVX1dFFzTt3MOVlrvmxSP205ysP4yfKTEEDF6gcJS9UmRVNmUmHAQxC5REV6TlD2fA40qe-6f0ewcNGVBmJzlPeUXFZXrxBTK8 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98409a78d3d94df29756d76fb512f775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98409a78d3d94df29756d76fb512f775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 21651a16864b4903babae762232ce3f4 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '09510d0f-c191-4e78-9ffa-d1d7495ada3f'} Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:29:18.283724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Returning 404 to user: Security group 09510d0f-c191-4e78-9ffa-d1d7495ada3f does not exist Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-97564c2b-d302-4f2b-bf9b-7f974caba3ab'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43564f7c-5259-4945-a94d-5d6e7b48a816 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/09510d0f-c191-4e78-9ffa-d1d7495ada3f" status: 404 len: 194 microversion: 2.1 time: 0.552302 Oct 31 15:29:18.293898 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1710/3321] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:29:17 2022] DELETE /compute/v2.1/os-security-groups/09510d0f-c191-4e78-9ffa-d1d7495ada3f => generated 194 bytes in 554 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:18.306323 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98e64f89-d9d4-4252-8e43-a06d80e90a6a tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.013219 Oct 31 15:29:18.309603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:18.318603 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1711/3322] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Oct 31 15:29:18 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:29:18.324251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d99a6d08-0cfe-4eb0-a452-e8410f7a14a0 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Calling method '.version_select at 0x7f5ca14fff70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:18.333868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:18.336130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:18.345062 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d79d75a8-49fc-4b5a-8346-35d9f3314d54 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.475957 Oct 31 15:29:18.349013 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1612/3323] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:17 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:18.929624 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d99a6d08-0cfe-4eb0-a452-e8410f7a14a0 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.610003 Oct 31 15:29:18.941512 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1712/3324] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:29:18 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:18.945950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d12bb96e-0702-4397-8b6b-ccc7a1823082 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Calling method '.version_select at 0x7f5ca12e3e50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:19.339250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG neutronclient.v2_0.client [None req-d12bb96e-0702-4397-8b6b-ccc7a1823082 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120626) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:29:19.339957 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d12bb96e-0702-4397-8b6b-ccc7a1823082 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 31 15:29:19.339957 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d12bb96e-0702-4397-8b6b-ccc7a1823082 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Request method failure captured: Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-security-groups/88d7087e-978a-4a56-98e8-8cd96a23d40f HTTP/1.1 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-nNppzrF0DdEsqJAVwBLjcIc57Pnn4j-HLNaP9M0bF6krSuFEjtBJKi6cMz01acD6_0fP18xsy5UvVX1dFFzTt3MOVlrvmxSP205ysP4yfKTEEDF6gcJS9UmRVNmUmHAQxC5REV6TlD2fA40qe-6f0ewcNGVBmJzlPeUXFZXrxBTK8 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98409a78d3d94df29756d76fb512f775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98409a78d3d94df29756d76fb512f775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 21651a16864b4903babae762232ce3f4 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: exception: Insufficient rights for removing default security group. Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '88d7087e-978a-4a56-98e8-8cd96a23d40f'} Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:29:19.342624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d12bb96e-0702-4397-8b6b-ccc7a1823082 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: Neutron server returns request_ids: ['req-10873cf3-b0b4-487a-9fd1-bbd14c98f219'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d12bb96e-0702-4397-8b6b-ccc7a1823082 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/88d7087e-978a-4a56-98e8-8cd96a23d40f" status: 400 len: 182 microversion: 2.1 time: 0.402665 Oct 31 15:29:19.356064 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1613/3325] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:29:18 2022] DELETE /compute/v2.1/os-security-groups/88d7087e-978a-4a56-98e8-8cd96a23d40f => generated 182 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:29:19.364810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Calling method '.version_select at 0x7f5ca14b6280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:19.383384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:19.383988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:19.387155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:19.417073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.421920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.422609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.425205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.426510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.427136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.437289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:29:19.438188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Neutron security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:29:19.439541 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] HTTP exception thrown: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.439541 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Request method failure captured: Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-security-groups/0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 HTTP/1.1 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-nNppzrF0DdEsqJAVwBLjcIc57Pnn4j-HLNaP9M0bF6krSuFEjtBJKi6cMz01acD6_0fP18xsy5UvVX1dFFzTt3MOVlrvmxSP205ysP4yfKTEEDF6gcJS9UmRVNmUmHAQxC5REV6TlD2fA40qe-6f0ewcNGVBmJzlPeUXFZXrxBTK8 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98409a78d3d94df29756d76fb512f775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98409a78d3d94df29756d76fb512f775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 21651a16864b4903babae762232ce3f4 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5'} Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:29:19.441761 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] Oct 31 15:29:19.445637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.449462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Returning 404 to user: Security group 0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 does not exist Oct 31 15:29:19.449462 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-46047bd7-731a-41d2-b572-dcea8b31a3c1'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:19.451565 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8750536-803e-488d-86d4-b48881502a50 tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5" status: 404 len: 194 microversion: 2.1 time: 0.097889 Oct 31 15:29:19.453194 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1713/3326] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:29:19 2022] GET /compute/v2.1/os-security-groups/0bc7fd04-3711-4ad2-8403-a8f4f14ca6d5 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:19.463475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Action: 'update', calling method: .version_select at 0x7f5ca14e0310>, body: {"security_group": {"name": "tempest-sg-1516777774", "description": "tempest-description-1725813332"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:19.532061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a15475b8-f148-4496-9278-3aa57609478a does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:29:19.532825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Neutron security group a15475b8-f148-4496-9278-3aa57609478a not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:29:19.533468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] HTTP exception thrown: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.533468 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Request method failure captured: Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/os-security-groups/a15475b8-f148-4496-9278-3aa57609478a HTTP/1.1 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 102 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-nNppzrF0DdEsqJAVwBLjcIc57Pnn4j-HLNaP9M0bF6krSuFEjtBJKi6cMz01acD6_0fP18xsy5UvVX1dFFzTt3MOVlrvmxSP205ysP4yfKTEEDF6gcJS9UmRVNmUmHAQxC5REV6TlD2fA40qe-6f0ewcNGVBmJzlPeUXFZXrxBTK8 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98409a78d3d94df29756d76fb512f775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98409a78d3d94df29756d76fb512f775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98409a78d3d94df29756d76fb512f775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 98409a78d3d94df29756d76fb512f775 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 21651a16864b4903babae762232ce3f4 Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1384936343-project Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: {"security_group": {"name": "tempest-sg-1516777774", "description": "tempest-description-1725813332"}} Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a15475b8-f148-4496-9278-3aa57609478a', 'body': {'security_group': {'name': 'tempest-sg-1516777774', 'description': 'tempest-description-1725813332'}}} Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:29:19.535590 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] Returning 404 to user: Security group a15475b8-f148-4496-9278-3aa57609478a does not exist Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-6e6b0a7a-03bb-4338-a4cd-2c4def747384'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:19.540573 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ee4480d-d5c3-45e3-8c67-984e5ab96b6f tempest-SecurityGroupsNegativeTestJSON-1384936343 tempest-SecurityGroupsNegativeTestJSON-1384936343-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/a15475b8-f148-4496-9278-3aa57609478a" status: 404 len: 194 microversion: 2.1 time: 0.080585 Oct 31 15:29:19.547408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1714/3327] 10.222.0.48 () {60 vars in 1290 bytes} [Mon Oct 31 15:29:19 2022] PUT /compute/v2.1/os-security-groups/a15475b8-f148-4496-9278-3aa57609478a => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:29:20.862792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:20.878866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:20.889739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:20.891707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8730078-6cfa-48e2-a3a2-52054d0589f2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.512144 Oct 31 15:29:20.906154 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1614/3328] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:19 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:29:21.924161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.924826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:21.974323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.974840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.975285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.976017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.983604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.984078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.732347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.748731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.759750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.761194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-892e012f-2816-4aa7-9fcd-c6be9608e64b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.843513 Oct 31 15:29:22.772863 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1715/3329] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:23.802213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:23.803089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:23.852147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.854382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.861249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.864206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.870490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.877418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.870701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.901588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.903322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.917433 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7cb093a3-01ed-4092-a205-9caa661423e6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.116596 Oct 31 15:29:24.929277 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1615/3330] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:23 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:25.948429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:25.949460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:25.982924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.993287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.995646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.007236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.007963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.008492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.135308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:26.687438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.712118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.714174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.715782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76740f33-156e-462f-b5e6-20baa4e0a63b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.772474 Oct 31 15:29:26.716654 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1716/3331] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:25 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:27.752310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:27.753730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:27.770885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.771664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.773016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.775353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.777591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.782381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.143309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:28.159886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:28.162173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:28.163772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aad88c64-3f99-401a-b103-81c51de29040 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.416368 Oct 31 15:29:28.169943 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1616/3332] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:27 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:29.205859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:29.206491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:29.226181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.234951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.237001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.242779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.243275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.243937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.380508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:29.383921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:29.435623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.436324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.445632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.448978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.453155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.454503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.301623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.326750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.328926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.336883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a33c9e9e-0a4c-41d9-921d-a508339ff58e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.134887 Oct 31 15:29:30.344576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.347468 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1717/3333] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:29 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:30.371644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-953285cf-8857-4d0b-9147-242504491d91 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 1.000673 Oct 31 15:29:30.372529 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1617/3334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:29 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:30.544221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-198809881", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "dfe5a64f-5323-4c45-8541-c7f655b58b72"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:30.651548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:30.733794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] validate_networks() for [('dfe5a64f-5323-4c45-8541-c7f655b58b72', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:31.372063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:31.377104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:31.393301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.394208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.394890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.395853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.397873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.398692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.996366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.016367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.022675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.023937 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3ef23c2-07bb-4fd1-83a2-9006e853884c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.656323 Oct 31 15:29:32.024514 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1618/3335] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:31 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:32.076107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.079419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:32.106081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.108111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.114914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.115723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.116195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.116635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.450117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:32.450605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:32.450705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:32.451125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:32.451574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:32.475369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.475911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.478546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.492238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.493627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.495595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.604416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Getting quotas for project c2aa70dab82c4d7da39faa20cc72f600. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:32.632258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Getting quotas for user a9ede43ed72b4f4291ffdae413f62909 and project c2aa70dab82c4d7da39faa20cc72f600. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:32.678052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.680732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=80 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:32.687895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:32.694045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:32.699537 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89861658-a5d0-4459-8919-bce9cf6771f8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.640516 Oct 31 15:29:32.730452 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1619/3336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:32.754573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-949296114"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:32.757137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:32.796544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.804857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.806063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.808665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.810925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.813663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.821249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.469711 Oct 31 15:29:32.851061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1718/3337] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:32.886183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bdc1a2a-56f4-4837-b0d6-a967e2e2fc57 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.888778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bdc1a2a-56f4-4837-b0d6-a967e2e2fc57 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.072485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bdc1a2a-56f4-4837-b0d6-a967e2e2fc57 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.085178 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bdc1a2a-56f4-4837-b0d6-a967e2e2fc57 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1216 microversion: 2.1 time: 0.232523 Oct 31 15:29:33.085868 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1719/3338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:33.095513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:33.096386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.118625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.119424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.120118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.121272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.121975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.124918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.422751 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dfb379d9-9dc5-454a-aa11-66ae3cb700fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.690321 Oct 31 15:29:33.426606 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1620/3339] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:32 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 15:29:33.441138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:33.446454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.468991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.469910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.471285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.473933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.474627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.475613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.555446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.591644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.598680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.602757 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7fe130ae-d279-474e-badd-33dfa759d3aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.515588 Oct 31 15:29:33.607405 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1720/3340] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:33 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:33.793870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-610abf9c-1e05-4b26-9163-06823c39a818 req-ace08351-ca07-4654-b069-cd3415786b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:33.817911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-610abf9c-1e05-4b26-9163-06823c39a818 req-ace08351-ca07-4654-b069-cd3415786b1e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.820442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-610abf9c-1e05-4b26-9163-06823c39a818 req-ace08351-ca07-4654-b069-cd3415786b1e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.822973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-610abf9c-1e05-4b26-9163-06823c39a818 req-ace08351-ca07-4654-b069-cd3415786b1e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.868382 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-610abf9c-1e05-4b26-9163-06823c39a818 req-ace08351-ca07-4654-b069-cd3415786b1e service nova] Creating event network-vif-unplugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:29:33.894034 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-610abf9c-1e05-4b26-9163-06823c39a818 req-ace08351-ca07-4654-b069-cd3415786b1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103339 Oct 31 15:29:33.896724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1721/3341] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:33.899584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.921285 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d03feb11-8371-48d2-8ba5-f213d9a22d87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.489421 Oct 31 15:29:33.924937 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1621/3342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:33 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:34.121926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:34.122818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:34.142736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.143221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.143664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.164164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.165693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.168126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.306189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:34.328469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e19f9fc-fada-4875-be59-ce037f29828d tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1220 microversion: 2.1 time: 0.219298 Oct 31 15:29:34.333136 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1722/3343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:34 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1220 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:34.635239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:34.635975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:34.650520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.651183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.651897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.656386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.657271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.657957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.828380 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:29:34.830480 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 15:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 (ip 10.222.0.48) !!! Oct 31 15:29:34.955784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:34.958080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:34.985750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.988046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.994166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.997190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.997701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.002139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.027660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.039216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.042075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.045481 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-585cee84-b370-4adf-839d-d731724145d0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.412219 Oct 31 15:29:35.054525 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1622/3344] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:34 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:35.318822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.327574 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6da441e2-61bc-4f02-a229-d3816d3eeaf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1687 microversion: 2.1 time: 0.376998 Oct 31 15:29:35.328429 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1723/3345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:34 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1687 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:35.365191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:35.369828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:35.377843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.378567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.379472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.380178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.380834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.381415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.501674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.511098 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fb70401-f265-454e-b524-a788e966d51a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1268 microversion: 2.1 time: 0.155602 Oct 31 15:29:35.528163 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1623/3346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:35 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:36.083468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.084753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.091621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.092905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.093520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.094733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.095476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.096081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.358490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.359620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.368514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.377113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.380241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.382913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.384667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff51ff1d-7a8c-4672-af09-12bafb4b19f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.305039 Oct 31 15:29:36.392074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.392914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.393950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.394803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.396041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.402177 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1724/3347] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:36.535178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.536182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.548989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.549870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.550584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.552843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.557457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.558289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.558413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.574526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-996577a7-79bf-4636-8bce-3782c6f9c74c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1687 microversion: 2.1 time: 0.226649 Oct 31 15:29:36.575747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1624/3348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:36.701254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.718155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-722f0f45-91f9-413e-a834-bf7060d3d813 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1268 microversion: 2.1 time: 0.185813 Oct 31 15:29:36.733072 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1725/3349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:37.412110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.412753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.419589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.433481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.433945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.434769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.435167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.436688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.480782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.485788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.499119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.499706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.500152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.500908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.501376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.501810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.562570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae990ad4-bab6-43d9-8def-6b5eaf4ab7c6 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089575 Oct 31 15:29:37.563336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1726/3350] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:37.582497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.583010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.593484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.594076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.595679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.596726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.597206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.597726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.644099 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db86a260-cfc2-4626-8d02-2c600cfcbc51 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/101b1226-0ead-4495-bd1d-0ee412652f4f" status: 200 len: 194 microversion: 2.1 time: 0.073628 Oct 31 15:29:37.648982 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1727/3351] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/101b1226-0ead-4495-bd1d-0ee412652f4f => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:37.651262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.654198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.664016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.666447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.666946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.667716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.668184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.669302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.770697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.784391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.791546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.796251 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c9d4f09-716d-4956-bee0-647dbc540327 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.388422 Oct 31 15:29:37.809676 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1625/3352] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:37.817921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.820219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.834296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.838757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.839393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.840302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.840967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.849242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.615154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:38.630817 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-270ca7e4-6792-427f-a5f6-595266e78d12 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.983819 Oct 31 15:29:38.632195 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1728/3353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:38.670884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:38.680032 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-19c7098a-b009-4f21-a94b-b658041711e0 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1316 microversion: 2.1 time: 0.868947 Oct 31 15:29:38.696635 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1626/3354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:38.837386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:38.838498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:38.857383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.860404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.861435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.870517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.871436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.871989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.399985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2d4bfe46-3b1f-4d3f-897e-bb1bec151fc0 req-25152979-66fe-4407-8e6c-10955cf6514e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-plugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:39.457426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2d4bfe46-3b1f-4d3f-897e-bb1bec151fc0 req-25152979-66fe-4407-8e6c-10955cf6514e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.459163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2d4bfe46-3b1f-4d3f-897e-bb1bec151fc0 req-25152979-66fe-4407-8e6c-10955cf6514e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.460763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2d4bfe46-3b1f-4d3f-897e-bb1bec151fc0 req-25152979-66fe-4407-8e6c-10955cf6514e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.494741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2d4bfe46-3b1f-4d3f-897e-bb1bec151fc0 req-25152979-66fe-4407-8e6c-10955cf6514e service nova] Creating event network-vif-plugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:29:39.524460 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2d4bfe46-3b1f-4d3f-897e-bb1bec151fc0 req-25152979-66fe-4407-8e6c-10955cf6514e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126606 Oct 31 15:29:39.534982 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1627/3355] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:39.661141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:39.662221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:39.674445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.679282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.679970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.681208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.681828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.682800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.051402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:40.073334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:40.079637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:40.088683 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0ccdc21-89f2-4d35-b7a2-e400baae3e22 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.256909 Oct 31 15:29:40.093820 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1729/3356] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:38 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:40.127562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:40.142611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:40.186882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.187701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.190804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.191615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.192102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.192538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.284455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:41.301879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0944eac4-0285-493a-90ed-c3cf1cbed03e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 1.647023 Oct 31 15:29:41.324122 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1628/3357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:39 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:41.338429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b7ff7133-9755-4d33-9e7b-a14a1341560e req-47edd12f-8501-437d-bc33-36debb789c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7241bc89-4294-4097-90eb-6f8d12dccb7b", "tag": "fd083af2-13bf-47cf-b908-2a35f58da100"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:41.361901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7ff7133-9755-4d33-9e7b-a14a1341560e req-47edd12f-8501-437d-bc33-36debb789c49 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.365012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7ff7133-9755-4d33-9e7b-a14a1341560e req-47edd12f-8501-437d-bc33-36debb789c49 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.365788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7ff7133-9755-4d33-9e7b-a14a1341560e req-47edd12f-8501-437d-bc33-36debb789c49 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.397498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b7ff7133-9755-4d33-9e7b-a14a1341560e req-47edd12f-8501-437d-bc33-36debb789c49 service nova] Creating event network-changed:fd083af2-13bf-47cf-b908-2a35f58da100 for instance 7241bc89-4294-4097-90eb-6f8d12dccb7b on n-h2-858383-17 Oct 31 15:29:41.408766 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b7ff7133-9755-4d33-9e7b-a14a1341560e req-47edd12f-8501-437d-bc33-36debb789c49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082623 Oct 31 15:29:41.412478 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1629/3358] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:41.419395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:41.420100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:41.444549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.445469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.446125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.447165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.447800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.448564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.817347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:41.829841 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-171df91d-783b-4fb6-8700-9ede9faf9ac8 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1316 microversion: 2.1 time: 1.733050 Oct 31 15:29:41.844924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1730/3359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:40 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1316 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:41.853996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:41.854931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:41.863112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.864119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.865209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.866178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.867464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.868079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.231209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.245954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.257065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.265135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55c708c5-656f-413b-a77e-3ecd160ff7be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.847111 Oct 31 15:29:42.266828 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1630/3360] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:41 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:42.283595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "401055c7-f07e-4783-9f1b-e62ea35a105d"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:42.286394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:42.299475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.301365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.302018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.304590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.306231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.306850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.398497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.409759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.411497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.413046 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb868616-94f3-48e2-af12-539f1e85969b tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2948 microversion: 2.32 time: 0.566702 Oct 31 15:29:42.414137 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1731/3361] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:41 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2948 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:42.418991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:42.419876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:42.426762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.427513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.428169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.429103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.429766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.430389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.558312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:42.735897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.750642 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad7c84a7-e171-4cff-85ea-c05810df9490 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.335116 Oct 31 15:29:42.755033 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1732/3362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:42 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:42.762131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:42.768933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:42.784690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.787536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.788261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.791639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.793264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.793968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.877555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ddc9be8-3c8d-4cab-85f0-db48579a524c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "POST /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605283 Oct 31 15:29:42.897464 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1631/3363] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:29:42 2022] POST /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:42.922068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:42.925305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:42.956048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.971225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.972290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.974578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.975242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.975692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.077299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:43.281564 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af99d11d-23da-4235-8548-17a01b7891db tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.525025 Oct 31 15:29:43.282330 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1733/3364] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:29:42 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1/os-interface => generated 1831 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:43.298363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:43.299437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:43.318518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:43.328418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:43.334501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.335461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:43.335968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:43.336419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.018066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.043848 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cceaa037-fa70-4893-b79c-33feed78fff3 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1316 microversion: 2.1 time: 1.141656 Oct 31 15:29:44.045826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1632/3365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:42 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:44.067756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:44.074823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:44.090279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.091080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.093191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.095938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.096747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.097377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.403759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.435779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.442871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.456829 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-699b4f27-10a2-45f2-a483-071bdc1d019b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.150813 Oct 31 15:29:44.478022 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1734/3366] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:43 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:29:44.483079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-937127371", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a894f4b9-7bb9-45b6-b49f-684d8b80987a"}], "block_device_mapping_v2": [{"uuid": "9655fed8-9e5d-46a0-92fd-82d296fcb2bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:44.549660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.563154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c7fd65b-0545-41bc-a170-5a4d4c957680 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.510540 Oct 31 15:29:44.564114 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1633/3367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:44 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:44.631534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] validate_networks() for [('a894f4b9-7bb9-45b6-b49f-684d8b80987a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:45.073417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:45.074041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:45.091609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.093464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.093921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.094652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.095121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.095559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.739112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:45.757230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bce96e5d-0c76-40d6-9103-da50f33ed690 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1316 microversion: 2.1 time: 0.687600 Oct 31 15:29:45.758227 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1634/3368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:45 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:45.763136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:45.764472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:45.786151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.786808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.787364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.788194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.793222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.794022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.798788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:46.222225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:46.230312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:46.231538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:46.232280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:46.233631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:46.234615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:46.237092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:46.242750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:46.243994 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ef803b8-60af-45d7-b5c1-e326ece0aae2 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.484536 Oct 31 15:29:46.257660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.266588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.267359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.271315 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1635/3369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:45 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:46.277110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.278572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.279584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.301092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.301639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:46.317558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:46.317785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.318231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.318672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.319393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.319854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.326496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Getting quotas for user 847c3c51ceb3406eb86b222c4638fc59 and project 49e1cf1de16c4f1bac8fb2c7fd1d7cfc. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:46.330875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.439958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:46.441820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9655fed8-9e5d-46a0-92fd-82d296fcb2bd',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:46.836357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:46.857998 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c44e2be1-6b25-4169-a2f9-db72a69f8556 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.580603 Oct 31 15:29:46.876308 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1636/3370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:46 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:46.898164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.900335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:46.917372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.919679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.922782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.923996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.925708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.926459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.982958 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d45fb2a9-49ab-4fee-b072-76040d51f1d3 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.503419 Oct 31 15:29:46.984383 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1735/3371] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:46.997478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6caeb29-3c8f-48ff-9807-df8ce8b375e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.999082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6caeb29-3c8f-48ff-9807-df8ce8b375e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:47.275463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6caeb29-3c8f-48ff-9807-df8ce8b375e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.295466 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6caeb29-3c8f-48ff-9807-df8ce8b375e1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1052 microversion: 2.1 time: 0.302478 Oct 31 15:29:47.316803 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1736/3372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:46 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1052 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:47.316803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:47.316803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:47.335382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.336037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.336326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.337160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.341614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.343066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.363036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:47.376053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.384260 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0231c574-261e-471d-8574-19f60978e2c7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1316 microversion: 2.1 time: 0.506090 Oct 31 15:29:47.388246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1637/3373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:46 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:47.656563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.672981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.678310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.680940 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-90c4ba86-3131-46f2-9ce7-41081deff880 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.374885 Oct 31 15:29:47.682998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1737/3374] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:47 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:47.903471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:47.905808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:47.908230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f0e7019d-c389-4169-a13d-993c24ddbe81 req-dfa2b083-9699-4c46-a9a7-4cf6e0631bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7241bc89-4294-4097-90eb-6f8d12dccb7b", "name": "network-vif-plugged", "status": "completed", "tag": "fd083af2-13bf-47cf-b908-2a35f58da100"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:47.915854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.917963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.918630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.922466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.923022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.924669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.933238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f0e7019d-c389-4169-a13d-993c24ddbe81 req-dfa2b083-9699-4c46-a9a7-4cf6e0631bf0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.933885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f0e7019d-c389-4169-a13d-993c24ddbe81 req-dfa2b083-9699-4c46-a9a7-4cf6e0631bf0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.938349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f0e7019d-c389-4169-a13d-993c24ddbe81 req-dfa2b083-9699-4c46-a9a7-4cf6e0631bf0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.988648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f0e7019d-c389-4169-a13d-993c24ddbe81 req-dfa2b083-9699-4c46-a9a7-4cf6e0631bf0 service nova] Creating event network-vif-plugged:fd083af2-13bf-47cf-b908-2a35f58da100 for instance 7241bc89-4294-4097-90eb-6f8d12dccb7b on n-h2-858383-17 Oct 31 15:29:48.022106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f0e7019d-c389-4169-a13d-993c24ddbe81 req-dfa2b083-9699-4c46-a9a7-4cf6e0631bf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118365 Oct 31 15:29:48.024976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1738/3375] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:48.331539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:48.332862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:48.349712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.350109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.350667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.351655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.352374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.353164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.503810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:48.512995 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3406fe75-5bb5-4f9c-aae1-b5b4674b7780 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.614729 Oct 31 15:29:48.517942 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1638/3376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:47 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:48.538185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:48.540451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:48.556207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.556802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.557180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.557963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.564949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.565675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.600251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:48.613744 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0524a4a-bd2e-460d-b95d-5769c6821b56 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1094 microversion: 2.1 time: 0.286603 Oct 31 15:29:48.630109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1739/3377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:48 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1094 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:48.719504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:48.720481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:48.737111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.738997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.740282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.742610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.743786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.744991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.237025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:49.250355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:49.258988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:49.265723 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-351f2bb8-a0a2-4809-a201-7d3e6cfabc1a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 0.552708 Oct 31 15:29:49.266659 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1740/3378] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:48 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:29:49.324532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:49.336359 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1195471-d4e9-4d62-8aea-6182461c4efe tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1316 microversion: 2.1 time: 0.816008 Oct 31 15:29:49.337015 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1639/3379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:48 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:49.551625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:49.555482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:49.585981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.586771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.587221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.593646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.594155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.594995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.642275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:49.643765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:49.646344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=52 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:49.666922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.667867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.671085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.672185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.672911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.674411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.233452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:50.242449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5341fd65-8a8a-4747-9342-8d2d7d398578 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1168 microversion: 2.1 time: 0.605322 Oct 31 15:29:50.244949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1640/3380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:49 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1168 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:50.352250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee756105-3edd-43e4-8238-0935172335c9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Action: 'create', calling method: .version_select at 0x7f5ca157f820>, body: {"keypair": {"name": "tempest-keypair-890329799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMAVkOgTBNaCLA4iS1rxn/U6fD5RdBseukhxfNMtXTHNGMFnCnF0iNTlp/hhZ2BrMoFB9YuKZuw1GNfKF7QncoZenG6wi/mhPvKopkBc0MUMw4e8R+zamNvZJ+sDhf9pA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:50.387004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-ee756105-3edd-43e4-8238-0935172335c9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Getting quotas for project 153ac418de4045d5a5bf4866c8c8b78d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:50.396495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-ee756105-3edd-43e4-8238-0935172335c9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Getting quotas for user d1783f2941594680a5499635e369585a and project 153ac418de4045d5a5bf4866c8c8b78d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:50.459233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee756105-3edd-43e4-8238-0935172335c9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212954 Oct 31 15:29:50.459857 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1641/3381] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:50.473831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7040b6ef-1ef9-4825-85c6-9853683918e7 req-6ff9c51d-446d-43f3-83a5-09a686aee8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "name": "network-vif-plugged", "status": "completed", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:50.485994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7040b6ef-1ef9-4825-85c6-9853683918e7 req-6ff9c51d-446d-43f3-83a5-09a686aee8c7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.486861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7040b6ef-1ef9-4825-85c6-9853683918e7 req-6ff9c51d-446d-43f3-83a5-09a686aee8c7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.487606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7040b6ef-1ef9-4825-85c6-9853683918e7 req-6ff9c51d-446d-43f3-83a5-09a686aee8c7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.508817 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7040b6ef-1ef9-4825-85c6-9853683918e7 req-6ff9c51d-446d-43f3-83a5-09a686aee8c7 service nova] Creating event network-vif-plugged:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:29:50.528792 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7040b6ef-1ef9-4825-85c6-9853683918e7 req-6ff9c51d-446d-43f3-83a5-09a686aee8c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058966 Oct 31 15:29:50.530634 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1642/3382] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:50.544290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:50.547031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:50.564135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.568605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.569454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.570434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.586680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.588143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.650141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:50.674422 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3eb890f-ff86-4a95-a597-4c7a01949bad tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 1.130060 Oct 31 15:29:50.677444 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1741/3383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:49 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:50.686643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:50.692656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:50.709680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.711502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.713558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.714551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.718214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.719069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.566121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:51.580065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:51.581545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:51.594053 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47d27033-ac5d-461f-9ed4-221a72656f0c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.059177 Oct 31 15:29:51.603264 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1643/3384] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:50 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:51.621676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.622661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.639807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.650655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.651402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.652327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.653019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.653645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.869456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:51.884816 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a790dc1-08f5-43c1-b4e8-78bbab9fdad2 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1505 microversion: 2.1 time: 1.203669 Oct 31 15:29:51.901592 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1742/3385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:50 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1505 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:51.922713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.923711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.934826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:51.939415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.941503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.943035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.944625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.946614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.947645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.963913 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d28033f8-b349-4f99-9c47-3a30a8818e76 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1168 microversion: 2.1 time: 0.351180 Oct 31 15:29:51.984672 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1644/3386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1168 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:52.008079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.012854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.038367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.039098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.051877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.052957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.060160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.065357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.172362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:52.173892 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1732379e-920d-4799-9093-afcf25600f83 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b/os-instance-actions/req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef" status: 200 len: 313 microversion: 2.1 time: 0.188075 Oct 31 15:29:52.174776 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1645/3387] 10.222.0.48 () {58 vars in 1419 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b/os-instance-actions/req-02635cdb-c824-4a58-a0c9-74a1ff4bd7ef => generated 313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:52.192826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:52.195489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.208560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.211076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.215039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.216071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.218175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.220912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.381517 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6923585c-73a2-4800-9fbf-609164a764ff tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "POST /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b/action" status: 202 len: 0 microversion: 2.1 time: 0.193966 Oct 31 15:29:52.382434 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1646/3388] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:52 2022] POST /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:29:52.391855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.395536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.415593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.416131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.416586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.423930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.424708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.427374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.636028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:52.645930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-274ca568-322c-43bd-a976-213f1cc6539c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.742836 Oct 31 15:29:52.646527 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1743/3389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:52.675705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.681295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.700637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.707513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.714064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.718504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.722461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.723004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.130379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.148166 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7fcff42-813a-4fd5-a474-329a928d0ae7 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1507 microversion: 2.1 time: 0.758305 Oct 31 15:29:53.186320 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1647/3390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:52 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1507 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:53.193146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:53.198982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:53.238388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.239836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.241274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.245544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.246144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.247372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.787934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.808624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.831084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.838302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.845293 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-487be15e-7a31-4886-bc0b-9245de2e22fb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1808 microversion: 2.20 time: 1.187695 Oct 31 15:29:53.848780 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1744/3391] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:52 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1808 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:53.849159 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04096bd4-1046-419c-80e1-281c35f95e21 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1210 microversion: 2.1 time: 0.685250 Oct 31 15:29:53.860901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:53.863164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:53.864473 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1648/3392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:53 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1210 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:53.885772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.887321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.892517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.893779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.898471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.901015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.178073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:54.180801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:54.192207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.193546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.194368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.202600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.205880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.208612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.823167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:54.838453 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d18c8e9-8a98-4d44-a671-c83447502b01 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.988329 Oct 31 15:29:54.844219 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1745/3393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:53 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:54.878538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:54.879893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:54.921645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.927756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.928497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.934621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.936184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.936838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.044987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.116664 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-51cfe348-dd5d-4071-b0bd-f5bcbe19f22a tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1507 microversion: 2.1 time: 0.928940 Oct 31 15:29:55.118890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1649/3394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:54 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1507 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:55.163158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:55.163796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:55.232455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.235422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.245046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.250167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.252478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.256138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.678749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.703219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.714913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.722824 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a705c88f-b9db-4ffa-a24f-2e2cad50556f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1795 microversion: 2.20 time: 0.845726 Oct 31 15:29:55.724332 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1746/3395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:54 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1795 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:55.730414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-963893197", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e0a94771-5ab4-456f-a60f-f0ff3878d7aa"}], "security_groups": [{"name": "tempest-securitygroup--1113724559"}], "key_name": "tempest-keypair-890329799", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:55.790051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.798283 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b7ec9182-fef5-4669-9515-3a3b1f4d6fbe tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1210 microversion: 2.1 time: 0.668710 Oct 31 15:29:55.799063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1650/3396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:55 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1210 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:55.871677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:55.872969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:55.882863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.889175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.890782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.915052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.918562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.919023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.301514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:56.489287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] validate_networks() for [('e0a94771-5ab4-456f-a60f-f0ff3878d7aa', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:56.846645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:56.854616 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4946b72e-161a-4de1-b530-444a7f7614d0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.988804 Oct 31 15:29:56.876711 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1651/3397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:55 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:56.881946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:56.883743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:56.891245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.891980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.893187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.894108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.895319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.895932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.914612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:57.261567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:57.280999 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b6daf43-77e1-443d-ab54-f5406a05ed6b tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1505 microversion: 2.1 time: 0.400714 Oct 31 15:29:57.281798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:57.283537 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1652/3398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:56 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:57.289244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.290140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.298514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.299420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.300095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.301300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.301990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.302627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.932857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:57.945348 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dfd4cf35-08cb-4de3-ade1-2f0c3df6e048 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1210 microversion: 2.1 time: 0.660436 Oct 31 15:29:57.949797 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1653/3399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:57 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1210 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:57.963311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '.version_select at 0x7f5ca12a3b80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.968672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.986654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.987931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.989213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.990592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.991914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.992570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.065287 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1cd6fe53-f80c-4a3c-bfa1-8a43ecc99ac9 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.106724 Oct 31 15:29:58.073159 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1654/3400] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Oct 31 15:29:57 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b/os-instance-actions => generated 611 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:58.082271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0b4b17b4-c0ce-4ccd-a828-f65b052c186f req-449991a6-197f-46eb-b4e1-24785e63db7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62ea834-5faf-4d9e-936c-884461341dcf", "tag": "79160ec8-bdce-46cc-8e82-b616e34e7c71"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:58.095705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0b4b17b4-c0ce-4ccd-a828-f65b052c186f req-449991a6-197f-46eb-b4e1-24785e63db7c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.096733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0b4b17b4-c0ce-4ccd-a828-f65b052c186f req-449991a6-197f-46eb-b4e1-24785e63db7c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.098044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0b4b17b4-c0ce-4ccd-a828-f65b052c186f req-449991a6-197f-46eb-b4e1-24785e63db7c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.117706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0b4b17b4-c0ce-4ccd-a828-f65b052c186f req-449991a6-197f-46eb-b4e1-24785e63db7c service nova] Creating event network-changed:79160ec8-bdce-46cc-8e82-b616e34e7c71 for instance f62ea834-5faf-4d9e-936c-884461341dcf on n-h1-858383-17 Oct 31 15:29:58.123701 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0b4b17b4-c0ce-4ccd-a828-f65b052c186f req-449991a6-197f-46eb-b4e1-24785e63db7c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048112 Oct 31 15:29:58.124762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1655/3401] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:58.129495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Getting quotas for project 153ac418de4045d5a5bf4866c8c8b78d. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:58.130802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.131517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.139203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Getting quotas for user d1783f2941594680a5499635e369585a and project 153ac418de4045d5a5bf4866c8c8b78d. Resources: dict_keys(['metadata_items']) {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:58.141691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.142824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.143315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.144036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.144480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.144998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.158242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:58.160275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:58.161138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:58.164925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:58.164925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:58.164925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:58.190640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.191518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.193478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.195062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.196021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.196877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.221830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Getting quotas for project 153ac418de4045d5a5bf4866c8c8b78d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:58.232538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Getting quotas for user d1783f2941594680a5499635e369585a and project 153ac418de4045d5a5bf4866c8c8b78d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:58.246897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:58.251022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:58.316250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc0e7682-967d-435e-a52b-c770c3300279 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.590506 Oct 31 15:29:58.323636 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1747/3402] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 2599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:58.329632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.330416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.353591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.354751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.355442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.356452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.357393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.358100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.390496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:58.524007 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13025694-ba96-4c7c-91e4-fc364eb23648 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 204 len: 0 microversion: 2.1 time: 0.198626 Oct 31 15:29:58.525205 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1748/3403] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:58 2022] DELETE /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:29:58.539684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7ddee2c-a84c-4910-bcc6-6404b0c439b7 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.541783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7ddee2c-a84c-4910-bcc6-6404b0c439b7 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.676058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7ddee2c-a84c-4910-bcc6-6404b0c439b7 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.686513 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7ddee2c-a84c-4910-bcc6-6404b0c439b7 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1268 microversion: 2.1 time: 0.158880 Oct 31 15:29:58.708345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1749/3404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:58.714675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.715698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.724076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.727274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.728021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.728734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.729887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.730677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.731341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.732613 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eae2a2d8-01af-44e2-b8f2-1c73c7509fee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.605631 Oct 31 15:29:58.735394 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1656/3405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:58.983098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.984417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.994318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.995625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.996605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.999758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.000240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.003011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.356054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:59.374364 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-575afb58-59f6-4834-aa4b-d130fac12e71 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1511 microversion: 2.1 time: 0.664429 Oct 31 15:29:59.375724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1750/3406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1511 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:59.477333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:59.486918 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab9c9e34-a7c5-4ec4-9def-37b7e0636fd6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1210 microversion: 2.1 time: 0.509970 Oct 31 15:29:59.487476 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1657/3407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1210 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:59.715529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:59.717173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:59.737008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.737886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.738556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.739499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.740175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.740826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.761527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:59.762446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:59.775462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.776235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.776931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.777868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.778624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.781920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.948527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:59.962376 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94637aac-a20e-4f4e-8840-7d711b006343 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1272 microversion: 2.1 time: 0.250608 Oct 31 15:29:59.977720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1751/3408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:59 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:00.117520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:00.141230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a73a1adc-f5e7-485b-b19b-cac913804880 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.383254 Oct 31 15:30:00.156396 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1658/3409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:59 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:00.398558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:00.399386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:00.413270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.413845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.414483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.416192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.416859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.418864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.512747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:00.514325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:00.535207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:00.548652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.549513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.550165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.551184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.551805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.552392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.182451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ede43ed72b4f4291ffdae413f62909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2aa70dab82c4d7da39faa20cc72f600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.194056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39308216-7c75-4f5c-af7d-0b146c15153c tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 200 len: 1469 microversion: 2.1 time: 0.799783 Oct 31 15:30:01.195809 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1752/3410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:00 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 1469 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:01.203359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c49b2a9b-6169-467e-890e-64a086691ff0 req-3328fc9c-2d8c-4b45-b913-0618521f7fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7241bc89-4294-4097-90eb-6f8d12dccb7b", "name": "network-vif-deleted", "tag": "fd083af2-13bf-47cf-b908-2a35f58da100"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:01.231193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c49b2a9b-6169-467e-890e-64a086691ff0 req-3328fc9c-2d8c-4b45-b913-0618521f7fe4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.232916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c49b2a9b-6169-467e-890e-64a086691ff0 req-3328fc9c-2d8c-4b45-b913-0618521f7fe4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.233750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c49b2a9b-6169-467e-890e-64a086691ff0 req-3328fc9c-2d8c-4b45-b913-0618521f7fe4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.255064 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c49b2a9b-6169-467e-890e-64a086691ff0 req-3328fc9c-2d8c-4b45-b913-0618521f7fe4 service nova] Creating event network-vif-deleted:fd083af2-13bf-47cf-b908-2a35f58da100 for instance 7241bc89-4294-4097-90eb-6f8d12dccb7b on n-h2-858383-17 Oct 31 15:30:01.261068 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c49b2a9b-6169-467e-890e-64a086691ff0 req-3328fc9c-2d8c-4b45-b913-0618521f7fe4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063767 Oct 31 15:30:01.262138 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1753/3411] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:01.268596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.269771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.277467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.278288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.280375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.281427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.282073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.283087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.508998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.551050 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70fb0b30-710f-451f-adf0-32b1d23fbc96 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1326 microversion: 2.1 time: 0.287346 Oct 31 15:30:01.560230 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1754/3412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1326 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:01.592837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.622295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.628278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.629920 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-863c417c-d8f0-4a20-8408-80770842663f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1210 microversion: 2.1 time: 1.123386 Oct 31 15:30:01.635153 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1659/3413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:00 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1210 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:01.644788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.656048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.658697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.661122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.661722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.665744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.668818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.669910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.696728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.697991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:01.717400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.717400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.717400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.717400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.717400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.742432 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-665424f8-37ed-4b7c-bf55-b3d8c9eda69e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.105747 Oct 31 15:30:01.743919 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1660/3414] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:01.905719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.906050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.918491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.918989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.919669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.920562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.921295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.921896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.959110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.971553 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4663b36f-696f-42ce-8524-b3a8229fd9e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.407131 Oct 31 15:30:01.972557 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1755/3415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:01.990424 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a106b888-ade2-4d4f-bfd8-809a8bda3a4c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/101b1226-0ead-4495-bd1d-0ee412652f4f" status: 200 len: 194 microversion: 2.1 time: 0.089996 Oct 31 15:30:01.991689 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1661/3416] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/101b1226-0ead-4495-bd1d-0ee412652f4f => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:02.003567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.004426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.016624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.017523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.018753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.019664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.020203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.020884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.164940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lazy-loading 'services' on Instance uuid dd6e134c-8818-4583-85a2-0b63c8516203 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:02.224138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.225079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] [instance: 7241bc89-4294-4097-90eb-6f8d12dccb7b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.233482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.233979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.234427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.235135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.241444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.242176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.274755 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] HTTP exception thrown: Instance 7241bc89-4294-4097-90eb-6f8d12dccb7b could not be found. Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Request method failure captured: Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b HTTP/1.1 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-nZPYG918481u0gJCigLmu-nx43vcZ79M-kUKeJxCxwjoon0w_YWsweFhQiA9Ru7bNwS_e_cVXBZUqOSEcrySlelEMi50hm1Cu7z3fkYPzy0wmG1NYkiFoWckAXslzJ96hNwsXs20FATDt2-UwFH41ExBeQWaQOIIeCkc1vmQ3sTds Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c2aa70dab82c4d7da39faa20cc72f600 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-InstanceActionsTestJSON-1654692052 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2aa70dab82c4d7da39faa20cc72f600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2aa70dab82c4d7da39faa20cc72f600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2aa70dab82c4d7da39faa20cc72f600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2aa70dab82c4d7da39faa20cc72f600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-InstanceActionsTestJSON-1654692052 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c2aa70dab82c4d7da39faa20cc72f600 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1654692052 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-InstanceActionsTestJSON-1654692052-project Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a9ede43ed72b4f4291ffdae413f62909 Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-InstanceActionsTestJSON-1654692052-project Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 7241bc89-4294-4097-90eb-6f8d12dccb7b could not be found. Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '7241bc89-4294-4097-90eb-6f8d12dccb7b'} Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7241bc89-4294-4097-90eb-6f8d12dccb7b could not be found. Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7241bc89-4294-4097-90eb-6f8d12dccb7b could not be found. Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:02.277276 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7241bc89-4294-4097-90eb-6f8d12dccb7b could not be found. Oct 31 15:30:02.283258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:02.285790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] Returning 404 to user: Instance 7241bc89-4294-4097-90eb-6f8d12dccb7b could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:02.287042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6d16813-12f9-44cf-ac87-59526a8f3924 tempest-InstanceActionsTestJSON-1654692052 tempest-InstanceActionsTestJSON-1654692052-project] 10.222.0.48 "GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b" status: 404 len: 111 microversion: 2.1 time: 0.067420 Oct 31 15:30:02.291843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1662/3417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/7241bc89-4294-4097-90eb-6f8d12dccb7b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:02.302693 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-588edd40-aea7-4e36-8357-126cb2860d0c tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/101b1226-0ead-4495-bd1d-0ee412652f4f" status: 202 len: 0 microversion: 2.1 time: 0.303763 Oct 31 15:30:02.303955 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1756/3418] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:30:01 2022] DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/101b1226-0ead-4495-bd1d-0ee412652f4f => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:02.586275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.587148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.596179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.597479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.598108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.599521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.599985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.600565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.675096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.676141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.684018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.684659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.685285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.686287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.686867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.687382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.942706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:02.968497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16f600d4-2735-40f5-ab9b-ee6bdc16deea tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.297875 Oct 31 15:30:02.969478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1757/3419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:02.972498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:02.989434 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f11438c-3d34-4790-af40-8017ce2dfc14 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.406797 Oct 31 15:30:02.990639 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1663/3420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:03.011885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:03.012933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:03.020445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.021281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.021889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:03.022796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.023445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.024148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:03.215202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:03.224501 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3252cd24-fbcd-4c21-8cce-8b4fa85ba4ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1682 microversion: 2.1 time: 0.216938 Oct 31 15:30:03.227768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1758/3421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:03.996063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:03.996929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.007210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.008141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.009034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.017566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.020159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.025674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.026457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.030115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.033068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.033931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.035922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.036879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.038305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.038926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.374502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.395976 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1bf92714-6395-47ee-aa4c-965b706c4c37 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.385220 Oct 31 15:30:04.405402 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1759/3422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:04.420059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a7363dad-8af2-43ca-b049-7ebc1415eb9b req-4f7acc80-a21a-40a2-b688-83239ca26785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0017d3-d87e-40dd-a09e-f3e0f67504e2", "tag": "3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:04.432982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7363dad-8af2-43ca-b049-7ebc1415eb9b req-4f7acc80-a21a-40a2-b688-83239ca26785 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.434513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7363dad-8af2-43ca-b049-7ebc1415eb9b req-4f7acc80-a21a-40a2-b688-83239ca26785 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.435518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7363dad-8af2-43ca-b049-7ebc1415eb9b req-4f7acc80-a21a-40a2-b688-83239ca26785 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.447793 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a7363dad-8af2-43ca-b049-7ebc1415eb9b req-4f7acc80-a21a-40a2-b688-83239ca26785 service nova] Creating event network-changed:3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03 for instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 on n-h2-858383-17 Oct 31 15:30:04.467868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.470505 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a7363dad-8af2-43ca-b049-7ebc1415eb9b req-4f7acc80-a21a-40a2-b688-83239ca26785 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063550 Oct 31 15:30:04.471123 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1760/3423] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:04.476977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d9276cc7-61dd-4d27-8283-f68ad4026f74 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.485676 Oct 31 15:30:04.478088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1664/3424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:03 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:04.483306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.484247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.491438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.492321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.492950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.493853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.494314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.494778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.712834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.729964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcc73572-aecf-45a0-8188-7de5dea52b72 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.257248 Oct 31 15:30:04.745962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1761/3425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:04.849373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.850261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.856718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.858249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.858862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.859737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.860350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.861035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.017722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:05.026470 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39a8d86f-dbb2-48f3-befe-c058693178a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.181581 Oct 31 15:30:05.027690 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1665/3426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:05.425106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:05.426101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:05.456349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.456835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.457865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.458603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.459036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.460079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.500803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:05.501575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:05.509596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.510111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.510537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.511246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.517170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.517879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.023239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:06.036469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27579c7e-ba92-4223-961d-6cf89b114853 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.615199 Oct 31 15:30:06.068110 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1762/3427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:05 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:06.089079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ea4460cf-5767-47d2-9548-e6fbacb7f6b4 req-f11bd2c6-eebe-417c-aee1-2b7a98b35c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:06.134085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ea4460cf-5767-47d2-9548-e6fbacb7f6b4 req-f11bd2c6-eebe-417c-aee1-2b7a98b35c7c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.136242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ea4460cf-5767-47d2-9548-e6fbacb7f6b4 req-f11bd2c6-eebe-417c-aee1-2b7a98b35c7c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.137863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ea4460cf-5767-47d2-9548-e6fbacb7f6b4 req-f11bd2c6-eebe-417c-aee1-2b7a98b35c7c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.165551 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ea4460cf-5767-47d2-9548-e6fbacb7f6b4 req-f11bd2c6-eebe-417c-aee1-2b7a98b35c7c service nova] Creating event network-vif-unplugged:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:30:06.190470 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ea4460cf-5767-47d2-9548-e6fbacb7f6b4 req-f11bd2c6-eebe-417c-aee1-2b7a98b35c7c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120919 Oct 31 15:30:06.196075 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1763/3428] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:06.216637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:06.232746 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4b233d0-ab8b-471f-9f02-f8b6be60a513 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.734953 Oct 31 15:30:06.233405 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1666/3429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:05 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:06.575753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:06.578186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:06.592178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.593291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.593966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.597204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.598088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.598720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.801411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:06.809438 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db0a8f52-e774-4f59-adda-bc6992d49495 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.237955 Oct 31 15:30:06.816197 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1764/3430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:06 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:06.832949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:06.833567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:06.839530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.840389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.840856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.842221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.844161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.845038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.993798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.001872 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78a22ed7-0244-48d7-8a03-2da4745c8b38 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.172810 Oct 31 15:30:07.002458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1667/3431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:06 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.037253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.064825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.065462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.073787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.074279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.074716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.080570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.081087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.081528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.303292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.313162 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d262efa9-aee7-44d1-a722-53d65908b30b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.292384 Oct 31 15:30:07.314543 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1765/3432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.320377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.321377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.328666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.329495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.330042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.331083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.331819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.332445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.357165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.369474 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-430515ac-3770-473d-9ae5-e6a1dfeda9ff tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.308220 Oct 31 15:30:07.370742 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1668/3433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.377018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:07.386506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.396301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.397854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.398476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.399562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.400364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.401077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.475292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:07.504380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.511567 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa5ae591-9ed0-4f3d-8389-42382562fbe8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.138393 Oct 31 15:30:07.517677 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1669/3434] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:07 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:07.524422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.525197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.526635 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65b77f74-1613-4f55-9283-b1f4659207d2 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.201591 Oct 31 15:30:07.534518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.535266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.536340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.537369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.538318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.539233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.541873 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1766/3435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.743544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.753544 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d47757d-eb0a-4faf-a777-7e229f1c4582 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1671 microversion: 2.1 time: 0.233568 Oct 31 15:30:07.754528 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1670/3436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:08.394976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.395595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.409022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:08.411907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.412404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.417214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.418196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.418744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.419208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.573921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.577945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.597430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.599222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.600260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.602674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.603316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.604407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.616376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:08.636661 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-addb4a23-952f-4225-a071-7a8838fede6c tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.244455 Oct 31 15:30:08.655441 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1767/3437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:08.780081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.780915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.784007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:08.791117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.791628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.792067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.792924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.793671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.794921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.917130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:08.931839 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-234eed8f-0e9f-4a9e-be6d-7a90ad5e7150 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.368237 Oct 31 15:30:08.946537 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1671/3438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:09.043396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:09.082181 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0338ca1a-ce57-4974-884f-a00ccc369295 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1676 microversion: 2.1 time: 0.306444 Oct 31 15:30:09.085417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1768/3439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1676 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:09.668943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:09.670621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:09.677598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.678163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.679455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.684085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.684085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.684085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.816136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-69fd4cba-3765-4825-910a-518809421139 req-8c1bab29-6df1-44f7-9051-908b1cea9d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0017d3-d87e-40dd-a09e-f3e0f67504e2", "name": "network-vif-plugged", "status": "completed", "tag": "3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:09.832898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-69fd4cba-3765-4825-910a-518809421139 req-8c1bab29-6df1-44f7-9051-908b1cea9d3f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.833696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-69fd4cba-3765-4825-910a-518809421139 req-8c1bab29-6df1-44f7-9051-908b1cea9d3f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.840459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-69fd4cba-3765-4825-910a-518809421139 req-8c1bab29-6df1-44f7-9051-908b1cea9d3f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.843837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:09.852268 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-acb9661e-e386-452c-b2f4-86bc020e387a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.188382 Oct 31 15:30:09.853079 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1672/3440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:09 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:09.860278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-69fd4cba-3765-4825-910a-518809421139 req-8c1bab29-6df1-44f7-9051-908b1cea9d3f service nova] Creating event network-vif-plugged:3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03 for instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 on n-h2-858383-17 Oct 31 15:30:09.866519 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-69fd4cba-3765-4825-910a-518809421139 req-8c1bab29-6df1-44f7-9051-908b1cea9d3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054130 Oct 31 15:30:09.867782 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1769/3441] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:09.957651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:09.958507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:09.967299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.967299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.967977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.968676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.969152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.969576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.057089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.057678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.064258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.064798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.065244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.066034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.066409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.066836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.106073 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6db7d164-c21b-4e80-a15c-ef16e134b59e tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/401055c7-f07e-4783-9f1b-e62ea35a105d" status: 200 len: 194 microversion: 2.1 time: 0.053253 Oct 31 15:30:10.107750 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1770/3442] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/401055c7-f07e-4783-9f1b-e62ea35a105d => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:10.113765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.115703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.123831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.124335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.124804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.125520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.125978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.126585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.152642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.170077 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7fe03ae6-6333-4ce1-9d4f-988fd1013740 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.215577 Oct 31 15:30:10.170991 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1673/3443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:09 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:10.194602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.195113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.203028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.203793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.204452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.205359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.205983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.208031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.302895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lazy-loading 'services' on Instance uuid dd6e134c-8818-4583-85a2-0b63c8516203 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:10.306985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.315579 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9b1a14e-39ca-4912-94c5-3ed361f6fe26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.206455 Oct 31 15:30:10.316065 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1771/3444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:10.339783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:10.343227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.349697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.350336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.350780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.351494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.351990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.352421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.385238 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4396d2a-35b6-47e6-a5c9-0e672d6f4b05 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/401055c7-f07e-4783-9f1b-e62ea35a105d" status: 202 len: 0 microversion: 2.1 time: 0.212949 Oct 31 15:30:10.386096 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1674/3445] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:30:10 2022] DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments/401055c7-f07e-4783-9f1b-e62ea35a105d => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:10.407534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df105492-df7f-49dc-b0bc-7244d7763e5a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 200 len: 322 microversion: 2.1 time: 0.071603 Oct 31 15:30:10.411928 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1772/3446] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:10 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 322 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:10.422347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.423125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.436078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.436877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.437541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.438450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.438957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.439566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.590280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.600186 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-410a51bb-2a55-4161-9e6f-146525f6faae tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.182163 Oct 31 15:30:10.600815 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1675/3447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:10.624447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.625472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.633148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.633751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.634410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.635351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.635931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.636424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.661363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:10.878104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.878761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.884882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.885744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.886225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.886655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.887396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.887846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.889318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.895177 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e37d980-35dc-4e48-8d2f-a1fd3ee9c268 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.275531 Oct 31 15:30:10.895924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1773/3448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:10.920437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.920998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.927805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.928533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.929166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.930070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.930695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.931335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.192792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.204759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.206010 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85d1941a-9197-4e3d-ae2b-78a092382b4a tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1394 microversion: 2.1 time: 0.330934 Oct 31 15:30:11.207479 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1676/3449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1394 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.213134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:11.214316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.219209 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40e16fa5-7a2c-4a7c-880b-983b482dcd29 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.303074 Oct 31 15:30:11.219805 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1774/3450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:11.246106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:11.246229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.260418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.261345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.261980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.262116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.263899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.264425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.264640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.265112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.265621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.266516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.268973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.270085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.654977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.665530 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26612f89-aa6d-4b06-a598-ce0544b94a63 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.423938 Oct 31 15:30:11.668103 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1775/3451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:11 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.675134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.686883 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27b64d48-2766-47f8-b819-f498e992237e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.475694 Oct 31 15:30:11.687646 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1677/3452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:11 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.846248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2135522628", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "8c999eef-3ab4-4489-9119-8b9357d0c054"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:11.943813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] validate_networks() for [('8c999eef-3ab4-4489-9119-8b9357d0c054', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:12.237094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:12.238312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.248170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.249434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.250056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.250972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.254328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.254506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.561732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:12.576320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09dbf231-f4d9-4605-9661-80a4ae1cb875 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1574 microversion: 2.1 time: 0.348510 Oct 31 15:30:12.577747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1678/3453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:12 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1574 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:12.606323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:12.607367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.616498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.617016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.617514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.621312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.623700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.624319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.756202 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9ed7a7f-b331-48f5-bc58-afb735dc261d tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154364 Oct 31 15:30:12.757198 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1679/3454] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:30:12 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:12.769167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:12.769873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:12.770104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:12.770732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.770932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:12.771598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:12.772180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:12.779800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.780139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.780582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.781324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.783967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.784421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.788509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.791110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.795960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.799007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.799686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.800358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.851737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:12.864484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for user 6b1695b4d61d40de8272561b0cf3362e and project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:12.907262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:12.914425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:13.013248 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fa3c959-1d5e-4f87-b452-bad35726d76b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170426 Oct 31 15:30:13.021000 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1776/3455] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:30:13.029160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa895113-e126-4eba-b75a-98428ec50b28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:13.030058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa895113-e126-4eba-b75a-98428ec50b28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:13.595260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa895113-e126-4eba-b75a-98428ec50b28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.615426 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa895113-e126-4eba-b75a-98428ec50b28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1215 microversion: 2.1 time: 0.592450 Oct 31 15:30:13.616090 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1777/3456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:13 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1215 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:13.773878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.782494 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fdbf3256-7841-45fd-9d29-4370dd1c3638 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 1.024235 Oct 31 15:30:13.786990 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1680/3457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:12 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:14.645301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:14.646621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:14.652008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:14.657476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.658290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.658963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.659995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.660756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.662108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.766109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:14.776147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2111ef4-8a08-4df5-84c1-98fcc66f01d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1267 microversion: 2.1 time: 0.137867 Oct 31 15:30:14.796793 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1778/3458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:14 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:14.822379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:14.824900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:14.849527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.850043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.850489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.851215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.855630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.858929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.046548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:15.047190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:15.064093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.065254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.065709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.066436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.066906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.067349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.216286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:15.243219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e1910b3-0f88-45eb-8591-4285049c7d18 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.428080 Oct 31 15:30:15.245683 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1681/3459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:14 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:15.518345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:15.534249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-79046265-0d4a-46dd-8a7b-f32d98fe3c44 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1574 microversion: 2.1 time: 0.492037 Oct 31 15:30:15.537167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1779/3460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:15 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1574 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:15.569697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-566ff556-f12c-410c-8918-9c1e0492d59f req-b0066bd6-0770-4dbd-84f0-d8c4b54e5bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0017d3-d87e-40dd-a09e-f3e0f67504e2", "tag": "3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:15.590524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-566ff556-f12c-410c-8918-9c1e0492d59f req-b0066bd6-0770-4dbd-84f0-d8c4b54e5bb1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.593332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-566ff556-f12c-410c-8918-9c1e0492d59f req-b0066bd6-0770-4dbd-84f0-d8c4b54e5bb1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.594335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-566ff556-f12c-410c-8918-9c1e0492d59f req-b0066bd6-0770-4dbd-84f0-d8c4b54e5bb1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.612134 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-566ff556-f12c-410c-8918-9c1e0492d59f req-b0066bd6-0770-4dbd-84f0-d8c4b54e5bb1 service nova] Creating event network-changed:3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03 for instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 on n-h2-858383-17 Oct 31 15:30:15.618856 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-566ff556-f12c-410c-8918-9c1e0492d59f req-b0066bd6-0770-4dbd-84f0-d8c4b54e5bb1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351835 Oct 31 15:30:15.620683 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1682/3461] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:15.808116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:15.810771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:15.819726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.820648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.821429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.822466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.823109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.823691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.973435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:15.992285 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0953363a-4699-4ae8-b022-c4ac348c222d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1273 microversion: 2.1 time: 0.192081 Oct 31 15:30:16.007203 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1780/3462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:15 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:16.275116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:16.277018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:16.298600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.302275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.302935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.305875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.309843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.311893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.562444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1e3cc751-dc98-4335-8669-f81b95df6b3a req-9fb0c9d7-b1dc-45fe-a286-4e720c44b64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62ea834-5faf-4d9e-936c-884461341dcf", "name": "network-vif-plugged", "status": "completed", "tag": "79160ec8-bdce-46cc-8e82-b616e34e7c71"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:16.614900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e3cc751-dc98-4335-8669-f81b95df6b3a req-9fb0c9d7-b1dc-45fe-a286-4e720c44b64c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.615384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e3cc751-dc98-4335-8669-f81b95df6b3a req-9fb0c9d7-b1dc-45fe-a286-4e720c44b64c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.615813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e3cc751-dc98-4335-8669-f81b95df6b3a req-9fb0c9d7-b1dc-45fe-a286-4e720c44b64c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.645257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1e3cc751-dc98-4335-8669-f81b95df6b3a req-9fb0c9d7-b1dc-45fe-a286-4e720c44b64c service nova] Creating event network-vif-plugged:79160ec8-bdce-46cc-8e82-b616e34e7c71 for instance f62ea834-5faf-4d9e-936c-884461341dcf on n-h1-858383-17 Oct 31 15:30:16.659726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1e3cc751-dc98-4335-8669-f81b95df6b3a req-9fb0c9d7-b1dc-45fe-a286-4e720c44b64c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108916 Oct 31 15:30:16.664280 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1781/3463] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:16.813127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:16.822762 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47202a7c-4881-48f2-a8f4-cf894d9656fb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.553009 Oct 31 15:30:16.845591 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1683/3464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:16 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:17.020885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:17.021589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:17.041649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.048188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.050372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.051145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.053350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.061252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.222385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:17.231404 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e29320e-7af3-4dc6-8bb7-4a3b2ecf8001 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1273 microversion: 2.1 time: 0.214894 Oct 31 15:30:17.232912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1782/3465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:17 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:17.876614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:17.884100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:17.907544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.908042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.913164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.914063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.914721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.915402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.280433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:18.319785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:18.347315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:18.358038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c3bacbf-05d1-4f1b-837e-0c7ac9254b3d tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1198 microversion: 2.1 time: 0.504100 Oct 31 15:30:18.364438 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1684/3466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:17 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1198 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:18.379208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.380846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.381302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.382116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.382494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.383023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.675969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:18.689687 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2681c33e-6295-435e-8084-625dfedc41b9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.430190 Oct 31 15:30:18.702989 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1783/3467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:18 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:19.382172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.383516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:19.391047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:19.393013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.393694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.394190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.395082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.395538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.396141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.610596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:19.620363 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13106b8f-1438-4388-bba7-51d0a3a2ae2f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1381 microversion: 2.1 time: 0.241950 Oct 31 15:30:19.621608 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1685/3468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1381 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:19.625286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.627575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:19.635288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.636052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.636681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.637588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.638869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.639606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.715050 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b11d054-41ff-4bb7-8229-f56923d7ae6d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092875 Oct 31 15:30:19.718317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1784/3469] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:30:19.729021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.729649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:19.748920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.749464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.751120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.751870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.752339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.753044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.859219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.860110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:19.877158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.878764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.880598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.883354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.883756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.884204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.922286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:19.996134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:20.014386 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92fc3292-9ea8-4acb-b1c4-50b87a63e778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.294924 Oct 31 15:30:20.017386 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1785/3470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:20.025349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.029580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.041314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.042154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.042938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.044362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.045102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.045780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.071663 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6dc1926f-6bb6-4cb2-8ddb-d9d4aea3eb3c tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1534 microversion: 2.1 time: 0.422652 Oct 31 15:30:20.072920 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1686/3471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1534 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:20.094914 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2996a13-8c23-456a-9e0e-5d9aa3c1882b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075642 Oct 31 15:30:20.096211 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1786/3472] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:30:20.101035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.102011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.109585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.110112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.110616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.111346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.112082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.112666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.186462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-788010610", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "168936a3-6b27-43dc-9e11-b47c29f17b25"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:20.268767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] validate_networks() for [('168936a3-6b27-43dc-9e11-b47c29f17b25', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:20.428147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4aa2ddaf-1998-4671-acf2-135b8e1cd176 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1534 microversion: 2.1 time: 0.330550 Oct 31 15:30:20.428855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1787/3473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1534 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:20.435574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.436072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.444421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.445168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.445886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.446964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.447684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.448412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.489322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:20.607781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b162966e-a8bd-473a-846d-171c00b355c1 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 204 len: 0 microversion: 2.1 time: 0.176475 Oct 31 15:30:20.614480 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1788/3474] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:20 2022] DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:30:20.622839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-972085f5-bd89-44d8-a878-0846099c9125 req-2c672b8a-8d72-463b-8e4b-a74ad4340226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f713b0-f7f6-4dfb-8eea-6dfd87d0446d", "tag": "bfa30e8d-ee64-455f-93d6-938773d694f8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:20.635692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-972085f5-bd89-44d8-a878-0846099c9125 req-2c672b8a-8d72-463b-8e4b-a74ad4340226 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.636351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-972085f5-bd89-44d8-a878-0846099c9125 req-2c672b8a-8d72-463b-8e4b-a74ad4340226 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.636925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-972085f5-bd89-44d8-a878-0846099c9125 req-2c672b8a-8d72-463b-8e4b-a74ad4340226 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.651988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-972085f5-bd89-44d8-a878-0846099c9125 req-2c672b8a-8d72-463b-8e4b-a74ad4340226 service nova] Creating event network-changed:bfa30e8d-ee64-455f-93d6-938773d694f8 for instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d on n-h2-858383-17 Oct 31 15:30:20.658883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-972085f5-bd89-44d8-a878-0846099c9125 req-2c672b8a-8d72-463b-8e4b-a74ad4340226 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042513 Oct 31 15:30:20.660608 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1789/3475] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:20.673938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.679709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.680454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.681267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.682218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.682894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.683539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.712800 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea99876a-6f09-4559-9fdc-f6f3c41afca2 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.050664 Oct 31 15:30:20.714065 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1790/3476] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:20.728455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.729775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.738604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.739339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.739848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.740630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.741193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.741696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.879562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:20.880052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:20.880725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:20.881139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:20.881695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:20.891285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.891891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.892326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.893075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.893530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.894010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.911730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Getting quotas for project 90dbb6233874476e9923f9cff595f80a. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:20.913381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:20.917294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Getting quotas for user 6b05a66035a749ad8c850bec237dcaf3 and project 90dbb6233874476e9923f9cff595f80a. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:20.921753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d287009b-2214-4f32-b521-02b9d8205fc0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1673 microversion: 2.1 time: 0.197080 Oct 31 15:30:20.922961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1791/3477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:20.928042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-17", "block_migration": false, "disk_over_commit": false}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:20.930978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.941211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.941805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.942316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.943224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.943714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.944145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.946297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:20.948605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:20.948789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:20.974641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lazy-loading 'flavor' on Instance uuid f62ea834-5faf-4d9e-936c-884461341dcf {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:20.991923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Going to try to live migrate instance to n-h2-858383-17 {{(pid=120625) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:30:21.013377 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf95d626-6866-430d-a1ee-1fee44f03c4b tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 0.938278 Oct 31 15:30:21.021242 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1687/3478] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:30:21.028960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6062b922-d927-43d9-a99b-5fe50e9657a2 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:21.029829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6062b922-d927-43d9-a99b-5fe50e9657a2 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:21.097698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6062b922-d927-43d9-a99b-5fe50e9657a2 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.108002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6062b922-d927-43d9-a99b-5fe50e9657a2 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.109538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6062b922-d927-43d9-a99b-5fe50e9657a2 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.110757 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6062b922-d927-43d9-a99b-5fe50e9657a2 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1258 microversion: 2.21 time: 0.088170 Oct 31 15:30:21.116815 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1688/3479] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:21 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:21.116815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:21.117114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:21.125505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.126133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.127673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.127673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.127962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.128438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.337480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.348917 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41f6f7c0-d261-4c8f-9032-98fd29009ef6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.236236 Oct 31 15:30:21.351647 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1689/3480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:21 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:21.949865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:21.952315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:21.961612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.962650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.963321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.964257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.965026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.966305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.138352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.147859 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b01d5e27-b580-4e46-9d5d-67ec2741ed48 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1673 microversion: 2.1 time: 0.204233 Oct 31 15:30:22.148564 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1690/3481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:21 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:22.154145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:22.155039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:22.169942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.170824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.171504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.173499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.174207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.174877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.262485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.278854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.281361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.295482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b206258e-d53c-4ed2-98f8-1ef965356c52 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1262 microversion: 2.21 time: 0.145462 Oct 31 15:30:22.299684 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1691/3482] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:22 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:22.378032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:22.378678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:22.396188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.396785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.400999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.401790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.402769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.404372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.616615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.628614 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a5f14e62-d19d-4029-9bbb-c758ed54d2fc tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.258818 Oct 31 15:30:22.632801 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1692/3483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:22 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:23.027026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c09d10f9-b83f-40d1-9e6d-77c42c6b6f04 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf/action" status: 202 len: 0 microversion: 2.1 time: 2.099364 Oct 31 15:30:23.031844 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1792/3484] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:20 2022] POST /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf/action => generated 0 bytes in 2107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:23.037813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.039221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.051248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.051745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.052185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.052932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.053389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.054034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.179935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.180935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.190653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.191137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.191803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.192508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.192995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.193419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.347606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.364336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-99f779b4-1ff6-4350-8be6-a72b981300ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.331809 Oct 31 15:30:23.365582 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1693/3485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:23.371568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.372459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.378843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.379329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.379793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.380485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.381270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.382456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.525453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.538529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.539915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.545601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.547724 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-19d350fe-bfa6-4a56-b110-d0a4e9a20ade tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1310 microversion: 2.21 time: 0.180918 Oct 31 15:30:23.547968 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-512d94f9-8be2-4a7c-8766-79df0fc00f46 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1673 microversion: 2.1 time: 0.373073 Oct 31 15:30:23.549143 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1694/3486] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:23.553111 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1793/3487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1673 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:23.652542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.653943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.668375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.669879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.670958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.683782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.684562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.685420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.035204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:24.045177 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bb1aca70-50c9-4c36-a946-9559a518bc6a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.396606 Oct 31 15:30:24.046244 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1695/3488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:24.387337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:24.388283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:24.405806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:24.409195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.409889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.410585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.411681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.412317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.412833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.571877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:24.572509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:24.583954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.584454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.586440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.589614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.590302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.591573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.012101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.021282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5822a1e8-e4e9-49b5-9ced-a332af111730 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1606 microversion: 2.1 time: 0.453665 Oct 31 15:30:25.036933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1696/3489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:24 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1606 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:25.036933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:25.036933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.037921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.038614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.039246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.040130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.040772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.041368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.172864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.190162 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9714ccc5-d449-4834-8b5a-3729272049bc tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.806607 Oct 31 15:30:25.193964 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1794/3490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:24 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:25.204117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:25.206997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.211812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.220442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.220974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.221420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.222135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.222488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.222629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.223003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.229084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.230556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a780f320-6bea-40ea-bdf8-391f6b270ace tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1316 microversion: 2.21 time: 0.207727 Oct 31 15:30:25.253637 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1697/3491] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:25.258757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b5bc8fee-fb8b-4709-af6b-42f9fa4fedd7 req-7bfc78bf-7573-46cd-a8bf-9775db062b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6e134c-8818-4583-85a2-0b63c8516203", "name": "network-vif-deleted", "tag": "5703f7d4-20c1-4300-8fe7-704ac6c4c6e0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:25.275290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b5bc8fee-fb8b-4709-af6b-42f9fa4fedd7 req-7bfc78bf-7573-46cd-a8bf-9775db062b79 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.276199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b5bc8fee-fb8b-4709-af6b-42f9fa4fedd7 req-7bfc78bf-7573-46cd-a8bf-9775db062b79 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.276879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b5bc8fee-fb8b-4709-af6b-42f9fa4fedd7 req-7bfc78bf-7573-46cd-a8bf-9775db062b79 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.304188 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b5bc8fee-fb8b-4709-af6b-42f9fa4fedd7 req-7bfc78bf-7573-46cd-a8bf-9775db062b79 service nova] Creating event network-vif-deleted:5703f7d4-20c1-4300-8fe7-704ac6c4c6e0 for instance dd6e134c-8818-4583-85a2-0b63c8516203 on n-h1-858383-17 Oct 31 15:30:25.312975 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b5bc8fee-fb8b-4709-af6b-42f9fa4fedd7 req-7bfc78bf-7573-46cd-a8bf-9775db062b79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057568 Oct 31 15:30:25.313590 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1698/3492] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:25.601081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.610256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9206253a-a025-481e-8579-d5b30d015198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.414501 Oct 31 15:30:25.610838 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1795/3493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:26.051503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.054176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.072895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.073902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.093678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.095278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.098205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.098880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.207282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.207677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.208315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.208963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lazy-loading 'fault' on Instance uuid dd6e134c-8818-4583-85a2-0b63c8516203 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:26.222038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.223022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.240326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.242052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.243396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.245199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.247767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.248496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.419563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf304336d1f2420db7a197a36036ccab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a6d9faf79449b7bdd9b287186c792e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.433312 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4942806f-5581-4b6d-9dc1-e987bd55264d tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 200 len: 1327 microversion: 2.1 time: 0.388775 Oct 31 15:30:26.436067 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1699/3494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 1327 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:26.444014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.444637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.484013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.484572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.485068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.485824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.486293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.486724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.888556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.900275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.901754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.902880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0635f1eb-fa61-4f47-8feb-10b8f6bc8e16 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.465809 Oct 31 15:30:26.924017 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1700/3495] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:26.924231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.930024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-83b0b17f-0efb-4300-903d-78ea250de3b9 req-70413a67-4d77-4571-83ff-7068be7bd977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f713b0-f7f6-4dfb-8eea-6dfd87d0446d", "name": "network-vif-plugged", "status": "completed", "tag": "bfa30e8d-ee64-455f-93d6-938773d694f8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:26.937590 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-497563a1-836a-4739-a038-fce62c0164af tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.724818 Oct 31 15:30:26.939400 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1796/3496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:26.955226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-83b0b17f-0efb-4300-903d-78ea250de3b9 req-70413a67-4d77-4571-83ff-7068be7bd977 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.956510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-83b0b17f-0efb-4300-903d-78ea250de3b9 req-70413a67-4d77-4571-83ff-7068be7bd977 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.957344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-83b0b17f-0efb-4300-903d-78ea250de3b9 req-70413a67-4d77-4571-83ff-7068be7bd977 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.966428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.970134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.979964 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-83b0b17f-0efb-4300-903d-78ea250de3b9 req-70413a67-4d77-4571-83ff-7068be7bd977 service nova] Creating event network-vif-plugged:bfa30e8d-ee64-455f-93d6-938773d694f8 for instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d on n-h2-858383-17 Oct 31 15:30:26.981505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.982326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.983003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.983728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.984264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.984749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.989020 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-83b0b17f-0efb-4300-903d-78ea250de3b9 req-70413a67-4d77-4571-83ff-7068be7bd977 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074636 Oct 31 15:30:26.999259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1701/3497] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:27.288403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:27.297463 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8f66af8-9f31-4b26-993b-0cbd2f71b68e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.355848 Oct 31 15:30:27.298049 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1797/3498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:27.353952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a4ed0a2e-d948-42c7-99e0-87ac316c3589 req-f50b6c18-cf1b-4879-ab4d-aed038714fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7910b6c-374f-4fa4-9f54-ad44bf0f5e34", "tag": "79c92674-955d-4524-891e-d0be36f30c78"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:27.366214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4ed0a2e-d948-42c7-99e0-87ac316c3589 req-f50b6c18-cf1b-4879-ab4d-aed038714fbe service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.366689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4ed0a2e-d948-42c7-99e0-87ac316c3589 req-f50b6c18-cf1b-4879-ab4d-aed038714fbe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.367149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a4ed0a2e-d948-42c7-99e0-87ac316c3589 req-f50b6c18-cf1b-4879-ab4d-aed038714fbe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.378926 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a4ed0a2e-d948-42c7-99e0-87ac316c3589 req-f50b6c18-cf1b-4879-ab4d-aed038714fbe service nova] Creating event network-changed:79c92674-955d-4524-891e-d0be36f30c78 for instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 on n-h1-858383-17 Oct 31 15:30:27.383855 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a4ed0a2e-d948-42c7-99e0-87ac316c3589 req-f50b6c18-cf1b-4879-ab4d-aed038714fbe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035491 Oct 31 15:30:27.384676 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1702/3499] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:27.461794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:27.462530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:27.473890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.474383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.474951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.475674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.476135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.476563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.492180 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] HTTP exception thrown: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Request method failure captured: Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 HTTP/1.1 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-hcrAkXEBIlg7Xu2_GzaS03lxxL3bOkq0s0Sj4eQgeW6Ie8PHLwL1P9Tqm-bDIvoZHmgNc1oWabNtbOZnIKL3BXp7mG5f6DiNp9fPLwEcv_2KOkFHE3X6eWr8r1MFLsNi01zhKzGufVxmIEJCutAA5-GPoY_QxxDTBwaeZQJS8xFjA Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bf304336d1f2420db7a197a36036ccab Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'dd6e134c-8818-4583-85a2-0b63c8516203'} Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:27.494259 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Returning 404 to user: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5290d65-b5cb-4eaa-986c-388c8172c61b tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 404 len: 111 microversion: 2.1 time: 0.037776 Oct 31 15:30:27.498888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1798/3500] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:27 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:27.504996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-566824c7-5859-449f-bf90-426efd4edad0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '.version_select at 0x7f5ca1262670>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:27.525624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-566824c7-5859-449f-bf90-426efd4edad0 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351931166" status: 202 len: 0 microversion: 2.1 time: 0.024652 Oct 31 15:30:27.526266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1703/3501] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1351931166 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:27.946122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:27.947373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:27.954530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.955025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.955464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.956264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.956793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.957181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.970528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:27.971743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:27.978318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.979043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.979709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.980609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.982360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.983123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.259894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.277742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.279750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.281235 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0891eb1-8ab7-4a54-a564-c8975360ab68 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.339167 Oct 31 15:30:28.281831 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1799/3502] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:27 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:28.298588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.301662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.302169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.318516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.319022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.319496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.320200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.320653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.321106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.329964 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-72a740d9-8363-4d52-9969-d572da689617 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.364191 Oct 31 15:30:28.334282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1704/3503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:27 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.339931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.345738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.363939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.364435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.364907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.368344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.368861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.369297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.372525 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f129cdd3-0e2c-4fea-98e7-73aa49e520ee tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments/894d1c99-a718-4d70-8a8d-92e954a73387" status: 200 len: 194 microversion: 2.20 time: 0.088398 Oct 31 15:30:28.379041 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1800/3504] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Oct 31 15:30:28 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments/894d1c99-a718-4d70-8a8d-92e954a73387 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:28.478664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.479272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.486272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.494491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.495295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.496112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.497844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.500728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.623488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.641484 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7207abf8-3900-4cb1-a922-a6b21d19b60c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1315 microversion: 2.1 time: 0.305636 Oct 31 15:30:28.659204 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1705/3505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:28 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.691191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lazy-loading 'services' on Instance uuid b15880e4-0725-4b00-bb5d-99fea0b93694 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:28.780056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b84f9d97-5ed7-4862-affd-9f356a60ae08 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments/894d1c99-a718-4d70-8a8d-92e954a73387" status: 202 len: 0 microversion: 2.20 time: 0.305357 Oct 31 15:30:28.780813 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1801/3506] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Oct 31 15:30:28 2022] DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments/894d1c99-a718-4d70-8a8d-92e954a73387 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:30:28.789537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.792220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.800776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.801776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.802410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.803678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.804351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.804913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.843668 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc89f23c-bec7-455c-a6f4-edeb33a9d505 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058299 Oct 31 15:30:28.849237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1706/3507] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:28 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:30:29.308457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.309219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.315767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.316249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.316684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.317447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.317906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.318326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.359562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.360364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.367773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.368347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.368899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.369668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.370338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.370971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.394215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:29.517250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.528951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.531575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.533660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21002cfc-eca6-4e24-b79a-8295f6384355 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.229948 Oct 31 15:30:29.534640 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1802/3508] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:29.547190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.555840 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8ad6272-cfba-430b-9078-8f9172fded5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.200394 Oct 31 15:30:29.556420 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1707/3509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:29.670777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.671393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.677472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.677962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.678403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.679129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.679604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.680033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.813792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.821743 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-280ef529-609b-44dc-a425-858a1f553a48 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1502 microversion: 2.1 time: 0.155384 Oct 31 15:30:29.822310 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1803/3510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:29.845764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7816b62-ac65-4259-bbc2-d8893e18f1f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:29.852063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7816b62-ac65-4259-bbc2-d8893e18f1f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.852607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7816b62-ac65-4259-bbc2-d8893e18f1f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.853084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7816b62-ac65-4259-bbc2-d8893e18f1f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.857739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.860112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.866044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.866958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.866958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.867637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.868100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.868581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.875979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7816b62-ac65-4259-bbc2-d8893e18f1f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Going to try to stop instance {{(pid=120626) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:30:29.904202 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab69d9a8-dd68-479b-b79a-afd2f3ddb805 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050633 Oct 31 15:30:29.905049 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1804/3511] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:30:29.926343 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7816b62-ac65-4259-bbc2-d8893e18f1f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d/action" status: 202 len: 0 microversion: 2.1 time: 0.085334 Oct 31 15:30:29.927292 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1708/3512] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:29 2022] POST /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:29.936246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.937034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.943757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.944498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.945148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.946018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.946639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.947215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.206744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.218144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4fce879c-b3be-4ec2-9f28-2250bbd1278d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.285923 Oct 31 15:30:30.219098 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1805/3513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:30.563407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.564117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.572055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.572853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.573928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.574973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.575661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.576349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.578921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.579541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.590946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.591781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.591887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.595501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.596221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.598450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.694473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:30.858300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.864925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.867103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.868722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:30.869123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.870539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0c66f76b-a1e7-44c6-95e2-3c39151d6ae4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.312892 Oct 31 15:30:30.871391 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1709/3514] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:30.879127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4ca5f57-0f58-4d18-8d01-1f5bb2f472dd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.303904 Oct 31 15:30:30.883721 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1806/3515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:30.918192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.921499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.923776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:30.931488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.931488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.931488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.931488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.931985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.932190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.964457 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a04b2272-9aae-408c-a908-65e544c7d901 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050477 Oct 31 15:30:30.965070 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1710/3516] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:31.247764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:31.248388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.255202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.255940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.256558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.257314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.257772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.258439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.410953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:31.420830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-320404ce-babb-45e1-ba62-4a627e3fc0f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.181211 Oct 31 15:30:31.435384 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1807/3517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:31 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:31.898503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:31.899815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.903792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:31.904371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.907252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:31.910521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.911269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.912065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.912583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.913313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.913443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.913889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.914322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.914947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.915154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.915771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.916728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.141816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.151205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.156204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.157716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.158825 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ea63c1a-c6c1-41d8-a7b3-da1b5cacc8d7 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.264689 Oct 31 15:30:32.175154 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1711/3518] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:31 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:32.181898 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4c5a590-f7d2-434a-9508-504239938599 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.283244 Oct 31 15:30:32.182163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.182878 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1808/3519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:31 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:32.184425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.190876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.191585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.192180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.193072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.193683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.194263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.226327 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-83bc5b74-bc7a-458d-a035-eea81a37dce0 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048449 Oct 31 15:30:32.227043 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1712/3520] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:32.445978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.446788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.453392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.453914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.454321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.455029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.455488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.455916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.616346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.627421 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-931a9483-cbb3-4a8b-b456-773f1b77c142 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.185610 Oct 31 15:30:32.631051 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1809/3521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:33.187912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.189190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.196862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.197654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.198255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.199188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.200564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.206441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.207724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.213783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.221807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.222577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.224311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.225286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.226391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.227449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.517972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.522822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.532956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.534997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.536548 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-66b2b336-df3f-4182-909b-03dbd06395dd tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.353367 Oct 31 15:30:33.538619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1713/3522] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:33.543562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.548125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.554855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.556670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.558823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.561007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.562284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.563392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.564911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9970df3e-a8de-400a-a249-960e894ae65c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.362680 Oct 31 15:30:33.577412 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1810/3523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:33.608199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c78e56d8-5da8-4a0e-9cf2-2f42bdd24d5d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068158 Oct 31 15:30:33.610135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1714/3524] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:33.652575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.653511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.665430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.667744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.668371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.670158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.671779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.672328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.783996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-aa2ba17c-da0b-4dba-b2de-0836b11d3c29 req-a509fbca-9a96-48a4-bcfa-6b49cd88f6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7910b6c-374f-4fa4-9f54-ad44bf0f5e34", "name": "network-vif-plugged", "status": "completed", "tag": "79c92674-955d-4524-891e-d0be36f30c78"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:33.803539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-aa2ba17c-da0b-4dba-b2de-0836b11d3c29 req-a509fbca-9a96-48a4-bcfa-6b49cd88f6c3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.804404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-aa2ba17c-da0b-4dba-b2de-0836b11d3c29 req-a509fbca-9a96-48a4-bcfa-6b49cd88f6c3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.805122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-aa2ba17c-da0b-4dba-b2de-0836b11d3c29 req-a509fbca-9a96-48a4-bcfa-6b49cd88f6c3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.823882 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-aa2ba17c-da0b-4dba-b2de-0836b11d3c29 req-a509fbca-9a96-48a4-bcfa-6b49cd88f6c3 service nova] Creating event network-vif-plugged:79c92674-955d-4524-891e-d0be36f30c78 for instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 on n-h1-858383-17 Oct 31 15:30:33.834127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-aa2ba17c-da0b-4dba-b2de-0836b11d3c29 req-a509fbca-9a96-48a4-bcfa-6b49cd88f6c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255168 Oct 31 15:30:33.834978 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1811/3525] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:33.922643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.935265 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa226eea-51e4-4176-8890-d9363426c264 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.287726 Oct 31 15:30:33.940267 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1715/3526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:34.569003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.570273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.580666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.581526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.582058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.583044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.583673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.584501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.595168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.596460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.605337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.606210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.606904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.607839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.608935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.609599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.819364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.836087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.839223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.848220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-739c5add-00d9-4c26-a2fe-1d5131d09139 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1358 microversion: 2.21 time: 0.280239 Oct 31 15:30:34.860969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.861962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1812/3527] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:34.873854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.877498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.882893 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-754ebd95-b0ee-4192-8a11-d18a05fe266e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.293291 Oct 31 15:30:34.885265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.885706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.885942 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1716/3528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:34.886295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.887018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.887560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.888251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.931829 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97663a3a-f401-4ed3-b3cc-be1715b5b81d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068624 Oct 31 15:30:34.933084 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1813/3529] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:34.963133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.964112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.971532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.972025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.972461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.973245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.973677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.974107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.118677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:35.127778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f4c04c02-a566-4112-bf79-44a186c555e2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.168629 Oct 31 15:30:35.128357 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1717/3530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:35.877676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:35.879053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:35.887896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.888633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.890174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.891004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.891470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.891897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.908950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:35.910656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:35.921431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.922189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.923776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.925527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.926310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.926996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.123431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.133978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.135874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.138500 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a1f0410-a717-4f58-8847-3804258b5452 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1551 microversion: 2.21 time: 0.263998 Oct 31 15:30:36.140179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1814/3531] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:35 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1551 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:36.147717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:36.152641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.158471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:36.165704 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57c944ce-0f53-462b-8ca3-22f61e30f19a tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.261416 Oct 31 15:30:36.173897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.176219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.176915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.177759 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1718/3532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:35 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:36.177912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.178485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.179007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.183226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:36.185184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:36.193462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.194433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.194626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.195620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.195986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.196529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.215150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f3830a4-0380-4c36-920d-7ce0314b09e5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073045 Oct 31 15:30:36.215150 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1815/3533] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:36 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:36.221178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:36.221178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:36.227328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.230084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.230084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.231185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.231887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.232539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.268975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:36.389130 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc1dd253-534f-4fa3-927b-0d32b9fc0a67 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 204 len: 0 microversion: 2.21 time: 0.172293 Oct 31 15:30:36.391248 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1816/3534] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:30:36 2022] DELETE /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:30:36.404910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:36.405708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:36.412534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.414365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.414818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.415534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.417163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.417605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.420725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.430784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-779e5143-46b4-4de7-ba1e-7353c6dd4733 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.250678 Oct 31 15:30:36.431958 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1719/3535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:36 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:36.569421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.578423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.579573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.581658 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85687d9f-5523-4c67-be86-04a6616cf73a tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1557 microversion: 2.21 time: 0.183549 Oct 31 15:30:36.582237 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1817/3536] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:36 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1557 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:36.916885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c82546e0-ef9c-4504-aadf-bf871365feb3 req-9d7deea5-110e-4022-8648-0fee43398852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62ea834-5faf-4d9e-936c-884461341dcf", "name": "network-vif-unplugged", "status": "completed", "tag": "79160ec8-bdce-46cc-8e82-b616e34e7c71"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:36.929363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c82546e0-ef9c-4504-aadf-bf871365feb3 req-9d7deea5-110e-4022-8648-0fee43398852 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.929984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c82546e0-ef9c-4504-aadf-bf871365feb3 req-9d7deea5-110e-4022-8648-0fee43398852 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.930662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c82546e0-ef9c-4504-aadf-bf871365feb3 req-9d7deea5-110e-4022-8648-0fee43398852 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.947906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c82546e0-ef9c-4504-aadf-bf871365feb3 req-9d7deea5-110e-4022-8648-0fee43398852 service nova] Creating event network-vif-unplugged:79160ec8-bdce-46cc-8e82-b616e34e7c71 for instance f62ea834-5faf-4d9e-936c-884461341dcf on n-h1-858383-17 Oct 31 15:30:36.955157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c82546e0-ef9c-4504-aadf-bf871365feb3 req-9d7deea5-110e-4022-8648-0fee43398852 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043577 Oct 31 15:30:36.956241 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1720/3537] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:37.194973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.197440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.208808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.209969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.211110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.212190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.212656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.213109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.237108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.239400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.255904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.256620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.257291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.258158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.258774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.259362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.304098 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e99eb103-9230-4963-8c0b-89f2bbd47f62 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.078398 Oct 31 15:30:37.304920 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1721/3538] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:37.401290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.402036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.417222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.417718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.418229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.419013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.419458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.419883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.439964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.457092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a31c4468-b5dd-4f44-8d00-3220da27c764 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.269369 Oct 31 15:30:37.459353 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1818/3539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:37.464109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.465188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.479032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:37.481206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.481707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.482259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.482944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.483397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.483824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.544978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:37.598588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:37.617587 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8453dc73-0d36-49a4-9f0b-9bb219e27753 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 204 len: 0 microversion: 2.20 time: 0.220188 Oct 31 15:30:37.622320 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1722/3540] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:30:37 2022] DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:30:37.642123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.642985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.652490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.653486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.654574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.655833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.656790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.657606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.775547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.787590 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87fed341-337a-4218-9e69-f27b9142f3cd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.326970 Oct 31 15:30:37.807047 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1819/3541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:37.816313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.817362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.832214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:37.837439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.841731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.843531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.844501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.845009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.845443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.859083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.871836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.874333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.876241 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-15b2754d-1568-4eb5-9757-97a680c8f6d4 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1557 microversion: 2.21 time: 0.243836 Oct 31 15:30:37.877250 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1723/3542] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1557 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:38.033249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:38.047875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:38.049386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:38.050934 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f52ea0a1-57fb-4e4b-a92f-e602db583115 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.242454 Oct 31 15:30:38.061073 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1820/3543] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:38.488411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.489202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.498427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.499159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.499758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.500473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.500979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.501415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.719588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:38.731504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6a003c2-e25d-4ade-ab8e-9343d7bd73cb tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.248610 Oct 31 15:30:38.731504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1724/3544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:38 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:38.821324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.822695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.834680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.836422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.837089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.838047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.838660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.839295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.941063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.942546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.964446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.967375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.971877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.972852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.973451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.974012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.169216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.194586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.202447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.208404 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0b30888-82aa-495a-8caa-d90dd1aba238 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1515 microversion: 2.21 time: 0.302102 Oct 31 15:30:39.209743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1725/3545] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:38 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:39.232761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a615b498-7ab2-4da4-b05f-40c009143eb1 req-7969923b-e101-424d-842a-6219ed332ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f62ea834-5faf-4d9e-936c-884461341dcf", "tag": "79160ec8-bdce-46cc-8e82-b616e34e7c71"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:39.233737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.251945 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1aabaa77-6b4e-4ac8-a7b4-65aeeb219778 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.435002 Oct 31 15:30:39.260113 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1821/3546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:38 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:39.272543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.274249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.287791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.288728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.290149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a615b498-7ab2-4da4-b05f-40c009143eb1 req-7969923b-e101-424d-842a-6219ed332ac5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.290763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.291701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a615b498-7ab2-4da4-b05f-40c009143eb1 req-7969923b-e101-424d-842a-6219ed332ac5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.292984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.294227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a615b498-7ab2-4da4-b05f-40c009143eb1 req-7969923b-e101-424d-842a-6219ed332ac5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.294742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.296324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.321969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:39.322560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a615b498-7ab2-4da4-b05f-40c009143eb1 req-7969923b-e101-424d-842a-6219ed332ac5 service nova] Creating event network-changed:79160ec8-bdce-46cc-8e82-b616e34e7c71 for instance f62ea834-5faf-4d9e-936c-884461341dcf on n-h1-858383-17 Oct 31 15:30:39.338681 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a615b498-7ab2-4da4-b05f-40c009143eb1 req-7969923b-e101-424d-842a-6219ed332ac5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127167 Oct 31 15:30:39.339457 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1726/3547] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:39.345884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5f3af132-3b83-4173-a16e-b4d9ad079bd1 req-fd430314-3a92-4595-9ccb-694e54fd4e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7910b6c-374f-4fa4-9f54-ad44bf0f5e34", "name": "network-vif-deleted", "tag": "79c92674-955d-4524-891e-d0be36f30c78"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:39.358770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5f3af132-3b83-4173-a16e-b4d9ad079bd1 req-fd430314-3a92-4595-9ccb-694e54fd4e38 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.360327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5f3af132-3b83-4173-a16e-b4d9ad079bd1 req-fd430314-3a92-4595-9ccb-694e54fd4e38 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.361418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5f3af132-3b83-4173-a16e-b4d9ad079bd1 req-fd430314-3a92-4595-9ccb-694e54fd4e38 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.376755 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5f3af132-3b83-4173-a16e-b4d9ad079bd1 req-fd430314-3a92-4595-9ccb-694e54fd4e38 service nova] Creating event network-vif-deleted:79c92674-955d-4524-891e-d0be36f30c78 for instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 on n-h1-858383-17 Oct 31 15:30:39.392854 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5f3af132-3b83-4173-a16e-b4d9ad079bd1 req-fd430314-3a92-4595-9ccb-694e54fd4e38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041229 Oct 31 15:30:39.394514 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1727/3548] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:39.401047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.401765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.423253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.425654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.426420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.427480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.428248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.428858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.451595 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] HTTP exception thrown: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Request method failure captured: Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 HTTP/1.1 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-hcrAkXEBIlg7Xu2_GzaS03lxxL3bOkq0s0Sj4eQgeW6Ie8PHLwL1P9Tqm-bDIvoZHmgNc1oWabNtbOZnIKL3BXp7mG5f6DiNp9fPLwEcv_2KOkFHE3X6eWr8r1MFLsNi01zhKzGufVxmIEJCutAA5-GPoY_QxxDTBwaeZQJS8xFjA Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bf304336d1f2420db7a197a36036ccab Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'dd6e134c-8818-4583-85a2-0b63c8516203'} Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:39.459846 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Returning 404 to user: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:39.464774 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0f6257b-9a01-4992-b78f-ebe188aab50f tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 404 len: 111 microversion: 2.1 time: 0.066870 Oct 31 15:30:39.468994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1728/3549] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:39 2022] DELETE /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:39.474558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.475384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: dd6e134c-8818-4583-85a2-0b63c8516203] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.485257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.486220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.491326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.492185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.492883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.493832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.513847 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] HTTP exception thrown: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Request method failure captured: Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 HTTP/1.1 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-hcrAkXEBIlg7Xu2_GzaS03lxxL3bOkq0s0Sj4eQgeW6Ie8PHLwL1P9Tqm-bDIvoZHmgNc1oWabNtbOZnIKL3BXp7mG5f6DiNp9fPLwEcv_2KOkFHE3X6eWr8r1MFLsNi01zhKzGufVxmIEJCutAA5-GPoY_QxxDTBwaeZQJS8xFjA Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bf304336d1f2420db7a197a36036ccab Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'dd6e134c-8818-4583-85a2-0b63c8516203'} Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.515387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Returning 404 to user: Instance dd6e134c-8818-4583-85a2-0b63c8516203 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02105ee4-ccba-4a40-b2c9-18524eef1b4a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203" status: 404 len: 111 microversion: 2.1 time: 0.046637 Oct 31 15:30:39.519694 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1729/3550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/dd6e134c-8818-4583-85a2-0b63c8516203 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:39.756972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.757885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.771985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.772484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.772960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.773671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.781164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.781564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.834372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.850666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.852102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.854320 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8841eff0-a0b6-4095-b9c5-2b520c14f618 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1723 microversion: 2.20 time: 0.592993 Oct 31 15:30:39.854885 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1822/3551] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:39.994581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:40.009530 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea006623-b1fb-4b5d-a7df-b61f0ab20624 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.256744 Oct 31 15:30:40.020735 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1730/3552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:40.240537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:40.241183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:40.248899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:40.251599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:40.253618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:40.254656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:40.259494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:40.260028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:40.290607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:40.292208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:40.318521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:40.319092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:40.319544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:40.320281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:40.320771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:40.321205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:40.376492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:40.377293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:40.377900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:40.380339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lazy-loading 'fault' on Instance uuid f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:41.187425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.201165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.207319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b05a66035a749ad8c850bec237dcaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90dbb6233874476e9923f9cff595f80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.208565 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5342192e-0da9-427c-83c6-a9e10f2d7143 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 200 len: 1348 microversion: 2.21 time: 0.971977 Oct 31 15:30:41.216793 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1823/3553] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:40 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 1348 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:41.228743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:41.229603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:41.237201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.241454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.242117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.243053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.243672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.245607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.508160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.518173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.525003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.526425 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-664db239-2178-4d72-bce6-c96d5fc85f26 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 200 len: 1655 microversion: 2.20 time: 0.308256 Oct 31 15:30:41.532741 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1824/3554] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:41 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 1655 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:41.559608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:41.560748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:41.570280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.571192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.571867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.572857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.573936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.575182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.802256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.823774 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2225792-ab27-4bbe-977d-af6dbe3ffb4a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 1.537644 Oct 31 15:30:41.835316 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1731/3555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:40 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:41.961269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a3a96c2e-aa6d-44bd-b56a-42b45f06b43d req-657fde0b-311b-41b3-ab9c-a0bb4a6d2dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b15880e4-0725-4b00-bb5d-99fea0b93694", "name": "network-vif-deleted", "tag": "1804f6ca-7e67-42f9-8420-b357cd9d3396"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:41.985305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3a96c2e-aa6d-44bd-b56a-42b45f06b43d req-657fde0b-311b-41b3-ab9c-a0bb4a6d2dc3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.986228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3a96c2e-aa6d-44bd-b56a-42b45f06b43d req-657fde0b-311b-41b3-ab9c-a0bb4a6d2dc3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.986843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a3a96c2e-aa6d-44bd-b56a-42b45f06b43d req-657fde0b-311b-41b3-ab9c-a0bb4a6d2dc3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.008667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:42.016894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a3a96c2e-aa6d-44bd-b56a-42b45f06b43d req-657fde0b-311b-41b3-ab9c-a0bb4a6d2dc3 service nova] Creating event network-vif-deleted:1804f6ca-7e67-42f9-8420-b357cd9d3396 for instance b15880e4-0725-4b00-bb5d-99fea0b93694 on n-h2-858383-17 Oct 31 15:30:42.022888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce220fa4-4068-45d5-8169-f47b0a9173b6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.469273 Oct 31 15:30:42.024433 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a3a96c2e-aa6d-44bd-b56a-42b45f06b43d req-657fde0b-311b-41b3-ab9c-a0bb4a6d2dc3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187547 Oct 31 15:30:42.025680 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1825/3556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:41 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:42.027466 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1732/3557] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:42.256800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.258168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.281695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.284109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.284775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.288133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.288654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.289099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.324623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] HTTP exception thrown: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Request method failure captured: Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 HTTP/1.1 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-oLoZxXg1eV5jpcJTyTuuNLeMjkBPbh3KRRgpCAYQZjNUCyMPoA6Ho_O1wa-QTs5gLCFJyn4KF_RxcvKhEIIKQDNYyOX6rZtM4JdEpWw-vluVbqH4MxF_-lIwR1Xh-nlyV2gTFmQ9pFf9QPAdSNgtrxyQcQKOcWjGwPU7nNNWyq2ZE Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 90dbb6233874476e9923f9cff595f80a Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_90dbb6233874476e9923f9cff595f80a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 90dbb6233874476e9923f9cff595f80a Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-InstanceActionsV221TestJSON-347687213-project Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6b05a66035a749ad8c850bec237dcaf3 Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-InstanceActionsV221TestJSON-347687213-project Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f7910b6c-374f-4fa4-9f54-ad44bf0f5e34'} Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.327518 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.332230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.335848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Returning 404 to user: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:42.337340 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-034c8648-abad-4309-bc73-3936a8eeb647 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 404 len: 111 microversion: 2.21 time: 0.091651 Oct 31 15:30:42.338603 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1826/3558] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:42 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:30:42.349315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '.version_select at 0x7f5ca12f8040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.350109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.361349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.361737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.362184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.362911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.363373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.363804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.521741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-430cede0-4ac6-465d-8439-492bda36aa83 tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.176871 Oct 31 15:30:42.522327 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1733/3559] 10.222.0.48 () {60 vars in 1337 bytes} [Mon Oct 31 15:30:42 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34/os-instance-actions => generated 611 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:30:42.551095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.560259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.560950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.567572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.568738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.569237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.569676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.570377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.570834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.571259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.585483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.586616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.597242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.598126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.598854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.599470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.603466 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] HTTP exception thrown: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Request method failure captured: Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 HTTP/1.1 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-k_ZVTrXxQz0rCV_-d9Xk14Lr5dwuanE5FW_rKGEAtlba7ihkMci4COAa67MdPhZXLt0_ha7UkXO8lyzHeylQG_PUMA3wwgmNYZst5KsLD7nCJrArrU3rsiipDm0NJ8Bv2UE6RNFn35OAcO1QrNm268MvXNaQNZaEePKlNU96S6GZA Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 58b6ccb6f0514e0991864ec6a6417b45 Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b15880e4-0725-4b00-bb5d-99fea0b93694'} Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.605486 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:30:42.610516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.611850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Returning 404 to user: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:42.612904 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8e716df-8e16-48af-b834-5379b82a2c94 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 404 len: 111 microversion: 2.20 time: 0.057392 Oct 31 15:30:42.617181 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1734/3560] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:42 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:30:42.622348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93386769-7548-402d-8ec3-83608906cbfd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '.version_select at 0x7f5ca11f1280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.630846 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] HTTP exception thrown: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Request method failure captured: Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 HTTP/1.1 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-oLoZxXg1eV5jpcJTyTuuNLeMjkBPbh3KRRgpCAYQZjNUCyMPoA6Ho_O1wa-QTs5gLCFJyn4KF_RxcvKhEIIKQDNYyOX6rZtM4JdEpWw-vluVbqH4MxF_-lIwR1Xh-nlyV2gTFmQ9pFf9QPAdSNgtrxyQcQKOcWjGwPU7nNNWyq2ZE Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 90dbb6233874476e9923f9cff595f80a Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_90dbb6233874476e9923f9cff595f80a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 90dbb6233874476e9923f9cff595f80a Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-InstanceActionsV221TestJSON-347687213-project Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6b05a66035a749ad8c850bec237dcaf3 Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-InstanceActionsV221TestJSON-347687213-project Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f7910b6c-374f-4fa4-9f54-ad44bf0f5e34'} Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:42.632405 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.638202 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.645869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Returning 404 to user: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:42.646980 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0065d6d-b0c9-49f4-8897-8767fa06ed0c tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 404 len: 111 microversion: 2.21 time: 0.109892 Oct 31 15:30:42.647714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1827/3561] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:30:42 2022] DELETE /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:30:42.658351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.661588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] [instance: f7910b6c-374f-4fa4-9f54-ad44bf0f5e34] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.681418 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93386769-7548-402d-8ec3-83608906cbfd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-813852773" status: 204 len: 0 microversion: 2.20 time: 0.061512 Oct 31 15:30:42.683732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1735/3562] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Oct 31 15:30:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-813852773 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:30:42.689884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.690398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.690841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.691562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.692489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.693210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.729670 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] HTTP exception thrown: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Request method failure captured: Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 HTTP/1.1 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-oLoZxXg1eV5jpcJTyTuuNLeMjkBPbh3KRRgpCAYQZjNUCyMPoA6Ho_O1wa-QTs5gLCFJyn4KF_RxcvKhEIIKQDNYyOX6rZtM4JdEpWw-vluVbqH4MxF_-lIwR1Xh-nlyV2gTFmQ9pFf9QPAdSNgtrxyQcQKOcWjGwPU7nNNWyq2ZE Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 90dbb6233874476e9923f9cff595f80a Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_90dbb6233874476e9923f9cff595f80a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/90dbb6233874476e9923f9cff595f80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 90dbb6233874476e9923f9cff595f80a Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-347687213 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-InstanceActionsV221TestJSON-347687213-project Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6b05a66035a749ad8c850bec237dcaf3 Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-InstanceActionsV221TestJSON-347687213-project Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f7910b6c-374f-4fa4-9f54-ad44bf0f5e34'} Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.731317 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:42.738708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] Returning 404 to user: Instance f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:42.745746 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f02fb82-2df1-48cd-8436-aa9fa0871d3d tempest-InstanceActionsV221TestJSON-347687213 tempest-InstanceActionsV221TestJSON-347687213-project] 10.222.0.48 "GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34" status: 404 len: 111 microversion: 2.21 time: 0.078319 Oct 31 15:30:42.747176 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1828/3563] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:42 2022] GET /compute/v2.1/servers/f7910b6c-374f-4fa4-9f54-ad44bf0f5e34 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:30:42.863933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.865069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.893112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.896690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.900982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.901958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.904840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.905483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:43.049525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:43.050538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:43.069338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:43.071883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:43.073333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:43.076191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:43.081657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:43.083910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:43.598518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:43.610557 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d36e4c46-d2d5-4ac0-89f9-04754ebd92c1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.752629 Oct 31 15:30:43.614290 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1736/3564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:42 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:43.635589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:43.654396 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b192a592-0188-4e53-8d1d-7665f6b312ce tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.608566 Oct 31 15:30:43.658466 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1829/3565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:43 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:44.254889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1852cce2-1af9-44c0-aefe-1371b8615ede tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'create', calling method: .version_select at 0x7f5ca12374c0>, body: {"keypair": {"name": "tempest-keypair-1813753198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxlbscujMpt9uN8GAKh2OTDUyrU48CGUuf+K9ZYJaXwPG/PZ8biwKB+9PD35nJpmj6ZGNgS/GJe6npAANLwSRVzebidSfNNc+CGGf6YivwXsrQQLjlfx7Q3mEshvwO5tA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:44.275572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1852cce2-1af9-44c0-aefe-1371b8615ede tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:44.283880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1852cce2-1af9-44c0-aefe-1371b8615ede tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for user 58b6ccb6f0514e0991864ec6a6417b45 and project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:44.375493 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1852cce2-1af9-44c0-aefe-1371b8615ede tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.123987 Oct 31 15:30:44.381137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1737/3566] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:30:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:30:44.645747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:44.647036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:44.655449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.656210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.658366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.659268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.659750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.660185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.694616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:44.696005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:44.718362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.719301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.719938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.720867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.722178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.722928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.998897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:45.009721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3304f21f-fb62-4e11-a2d1-4f5d8967cca2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.368022 Oct 31 15:30:45.010891 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1830/3567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:44 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:45.073344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:45.082894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dfb0cedb-54d6-4085-b9b0-fff7d0f6f083 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.403106 Oct 31 15:30:45.094630 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1738/3568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:44 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:45.247611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:45.249339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:45.258007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:45.259346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:45.260074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:45.261292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:45.262369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:45.263196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:45.282260 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] HTTP exception thrown: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Request method failure captured: Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 HTTP/1.1 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-hcrAkXEBIlg7Xu2_GzaS03lxxL3bOkq0s0Sj4eQgeW6Ie8PHLwL1P9Tqm-bDIvoZHmgNc1oWabNtbOZnIKL3BXp7mG5f6DiNp9fPLwEcv_2KOkFHE3X6eWr8r1MFLsNi01zhKzGufVxmIEJCutAA5-GPoY_QxxDTBwaeZQJS8xFjA Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bf304336d1f2420db7a197a36036ccab Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b36cbe18-c310-412f-b545-20d7a7ba77b4'} Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:45.284280 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.289274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.292439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Returning 404 to user: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:45.295048 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8a9688e-8b78-4cff-8d3a-a25c09824189 tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 404 len: 111 microversion: 2.1 time: 0.053202 Oct 31 15:30:45.296255 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1831/3569] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:45 2022] DELETE /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:45.305491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:45.306112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] [instance: b36cbe18-c310-412f-b545-20d7a7ba77b4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:45.313791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:45.314599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:45.315588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:45.316490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:45.317153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:45.317735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:45.339501 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] HTTP exception thrown: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Request method failure captured: Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 HTTP/1.1 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-hcrAkXEBIlg7Xu2_GzaS03lxxL3bOkq0s0Sj4eQgeW6Ie8PHLwL1P9Tqm-bDIvoZHmgNc1oWabNtbOZnIKL3BXp7mG5f6DiNp9fPLwEcv_2KOkFHE3X6eWr8r1MFLsNi01zhKzGufVxmIEJCutAA5-GPoY_QxxDTBwaeZQJS8xFjA Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04a6d9faf79449b7bdd9b287186c792e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 04a6d9faf79449b7bdd9b287186c792e Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeTestJSON-519769813 Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bf304336d1f2420db7a197a36036ccab Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeTestJSON-519769813-project Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b36cbe18-c310-412f-b545-20d7a7ba77b4'} Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:45.341639 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] Returning 404 to user: Instance b36cbe18-c310-412f-b545-20d7a7ba77b4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:45.347221 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e77891f9-a0a3-4dd2-9593-173db91cc22a tempest-AttachVolumeTestJSON-519769813 tempest-AttachVolumeTestJSON-519769813-project] 10.222.0.48 "GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4" status: 404 len: 111 microversion: 2.1 time: 0.042439 Oct 31 15:30:45.349274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1739/3570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:45 2022] GET /compute/v2.1/servers/b36cbe18-c310-412f-b545-20d7a7ba77b4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:46.035600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:46.037547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:46.061492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:46.063367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:46.064383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.065840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:46.067676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:46.068552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.113792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:46.114607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:46.130232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:46.132564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:46.134433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.135436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:46.140613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:46.141660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.591907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:46.611457 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f450c740-0a3f-4ade-aa1b-4c5accd0a1d3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.579952 Oct 31 15:30:46.627469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1832/3571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:46 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:46.745456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:46.771248 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22a03d6d-3fb2-4765-950e-a480792b090c tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1391 microversion: 2.1 time: 0.661774 Oct 31 15:30:46.771976 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1740/3572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:46 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1391 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:47.641594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:47.642402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:47.662633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.662874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.663868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.664823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.665463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.666166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.761013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-474923954", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22185265-e8f0-4ca5-8245-2f62f6302878"}], "security_groups": [{"name": "tempest-securitygroup--1972638663"}], "key_name": "tempest-keypair-1813753198", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:48.428745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] validate_networks() for [('22185265-e8f0-4ca5-8245-2f62f6302878', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:48.454383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:48.468727 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be79667d-dc70-49e9-b27c-7a2d858de244 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.831703 Oct 31 15:30:48.487903 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1833/3573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:47 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:48.494287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:48.495512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:48.503670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.504179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.504624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.505435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.505897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.506401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.007646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:49.016960 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa766fd7-c3a4-4f96-8601-3366a705cba0 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1381 microversion: 2.1 time: 0.527723 Oct 31 15:30:49.017551 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1834/3574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:48 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1381 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:49.040020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b06760d4-083b-4d5b-a541-6ecfc84f57d6 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '.version_select at 0x7f5ca14e7a60>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:49.045101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b06760d4-083b-4d5b-a541-6ecfc84f57d6 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.045882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b06760d4-083b-4d5b-a541-6ecfc84f57d6 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.046588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b06760d4-083b-4d5b-a541-6ecfc84f57d6 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.057232 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b06760d4-083b-4d5b-a541-6ecfc84f57d6 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1569 microversion: 2.1 time: 0.020975 Oct 31 15:30:49.058782 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1835/3575] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:30:49 2022] GET /compute/v2.1/os-migrations => generated 1569 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:49.074899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:49.076380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:49.085379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.086350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.087011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.090599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.091299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.092180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.610638 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7bb366e0-14e5-437a-a395-14c9f0e891c4 tempest-LiveMigrationTest-112950900 tempest-LiveMigrationTest-112950900-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1534 microversion: 2.1 time: 0.541993 Oct 31 15:30:49.611656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1836/3576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:49 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1534 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:49.617748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:49.618703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:49.627628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.628476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.629183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.642290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.643528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.645203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.736831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:49.737323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:49.737952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:49.738520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:49.739066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:49.750266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.751018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.751545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.752480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.753157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.753784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.781731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:49.789205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Getting quotas for user 58b6ccb6f0514e0991864ec6a6417b45 and project 9fa76f3e952245dd89ecd0ba7ba44111. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:49.815695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:49.818469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:49.895663 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76c892f1-9688-49e8-a7f7-5f4cd49738ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.138878 Oct 31 15:30:49.897527 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1741/3577] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:30:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 31 15:30:49.905788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:49.906983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:49.924280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.926150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.926737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.927700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.957358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.959871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.966884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:49.988565 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20e8f20e-5c1e-434b-b96f-033a0e1292a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.375154 Oct 31 15:30:49.992293 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1837/3578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:49 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:49.999755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37163eda-d6f0-4ee0-b963-f27cc4e1cd56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:50.002742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37163eda-d6f0-4ee0-b963-f27cc4e1cd56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:50.066935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:50.150848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37163eda-d6f0-4ee0-b963-f27cc4e1cd56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:50.196119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37163eda-d6f0-4ee0-b963-f27cc4e1cd56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:50.205595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37163eda-d6f0-4ee0-b963-f27cc4e1cd56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:50.209786 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37163eda-d6f0-4ee0-b963-f27cc4e1cd56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1281 microversion: 2.20 time: 0.213453 Oct 31 15:30:50.212656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1838/3579] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:49 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:50.288593 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-302b562f-9992-466d-b6fb-533f6d71b10f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 204 len: 0 microversion: 2.1 time: 0.389537 Oct 31 15:30:50.294520 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1742/3580] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:49 2022] DELETE /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:30:50.299217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:50.301063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:50.329721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:50.332098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:50.334831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:50.335845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:50.336502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:50.338856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:50.701067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:50.715433 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-672aa764-182b-47e9-a72c-46f9f7c0e0ae tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1387 microversion: 2.1 time: 0.421163 Oct 31 15:30:50.718671 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1839/3581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:50 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1387 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:51.019609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:51.021282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:51.030587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.031384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.032081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.033046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.033732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.034453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.244243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:51.245029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:51.258353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.260303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.260888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.264807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.271748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.273092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.471939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:51.481461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:51.483414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:51.484917 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2468c645-ab36-4ac5-8fc9-bcdb7b5d3496 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1333 microversion: 2.20 time: 0.245195 Oct 31 15:30:51.485669 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1840/3582] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:51 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1333 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:51.649806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-db4dc791-d702-4fcc-acee-40359f52f566 req-97442049-c0b9-4ec6-9293-24092ed4f1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f62ea834-5faf-4d9e-936c-884461341dcf", "name": "network-vif-deleted", "tag": "79160ec8-bdce-46cc-8e82-b616e34e7c71"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:51.662269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-db4dc791-d702-4fcc-acee-40359f52f566 req-97442049-c0b9-4ec6-9293-24092ed4f1d2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.662829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-db4dc791-d702-4fcc-acee-40359f52f566 req-97442049-c0b9-4ec6-9293-24092ed4f1d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.663485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-db4dc791-d702-4fcc-acee-40359f52f566 req-97442049-c0b9-4ec6-9293-24092ed4f1d2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.677759 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-db4dc791-d702-4fcc-acee-40359f52f566 req-97442049-c0b9-4ec6-9293-24092ed4f1d2 service nova] Creating event network-vif-deleted:79160ec8-bdce-46cc-8e82-b616e34e7c71 for instance f62ea834-5faf-4d9e-936c-884461341dcf on n-h2-858383-17 Oct 31 15:30:51.685464 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-db4dc791-d702-4fcc-acee-40359f52f566 req-97442049-c0b9-4ec6-9293-24092ed4f1d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038845 Oct 31 15:30:51.686821 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1841/3583] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:51.743395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:51.744232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:51.794092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.796722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.797936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.798742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.800959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.802796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.087901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.098947 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55463932-ac25-4c34-9e13-c95a01c0408f tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1183 microversion: 2.1 time: 0.362735 Oct 31 15:30:52.099644 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1842/3584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:51 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:52.401124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.416831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fbc3e8b3-3554-4731-b243-49ff06f22a41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 1.399683 Oct 31 15:30:52.422459 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1743/3585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:51 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:52.525927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:52.529501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:52.539061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.540038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.540885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.541829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.542511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.543338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.626228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:52.631550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.632324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Searching by: {'deleted': False, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:30:52.646702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.652074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.652829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.653729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.654192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.655250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.663363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.667391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:52.681325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.684393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.686250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dbff3f24-3baf-4b44-be94-a3513ac6a2cb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1339 microversion: 2.20 time: 0.177573 Oct 31 15:30:52.688455 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1843/3586] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:52 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:52.707571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:52.715874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:30:52.754551 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9042081f-5b55-4d39-9c2d-53e4035ba3d9 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.139660 Oct 31 15:30:52.755715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1744/3587] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:30:52 2022] GET /compute/v2.1/servers => generated 333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:52.772439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:52.782819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.785063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Searching by: {'deleted': False, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:30:52.793818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.797047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.797689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.798644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.799485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.800112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.848195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:30:52.920923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.929345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.929938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.930495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.126612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:53.127249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:53.142834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.145843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.146303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.147295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.149024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.149629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.399959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.410561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb36d05b-efff-4975-a55f-c28877644d5b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1183 microversion: 2.1 time: 0.290919 Oct 31 15:30:53.412076 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1745/3588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:53 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:53.445905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:53.446789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:53.454900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.455612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.457144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.458046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.458672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.459267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.509915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7678dd79-f58f-41ae-bc81-1b98cf609fe4 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.743182 Oct 31 15:30:53.510511 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1844/3589] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:30:52 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:53.538879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55919d3d-2a06-4f20-ae42-5944610ba97f tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:53.548940 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55919d3d-2a06-4f20-ae42-5944610ba97f tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015106 Oct 31 15:30:53.550213 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1845/3590] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:30:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:53.742218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2dae94fc-5111-4afa-8e7d-da125f04ee00 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-684983709", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:53.748506 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2dae94fc-5111-4afa-8e7d-da125f04ee00 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] HTTP exception thrown: min_count must be <= max_count Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2dae94fc-5111-4afa-8e7d-da125f04ee00 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Request method failure captured: Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 183 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-otENfsx_Wa2k2CgUZ89FnA1fusif_ctCnoGVBIMnDLzd4MywPpGE-wVbkhGTub8zKBcFGaNuPlY9YMhE38e6VLmVQnfsAsf1JAUIuCiXSKZuTD1cxeGzJgWmNi_zZEbq6Z2TMZkHwKsg0Y-FHzsXhmOWqoIe4oG5VP9L_Eigtg5aQ Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 2fc9807ef3c040c4831d60096fa54abb Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-684983709", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: exception: min_count must be <= max_count Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-684983709', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 31 15:30:53.750134 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2dae94fc-5111-4afa-8e7d-da125f04ee00 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Returning 400 to user: min_count must be <= max_count {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2dae94fc-5111-4afa-8e7d-da125f04ee00 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.145117 Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1846/3591] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:53 2022] POST /compute/v2.1/servers => generated 74 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.766998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.768025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.768222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.768639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.881737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.890605 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92f639d5-e6c7-4415-bf69-ffdbae92b06d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.449925 Oct 31 15:30:53.891318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1746/3592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:53 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:53.910050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.911219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-592e4765-7eb8-4cf8-a281-29c896e5cf87 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1840539190", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "max_count": 0}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-592e4765-7eb8-4cf8-a281-29c896e5cf87 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Request method failure captured: Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 168 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-otENfsx_Wa2k2CgUZ89FnA1fusif_ctCnoGVBIMnDLzd4MywPpGE-wVbkhGTub8zKBcFGaNuPlY9YMhE38e6VLmVQnfsAsf1JAUIuCiXSKZuTD1cxeGzJgWmNi_zZEbq6Z2TMZkHwKsg0Y-FHzsXhmOWqoIe4oG5VP9L_Eigtg5aQ Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 2fc9807ef3c040c4831d60096fa54abb Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1840539190", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "max_count": 0}} Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1840539190', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'max_count': 0}}} Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 0 Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:30:53.915565 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-592e4765-7eb8-4cf8-a281-29c896e5cf87 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-592e4765-7eb8-4cf8-a281-29c896e5cf87 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011076 Oct 31 15:30:53.921578 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1747/3593] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:30:53.923045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:53.923242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:53.932210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.932982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.934277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.935281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:53.935949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:53.936583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.942625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.944381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.949335 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e88e125b-cbe0-44f0-9a76-144ba2f1a980 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1339 microversion: 2.20 time: 0.195478 Oct 31 15:30:53.952521 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1847/3594] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:53 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:53.973004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:53.995331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-779125db-ec78-4840-a673-f311664512e5 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1946535660", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "max_count": 2.5}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-779125db-ec78-4840-a673-f311664512e5 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Request method failure captured: Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 170 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-otENfsx_Wa2k2CgUZ89FnA1fusif_ctCnoGVBIMnDLzd4MywPpGE-wVbkhGTub8zKBcFGaNuPlY9YMhE38e6VLmVQnfsAsf1JAUIuCiXSKZuTD1cxeGzJgWmNi_zZEbq6Z2TMZkHwKsg0Y-FHzsXhmOWqoIe4oG5VP9L_Eigtg5aQ Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 2fc9807ef3c040c4831d60096fa54abb Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1946535660", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "max_count": 2.5}} Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1946535660', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'max_count': 2.5}}} Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 2.5 Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:30:54.001104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-779125db-ec78-4840-a673-f311664512e5 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:54.005784 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-779125db-ec78-4840-a673-f311664512e5 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011633 Oct 31 15:30:54.013346 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1848/3595] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:53 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:30:54.062147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95ba5d37-9142-4583-9e26-0313f2ec5833 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1012686377", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 0}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95ba5d37-9142-4583-9e26-0313f2ec5833 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Request method failure captured: Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 168 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-otENfsx_Wa2k2CgUZ89FnA1fusif_ctCnoGVBIMnDLzd4MywPpGE-wVbkhGTub8zKBcFGaNuPlY9YMhE38e6VLmVQnfsAsf1JAUIuCiXSKZuTD1cxeGzJgWmNi_zZEbq6Z2TMZkHwKsg0Y-FHzsXhmOWqoIe4oG5VP9L_Eigtg5aQ Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 2fc9807ef3c040c4831d60096fa54abb Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1012686377", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 0}} Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1012686377', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'min_count': 0}}} Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 0 Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:30:54.067021 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:30:54.071863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.075676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95ba5d37-9142-4583-9e26-0313f2ec5833 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:54.077088 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95ba5d37-9142-4583-9e26-0313f2ec5833 tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022511 Oct 31 15:30:54.078415 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1849/3596] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:30:54.121467 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c437bf65-e650-4cca-8e0a-effc517cecbe tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 204 len: 0 microversion: 2.1 time: 0.201149 Oct 31 15:30:54.124643 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1748/3597] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:53 2022] DELETE /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:30:54.137707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:54.137707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:54.146214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.147981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.148996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.150136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.150868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.159070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-346cd89e-986d-4248-ae46-df25d1217dca tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-997949157", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 2.5}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:54.175238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-346cd89e-986d-4248-ae46-df25d1217dca tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Request method failure captured: Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 169 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-otENfsx_Wa2k2CgUZ89FnA1fusif_ctCnoGVBIMnDLzd4MywPpGE-wVbkhGTub8zKBcFGaNuPlY9YMhE38e6VLmVQnfsAsf1JAUIuCiXSKZuTD1cxeGzJgWmNi_zZEbq6Z2TMZkHwKsg0Y-FHzsXhmOWqoIe4oG5VP9L_Eigtg5aQ Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d51bb2f8afcb4c6b99c8cd2fcefabcf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d51bb2f8afcb4c6b99c8cd2fcefabcf9 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-61492833 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 2fc9807ef3c040c4831d60096fa54abb Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-61492833-project Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-997949157", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 2.5}} Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-997949157', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'min_count': 2.5}}} Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 2.5 Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:30:54.180505 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:30:54.187127 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:30:54.191788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-346cd89e-986d-4248-ae46-df25d1217dca tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:54.193659 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-346cd89e-986d-4248-ae46-df25d1217dca tempest-MultipleCreateNegativeTestJSON-61492833 tempest-MultipleCreateNegativeTestJSON-61492833-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.039962 Oct 31 15:30:54.202239 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1749/3598] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:30:54.436884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:54.439447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:54.459865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.460359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.460818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.467202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.472182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.474466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.513774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:54.525318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ccf5ef6-54b8-41d9-889f-6405b5164ce0 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1698 microversion: 2.1 time: 0.394600 Oct 31 15:30:54.530614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1850/3599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:54 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1698 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:54.667111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:54.677164 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8aa569b2-6486-4513-9288-e1fee0c0ab8e tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1183 microversion: 2.1 time: 0.246018 Oct 31 15:30:54.684823 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1750/3600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:54 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:54.915367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:54.915954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:54.930138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.930630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.931061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.931770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.932225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.932644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.979577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:54.982468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:55.005372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.008295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.009303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.012328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.013632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.016114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.310534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:55.331423 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13bc976e-5ac8-4206-a672-e734e35b56e1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.419765 Oct 31 15:30:55.350375 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1851/3601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:54 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:55.388218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:55.399759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:55.403140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:55.405558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1facb057-3bf4-4e09-9745-c26801232a5c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.429933 Oct 31 15:30:55.406739 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1751/3602] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:54 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:30:55.551579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:55.552512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:55.564517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.564898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.567696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.570243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.572304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.573934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.708767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:55.709391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:55.722547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.723050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.723488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.724409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.725051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.725630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.887590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:55.896986 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-25a8da9d-9aac-4c06-a7fb-f00034f1e481 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1183 microversion: 2.1 time: 0.193314 Oct 31 15:30:55.898681 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1752/3603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:55 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:56.011270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:56.021534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ebe1927-c5a4-4871-a771-2d7d26e934ab tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1698 microversion: 2.1 time: 0.474947 Oct 31 15:30:56.024598 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1852/3604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:55 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1698 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:56.046048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1bbf8b6f-999f-4c0e-b5e6-561c8bba1f5e req-b6b7cec3-3383-4af1-af68-549ed49c6919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:56.056908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1bbf8b6f-999f-4c0e-b5e6-561c8bba1f5e req-b6b7cec3-3383-4af1-af68-549ed49c6919 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.057489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1bbf8b6f-999f-4c0e-b5e6-561c8bba1f5e req-b6b7cec3-3383-4af1-af68-549ed49c6919 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.058255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1bbf8b6f-999f-4c0e-b5e6-561c8bba1f5e req-b6b7cec3-3383-4af1-af68-549ed49c6919 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.071483 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1bbf8b6f-999f-4c0e-b5e6-561c8bba1f5e req-b6b7cec3-3383-4af1-af68-549ed49c6919 service nova] Creating event network-changed:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:30:56.078667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1bbf8b6f-999f-4c0e-b5e6-561c8bba1f5e req-b6b7cec3-3383-4af1-af68-549ed49c6919 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036580 Oct 31 15:30:56.079998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1853/3605] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:56.360875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:56.361589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:56.371777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.372279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.372740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.373442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.373899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.374324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.475682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:56.476399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:56.489958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.490599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.492004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.493924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.502710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.503583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.562831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:56.731719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:56.776081 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ed4a3c42-4222-4dbd-b04c-23f59e199d64 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 204 len: 0 microversion: 2.42 time: 0.875539 Oct 31 15:30:56.778771 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1753/3606] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:30:55 2022] DELETE /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:30:56.797658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:56.799949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:56.819853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.821008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.821810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.826130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.826892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.827781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.292735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.324979 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85c1fab6-c51b-41b0-9a5a-cefd93cfcbac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.967445 Oct 31 15:30:57.359281 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1854/3607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:56 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:57.365687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.371566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:57.375611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.377093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.378749 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d4ef07d-f0a5-40f7-993a-d9400b3c3a79 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.596653 Oct 31 15:30:57.379606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:57.381619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1754/3608] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:56 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:57.390323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:57.390946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:57.399171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.400875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.401563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.406981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.407493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.407919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.422299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.424434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.424972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.425652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.426122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.426554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.537838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.546267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42363ae1-d910-4f3d-a54b-bada0598c275 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 200 len: 1183 microversion: 2.1 time: 0.163605 Oct 31 15:30:57.548514 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1755/3609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:57 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 1183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:57.557023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:57.558881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:57.597960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.598514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.598948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.600000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.600794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.601232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.674154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.674646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.675078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.675532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lazy-loading 'fault' on Instance uuid 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:57.771348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1783f2941594680a5499635e369585a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153ac418de4045d5a5bf4866c8c8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.784590 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ae961bc-71a5-4594-88b3-f179c6c2b43e tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 200 len: 1358 microversion: 2.1 time: 0.234288 Oct 31 15:30:57.785590 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1756/3610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:57 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:57.792468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-857ce494-2bb2-4fe1-9200-c3ba4da3d5b3 req-10203280-b036-42ff-a7d0-b2a7b7eb9964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0017d3-d87e-40dd-a09e-f3e0f67504e2", "name": "network-vif-deleted", "tag": "3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:57.822470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-857ce494-2bb2-4fe1-9200-c3ba4da3d5b3 req-10203280-b036-42ff-a7d0-b2a7b7eb9964 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.823590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-857ce494-2bb2-4fe1-9200-c3ba4da3d5b3 req-10203280-b036-42ff-a7d0-b2a7b7eb9964 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.826137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-857ce494-2bb2-4fe1-9200-c3ba4da3d5b3 req-10203280-b036-42ff-a7d0-b2a7b7eb9964 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.858324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.873389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.876164 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-857ce494-2bb2-4fe1-9200-c3ba4da3d5b3 req-10203280-b036-42ff-a7d0-b2a7b7eb9964 service nova] Creating event network-vif-deleted:3d4d883d-9b1c-4081-a4ab-b0fe6b76bc03 for instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 on n-h2-858383-17 Oct 31 15:30:57.880892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:57.882354 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68a60a6b-5598-474a-8947-bfdf113de24a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2962 microversion: 2.42 time: 0.521651 Oct 31 15:30:57.903261 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1855/3611] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:57 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2962 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:57.905104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-857ce494-2bb2-4fe1-9200-c3ba4da3d5b3 req-10203280-b036-42ff-a7d0-b2a7b7eb9964 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116726 Oct 31 15:30:57.907960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1757/3612] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:58.357787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:58.358973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:58.366741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.370788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.372319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.373330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.374017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.374640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.412820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:58.414016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:58.439258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.440191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.440869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.441780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.442490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.443090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.607565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:58.635183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3cfd91da-be4d-41df-aa38-a8aea5ccb2d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.281955 Oct 31 15:30:58.636257 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1856/3613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:58 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:58.648139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:58.649098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f62ea834-5faf-4d9e-936c-884461341dcf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:58.684882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.686297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.689090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.690078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.690752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.692210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.726637 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] HTTP exception thrown: Instance f62ea834-5faf-4d9e-936c-884461341dcf could not be found. Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Request method failure captured: Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf HTTP/1.1 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-iZ2VvjhE1kqr5x42NPhMR3y2gngJ6gYPFtM4WVCqF2NP834Z4kEX0hvFihvehS0rby3Ppuh0X0wiA5FhiVlJRcXN_v0tMJdlG6sDvxLwcDpQjeHtPByW-p3tTa3UMOjkbD3uVhxBTZerUAOm4ZQr1r9-VkH77rAp6Mqsa2Lo6rVtM Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveMigrationTest-1618818750 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveMigrationTest-1618818750-project Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 847c3c51ceb3406eb86b222c4638fc59 Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveMigrationTest-1618818750-project Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f62ea834-5faf-4d9e-936c-884461341dcf could not be found. Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f62ea834-5faf-4d9e-936c-884461341dcf'} Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f62ea834-5faf-4d9e-936c-884461341dcf could not be found. Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f62ea834-5faf-4d9e-936c-884461341dcf could not be found. Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:58.744222 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f62ea834-5faf-4d9e-936c-884461341dcf could not be found. Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.750108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Returning 404 to user: Instance f62ea834-5faf-4d9e-936c-884461341dcf could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:58.753416 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-789f0108-71c7-41c9-8e9e-92129f0dbcc9 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf" status: 404 len: 111 microversion: 2.1 time: 0.115248 Oct 31 15:30:58.754009 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1857/3614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:58 2022] GET /compute/v2.1/servers/f62ea834-5faf-4d9e-936c-884461341dcf => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:58.811471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:58.812093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] [instance: 3b0017d3-d87e-40dd-a09e-f3e0f67504e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:58.830438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.831218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.831832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.832762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.833408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.836182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.883614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] HTTP exception thrown: Instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 could not be found. Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Request method failure captured: Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 HTTP/1.1 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ntmNHsEAvVNHiCo-7eEsC2rj1KcN9x7_WTohZnNPck3F5SFjN9HlZR7IEWxwmj8aWk2iYfkIM5MtKhgxuumzFX7HyzvSnaUDFs3gXh6CuGSIhY2rNMNz-l6dNxtzh98Jw2eToQ3ZcWdXal5pni5RymItzWrU-rSphN9V_h0jrs9WE Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 153ac418de4045d5a5bf4866c8c8b78d Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-976186868 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/153ac418de4045d5a5bf4866c8c8b78d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/153ac418de4045d5a5bf4866c8c8b78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_153ac418de4045d5a5bf4866c8c8b78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/153ac418de4045d5a5bf4866c8c8b78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-976186868 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 153ac418de4045d5a5bf4866c8c8b78d Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-976186868 Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-976186868-project Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d1783f2941594680a5499635e369585a Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-976186868-project Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 could not be found. Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3b0017d3-d87e-40dd-a09e-f3e0f67504e2'} Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 could not be found. Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 could not be found. Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.893721 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:58.899383 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:58.899383 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:58.899383 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:58.899383 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:58.899383 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 could not be found. Oct 31 15:30:58.899383 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:30:58.909523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Returning 404 to user: Instance 3b0017d3-d87e-40dd-a09e-f3e0f67504e2 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:58.915443 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e96966d-0a06-4cbc-aa4b-1022d66be1df tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2" status: 404 len: 111 microversion: 2.1 time: 0.107601 Oct 31 15:30:58.916282 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1858/3615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:58 2022] GET /compute/v2.1/servers/3b0017d3-d87e-40dd-a09e-f3e0f67504e2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:58.927379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:58.928391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:58.945540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.946402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.947088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.948006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:58.948805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:58.949587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.991255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:59.011435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:59.018469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:59.021402 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0bba556-1e36-4b30-9fa2-f2e135420f32 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.615200 Oct 31 15:30:59.023383 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1758/3616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:58 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:30:59.037036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2645cd9b-7fea-49eb-a6b3-68b621a900a8 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] Calling method '.version_select at 0x7f5ca12a3670>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:59.082945 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2645cd9b-7fea-49eb-a6b3-68b621a900a8 tempest-ServersTestJSON-976186868 tempest-ServersTestJSON-976186868-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890329799" status: 202 len: 0 microversion: 2.1 time: 0.055958 Oct 31 15:30:59.087908 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1759/3617] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890329799 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:59.549945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:59.568147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:59.580143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:59.584761 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7cffd45-8004-4e48-809c-3fc5665ebd02 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2962 microversion: 2.42 time: 0.666924 Oct 31 15:30:59.587746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1859/3618] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:30:58 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2962 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:30:59.662128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:59.663191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:59.673204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.674003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.674678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:59.675571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.676209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.676917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:59.810866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:00.056684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:00.057826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:00.066117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:00.066838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:00.067465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:00.068741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:00.069381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:00.069965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:00.571595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:00.579362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:00.599449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff4c444f-1755-4b31-a422-9183bc286c15 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1512 microversion: 2.1 time: 0.935261 Oct 31 15:31:00.601055 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1760/3619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:59 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1512 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:00.617809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:00.632207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4f32fcd-2dd3-42e2-844c-ccd274c7f181 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca1223790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:00.642833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:00.646589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:00.664508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-883cb62a-b952-4731-a53b-f1ee2d51802e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.610280 Oct 31 15:31:00.676216 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1860/3620] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:00 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:00.685931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:00.687913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:00.699766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:00.700333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:00.708224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:00.709114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:00.709597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:00.710227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:00.763070 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4f32fcd-2dd3-42e2-844c-ccd274c7f181 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1257d4a1-d207-4d55-94ec-d0bc8ce05631" status: 200 len: 351 microversion: 2.1 time: 0.160535 Oct 31 15:31:00.763730 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1761/3621] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:31:00 2022] GET /compute/v2.1/os-volumes/1257d4a1-d207-4d55-94ec-d0bc8ce05631 => generated 351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:01.141957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:01.161495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:01.163449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:01.167389 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e117493-95fa-495f-b128-7fd7dd153792 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2962 microversion: 2.42 time: 0.489681 Oct 31 15:31:01.170124 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1861/3622] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:00 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2962 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:01.628184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:01.629349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:01.646404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:01.648084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:01.650847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:01.653030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:01.656404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:01.657035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:01.695998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:01.697515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:01.710165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:01.717623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:01.718007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:01.719447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:01.721257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:01.725617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:02.691645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:02.815201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:02.915744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:03.063514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:03.078641 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a03be1b-7cf5-4ff4-8370-51f8ba2a0218 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1489 microversion: 2.1 time: 1.455446 Oct 31 15:31:03.079504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1762/3623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:01 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1489 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:03.097675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:03.099661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:03.117493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.118023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.121318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.124260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.124930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.125401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.239530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:03.251429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:03.256470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:03.257669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea7c2297-241d-41e8-89d6-bcd1d0029a9f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 1.565985 Oct 31 15:31:03.282404 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1862/3624] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:01 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:03.299540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:03.302247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:03.314782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.315583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.319338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.320296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.320987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.321618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.405365 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-388a017b-16cf-40c7-b280-2cf32fa67746 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 200 len: 169 microversion: 2.1 time: 0.121228 Oct 31 15:31:03.406016 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1863/3625] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:03 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 169 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:03.428948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:03.429891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:03.439582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.440460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.442018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.442909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.443523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.444233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.124520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.149637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.151178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.159430 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78cc5ed8-8bc3-4f86-a202-a5583b9d04fa tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2962 microversion: 2.42 time: 1.070428 Oct 31 15:31:04.182319 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1763/3626] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:03 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2962 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:04.196386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42b7c33e-30f6-42dd-97ab-c9a26e13ef08 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca15031f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:04.290361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42b7c33e-30f6-42dd-97ab-c9a26e13ef08 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0a2b97ab-9c53-4f92-82e4-46d63f2abb7b" status: 200 len: 351 microversion: 2.1 time: 0.112421 Oct 31 15:31:04.291146 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1764/3627] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:31:04 2022] GET /compute/v2.1/os-volumes/0a2b97ab-9c53-4f92-82e4-46d63f2abb7b => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:04.307831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:04.309478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:04.330370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.332099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.332257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.334867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.337136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.337795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.418345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:05.453077 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7292bd85-6265-4ef9-a826-bfa7d92fbb41 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 2.039264 Oct 31 15:31:05.454268 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1864/3628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:03 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:05.463408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:05.468520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:05.489625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.491897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.492933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.494105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.496685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.497817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.560326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:05.668108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:05.768280 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-857f87f6-2f61-46d4-94b6-316b2fc5d4ed tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 204 len: 0 microversion: 2.1 time: 0.311617 Oct 31 15:31:05.771956 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1865/3629] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:05 2022] DELETE /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:05.780231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2c37d92d-73d7-4c85-a111-c76d6064575f req-845973b4-35f8-459a-9467-09744c197a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-unplugged", "status": "completed", "tag": "5673ce77-3331-415e-911c-8827eeed1fec"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:05.809321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2c37d92d-73d7-4c85-a111-c76d6064575f req-845973b4-35f8-459a-9467-09744c197a2a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.811563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2c37d92d-73d7-4c85-a111-c76d6064575f req-845973b4-35f8-459a-9467-09744c197a2a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.812346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2c37d92d-73d7-4c85-a111-c76d6064575f req-845973b4-35f8-459a-9467-09744c197a2a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.845104 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2c37d92d-73d7-4c85-a111-c76d6064575f req-845973b4-35f8-459a-9467-09744c197a2a service nova] Creating event network-vif-unplugged:5673ce77-3331-415e-911c-8827eeed1fec for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:05.853709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2c37d92d-73d7-4c85-a111-c76d6064575f req-845973b4-35f8-459a-9467-09744c197a2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081706 Oct 31 15:31:05.859117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1866/3630] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:05.873637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:05.874609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:05.890517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.891432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.892887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.893838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.899737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.900479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.405491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.423653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.429420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.433586 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1298ef39-0927-4c33-8bd9-dbd286562478 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 2.130746 Oct 31 15:31:06.436528 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1765/3631] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:04 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:06.458814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:06.461175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:06.489193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.490437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.492315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.495967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.496600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.497965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.621502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.632068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.645955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.647752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19ef14e2-e04b-4a5d-91eb-496cee0c7ec4 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2962 microversion: 2.42 time: 0.786884 Oct 31 15:31:06.648634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1867/3632] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:05 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2962 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:06.655868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:06.660902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:06.671557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:06.684059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.684990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.685753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.691593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.692933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.693624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.146300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:07.156043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e32c3c79-f07b-4dfd-a4c1-018be69d6cf1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.717912 Oct 31 15:31:07.157119 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1766/3633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:06 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:07.304909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:07.321655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b525f45-01eb-491d-ae4f-6e40099ff89a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Action: 'create', calling method: .version_select at 0x7f5ca14d3ca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1686437911", "policies": ["affinity"]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:07.330254 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-091e011c-808a-4030-a306-789f23acd5c6 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1667 microversion: 2.1 time: 0.680139 Oct 31 15:31:07.331207 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1868/3634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:06 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1667 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:07.343722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f906997e-dba6-4d2c-bbba-a713d5ebb712 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca13e5040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.359567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1b525f45-01eb-491d-ae4f-6e40099ff89a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:07.372311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1b525f45-01eb-491d-ae4f-6e40099ff89a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:07.430441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f906997e-dba6-4d2c-bbba-a713d5ebb712 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/703904db-dc2d-4342-8ae3-f33e98eaf620" status: 200 len: 351 microversion: 2.1 time: 0.095912 Oct 31 15:31:07.441355 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1869/3635] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/os-volumes/703904db-dc2d-4342-8ae3-f33e98eaf620 => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:07.444311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1b525f45-01eb-491d-ae4f-6e40099ff89a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:07.447186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.447960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:07.456634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-1b525f45-01eb-491d-ae4f-6e40099ff89a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:07.474287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.475009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.476290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.477729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.478316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.478516 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b525f45-01eb-491d-ae4f-6e40099ff89a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.319894 Oct 31 15:31:07.479145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.481194 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1767/3636] 10.222.0.48 () {60 vars in 1174 bytes} [Mon Oct 31 15:31:07 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:07.486744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78e198df-4157-4467-8b56-49b38e73459c tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca14d3790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.591244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78e198df-4157-4467-8b56-49b38e73459c tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.108499 Oct 31 15:31:07.592013 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1768/3637] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:07.599049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.599946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:07.614844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.615347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.615823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.616833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.617469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.617729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.991106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.000013 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5fe8d697-93da-4068-8106-e8562c2ba24b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.557450 Oct 31 15:31:08.015143 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1870/3638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:08.022875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86a7d736-a798-44ff-aa95-688b810ffd66 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Action: 'create', calling method: .version_select at 0x7f5ca140ab80>, body: {"server_group": {"name": "tempest-server-group-692602981", "policies": ["affinity"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:08.045702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-86a7d736-a798-44ff-aa95-688b810ffd66 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:08.051674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-86a7d736-a798-44ff-aa95-688b810ffd66 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:08.084654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.110032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-86a7d736-a798-44ff-aa95-688b810ffd66 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:08.121550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-86a7d736-a798-44ff-aa95-688b810ffd66 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:08.134851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.140031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.141310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86a7d736-a798-44ff-aa95-688b810ffd66 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.124035 Oct 31 15:31:08.142155 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1871/3639] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Oct 31 15:31:08 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:08.144577 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-784d8dae-a518-401b-aa4f-8857c9d096ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.548577 Oct 31 15:31:08.145640 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1769/3640] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:08.154651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.155978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:08.168220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29da3e0e-81a6-4237-8c5f-d761d94f2086 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca13eb670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.190781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.191930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.192938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.193925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.195084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.195951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.366566 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29da3e0e-81a6-4237-8c5f-d761d94f2086 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.223142 Oct 31 15:31:08.367149 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1872/3641] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Oct 31 15:31:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:08.382350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-unplugged", "status": "completed", "tag": "735fab76-f84c-4805-84d4-37b8dceb5040"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-unplugged", "status": "completed", "tag": "d3956ef2-61dc-4b6a-84dd-c6a3da755bdf"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-unplugged", "status": "completed", "tag": "699d5e32-b18a-41a1-8fd2-752d4710602c"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-unplugged", "status": "completed", "tag": "c32bc1a8-8026-4831-9ece-c08bbcaf39c1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:08.435324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.436187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.438202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.466958 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Creating event network-vif-unplugged:735fab76-f84c-4805-84d4-37b8dceb5040 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:08.471157 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Creating event network-vif-unplugged:d3956ef2-61dc-4b6a-84dd-c6a3da755bdf for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:08.471999 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Creating event network-vif-unplugged:699d5e32-b18a-41a1-8fd2-752d4710602c for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:08.473775 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] Creating event network-vif-unplugged:c32bc1a8-8026-4831-9ece-c08bbcaf39c1 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:08.483274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d7cfce6b-aa2a-465a-beb1-84c91e77468d req-34388262-f313-4503-a45e-617ab8e03008 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.104267 Oct 31 15:31:08.486027 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1873/3642] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:08.499950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.501035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:08.518206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.518540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.523312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.524838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.524838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.526083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.249439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.258697 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f57c980-0918-4905-9203-73b3855fe8e0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.771006 Oct 31 15:31:09.265681 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1874/3643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:08 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:09.271325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07ffe69d-cdaf-4fde-ae69-5ecd164d76b0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Action: 'create', calling method: .version_select at 0x7f5ca1444280>, body: {"server_group": {"name": "tempest-server-group-692602981", "policies": ["affinity"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:09.323178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-07ffe69d-cdaf-4fde-ae69-5ecd164d76b0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:09.330645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-07ffe69d-cdaf-4fde-ae69-5ecd164d76b0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:09.419810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-07ffe69d-cdaf-4fde-ae69-5ecd164d76b0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:09.427286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-07ffe69d-cdaf-4fde-ae69-5ecd164d76b0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:09.462882 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07ffe69d-cdaf-4fde-ae69-5ecd164d76b0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.195397 Oct 31 15:31:09.469272 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1875/3644] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Oct 31 15:31:09 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:09.474544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.475167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:09.484573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.498734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.499236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.499674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.500390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.500721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.501032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.501469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.502334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.503644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-87db99e4-48dd-42c4-b63d-4655bf208801 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2941 microversion: 2.42 time: 1.356680 Oct 31 15:31:09.513670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1770/3645] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:08 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2941 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:09.533673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2e45512f-e62e-46a4-ac34-a112ccc45731 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca1250940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.697698 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2e45512f-e62e-46a4-ac34-a112ccc45731 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.182651 Oct 31 15:31:09.698593 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1771/3646] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:09.713072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.715557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:09.725526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.726406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.727093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.728075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.729141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.729843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.738094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.747163 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-507b4afa-7b5e-4a6e-ad89-84cd942a8ee7 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1600 microversion: 2.1 time: 0.276388 Oct 31 15:31:09.747759 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1876/3647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1600 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:09.773046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a722ff8-7bd8-46d9-9f3f-5d18139e5d7d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.813971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a722ff8-7bd8-46d9-9f3f-5d18139e5d7d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/66b52f54-b64e-48eb-af67-f13f71f10ffe" status: 204 len: 0 microversion: 2.1 time: 0.046723 Oct 31 15:31:09.815078 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1877/3648] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:09 2022] DELETE /compute/v2.1/os-server-groups/66b52f54-b64e-48eb-af67-f13f71f10ffe => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:09.820133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1060724373", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "8c999eef-3ab4-4489-9119-8b9357d0c054"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:09.887245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] validate_networks() for [('8c999eef-3ab4-4489-9119-8b9357d0c054', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:31:10.224635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.252558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.258499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.259692 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-978a20ee-34c3-4452-a07f-d2df980381ea tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.559212 Oct 31 15:31:10.260260 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1772/3649] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:10.274711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-43f4ca1d-b4a6-4d59-9ffe-4d7ff1a534ef tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca12a3dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.430792 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-43f4ca1d-b4a6-4d59-9ffe-4d7ff1a534ef tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.169436 Oct 31 15:31:10.431456 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1773/3650] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:10.436215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b689fc74-b69f-45f8-89dd-cc53e49bf568 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.452928 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b689fc74-b69f-45f8-89dd-cc53e49bf568 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.020113 Oct 31 15:31:10.453927 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1774/3651] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:10.458698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-14d081a9-a3c9-4591-949a-2a3c95566974 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca153c5e0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.557715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-14d081a9-a3c9-4591-949a-2a3c95566974 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102509 Oct 31 15:31:10.559392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1775/3652] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:10.564861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-19a06234-f78a-4f3d-934f-fc51948b6a7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.609154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-19a06234-f78a-4f3d-934f-fc51948b6a7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a" status: 204 len: 0 microversion: 2.1 time: 0.048331 Oct 31 15:31:10.612950 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1776/3653] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:10 2022] DELETE /compute/v2.1/os-server-groups/1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:10.615740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.617399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:10.638648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.639216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.639749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.640539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.641100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.642985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.108570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.143124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.146691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.148903 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d9d0985-6249-4a60-9e68-0f6a16289f1b tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2920 microversion: 2.42 time: 0.537638 Oct 31 15:31:11.151026 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1777/3654] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2920 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:11.160224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-978430fd-2ca9-495d-a1cd-747e5c662248 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca14d0700>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.234199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:11.234995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:11.235236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:11.235485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:11.239521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:11.255677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.256533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.257205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.258146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.258839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.259487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.287722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:11.296095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for user 6b1695b4d61d40de8272561b0cf3362e and project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:11.312306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:31:11.315655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:31:11.364200 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-978430fd-2ca9-495d-a1cd-747e5c662248 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.208352 Oct 31 15:31:11.364200 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1778/3655] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:11.373617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94776a25-ea74-4e69-a934-41b01249c707 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.413733 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94776a25-ea74-4e69-a934-41b01249c707 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044779 Oct 31 15:31:11.421489 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1779/3656] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:11.430336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.430959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:11.438260 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e4ffa28-2c38-406d-81ce-372301186974 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621611 Oct 31 15:31:11.438471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.439188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.439725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.440502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.441008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.441427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.444876 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1878/3657] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:31:11.453190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-01348936-7e60-4161-99e0-8014347b718d req-ee56c551-57cc-44cf-950c-198ada697bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d996a123-2a37-4dc3-b750-55fcde7248df", "name": "network-vif-deleted", "tag": "b96b709b-0d7f-4c3d-9c98-89e9cac4f272"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:11.465477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-01348936-7e60-4161-99e0-8014347b718d req-ee56c551-57cc-44cf-950c-198ada697bdd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.465979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-01348936-7e60-4161-99e0-8014347b718d req-ee56c551-57cc-44cf-950c-198ada697bdd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.466421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-01348936-7e60-4161-99e0-8014347b718d req-ee56c551-57cc-44cf-950c-198ada697bdd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.478292 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-01348936-7e60-4161-99e0-8014347b718d req-ee56c551-57cc-44cf-950c-198ada697bdd service nova] Creating event network-vif-deleted:b96b709b-0d7f-4c3d-9c98-89e9cac4f272 for instance d996a123-2a37-4dc3-b750-55fcde7248df on n-h1-858383-17 Oct 31 15:31:11.484019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-01348936-7e60-4161-99e0-8014347b718d req-ee56c551-57cc-44cf-950c-198ada697bdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035676 Oct 31 15:31:11.485205 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1879/3658] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:11.490721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-unplugged", "status": "completed", "tag": "7d1dfbb7-be68-41e6-861f-2714c16eeda6"}, {"server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "name": "network-vif-plugged", "status": "completed", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:11.512609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.513619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.515484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.516730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.516892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.518019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.518804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lazy-loading 'fault' on Instance uuid d996a123-2a37-4dc3-b750-55fcde7248df {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:31:11.555652 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] Creating event network-vif-unplugged:7d1dfbb7-be68-41e6-861f-2714c16eeda6 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:11.556544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] Creating event network-vif-plugged:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:31:11.567744 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5a512cfa-6f68-4720-941e-6fdc406f0599 req-88b756ea-367e-4c4c-9b97-782b2c72d968 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.080749 Oct 31 15:31:11.570550 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1880/3659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:11.585238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.586390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:11.597459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.598682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.599359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.600597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.601370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.602045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.654468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.667935 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd90866c-0cd8-477b-b951-99387deb4670 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 200 len: 1324 microversion: 2.1 time: 0.251854 Oct 31 15:31:11.668535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1780/3660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:11.691854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3869dbef-3f3e-4cbf-8167-fc67c76a9ba0 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca12af3a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.884012 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3869dbef-3f3e-4cbf-8167-fc67c76a9ba0 tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.213888 Oct 31 15:31:11.884937 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1781/3661] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:11.893824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0d9c442-f59e-4042-9c86-c2538896c54d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Action: 'create', calling method: .version_select at 0x7f5ca1503ee0>, body: {"server_group": {"name": "tempest-server-group-91940464", "policies": ["affinity"]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:11.941767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f0d9c442-f59e-4042-9c86-c2538896c54d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:11.955328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f0d9c442-f59e-4042-9c86-c2538896c54d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:12.044913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:12.076669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f0d9c442-f59e-4042-9c86-c2538896c54d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:12.091402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f0d9c442-f59e-4042-9c86-c2538896c54d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:12.149285 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0d9c442-f59e-4042-9c86-c2538896c54d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.260517 Oct 31 15:31:12.150593 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1782/3662] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Oct 31 15:31:11 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:12.159320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-177f433f-c77d-4863-8b96-e5b59cb99ad1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.160609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-177f433f-c77d-4863-8b96-e5b59cb99ad1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:12.202692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.213808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.216115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.217312 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ec31f56-9bce-417b-971f-7989d700f18a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.645298 Oct 31 15:31:12.223306 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1881/3663] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:12.248990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1550a2c4-f62c-40df-a368-aebbdb1c538c tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] Calling method '.version_select at 0x7f5ca13d9af0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.362379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-177f433f-c77d-4863-8b96-e5b59cb99ad1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.373476 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-177f433f-c77d-4863-8b96-e5b59cb99ad1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1215 microversion: 2.1 time: 0.220744 Oct 31 15:31:12.389921 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1783/3664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:12.395572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c24a8899-706d-49c3-af6b-b09ec7955320 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.437496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c24a8899-706d-49c3-af6b-b09ec7955320 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/29f24314-a0e5-4710-b3fa-ea367c183119" status: 204 len: 0 microversion: 2.1 time: 0.046113 Oct 31 15:31:12.438971 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1784/3665] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:12 2022] DELETE /compute/v2.1/os-server-groups/29f24314-a0e5-4710-b3fa-ea367c183119 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:12.444609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.446765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:12.459169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.461864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.463267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.465718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.467074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.467739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.471054 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1550a2c4-f62c-40df-a368-aebbdb1c538c tempest-VolumesTestJSON-452360305 tempest-VolumesTestJSON-452360305-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.246563 Oct 31 15:31:12.471635 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1882/3666] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:12.477241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12b70d69-9b00-4c89-bca1-acdb980d8e9a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.524820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12b70d69-9b00-4c89-bca1-acdb980d8e9a tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.051446 Oct 31 15:31:12.532992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1883/3667] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:12.564937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94bd5c0c-9bdf-4811-91d5-4f2cc2b29771 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Action: 'create', calling method: .version_select at 0x7f5ca139b820>, body: {"server_group": {"name": "tempest-server-group-1189950239", "policies": ["anti-affinity"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:12.607545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-94bd5c0c-9bdf-4811-91d5-4f2cc2b29771 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:12.616535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:12.620330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-94bd5c0c-9bdf-4811-91d5-4f2cc2b29771 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:12.746740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-94bd5c0c-9bdf-4811-91d5-4f2cc2b29771 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:12.769294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-94bd5c0c-9bdf-4811-91d5-4f2cc2b29771 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:12.811610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94bd5c0c-9bdf-4811-91d5-4f2cc2b29771 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.270913 Oct 31 15:31:12.812556 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1884/3668] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Oct 31 15:31:12 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:12.822097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.829121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: d996a123-2a37-4dc3-b750-55fcde7248df] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:12.841864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.844364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.845108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.846638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.847364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.848062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.863740 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] HTTP exception thrown: Instance d996a123-2a37-4dc3-b750-55fcde7248df could not be found. Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Request method failure captured: Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df HTTP/1.1 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-iZ2VvjhE1kqr5x42NPhMR3y2gngJ6gYPFtM4WVCqF2NP834Z4kEX0hvFihvehS0rby3Ppuh0X0wiA5FhiVlJRcXN_v0tMJdlG6sDvxLwcDpQjeHtPByW-p3tTa3UMOjkbD3uVhxBTZerUAOm4ZQr1r9-VkH77rAp6Mqsa2Lo6rVtM Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveMigrationTest-1618818750-project Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 847c3c51ceb3406eb86b222c4638fc59 Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveMigrationTest-1618818750-project Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d996a123-2a37-4dc3-b750-55fcde7248df could not be found. Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd996a123-2a37-4dc3-b750-55fcde7248df'} Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d996a123-2a37-4dc3-b750-55fcde7248df could not be found. Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d996a123-2a37-4dc3-b750-55fcde7248df could not be found. Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:12.865930 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d996a123-2a37-4dc3-b750-55fcde7248df could not be found. Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:12.872682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Returning 404 to user: Instance d996a123-2a37-4dc3-b750-55fcde7248df could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:12.874292 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c156a07a-25ec-4dab-9b6b-45f4ae085246 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df" status: 404 len: 111 microversion: 2.1 time: 0.060163 Oct 31 15:31:12.875291 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1885/3669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/servers/d996a123-2a37-4dc3-b750-55fcde7248df => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:12.884554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4cfe8e1-4a5e-486f-b9d9-34628306244d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.947251 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4cfe8e1-4a5e-486f-b9d9-34628306244d tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/b0208949-c1ae-40b6-846c-b1bdb7217473" status: 204 len: 0 microversion: 2.1 time: 0.070821 Oct 31 15:31:12.948347 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1886/3670] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:12 2022] DELETE /compute/v2.1/os-server-groups/b0208949-c1ae-40b6-846c-b1bdb7217473 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:12.960797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ca4a2d8-ec18-45f0-aab9-b598475619e5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '.version_select at 0x7f5ca139bdc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:13.008147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ca4a2d8-ec18-45f0-aab9-b598475619e5 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397679655" status: 202 len: 0 microversion: 2.1 time: 0.057630 Oct 31 15:31:13.008767 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1887/3671] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:31:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397679655 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:13.032678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f33243d5-3a3f-429b-9696-a443e8cc9b50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:13.055500 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f33243d5-3a3f-429b-9696-a443e8cc9b50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.045379 Oct 31 15:31:13.077085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1888/3672] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:31:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:13.244903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:13.245569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:13.254562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.255251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.255481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:13.256192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.266592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.269876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:13.604353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:13.623886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:13.634065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:13.643865 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7783c885-4447-4535-b403-c11915d5f2b5 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2873 microversion: 2.42 time: 1.201514 Oct 31 15:31:13.647175 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1785/3673] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2873 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:13.667082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1845966218", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a43f14d2-3a4e-496c-9a59-7f517ec1db59"}]}, "os:scheduler_hints": {"group": "545d5127-da34-4b03-b136-b904673282c3"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:13.842456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] validate_networks() for [('a43f14d2-3a4e-496c-9a59-7f517ec1db59', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:31:14.064860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.075532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.079440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.086502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eefc5204-119c-4a24-98cb-13c520bb4a49 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1407 microversion: 2.20 time: 0.841644 Oct 31 15:31:14.087615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1889/3674] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:13 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1407 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:14.093876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.100003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.137557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.139605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.140079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.145254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.145756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.146227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.373751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.384223 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d1f8aa6-203a-4b15-ae79-8bb8f8f53292 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1267 microversion: 2.1 time: 0.295314 Oct 31 15:31:14.390751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1890/3675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:14 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:14.418611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-deleted", "tag": "699d5e32-b18a-41a1-8fd2-752d4710602c"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-deleted", "tag": "7d1dfbb7-be68-41e6-861f-2714c16eeda6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:14.442533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.450886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.452942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.489877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] Creating event network-vif-deleted:699d5e32-b18a-41a1-8fd2-752d4710602c for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:14.491489 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] Creating event network-vif-deleted:7d1dfbb7-be68-41e6-861f-2714c16eeda6 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:14.508554 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8328b954-0c2d-4bcf-b8fd-dd8dbeea7545 req-82c8a5b1-b9b8-46a3-9532-6596b955f6af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113409 Oct 31 15:31:14.512543 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1891/3676] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:14.529432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.530037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.542719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.543466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.543918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.544650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.545143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.545579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.608996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:14.715269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a64c450f-607a-419d-b071-090db7b109aa tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 204 len: 0 microversion: 2.1 time: 0.200513 Oct 31 15:31:14.716630 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1892/3677] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:14 2022] DELETE /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:14.722825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.723832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.731744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.732502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.733992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.735091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.735789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.736806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.202327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:15.220753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:15.227593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:15.229374 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c19c4b77-fbfb-445b-b698-c1b6b60b9d3e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2599 microversion: 2.42 time: 0.511385 Oct 31 15:31:15.231587 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1893/3678] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:14 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2599 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:15.253831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.254857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.271265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.272091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.272760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.273798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.274547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.275278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.905054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:15.923213 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7d404a9-23a2-4d99-bd43-7d6008b89e40 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1485 microversion: 2.1 time: 0.690211 Oct 31 15:31:15.924542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1894/3679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1485 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:15.942968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.943595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.951313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.952061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.952668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.954838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.955467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.956077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.006983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:16.007493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:16.011289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:16.012491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:16.013585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:16.031827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:16.051405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.051908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.052354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.053123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.056157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.056633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.114260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:16.124065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:16.148669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:31:16.151329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:31:16.192877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120626) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 31 15:31:16.216981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_group_members'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:16.227921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_group_members'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:16.314818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_group_members'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:16.321308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Getting quotas for user f49f64ef1eea4be7b0b4f34eaf9a094c and project 8f2c55a7e19348d89bf910385829aff5. Resources: {'server_group_members'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:16.356044 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4392e537-7039-40e6-afae-4839c75da009 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.703060 Oct 31 15:31:16.357057 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1786/3680] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:31:16.363002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.363965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.372167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.372805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.373263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.374155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.374687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.375185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.596331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.613536 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-87b6e92b-1079-4f8b-bb75-2b0288a2762f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1273 microversion: 2.1 time: 0.254637 Oct 31 15:31:16.614134 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1787/3681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:16.634430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.635126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.651406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.652127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.652645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.656970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.661716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.663248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.761670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.771047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.779029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.783565 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-369a8d23-e21d-43f6-8d39-f221e06941ab tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1600 microversion: 2.20 time: 0.857057 Oct 31 15:31:16.784678 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1895/3682] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1600 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:16.804946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-715cc4aa-f2f8-4de8-a745-5acc52106180 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.805770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-715cc4aa-f2f8-4de8-a745-5acc52106180 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.145205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-715cc4aa-f2f8-4de8-a745-5acc52106180 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:17.158319 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-715cc4aa-f2f8-4de8-a745-5acc52106180 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1213 microversion: 2.1 time: 0.370495 Oct 31 15:31:17.176274 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1896/3683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1213 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:17.181916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.182710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.191731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.192559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.193314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.194381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.195065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.195744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.331007 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63f7b9fb-6a83-4693-9885-1de45632d530 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.152449 Oct 31 15:31:17.332245 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1897/3684] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:31:17.338175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-34720827-3d3d-41d1-99a5-1eb45aa8c324 req-926945e1-5300-4bff-9a53-e54bb8c666f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-deleted", "tag": "5673ce77-3331-415e-911c-8827eeed1fec"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:17.379872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-34720827-3d3d-41d1-99a5-1eb45aa8c324 req-926945e1-5300-4bff-9a53-e54bb8c666f0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.382049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-34720827-3d3d-41d1-99a5-1eb45aa8c324 req-926945e1-5300-4bff-9a53-e54bb8c666f0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.383093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-34720827-3d3d-41d1-99a5-1eb45aa8c324 req-926945e1-5300-4bff-9a53-e54bb8c666f0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.397443 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-34720827-3d3d-41d1-99a5-1eb45aa8c324 req-926945e1-5300-4bff-9a53-e54bb8c666f0 service nova] Creating event network-vif-deleted:5673ce77-3331-415e-911c-8827eeed1fec for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:17.404682 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-34720827-3d3d-41d1-99a5-1eb45aa8c324 req-926945e1-5300-4bff-9a53-e54bb8c666f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070643 Oct 31 15:31:17.406057 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1898/3685] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:17.412128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.413860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.422949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.423600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.424140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.425103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.425716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.426239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.633123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:17.645715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:17.647196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:17.648510 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6336f1df-0f6e-4ce6-bd6f-02b02f6b7e01 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2552 microversion: 2.42 time: 1.022807 Oct 31 15:31:17.661463 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1788/3686] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2552 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:17.666512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.667969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.684757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.685570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.686184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.687079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.687712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.688310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.917134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:17.929689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5888433d-f082-4795-9ae2-d75bc7c9ee06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1273 microversion: 2.1 time: 0.264667 Oct 31 15:31:17.944811 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1789/3687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:18.148336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:18.171637 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-957c0e03-87ed-4d3b-8836-59a39b41be68 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 200 len: 1485 microversion: 2.1 time: 0.764066 Oct 31 15:31:18.174777 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1899/3688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 1485 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:18.192815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:18.193363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:18.204689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.205167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.205614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.206350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.206818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.207248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.411418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:18.425566 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-098b5b93-3f63-4aef-a250-2b29616efd7c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1273 microversion: 2.1 time: 0.243223 Oct 31 15:31:18.427426 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1790/3689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:18 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:18.695684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:18.696728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:18.717090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.721281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.725107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.727680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.731349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.732146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.961845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:18.963124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:18.986207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.987150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.987797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.988785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.990319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.992383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.082319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.095633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.097585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.099011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29079640-e96c-4e09-b8d4-762d205c3bc6 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2391 microversion: 2.42 time: 1.409335 Oct 31 15:31:20.122932 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1900/3690] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:18 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2391 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:20.139044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.140519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: c7bdba62-3915-4a6e-9e9a-e62816afbf43] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.145327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.152568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.153367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.155365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.157064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.158201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.159063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.176570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] HTTP exception thrown: Instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 could not be found. Oct 31 15:31:20.178160 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-458dc08b-7d1e-4fd5-9337-e16ffdfc0eac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 1.223010 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Request method failure captured: Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 HTTP/1.1 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-iZ2VvjhE1kqr5x42NPhMR3y2gngJ6gYPFtM4WVCqF2NP834Z4kEX0hvFihvehS0rby3Ppuh0X0wiA5FhiVlJRcXN_v0tMJdlG6sDvxLwcDpQjeHtPByW-p3tTa3UMOjkbD3uVhxBTZerUAOm4ZQr1r9-VkH77rAp6Mqsa2Lo6rVtM Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-LiveMigrationTest-1618818750-project Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 847c3c51ceb3406eb86b222c4638fc59 Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-LiveMigrationTest-1618818750-project Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 could not be found. Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'c7bdba62-3915-4a6e-9e9a-e62816afbf43'} Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 could not be found. Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 could not be found. Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:20.178794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 could not be found. Oct 31 15:31:20.186284 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.188626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1791/3691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:18 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:20.190725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Returning 404 to user: Instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:20.191927 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca1b2739-891f-4f8a-923e-342e15e6c314 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43" status: 404 len: 111 microversion: 2.1 time: 0.065410 Oct 31 15:31:20.192726 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1901/3692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:20 2022] GET /compute/v2.1/servers/c7bdba62-3915-4a6e-9e9a-e62816afbf43 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:20.201829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bdba62-3915-4a6e-9e9a-e62816afbf43", "name": "network-vif-deleted", "tag": "492b079c-3e8b-4cf0-abb8-9148ca51a365"}, {"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-deleted", "tag": "c32bc1a8-8026-4831-9ece-c08bbcaf39c1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:20.207071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.213281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.215096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.215870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.216463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.230533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.231267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.231931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.234143 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] Creating event network-vif-deleted:492b079c-3e8b-4cf0-abb8-9148ca51a365 for instance c7bdba62-3915-4a6e-9e9a-e62816afbf43 on n-h1-858383-17 Oct 31 15:31:20.234852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] Creating event network-vif-deleted:c32bc1a8-8026-4831-9ece-c08bbcaf39c1 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:20.242691 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-073c7ded-2ff4-48aa-ab12-680efdc9389d req-1bed3b4c-e993-4aba-9b3b-97107651bdc9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048378 Oct 31 15:31:20.243644 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1902/3693] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:20.246391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.249135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.250936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.252312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.253138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.260675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.262347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.263006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.264108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.266920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.267643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.373792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:20.406674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.409631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:20.425476 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c09171a4-1216-43a6-a65c-e684e0ecd4ed tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1271 microversion: 2.1 time: 0.236329 Oct 31 15:31:20.429221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1792/3694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:20 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:20.437723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c2db81c4-cf8c-4c4b-af13-336ec1772690 req-c5ac9218-b612-4bd9-9410-e5ac15661a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:20.476914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c2db81c4-cf8c-4c4b-af13-336ec1772690 req-c5ac9218-b612-4bd9-9410-e5ac15661a38 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.477745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c2db81c4-cf8c-4c4b-af13-336ec1772690 req-c5ac9218-b612-4bd9-9410-e5ac15661a38 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.479541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c2db81c4-cf8c-4c4b-af13-336ec1772690 req-c5ac9218-b612-4bd9-9410-e5ac15661a38 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.510414 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c2db81c4-cf8c-4c4b-af13-336ec1772690 req-c5ac9218-b612-4bd9-9410-e5ac15661a38 service nova] Creating event network-changed:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:31:20.524393 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c2db81c4-cf8c-4c4b-af13-336ec1772690 req-c5ac9218-b612-4bd9-9410-e5ac15661a38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088238 Oct 31 15:31:20.527516 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1793/3695] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:20.559623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6eec1426-ff80-4aab-bd88-1f57fed7a64b tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 204 len: 0 microversion: 2.1 time: 0.313997 Oct 31 15:31:20.563453 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1903/3696] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:20 2022] DELETE /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:20.572041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.572759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.585669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.587300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.588949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.592557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.594049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.597323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.125620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:21.134729 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f26f691-47c3-4e8b-97d8-647fa529d512 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1499 microversion: 2.1 time: 0.566943 Oct 31 15:31:21.135044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.135549 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1794/3697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:20 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1499 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:21.137353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.150317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.155949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.156841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.158197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.158512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.159227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.203487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.204111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.220473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.221009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.221462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.222186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.222656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.223089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.275841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:21.813209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:21.829581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:21.831063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:21.836540 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f6cf8c6-685b-46f8-8e90-fbb10bfbed55 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2165 microversion: 2.42 time: 0.705751 Oct 31 15:31:21.838858 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1904/3698] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2165 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:21.849906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.854279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.872032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.872847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.876203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.877292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.877951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.879552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.282883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.294048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e80ddb36-4471-4343-8fec-569564ecd539 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 1.095666 Oct 31 15:31:22.304133 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1795/3699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:22.310537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:22.311456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:22.332469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.349593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.350364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.351332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.352020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.352663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.770964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.785739 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f073533e-2d0d-4a25-8c7b-46050d49bf6c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.940544 Oct 31 15:31:22.786405 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1905/3700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:22.877471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:22.878197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:22.897404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.898051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.898509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.899263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.899727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.900164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.438404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:23.456722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:23.458170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:23.470119 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a288cd5-663f-4c71-bac5-a80553048804 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 2165 microversion: 2.42 time: 0.589537 Oct 31 15:31:23.494407 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1906/3701] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:22 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 2165 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:23.517231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:23.517872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:23.547677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.548187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.548632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.549381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.549836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.550470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.920076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:23.929399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-230d7ad8-25ee-406b-90aa-16070c5e8e71 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1499 microversion: 2.1 time: 1.623584 Oct 31 15:31:23.932508 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1796/3702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:22 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1499 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:23.952791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c2e13093-102b-41ab-a436-537f995e50a8 req-0c7ddcd9-45b8-4841-84a0-19ec883ab50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3cad05f-1a22-414c-a2f6-5a4e5c1850c4", "name": "network-vif-deleted", "tag": "735fab76-f84c-4805-84d4-37b8dceb5040"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:23.972411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c2e13093-102b-41ab-a436-537f995e50a8 req-0c7ddcd9-45b8-4841-84a0-19ec883ab50d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.973147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c2e13093-102b-41ab-a436-537f995e50a8 req-0c7ddcd9-45b8-4841-84a0-19ec883ab50d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.979626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c2e13093-102b-41ab-a436-537f995e50a8 req-0c7ddcd9-45b8-4841-84a0-19ec883ab50d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.005957 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c2e13093-102b-41ab-a436-537f995e50a8 req-0c7ddcd9-45b8-4841-84a0-19ec883ab50d service nova] Creating event network-vif-deleted:735fab76-f84c-4805-84d4-37b8dceb5040 for instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 on n-h1-858383-17 Oct 31 15:31:24.017094 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c2e13093-102b-41ab-a436-537f995e50a8 req-0c7ddcd9-45b8-4841-84a0-19ec883ab50d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068052 Oct 31 15:31:24.021378 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1797/3703] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:24.037813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:24.038967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:24.052662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.057959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.058658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.060783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.061436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.062043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.361438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.377121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac48cab7-a3b4-4501-9f2f-f1024d941f02 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.880686 Oct 31 15:31:24.381078 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1907/3704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:23 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:24.474497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.484306 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dd3eefa-b13e-4022-8d55-5299751591a0 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.459910 Oct 31 15:31:24.484916 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1798/3705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:24 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:24.503108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:24.503388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:24.512057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.512563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.515435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.516194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.516672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.517349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.685456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.696178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.702112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.709543 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0826c2a2-01ae-441a-80a2-a536d525c89c tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.210741 Oct 31 15:31:24.710670 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1908/3706] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:24 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:24.955649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:24.956395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:24.971282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.973625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.975563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.976933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.982589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.983051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.174324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847c3c51ceb3406eb86b222c4638fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e1cf1de16c4f1bac8fb2c7fd1d7cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:25.191044 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55d2b4df-8fd3-4fda-8dfa-ad6aff879cdd tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 200 len: 1457 microversion: 2.1 time: 0.236909 Oct 31 15:31:25.192143 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1799/3707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:24 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 1457 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:25.249319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4edca78b-82de-431e-aadd-53a048ab56a8 req-f1ecb92d-c861-4ff1-966c-105908517f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e", "name": "network-vif-deleted", "tag": "9708d710-440d-457d-abcf-a70ea42adc02"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:25.283908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4edca78b-82de-431e-aadd-53a048ab56a8 req-f1ecb92d-c861-4ff1-966c-105908517f57 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.284787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4edca78b-82de-431e-aadd-53a048ab56a8 req-f1ecb92d-c861-4ff1-966c-105908517f57 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.285779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4edca78b-82de-431e-aadd-53a048ab56a8 req-f1ecb92d-c861-4ff1-966c-105908517f57 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.329278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4edca78b-82de-431e-aadd-53a048ab56a8 req-f1ecb92d-c861-4ff1-966c-105908517f57 service nova] Creating event network-vif-deleted:9708d710-440d-457d-abcf-a70ea42adc02 for instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e on n-h2-858383-17 Oct 31 15:31:25.354136 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4edca78b-82de-431e-aadd-53a048ab56a8 req-f1ecb92d-c861-4ff1-966c-105908517f57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110866 Oct 31 15:31:25.362791 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1909/3708] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:25.406939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:25.407694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:25.422393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.423941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.426521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.427463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.428779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.430105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.514474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:25.515507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:25.541873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.544139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.544852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.545814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.546878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.547659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.081756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:26.330204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=32 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:26.521947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:26.536477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e51eb78e-e6eb-4ca5-8eb8-1d0cec9f8ad9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 1.029431 Oct 31 15:31:26.537110 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1910/3709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:25 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:26.561718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:26.563317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:26.563947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:26.574018 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf1549e6-042b-45c0-9e79-d66863399741 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 1.172037 Oct 31 15:31:26.577631 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1800/3710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:25 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:26.591291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:26.592292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] [instance: f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:26.596591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.597320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.597957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.598965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.599600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.600222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.608608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.610533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.614979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.616228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.618893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.622627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.676214 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] HTTP exception thrown: Instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e could not be found. Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Request method failure captured: Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e HTTP/1.1 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-iZ2VvjhE1kqr5x42NPhMR3y2gngJ6gYPFtM4WVCqF2NP834Z4kEX0hvFihvehS0rby3Ppuh0X0wiA5FhiVlJRcXN_v0tMJdlG6sDvxLwcDpQjeHtPByW-p3tTa3UMOjkbD3uVhxBTZerUAOm4ZQr1r9-VkH77rAp6Mqsa2Lo6rVtM Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/49e1cf1de16c4f1bac8fb2c7fd1d7cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 49e1cf1de16c4f1bac8fb2c7fd1d7cfc Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-LiveMigrationTest-1618818750 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-LiveMigrationTest-1618818750-project Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 847c3c51ceb3406eb86b222c4638fc59 Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-LiveMigrationTest-1618818750-project Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e could not be found. Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e'} Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e could not be found. Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e could not be found. Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:26.682646 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e could not be found. Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:26.687431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] Returning 404 to user: Instance f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:26.688930 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-54bfe93d-da3b-4ea7-b904-d653b7f89ba1 tempest-LiveMigrationTest-1618818750 tempest-LiveMigrationTest-1618818750-project] 10.222.0.48 "GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e" status: 404 len: 111 microversion: 2.1 time: 0.107890 Oct 31 15:31:26.693832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1801/3711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:26 2022] GET /compute/v2.1/servers/f40cb7d4-a2c1-4eb6-a38b-61df59c1bd5e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:26.700431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-86b08025-fc23-4289-ba34-9a72dba8cb4c req-f22bfab3-f1e3-45d5-ae77-7031ef715f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72ae79b-1d7f-476a-a78d-c87145499fa4", "tag": "6e8e0815-df9d-4c8b-9c7b-d5b8a5dc7cfb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:26.734503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86b08025-fc23-4289-ba34-9a72dba8cb4c req-f22bfab3-f1e3-45d5-ae77-7031ef715f5f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.739004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86b08025-fc23-4289-ba34-9a72dba8cb4c req-f22bfab3-f1e3-45d5-ae77-7031ef715f5f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.739617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86b08025-fc23-4289-ba34-9a72dba8cb4c req-f22bfab3-f1e3-45d5-ae77-7031ef715f5f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.775351 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-86b08025-fc23-4289-ba34-9a72dba8cb4c req-f22bfab3-f1e3-45d5-ae77-7031ef715f5f service nova] Creating event network-changed:6e8e0815-df9d-4c8b-9c7b-d5b8a5dc7cfb for instance f72ae79b-1d7f-476a-a78d-c87145499fa4 on n-h1-858383-17 Oct 31 15:31:26.791705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-86b08025-fc23-4289-ba34-9a72dba8cb4c req-f22bfab3-f1e3-45d5-ae77-7031ef715f5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100170 Oct 31 15:31:26.795769 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1802/3712] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:27.150584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:27.347631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.357643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.361544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.366125 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47ca2b25-6360-4ca8-a07c-77c6157f3456 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.814814 Oct 31 15:31:27.366901 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1911/3713] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:26 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:27.428990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7d0c011c-ac49-4b7c-a705-c46018b8fa41 req-910df663-d3cb-47ce-8508-acff32c05674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1894d280-fc85-4f08-8077-d217bb0ec007", "tag": "366ad3e5-7d78-4533-815e-4c853ffac0c8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:27.445383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:27.461506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7d0c011c-ac49-4b7c-a705-c46018b8fa41 req-910df663-d3cb-47ce-8508-acff32c05674 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.462267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7d0c011c-ac49-4b7c-a705-c46018b8fa41 req-910df663-d3cb-47ce-8508-acff32c05674 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.463262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7d0c011c-ac49-4b7c-a705-c46018b8fa41 req-910df663-d3cb-47ce-8508-acff32c05674 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.485134 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7d0c011c-ac49-4b7c-a705-c46018b8fa41 req-910df663-d3cb-47ce-8508-acff32c05674 service nova] Creating event network-changed:366ad3e5-7d78-4533-815e-4c853ffac0c8 for instance 1894d280-fc85-4f08-8077-d217bb0ec007 on n-h2-858383-17 Oct 31 15:31:27.494960 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7d0c011c-ac49-4b7c-a705-c46018b8fa41 req-910df663-d3cb-47ce-8508-acff32c05674 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071537 Oct 31 15:31:27.494960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1803/3714] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:27.564812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:27.565212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:27.585836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.586355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.586772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.587471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.591422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.591943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.603465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:27.604193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:27.628289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.629025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.629755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.633300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.634263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.635100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.578755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.586822 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7b864eb5-c2b8-4863-b5a8-8d2f3791e60a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.990883 Oct 31 15:31:28.587421 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1804/3715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:27 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:28.596589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:28.606254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.615397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.631574 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-389513c8-2372-432e-9ee2-c88d3b634d50 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 1.070581 Oct 31 15:31:28.641239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1912/3716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:27 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:28.643203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.643713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.644158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.644920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.645382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.651058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.788228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.798792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.800241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.801479 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17fb22a0-9a33-4e65-8887-3dc57733ac1a tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.213129 Oct 31 15:31:28.802265 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1805/3717] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:28 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:28.955986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c34568ac-ec79-4756-a491-e9bceb851a62 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Action: 'create', calling method: .version_select at 0x7f5ca1392550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-28457149", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c34568ac-ec79-4756-a491-e9bceb851a62 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Request method failure captured: Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 120 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pQ50mAH1ntsUteZ9onMEHv800dEgO0AZ6GBWiD_DQmNlwXV7k9pWME7CbPG3G-V0adF9aBGuBYkDYIwkp8nsk5IZzhpjNAf0qcI9ilpjkloi3qGgOZK0mEhfcbBRW2lILn4M4w8nsAxOgXvsml5X4ru7iX1TbcpFfrpOTbNfv9Ur0 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: deb79078e5b3467c94ff4c4c6954dcc3 Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-28457149", "metadata": {"Type": "work"}}} Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-28457149', 'metadata': {'Type': 'work'}}}} Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '#$%' Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:28.962170 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c34568ac-ec79-4756-a491-e9bceb851a62 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:28.967989 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c34568ac-ec79-4756-a491-e9bceb851a62 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.267621 Oct 31 15:31:28.975622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5bd70c8-14fb-47f6-93d9-b32be0acad20 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Action: 'create', calling method: .version_select at 0x7f5ca12628b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-789632287", "metadata": {"Type": "work"}}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5bd70c8-14fb-47f6-93d9-b32be0acad20 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Request method failure captured: Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 119 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-pQ50mAH1ntsUteZ9onMEHv800dEgO0AZ6GBWiD_DQmNlwXV7k9pWME7CbPG3G-V0adF9aBGuBYkDYIwkp8nsk5IZzhpjNAf0qcI9ilpjkloi3qGgOZK0mEhfcbBRW2lILn4M4w8nsAxOgXvsml5X4ru7iX1TbcpFfrpOTbNfv9Ur0 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: deb79078e5b3467c94ff4c4c6954dcc3 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-789632287", "metadata": {"Type": "work"}}} Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-789632287', 'metadata': {'Type': 'work'}}}} Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi '0' Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:28.982629 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:28.987429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:28.989081 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1913/3718] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 31 15:31:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:31:28.989592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5bd70c8-14fb-47f6-93d9-b32be0acad20 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:28.990693 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5bd70c8-14fb-47f6-93d9-b32be0acad20 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019278 Oct 31 15:31:28.991483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1806/3719] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 31 15:31:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:31:29.001388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c2a8525-24b0-4c72-8794-da086055abc8 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Action: 'create', calling method: .version_select at 0x7f5ca141bb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1664256704", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c2a8525-24b0-4c72-8794-da086055abc8 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Request method failure captured: Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 119 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pQ50mAH1ntsUteZ9onMEHv800dEgO0AZ6GBWiD_DQmNlwXV7k9pWME7CbPG3G-V0adF9aBGuBYkDYIwkp8nsk5IZzhpjNAf0qcI9ilpjkloi3qGgOZK0mEhfcbBRW2lILn4M4w8nsAxOgXvsml5X4ru7iX1TbcpFfrpOTbNfv9Ur0 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: deb79078e5b3467c94ff4c4c6954dcc3 Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1664256704", "metadata": {"Type": "work"}}} Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1664256704', 'metadata': {'Type': 'work'}}}} Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '' Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:29.006125 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 15:31:29.011852 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.018693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c2a8525-24b0-4c72-8794-da086055abc8 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:29.019438 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0c2a8525-24b0-4c72-8794-da086055abc8 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022217 Oct 31 15:31:29.020380 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1914/3720] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 31 15:31:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:29.030874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ced3be7-369b-4b47-9054-b13a846b4f96 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Calling method '.version_select at 0x7f5ca1560160>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.067180 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0ced3be7-369b-4b47-9054-b13a846b4f96 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] HTTP exception thrown: Volume tempest-invalid-1006841485 could not be found. Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ced3be7-369b-4b47-9054-b13a846b4f96 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Request method failure captured: Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1006841485 HTTP/1.1 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-pQ50mAH1ntsUteZ9onMEHv800dEgO0AZ6GBWiD_DQmNlwXV7k9pWME7CbPG3G-V0adF9aBGuBYkDYIwkp8nsk5IZzhpjNAf0qcI9ilpjkloi3qGgOZK0mEhfcbBRW2lILn4M4w8nsAxOgXvsml5X4ru7iX1TbcpFfrpOTbNfv9Ur0 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: deb79078e5b3467c94ff4c4c6954dcc3 Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: exception: Volume tempest-invalid-1006841485 could not be found. Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'tempest-invalid-1006841485'} Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1006841485 could not be found. (HTTP 404) (Request-ID: req-1d30ff68-32ea-428a-8a09-055228c38fc2) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:31:29.112395 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1006841485 could not be found. Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1006841485 could not be found. Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1006841485 could not be found. Oct 31 15:31:29.116862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.123661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ced3be7-369b-4b47-9054-b13a846b4f96 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Returning 404 to user: Volume tempest-invalid-1006841485 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:29.124835 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ced3be7-369b-4b47-9054-b13a846b4f96 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1006841485" status: 404 len: 99 microversion: 2.1 time: 0.099250 Oct 31 15:31:29.125994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1807/3721] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:31:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1006841485 => generated 99 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:31:29.136312 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-982525fb-45ae-47ec-b30b-348d5a6c9d09 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004754 Oct 31 15:31:29.136959 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1915/3722] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 31 15:31:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:31:29.147075 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9aad4d34-4549-4351-b81d-4f85932af840 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004690 Oct 31 15:31:29.147916 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1808/3723] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:31:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:31:29.158426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-902192d5-924f-4f93-9ade-0c4f020c9157 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Calling method '.version_select at 0x7f5ca1392c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.228858 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-902192d5-924f-4f93-9ade-0c4f020c9157 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] HTTP exception thrown: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-902192d5-924f-4f93-9ade-0c4f020c9157 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Request method failure captured: Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-volumes/69c98a1b-edfb-4fc8-9091-c51af6aae268 HTTP/1.1 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pQ50mAH1ntsUteZ9onMEHv800dEgO0AZ6GBWiD_DQmNlwXV7k9pWME7CbPG3G-V0adF9aBGuBYkDYIwkp8nsk5IZzhpjNAf0qcI9ilpjkloi3qGgOZK0mEhfcbBRW2lILn4M4w8nsAxOgXvsml5X4ru7iX1TbcpFfrpOTbNfv9Ur0 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: deb79078e5b3467c94ff4c4c6954dcc3 Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: exception: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '69c98a1b-edfb-4fc8-9091-c51af6aae268'} Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. (HTTP 404) (Request-ID: req-4ec805e4-ee9a-45ec-a673-39415af35dff) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:31:29.233186 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. Oct 31 15:31:29.238143 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.244867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-902192d5-924f-4f93-9ade-0c4f020c9157 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Returning 404 to user: Volume 69c98a1b-edfb-4fc8-9091-c51af6aae268 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:29.246962 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-902192d5-924f-4f93-9ade-0c4f020c9157 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/69c98a1b-edfb-4fc8-9091-c51af6aae268" status: 404 len: 109 microversion: 2.1 time: 0.092116 Oct 31 15:31:29.247761 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1916/3724] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:31:29 2022] DELETE /compute/v2.1/os-volumes/69c98a1b-edfb-4fc8-9091-c51af6aae268 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:29.258017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc9cd609-c07b-48dc-8c0b-cf8aedca6c38 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Calling method '.version_select at 0x7f5ca15720d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.321779 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-dc9cd609-c07b-48dc-8c0b-cf8aedca6c38 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] HTTP exception thrown: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc9cd609-c07b-48dc-8c0b-cf8aedca6c38 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Request method failure captured: Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-volumes/9ac2eda3-4e2b-4918-a20d-655c6e430d22 HTTP/1.1 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-pQ50mAH1ntsUteZ9onMEHv800dEgO0AZ6GBWiD_DQmNlwXV7k9pWME7CbPG3G-V0adF9aBGuBYkDYIwkp8nsk5IZzhpjNAf0qcI9ilpjkloi3qGgOZK0mEhfcbBRW2lILn4M4w8nsAxOgXvsml5X4ru7iX1TbcpFfrpOTbNfv9Ur0 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c5364bc80cc544eeb98d34c339dfd4bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c5364bc80cc544eeb98d34c339dfd4bf Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesNegativeTest-609012358 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: deb79078e5b3467c94ff4c4c6954dcc3 Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesNegativeTest-609012358-project Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: exception: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9ac2eda3-4e2b-4918-a20d-655c6e430d22'} Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. (HTTP 404) (Request-ID: req-aa3b6ee0-55be-41ec-b47b-76feb27edbbb) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:31:29.324303 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:29.329665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc9cd609-c07b-48dc-8c0b-cf8aedca6c38 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] Returning 404 to user: Volume 9ac2eda3-4e2b-4918-a20d-655c6e430d22 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:29.338280 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc9cd609-c07b-48dc-8c0b-cf8aedca6c38 tempest-VolumesNegativeTest-609012358 tempest-VolumesNegativeTest-609012358-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9ac2eda3-4e2b-4918-a20d-655c6e430d22" status: 404 len: 109 microversion: 2.1 time: 0.077817 Oct 31 15:31:29.338280 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1809/3725] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:31:29 2022] GET /compute/v2.1/os-volumes/9ac2eda3-4e2b-4918-a20d-655c6e430d22 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:31:29.613098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.613720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:29.615777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:29.626537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.627045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.627491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.628269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.628652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.633296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.656874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.657378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:29.673918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.677340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.677990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.678926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.679632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.680538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.018388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.028009 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9032744-1eb5-4f92-9f03-83bdbf6a3e47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.420742 Oct 31 15:31:30.032818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1917/3726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:29 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:30.048237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:30.053179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:30.072087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.073050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.073886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.075464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.076097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.076533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.119511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:30.254623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.269525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.272760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.274219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51070474-9ad8-4422-aed0-6d2bd3240c68 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.240154 Oct 31 15:31:30.293539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1918/3727] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:30 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:30.550264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.562513 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0aae01c4-fe46-4897-969a-9e3473a8b0e4 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.911363 Oct 31 15:31:30.563126 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1810/3728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:29 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:31.060149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:31.060749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:31.080772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.081299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.081743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.082474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.082933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.083364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.315234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:31.315718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:31.327129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.331853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.332555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.333555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.334225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.335009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.364335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.374014 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb163ea6-6d16-4b36-b3af-f79c982b408d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.320699 Oct 31 15:31:31.384992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1919/3729] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:31 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:31.503726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.515076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.521957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.523357 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-135f9a98-873c-4e76-a012-1f3c0f10efb0 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.213586 Oct 31 15:31:31.537637 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1811/3730] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:31 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:31.587804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:31.588836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:31.601269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.602063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.602687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.607257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.607995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.608830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.918514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.929154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08a1bfc7-4211-481f-813e-f107aacf4b57 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.345252 Oct 31 15:31:31.930396 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1812/3731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:31 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:32.036133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-967400763", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "c434093f-3fbe-495e-a69d-5d6525f3d51c"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:32.149308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] validate_networks() for [('c434093f-3fbe-495e-a69d-5d6525f3d51c', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:31:32.397009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:32.397716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:32.417500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.421353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.421990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.422906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.425242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.425866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.895789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:32.896639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:32.897324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:32.898384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:32.898974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:32.918024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:32.927338 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dabab5d2-5743-4b26-beb9-f93180b9459b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.534257 Oct 31 15:31:32.930077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.931076 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1813/3732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:32 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:32.933307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.934027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.934992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.935647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.936281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.944862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:32.945780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:32.956000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.961134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.961861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.962793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.965194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.965878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.978256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Getting quotas for project 45f6b73c45784731bdf32b36378474de. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:32.992327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Getting quotas for user d56792ab8451481f82bb4d87b29ff9df and project 45f6b73c45784731bdf32b36378474de. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:33.046575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:31:33.049000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:31:33.113742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.123131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.124576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.134619 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a5ac72d-f86b-4565-87d9-ebf60ba04d1d tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.201760 Oct 31 15:31:33.135214 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1814/3733] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:32 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:33.143985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27be2787-91b6-4b41-a2f6-7c6aba5f1634 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756735 Oct 31 15:31:33.145150 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1920/3734] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:31:33.164126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:33.165076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:33.184080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.188825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.189506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.190564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.193276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.193908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.205493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78ad7077-45b3-417b-8621-2541e49b9758 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:33.206159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78ad7077-45b3-417b-8621-2541e49b9758 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:33.324115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-78ad7077-45b3-417b-8621-2541e49b9758 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.333194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78ad7077-45b3-417b-8621-2541e49b9758 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1217 microversion: 2.1 time: 0.175097 Oct 31 15:31:33.336674 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1921/3735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:33 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:33.552889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.561389 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7994dc7f-20c9-4547-9b9a-39f7cfa77ef9 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.423432 Oct 31 15:31:33.561996 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1815/3736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:33 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:33.957808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:33.958432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:33.976360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.976907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.977323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.978035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.978496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.978922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.170160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.170928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.187276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.193529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.196101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.197515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.200642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.201725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.440821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.448417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:34.456903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.461766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.465463 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-abaa56b9-f8c4-4aca-b2f9-d58a7403ab97 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.300313 Oct 31 15:31:34.470358 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1816/3737] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:34.477676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.480903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.504154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.505268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.505984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.507134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.507792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.508386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.515836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.529510 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8869501a-b24d-4819-aba5-f97466e994ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.577900 Oct 31 15:31:34.537799 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1922/3738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:33 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:34.586045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.586983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.596215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.602115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.602967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.603945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.605950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.606610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.350495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.363408 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e94478c-530c-4d7c-b1a8-c514b26b3ea2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1213 microversion: 2.1 time: 0.887513 Oct 31 15:31:35.366162 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1817/3739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1213 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:35.383120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c81fe6ab-02e4-4319-a865-11660a54f7d1 req-dfcea034-3eaf-4901-baa6-6467cc7dba67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72ae79b-1d7f-476a-a78d-c87145499fa4", "name": "network-vif-plugged", "status": "completed", "tag": "6e8e0815-df9d-4c8b-9c7b-d5b8a5dc7cfb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:35.408879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c81fe6ab-02e4-4319-a865-11660a54f7d1 req-dfcea034-3eaf-4901-baa6-6467cc7dba67 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.412289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c81fe6ab-02e4-4319-a865-11660a54f7d1 req-dfcea034-3eaf-4901-baa6-6467cc7dba67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.413215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c81fe6ab-02e4-4319-a865-11660a54f7d1 req-dfcea034-3eaf-4901-baa6-6467cc7dba67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.433881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c81fe6ab-02e4-4319-a865-11660a54f7d1 req-dfcea034-3eaf-4901-baa6-6467cc7dba67 service nova] Creating event network-vif-plugged:6e8e0815-df9d-4c8b-9c7b-d5b8a5dc7cfb for instance f72ae79b-1d7f-476a-a78d-c87145499fa4 on n-h1-858383-17 Oct 31 15:31:35.458037 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c81fe6ab-02e4-4319-a865-11660a54f7d1 req-dfcea034-3eaf-4901-baa6-6467cc7dba67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086470 Oct 31 15:31:35.462266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1818/3740] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:35.500385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:35.502768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.508892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:35.513845 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f71832ff-0a73-4edc-8465-ad16260d107b tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.932306 Oct 31 15:31:35.520617 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1923/3741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:35.525690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.533753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.535175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.536033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.536773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.537441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.560602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:35.561977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:35.582600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.583213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.583726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.584530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.585172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.588609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.839378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.857740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.863384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.867623 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-196eb8a1-17a2-4f93-90f5-360b795d8c88 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.371118 Oct 31 15:31:35.883168 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1819/3742] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:35 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:35.982446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.993152 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bbae7e45-cffa-4b98-abab-1d9d9a6f79d4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.437524 Oct 31 15:31:35.997578 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1924/3743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:35 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:36.394707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:36.396047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:36.413599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.416220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.416939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.423264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.423958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.424608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.548275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:36.549475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:36.562139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.570783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:36.574576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.575271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.578140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.578734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.579222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.585783 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd33d70b-9d3c-4f0e-a636-1b5d123625e8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1275 microversion: 2.1 time: 0.193401 Oct 31 15:31:36.587263 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1820/3744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:36 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:36.903880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:36.904803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:36.914003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.914833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.915820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.918578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.920441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.921987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.125668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.137252 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba07594a-b616-465a-8643-873e63d6b8b2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.594182 Oct 31 15:31:37.144473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.144999 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1925/3745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:36 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:37.149935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:37.166259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.168249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.169933 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4abc8ab7-f070-4db5-bab9-a7c28676b319 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.273968 Oct 31 15:31:37.171152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1821/3746] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:36 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:37.183070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.196776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.206721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.207579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.210630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.211353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.211974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.538665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-24f8e87f-1ea5-416d-a2e5-53a1141f8e43 req-4be64ea1-377c-487b-ba83-e35ac7b90952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1894d280-fc85-4f08-8077-d217bb0ec007", "name": "network-vif-plugged", "status": "completed", "tag": "366ad3e5-7d78-4533-815e-4c853ffac0c8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:37.577342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-24f8e87f-1ea5-416d-a2e5-53a1141f8e43 req-4be64ea1-377c-487b-ba83-e35ac7b90952 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.577826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-24f8e87f-1ea5-416d-a2e5-53a1141f8e43 req-4be64ea1-377c-487b-ba83-e35ac7b90952 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.591533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-24f8e87f-1ea5-416d-a2e5-53a1141f8e43 req-4be64ea1-377c-487b-ba83-e35ac7b90952 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.627361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-24f8e87f-1ea5-416d-a2e5-53a1141f8e43 req-4be64ea1-377c-487b-ba83-e35ac7b90952 service nova] Creating event network-vif-plugged:366ad3e5-7d78-4533-815e-4c853ffac0c8 for instance 1894d280-fc85-4f08-8077-d217bb0ec007 on n-h2-858383-17 Oct 31 15:31:37.658712 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-24f8e87f-1ea5-416d-a2e5-53a1141f8e43 req-4be64ea1-377c-487b-ba83-e35ac7b90952 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124893 Oct 31 15:31:37.660226 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1822/3747] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:37.684979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:37.692545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.704600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.712565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.717155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0b3c2a5-9311-45ee-9aa5-03a0ef433e26 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1315 microversion: 2.1 time: 0.569459 Oct 31 15:31:37.719226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1926/3748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:37 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:37.719400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.719868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.720846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.723518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.724002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.079027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.089831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9334c52-d7c1-4b2b-bc0f-0c6f70ba830e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.426100 Oct 31 15:31:38.090501 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1823/3749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:37 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:38.163284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:38.164353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:38.174649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.175580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.176792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.180205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.181762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.183485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.202456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:38.203257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:38.210990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.211508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.214797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.216982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.217531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.227503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.517021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.534881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.538664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.541190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a730375-dc48-4d23-9064-57134d0a3ca8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.343115 Oct 31 15:31:38.558648 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1824/3750] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:38 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:38.667633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-caaf0c7c-8a97-4230-86cc-160fb2c79f07 req-8aa88a78-831e-4d19-be0d-f19e4dbd3f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c", "tag": "994ba79a-be9e-4b61-938f-64b69e61e2ee"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:38.671295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.679294 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a5a7561-15cc-44c7-8d5a-621b14349f87 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1313 microversion: 2.1 time: 0.520217 Oct 31 15:31:38.691648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-caaf0c7c-8a97-4230-86cc-160fb2c79f07 req-8aa88a78-831e-4d19-be0d-f19e4dbd3f02 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.692438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-caaf0c7c-8a97-4230-86cc-160fb2c79f07 req-8aa88a78-831e-4d19-be0d-f19e4dbd3f02 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.693587 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1927/3751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:38 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:38.693822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-caaf0c7c-8a97-4230-86cc-160fb2c79f07 req-8aa88a78-831e-4d19-be0d-f19e4dbd3f02 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.716573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-caaf0c7c-8a97-4230-86cc-160fb2c79f07 req-8aa88a78-831e-4d19-be0d-f19e4dbd3f02 service nova] Creating event network-changed:994ba79a-be9e-4b61-938f-64b69e61e2ee for instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c on n-h2-858383-17 Oct 31 15:31:38.737387 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-caaf0c7c-8a97-4230-86cc-160fb2c79f07 req-8aa88a78-831e-4d19-be0d-f19e4dbd3f02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073659 Oct 31 15:31:38.738897 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1825/3752] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:38.740870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:38.741451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:38.749071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.749486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.749930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.750696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.751349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.752086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.082060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.099653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-727622de-1fd0-4242-b8ba-7303160f7ae2 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1501 microversion: 2.1 time: 0.362634 Oct 31 15:31:39.100515 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1928/3753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:38 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:39.118899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:39.119912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:39.127067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:39.155403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:39.179386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.179905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.180352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.181114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.181571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.185785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.193203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.205354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.206016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.207811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.209932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.211931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.349323 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-357dc916-b6d4-492c-9080-9c868988d90d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.225931 Oct 31 15:31:39.349994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1929/3754] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:39 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:31:39.562101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.570494 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2a00472-3516-40b2-90cb-8eb830c36f11 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.457377 Oct 31 15:31:39.571091 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1826/3755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:39 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:39.575449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:39.576444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:39.597806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.599190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.600288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.602686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.606052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.608607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.706203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:39.707483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:39.725748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.726557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.727174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.736303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.737038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.737650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.921961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.941340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.944302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.946684 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3012e4f-f229-4e02-a99a-ea5ce6914c34 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.378795 Oct 31 15:31:39.950671 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1930/3756] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:39 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:40.196053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.206042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d799903-57e4-416a-a940-a65f67bdff64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1498 microversion: 2.1 time: 0.503566 Oct 31 15:31:40.206786 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1827/3757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:39 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1498 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:40.235114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d02d82b8-ddf8-4535-acc5-bbdaad15cd64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.269518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_groups [None req-d02d82b8-ddf8-4535-acc5-bbdaad15cd64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Querying cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) for 1 instances {{(pid=120625) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:31:40.273207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d02d82b8-ddf8-4535-acc5-bbdaad15cd64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.273896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d02d82b8-ddf8-4535-acc5-bbdaad15cd64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.274351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d02d82b8-ddf8-4535-acc5-bbdaad15cd64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.323313 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d02d82b8-ddf8-4535-acc5-bbdaad15cd64 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/545d5127-da34-4b03-b136-b904673282c3" status: 200 len: 222 microversion: 2.1 time: 0.092967 Oct 31 15:31:40.329787 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1931/3758] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/os-server-groups/545d5127-da34-4b03-b136-b904673282c3 => generated 222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:40.334796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.335291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.342620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.343118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.344007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.345004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.345625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.346239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.361572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:40.364058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.377009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.377512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.377958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.378671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.381335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.382005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.397376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:40.465881 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03fe354c-8711-4851-8a61-53c9b328eedf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.107817 Oct 31 15:31:40.466423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1932/3759] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:40 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:31:40.539788 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-375f6d8a-b5a5-4074-95d9-4487d4cc9c46 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 204 len: 0 microversion: 2.1 time: 0.208619 Oct 31 15:31:40.540965 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1828/3760] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:40 2022] DELETE /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:31:40.552981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.554077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.567403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.568365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.569505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.571018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.572012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.573696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.597540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.598873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.612781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.613644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.614515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.619293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.620841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.621591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.933254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.952581 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-032c7375-5923-4c1e-a0b9-7e3f308cc0b6 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1504 microversion: 2.1 time: 0.403318 Oct 31 15:31:40.969576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1933/3761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:40.983752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.984384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.993722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.994231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.995177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.996233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.996889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.997575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.070661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.079112 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e0b65a2c-4bf0-4380-82a5-6ef669b15c5e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.486650 Oct 31 15:31:41.099443 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1829/3762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:41.478046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:41.483762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:41.498295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.499316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.500243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.501670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.502752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.503646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.521669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.536017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.540639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.542340 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e273b37d-48ab-4e8a-88bf-31bbfcc38217 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.566415 Oct 31 15:31:41.544911 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1934/3763] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:41.592916 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-23d085b9-0bc9-4c46-bfa4-f6803eb8da33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.119566 Oct 31 15:31:41.597144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1830/3764] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:41 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:31:41.985063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:41.985591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:41.995754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.996256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.998777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.001109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.001974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.003043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.110056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:42.110917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:42.148075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.153838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.154379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.157362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.157952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.158397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.331171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:42.345937 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ea751a5-067c-41b3-9b5b-970379115f86 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1504 microversion: 2.1 time: 0.365516 Oct 31 15:31:42.347919 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1935/3765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:41 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:42.454149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:42.465407 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79ee2eaf-905a-4ce9-afb2-15a3513c085d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.365946 Oct 31 15:31:42.467285 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1831/3766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:42 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:42.572434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:42.573552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:42.581562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.582994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.584415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.585413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.586074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.587220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.605681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:42.608065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:42.624063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.625655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.626314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.632527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.634836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.637526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.689089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:42.703305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:42.705990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:42.707583 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8de9785a-9d07-40d3-a4a1-76b2677feef8 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.139882 Oct 31 15:31:42.722195 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1936/3767] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:42 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:42.730776 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4948768-d93b-4240-b643-792b3aa213ac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.121911 Oct 31 15:31:42.730776 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1832/3768] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:42 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:31:43.388665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:43.390635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-66afa2b9-319d-410f-891e-5e20b2941f88 req-bbfdb514-3478-4cc1-a52e-cfe479f2f59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1894d280-fc85-4f08-8077-d217bb0ec007", "name": "network-vif-deleted", "tag": "366ad3e5-7d78-4533-815e-4c853ffac0c8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:43.391469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:43.399928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:43.401835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:43.413765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.426450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66afa2b9-319d-410f-891e-5e20b2941f88 req-bbfdb514-3478-4cc1-a52e-cfe479f2f59b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.428200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.431179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.431947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.433794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66afa2b9-319d-410f-891e-5e20b2941f88 req-bbfdb514-3478-4cc1-a52e-cfe479f2f59b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.434960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.437885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66afa2b9-319d-410f-891e-5e20b2941f88 req-bbfdb514-3478-4cc1-a52e-cfe479f2f59b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.440908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.474442 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-66afa2b9-319d-410f-891e-5e20b2941f88 req-bbfdb514-3478-4cc1-a52e-cfe479f2f59b service nova] Creating event network-vif-deleted:366ad3e5-7d78-4533-815e-4c853ffac0c8 for instance 1894d280-fc85-4f08-8077-d217bb0ec007 on n-h2-858383-17 Oct 31 15:31:43.488041 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-66afa2b9-319d-410f-891e-5e20b2941f88 req-bbfdb514-3478-4cc1-a52e-cfe479f2f59b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106803 Oct 31 15:31:43.493435 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1833/3769] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:43.500000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:43.504527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:43.525099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:43.529140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.533923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.534713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.536833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.537705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.542865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.653349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49f64ef1eea4be7b0b4f34eaf9a094c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2c55a7e19348d89bf910385829aff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:43.663599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-061f3b2d-97df-4b78-80de-8311b307a5ab tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 200 len: 1298 microversion: 2.1 time: 0.292577 Oct 31 15:31:43.684831 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1937/3770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:43 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:43.736472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:43.738871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:43.751683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.752392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.753033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.753917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.754563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.755149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.818908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-809eacfe-8400-4b1e-be69-9232ebbc3816 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.087731 Oct 31 15:31:43.823196 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1938/3771] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:43 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:31:43.844533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:43.846790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:43.866975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.868522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.874732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.875932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.877868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.879079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.892512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:43.906112 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-322cdf97-588f-47ff-bdb4-be409133876b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.411268 Oct 31 15:31:43.906746 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1834/3772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:43 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:44.000474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:44.015688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:44.018191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:44.020256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5a65864-5c04-4302-848b-3dde0f731aec tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.193962 Oct 31 15:31:44.035479 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1939/3773] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:43 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:44.692876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.694159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.712768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.715957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.716649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.717648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.718326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.720842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.734500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:44.762425 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 HTTP/1.1 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1894d280-fc85-4f08-8077-d217bb0ec007'} Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:44.771429 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0c43f8b9-4139-4361-a38c-5b8969b7c2a2 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 404 len: 111 microversion: 2.1 time: 0.084182 Oct 31 15:31:44.779401 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1835/3774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:44.786001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55cfa7d1-1d5a-4fd7-aa5e-567a2fef2676 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.803715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_groups [None req-55cfa7d1-1d5a-4fd7-aa5e-567a2fef2676 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Querying cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) for 1 instances {{(pid=120625) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:31:44.804363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55cfa7d1-1d5a-4fd7-aa5e-567a2fef2676 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.804876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55cfa7d1-1d5a-4fd7-aa5e-567a2fef2676 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.805307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55cfa7d1-1d5a-4fd7-aa5e-567a2fef2676 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.815792 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55cfa7d1-1d5a-4fd7-aa5e-567a2fef2676 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033579 Oct 31 15:31:44.816373 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1940/3775] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:44.828366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a67e956c-db48-4160-aea1-9ce4011f0e22 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.841114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:44.844059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.844911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.compute.server_groups [None req-a67e956c-db48-4160-aea1-9ce4011f0e22 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Querying cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) for 1 instances {{(pid=120626) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:31:44.846000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a67e956c-db48-4160-aea1-9ce4011f0e22 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.846657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a67e956c-db48-4160-aea1-9ce4011f0e22 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.847639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a67e956c-db48-4160-aea1-9ce4011f0e22 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.855353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.856079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.856759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.857704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.858362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.859554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.862130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a67e956c-db48-4160-aea1-9ce4011f0e22 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/545d5127-da34-4b03-b136-b904673282c3" status: 200 len: 184 microversion: 2.1 time: 0.037529 Oct 31 15:31:44.863138 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1836/3776] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/os-server-groups/545d5127-da34-4b03-b136-b904673282c3 => generated 184 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:44.877631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.878257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.886006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.886502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.887086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.887859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.888386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.888941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.905600 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 HTTP/1.1 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1894d280-fc85-4f08-8077-d217bb0ec007'} Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:44.907405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3b63cfc-33ca-495b-b60f-20472ae99472 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 404 len: 111 microversion: 2.1 time: 0.038610 Oct 31 15:31:44.913840 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1837/3777] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:44 2022] DELETE /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:44.920490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.921227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] [instance: 1894d280-fc85-4f08-8077-d217bb0ec007] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.929182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.929753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.930277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.931043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.931758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.932813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.940105 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ddd5a837-b874-41dd-903c-b5be67d68acb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.104118 Oct 31 15:31:44.941959 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1941/3778] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:44 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:31:44.950347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.951303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.959829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.962391 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 HTTP/1.1 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1894d280-fc85-4f08-8077-d217bb0ec007'} Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:44.965180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. Oct 31 15:31:44.971473 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:44.972936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance 1894d280-fc85-4f08-8077-d217bb0ec007 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:44.974021 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-05f0942c-be25-411b-a4e2-30401dfde867 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007" status: 404 len: 111 microversion: 2.1 time: 0.057803 Oct 31 15:31:44.977619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.977619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.978522 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1838/3779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/servers/1894d280-fc85-4f08-8077-d217bb0ec007 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:44.980260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.981640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.983664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.985290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5d8ddff-b7be-4542-a6ee-7501ed2a23cd tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.003757 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b5d8ddff-b7be-4542-a6ee-7501ed2a23cd tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance group b0208949-c1ae-40b6-846c-b1bdb7217473 could not be found. Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5d8ddff-b7be-4542-a6ee-7501ed2a23cd tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-server-groups/b0208949-c1ae-40b6-846c-b1bdb7217473 HTTP/1.1 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance group b0208949-c1ae-40b6-846c-b1bdb7217473 could not be found. Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b0208949-c1ae-40b6-846c-b1bdb7217473'} Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b0208949-c1ae-40b6-846c-b1bdb7217473 could not be found. Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b0208949-c1ae-40b6-846c-b1bdb7217473 could not be found. Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.013779 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b0208949-c1ae-40b6-846c-b1bdb7217473 could not be found. Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5d8ddff-b7be-4542-a6ee-7501ed2a23cd tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance group b0208949-c1ae-40b6-846c-b1bdb7217473 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:45.019305 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5d8ddff-b7be-4542-a6ee-7501ed2a23cd tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/b0208949-c1ae-40b6-846c-b1bdb7217473" status: 404 len: 117 microversion: 2.1 time: 0.038759 Oct 31 15:31:45.023182 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1839/3780] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:44 2022] DELETE /compute/v2.1/os-server-groups/b0208949-c1ae-40b6-846c-b1bdb7217473 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:45.035575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4199bc7b-f0f6-4e4a-8f01-58509d1f2503 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.044782 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4199bc7b-f0f6-4e4a-8f01-58509d1f2503 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance group 29f24314-a0e5-4710-b3fa-ea367c183119 could not be found. Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4199bc7b-f0f6-4e4a-8f01-58509d1f2503 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-server-groups/29f24314-a0e5-4710-b3fa-ea367c183119 HTTP/1.1 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance group 29f24314-a0e5-4710-b3fa-ea367c183119 could not be found. Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '29f24314-a0e5-4710-b3fa-ea367c183119'} Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29f24314-a0e5-4710-b3fa-ea367c183119 could not be found. Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29f24314-a0e5-4710-b3fa-ea367c183119 could not be found. Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.046391 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29f24314-a0e5-4710-b3fa-ea367c183119 could not be found. Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4199bc7b-f0f6-4e4a-8f01-58509d1f2503 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance group 29f24314-a0e5-4710-b3fa-ea367c183119 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4199bc7b-f0f6-4e4a-8f01-58509d1f2503 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/29f24314-a0e5-4710-b3fa-ea367c183119" status: 404 len: 117 microversion: 2.1 time: 0.019651 Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1840/3781] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:45 2022] DELETE /compute/v2.1/os-server-groups/29f24314-a0e5-4710-b3fa-ea367c183119 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.055767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:45.061292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:45.061795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:45.062233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:45.063003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:45.063407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:45.063836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:45.168003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.181624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.183478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.185130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78a665a0-4820-406e-9936-60e6c3588ec9 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1603 microversion: 2.42 time: 0.135301 Oct 31 15:31:45.186075 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1841/3782] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:45 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1603 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:45.192778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04f833aa-8309-4ef7-8b1e-4b2b721ffd15 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.200387 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-04f833aa-8309-4ef7-8b1e-4b2b721ffd15 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance group 1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a could not be found. Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04f833aa-8309-4ef7-8b1e-4b2b721ffd15 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-server-groups/1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a HTTP/1.1 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance group 1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a could not be found. Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a'} Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a could not be found. Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a could not be found. Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.202680 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.207094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.207094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.207094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:45.207094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:45.207094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a could not be found. Oct 31 15:31:45.207094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.209294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04f833aa-8309-4ef7-8b1e-4b2b721ffd15 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance group 1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:45.210785 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04f833aa-8309-4ef7-8b1e-4b2b721ffd15 tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a" status: 404 len: 117 microversion: 2.1 time: 0.023447 Oct 31 15:31:45.212905 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1842/3783] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:45 2022] DELETE /compute/v2.1/os-server-groups/1adbc5c0-fd7b-4d42-85a2-9b1f039ed32a => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:45.223071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-190912d3-088a-4c33-bb6b-ace2236875db tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.231933 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-190912d3-088a-4c33-bb6b-ace2236875db tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] HTTP exception thrown: Instance group 66b52f54-b64e-48eb-af67-f13f71f10ffe could not be found. Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-190912d3-088a-4c33-bb6b-ace2236875db tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Request method failure captured: Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/os-server-groups/66b52f54-b64e-48eb-af67-f13f71f10ffe HTTP/1.1 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-o6fAjOWmDgxYuKzx89nc6-BfGL5gZ1ZJYgWnPf3IhcjotFFZfP3feio0hmaaXI1kbNtY7v_x53fXhn5lfOgjBvSqNJTHyc5zW4rFGCGvMkX0q1Ic_YthSUz1g92uYL1cd3FECe88644ZWNJSu0ST0LrP1rsQOsCKBZ9pJkEd3N8TE Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f2c55a7e19348d89bf910385829aff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8f2c55a7e19348d89bf910385829aff5 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerGroupTestJSON-1938220709 Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: f49f64ef1eea4be7b0b4f34eaf9a094c Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerGroupTestJSON-1938220709-project Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance group 66b52f54-b64e-48eb-af67-f13f71f10ffe could not be found. Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '66b52f54-b64e-48eb-af67-f13f71f10ffe'} Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 66b52f54-b64e-48eb-af67-f13f71f10ffe could not be found. Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 66b52f54-b64e-48eb-af67-f13f71f10ffe could not be found. Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.233712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 66b52f54-b64e-48eb-af67-f13f71f10ffe could not be found. Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-190912d3-088a-4c33-bb6b-ace2236875db tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Returning 404 to user: Instance group 66b52f54-b64e-48eb-af67-f13f71f10ffe could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-190912d3-088a-4c33-bb6b-ace2236875db tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/66b52f54-b64e-48eb-af67-f13f71f10ffe" status: 404 len: 117 microversion: 2.1 time: 0.019334 Oct 31 15:31:45.240360 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1843/3784] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:45 2022] DELETE /compute/v2.1/os-server-groups/66b52f54-b64e-48eb-af67-f13f71f10ffe => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:45.244848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20e5cfa0-f5aa-4aab-9534-e0022a1d8a4c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.277477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20e5cfa0-f5aa-4aab-9534-e0022a1d8a4c tempest-ServerGroupTestJSON-1938220709 tempest-ServerGroupTestJSON-1938220709-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/545d5127-da34-4b03-b136-b904673282c3" status: 204 len: 0 microversion: 2.1 time: 0.036517 Oct 31 15:31:45.282196 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1844/3785] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:31:45 2022] DELETE /compute/v2.1/os-server-groups/545d5127-da34-4b03-b136-b904673282c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:31:45.293122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.302963 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76672770-b89d-4571-9793-00a7b6020332 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.359148 Oct 31 15:31:45.304082 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1942/3786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:45.953789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:45.956660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:45.968887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:45.969690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:45.970345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:45.971258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:45.971920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:45.972544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.066059 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-402a031d-466b-4575-8951-2b709ee8d6f4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.115787 Oct 31 15:31:46.069568 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1845/3787] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:45 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:31:46.217398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:46.218106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:46.231183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.232670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.234747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.235731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.236860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.238781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.291607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-69a92f3a-e049-4a13-a36c-4c65263fda74 req-d9a0f98e-95da-4a2e-a5e8-e806c2173b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c", "name": "network-vif-plugged", "status": "completed", "tag": "994ba79a-be9e-4b61-938f-64b69e61e2ee"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:46.309764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.310259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.310581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-69a92f3a-e049-4a13-a36c-4c65263fda74 req-d9a0f98e-95da-4a2e-a5e8-e806c2173b9f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.310756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.311459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-69a92f3a-e049-4a13-a36c-4c65263fda74 req-d9a0f98e-95da-4a2e-a5e8-e806c2173b9f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.312162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-69a92f3a-e049-4a13-a36c-4c65263fda74 req-d9a0f98e-95da-4a2e-a5e8-e806c2173b9f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.316572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lazy-loading 'fault' on Instance uuid f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:31:46.325742 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-69a92f3a-e049-4a13-a36c-4c65263fda74 req-d9a0f98e-95da-4a2e-a5e8-e806c2173b9f service nova] Creating event network-vif-plugged:994ba79a-be9e-4b61-938f-64b69e61e2ee for instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c on n-h2-858383-17 Oct 31 15:31:46.331723 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-69a92f3a-e049-4a13-a36c-4c65263fda74 req-d9a0f98e-95da-4a2e-a5e8-e806c2173b9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045122 Oct 31 15:31:46.333728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1846/3788] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:46.352185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:46.353858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:46.395361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.397592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.398336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.399301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.400015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.401829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.406043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.420612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.425183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '945f520b0ae244efa7a4e01cfa3018be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7406ef89338d4685a4ff9c3889497d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.429115 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-089a2898-f73a-4f6e-973e-b8e9dcfa6e9e tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 200 len: 1608 microversion: 2.42 time: 0.216299 Oct 31 15:31:46.433848 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1943/3789] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:46 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 1608 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:46.663326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.673498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-868acbbc-fb32-4637-ae7b-fd00affca6b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.338062 Oct 31 15:31:46.674407 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1847/3790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:46 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:47.082409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:47.085935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:47.102358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.103726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.104300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.105063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.105528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.105958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.188577 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac5c848e-b6d5-468b-9ac0-ffccdd65957a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 14 microversion: 2.1 time: 0.110255 Oct 31 15:31:47.190544 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1944/3791] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:47 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:31:47.464064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:47.465078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:47.482350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.482350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.482350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.482923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.484489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.484489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.507678 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] HTTP exception thrown: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Request method failure captured: Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 HTTP/1.1 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-icbZreMjjSJopzUp9hrjhQ15jWLAREXccosOS98e17nTmOgIl8OXC5MSK48ub0uQuee-5lN9YheWSQo-tSQEpIU7gpyNxCE2-nYQfZbflzbW6U4XvaelHzUDkd95NM-MH3XB9JVAuXDaQM9G5xhsWFgUjukkkg5fadsY5-Av1g888 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 7406ef89338d4685a4ff9c3889497d35 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 7406ef89338d4685a4ff9c3889497d35 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TaggedBootDevicesTest_v242-276121111-project Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 945f520b0ae244efa7a4e01cfa3018be Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TaggedBootDevicesTest_v242-276121111-project Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f3cad05f-1a22-414c-a2f6-5a4e5c1850c4'} Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:47.509522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:47.516831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:47.519388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Returning 404 to user: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:47.520823 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4650628-8ef4-4a9d-bb9c-6406add18d52 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 404 len: 111 microversion: 2.42 time: 0.061294 Oct 31 15:31:47.525347 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1848/3792] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:47 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:47.533492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-473d3a17-6f36-4616-b762-600e9c8ee316 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '.version_select at 0x7f5ca141b550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:47.585708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-473d3a17-6f36-4616-b762-600e9c8ee316 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-405673413" status: 204 len: 0 microversion: 2.42 time: 0.057433 Oct 31 15:31:47.590360 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1945/3793] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Oct 31 15:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-405673413 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:31:47.709730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:47.711497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:47.748750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.753173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.753985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.756739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.759604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.760583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.259470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:48.260543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:48.279789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:48.281605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:48.282128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.282876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:48.285255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:48.285719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.365103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:48.456750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:48.467349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48bc1622-0205-47b4-bbaf-aeced0e015ad tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1317 microversion: 2.1 time: 0.768734 Oct 31 15:31:48.488724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1946/3794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:47 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:48.546518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:48.592775 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-534e9dda-4da8-456a-b094-49c86572d05d tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 204 len: 0 microversion: 2.32 time: 1.019450 Oct 31 15:31:48.594023 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1849/3795] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:31:47 2022] DELETE /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:31:48.607026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:48.611501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:48.630639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:48.631140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:48.633801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.637750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:48.639209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:48.641763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.082263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de8cf213-5244-4cda-b4b8-c1e7dd1ea966 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '.version_select at 0x7f5ca14fb550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:49.454579 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de8cf213-5244-4cda-b4b8-c1e7dd1ea966 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852" status: 200 len: 371 microversion: 2.1 time: 0.964245 Oct 31 15:31:49.455261 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1947/3796] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:31:48 2022] GET /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852 => generated 371 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:49.468050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:49.469050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:49.475910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.477008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.477664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.478567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.479985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.480618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.737813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:49.752876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:49.753236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:49.754343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e366d7c-a34e-4559-8c09-f2ba34e2e036 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2954 microversion: 2.32 time: 0.291056 Oct 31 15:31:49.757861 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1948/3797] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:49 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2954 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:49.763374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca67381f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:50.235246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.239552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.240059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.243942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.245050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.245514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.381034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:50.398423 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b61fbb1-7c08-4f87-afa7-c1c7658aaea4 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852" status: 200 len: 328 microversion: 2.1 time: 0.639204 Oct 31 15:31:50.399079 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1949/3798] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:31:49 2022] PUT /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852 => generated 328 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:50.405572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:50.406814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:50.413592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.414454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.415134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.416180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.416921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.417577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.665117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:50.676846 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db3a4f58-1f13-4277-8823-f6433a97864a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1507 microversion: 2.1 time: 0.276292 Oct 31 15:31:50.678233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1950/3799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:50 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:50.683641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a72e3800-6755-4d50-a8c5-7b8fb5777c21 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:50.703231 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a72e3800-6755-4d50-a8c5-7b8fb5777c21 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852" status: 202 len: 0 microversion: 2.1 time: 0.023625 Oct 31 15:31:50.703835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1951/3800] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:31:50 2022] DELETE /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:50.719127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:50.719680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:50.731379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.731902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.735452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.737746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.739107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.739543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.794954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92d0edb0-7e68-4ebe-877c-23f0ee03dde5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action" status: 200 len: 8204 microversion: 2.1 time: 2.198306 Oct 31 15:31:50.798966 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1850/3801] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:48 2022] POST /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4/action => generated 8204 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:50.808271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-91b1235c-842f-4192-8503-05e047f98f7e tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '.version_select at 0x7f5ca1560280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:50.949096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:50.960976 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ae5a43e-6f10-40c0-b5e4-5be69e4b0985 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1507 microversion: 2.1 time: 0.255030 Oct 31 15:31:50.961570 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1952/3802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:50 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:50.978435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:50.979590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:50.987653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.988352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.989049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.989990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.990654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.992116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.273532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-91b1235c-842f-4192-8503-05e047f98f7e tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852" status: 200 len: 371 microversion: 2.1 time: 0.472862 Oct 31 15:31:51.274979 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1851/3803] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 15:31:50 2022] GET /compute/v2.1/os-quota-sets/c7f756feedea4523b8283521d6bcc852 => generated 371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:51.289107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:51.290113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:51.314366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.343335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.346382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.348176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.349719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.350540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.351317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.371085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.375648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.377678 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e4acf4d-a73c-4b62-bae7-4835337020ef tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2954 microversion: 2.32 time: 0.409956 Oct 31 15:31:51.382303 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1953/3804] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:50 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2954 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:51.396474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:51.406646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:51.417988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.419336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.420201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.421200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.422029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.422748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.579171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:51.583044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:51.585115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:51.585548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:51.589186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:51.623120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.631173 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-feefdcb1-1feb-4f4b-bac8-a1434221021a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.354622 Oct 31 15:31:51.634906 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1852/3805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:51 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:51.669428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:51.670212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:51.679565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.680146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.680598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.681339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.686667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.687690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.781042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:51.800157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.801257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.802543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.806131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.808344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.809990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.896345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c4efa54-e8c3-467f-a0b7-335e63427e13 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "POST /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c/action" status: 202 len: 1109 microversion: 2.1 time: 0.504546 Oct 31 15:31:51.912784 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1954/3806] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:51 2022] POST /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c/action => generated 1109 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:31:51.935220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ffcf2fce-63f9-41c5-82f3-8f70288373f0 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '.version_select at 0x7f5ca1541550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:51.974353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.983697 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8ea2d8d-ae3b-439d-a7fa-d81a08d06a9e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.322942 Oct 31 15:31:51.998812 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1853/3807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:51 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:52.011751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:52.012321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:52.019478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.020199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.020862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.022434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.023196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.023944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.231616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:52.242078 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00300c9d-4a8d-4e58-9243-36ea66b56caa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.241936 Oct 31 15:31:52.243279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1854/3808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:51 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:52.250154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:52.251014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:52.257625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.258387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.258996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.260247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.261634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.262239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.657611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:52.669813 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff8ea494-2482-4d61-8dd8-6c6fe419c9e5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.421837 Oct 31 15:31:52.671666 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1855/3809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:52 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:52.673239 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ffcf2fce-63f9-41c5-82f3-8f70288373f0 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.758635 Oct 31 15:31:52.678871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:52.679752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:52.683676 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1955/3810] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:31:51 2022] GET /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea/defaults => generated 371 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:52.698168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:52.698737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:52.699335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.701269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.701954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.703271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.703947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.705440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.724922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.725568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.726035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.726791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.727265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.727699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.341482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:53.361836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:53.363593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:53.365483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c22606ab-f99f-47cb-af7a-cd1161b6cb80 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2954 microversion: 2.32 time: 0.692066 Oct 31 15:31:53.366689 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1856/3811] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:52 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2954 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:53.375364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:53.376391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:53.389160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.391638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.393019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.394393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.395668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.396315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.407968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:53.418351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a9242f5-ef98-439f-8537-ad2eb6fa1080 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.726020 Oct 31 15:31:53.418954 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1956/3812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:52 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:53.434584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca150ee50>, body: {"quota_set": {"ram": "5120"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:53.753795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:53.769587 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d352c43-97a9-4f32-a377-2bc7d70c46d3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.400897 Oct 31 15:31:53.788218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1857/3813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:53 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:53.788530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.789929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.791144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.792454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.793235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.793828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.795320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:53.795918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:53.804027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.804687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.805919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.806653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.807659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.808362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.868113 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e32c749f-c077-46e9-9eed-4330e83f0824 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613" status: 200 len: 328 microversion: 2.1 time: 0.448071 Oct 31 15:31:53.875978 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1957/3814] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:31:53 2022] PUT /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613 => generated 328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:53.883936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '.version_select at 0x7f5ca67fc790>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:53.886184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Locking {{(pid=120626) lock /opt/stack/nova/nova/compute/api.py:4846}} Oct 31 15:31:53.973143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:54.011744 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-23c024d0-85e4-4b2d-b483-8e152982e81d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.222141 Oct 31 15:31:54.016527 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1858/3815] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:53 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:54.021971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.022779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.030351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.030989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.031828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.033055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.033678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.034277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.054424 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] HTTP exception thrown: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Request method failure captured: Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 HTTP/1.1 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-icbZreMjjSJopzUp9hrjhQ15jWLAREXccosOS98e17nTmOgIl8OXC5MSK48ub0uQuee-5lN9YheWSQo-tSQEpIU7gpyNxCE2-nYQfZbflzbW6U4XvaelHzUDkd95NM-MH3XB9JVAuXDaQM9G5xhsWFgUjukkkg5fadsY5-Av1g888 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 7406ef89338d4685a4ff9c3889497d35 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 7406ef89338d4685a4ff9c3889497d35 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TaggedBootDevicesTest_v242-276121111-project Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 945f520b0ae244efa7a4e01cfa3018be Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TaggedBootDevicesTest_v242-276121111-project Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f3cad05f-1a22-414c-a2f6-5a4e5c1850c4'} Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:54.056465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.062130 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.064259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Returning 404 to user: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:54.065426 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e10f6ae9-f81d-4f0b-bcdb-b8fcf64c8165 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 404 len: 111 microversion: 2.42 time: 0.047781 Oct 31 15:31:54.066130 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1859/3816] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:31:54 2022] DELETE /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:54.074880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.075743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.083102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.083925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.084308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.085203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.085974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.086370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.312325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.313104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.313913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.314822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.315653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.316255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.335247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.341840 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3e5de88-8525-4d51-8325-bc9fce2fef3b tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613/detail" status: 200 len: 916 microversion: 2.1 time: 0.464289 Oct 31 15:31:54.355858 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db37d000-d19d-4336-a484-4c8967f252d8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.277923 Oct 31 15:31:54.355858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1860/3817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:54 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:54.357140 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1958/3818] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:31:53 2022] GET /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613/detail => generated 916 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:31:54.377942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.378838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:54.378985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] [instance: f3cad05f-1a22-414c-a2f6-5a4e5c1850c4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.387292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.387801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.388241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.389188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.389750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.390007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.390553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.390796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.391409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.409382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] HTTP exception thrown: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Request method failure captured: Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 HTTP/1.1 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-icbZreMjjSJopzUp9hrjhQ15jWLAREXccosOS98e17nTmOgIl8OXC5MSK48ub0uQuee-5lN9YheWSQo-tSQEpIU7gpyNxCE2-nYQfZbflzbW6U4XvaelHzUDkd95NM-MH3XB9JVAuXDaQM9G5xhsWFgUjukkkg5fadsY5-Av1g888 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 7406ef89338d4685a4ff9c3889497d35 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7406ef89338d4685a4ff9c3889497d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 7406ef89338d4685a4ff9c3889497d35 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-276121111 Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TaggedBootDevicesTest_v242-276121111-project Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 945f520b0ae244efa7a4e01cfa3018be Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TaggedBootDevicesTest_v242-276121111-project Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f3cad05f-1a22-414c-a2f6-5a4e5c1850c4'} Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.412029 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. Oct 31 15:31:54.417973 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.418929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] Returning 404 to user: Instance f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:54.419823 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f221a851-0bc5-4ad8-96b8-010afaaae585 tempest-TaggedBootDevicesTest_v242-276121111 tempest-TaggedBootDevicesTest_v242-276121111-project] 10.222.0.48 "GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4" status: 404 len: 111 microversion: 2.42 time: 0.053172 Oct 31 15:31:54.423531 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1861/3819] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:54 2022] GET /compute/v2.1/servers/f3cad05f-1a22-414c-a2f6-5a4e5c1850c4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:54.428306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.429264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.433250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:54.437683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.438177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.438975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.440344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.441037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.441701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.452563 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] HTTP exception thrown: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf is locked Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Request method failure captured: Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action HTTP/1.1 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 15 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-lT8sK3oZTS4fMh5oyg1sNzWBs-z6goGvayCXg_FfN37F3pf8jx5tM7xF3zh9pOf9ybk5DKiXGJFAmq871If8DP5Z_p2O0G9cmXG2CABNQmJYHsnOqJE6vlwrNUfqbvfomBGpMSndJZ-ECLFXOJjdH-rpchPAvxDIDqewWtfpm91xs Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b75b127e3924430bc27f7f311747382"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b75b127e3924430bc27f7f311747382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-132335233 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6b1695b4d61d40de8272561b0cf3362e Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: {"os-stop": {}} Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf is locked Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '874df0b8-4d02-43ff-bc60-15b89e219abf', 'body': {'os-stop': {}}} Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf is locked Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf is locked Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf is locked Oct 31 15:31:54.457579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:31:54.465593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Returning 409 to user: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf is locked {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:54.467857 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8269a466-b8aa-43e8-a2ed-a12825e4a61e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 409 len: 107 microversion: 2.1 time: 0.093607 Oct 31 15:31:54.469771 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1959/3820] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:54 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 107 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:31:54.486845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:54.490162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.501157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.501658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.502100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.507183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.507674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.508125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.596833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Unlocking {{(pid=120625) unlock /opt/stack/nova/nova/compute/api.py:4875}} Oct 31 15:31:54.674675 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0aa21bbd-f2ac-45ea-b687-894e8785e703 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.200103 Oct 31 15:31:54.675706 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1960/3821] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:54 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:54.686132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77a7271b-e735-425d-aa47-bdbc3a52be7d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:54.699661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77a7271b-e735-425d-aa47-bdbc3a52be7d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.702123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77a7271b-e735-425d-aa47-bdbc3a52be7d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.703736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77a7271b-e735-425d-aa47-bdbc3a52be7d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.749834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.763514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.765660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77a7271b-e735-425d-aa47-bdbc3a52be7d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:31:54.769034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.770365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d192f298-4aa3-435e-8e3c-3bc98018c435 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2933 microversion: 2.32 time: 0.349002 Oct 31 15:31:54.770934 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1862/3822] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:54 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2933 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:54.804679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.805565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.818495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.819020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.819477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.820203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.823402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.824046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.846087 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77a7271b-e735-425d-aa47-bdbc3a52be7d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.166171 Oct 31 15:31:54.847814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1961/3823] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:54 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:54.887534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.888633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.902947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.903731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.904486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.905396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.906021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.906619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:55.273688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:55.286007 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dc0e66e-49aa-448c-94e9-50bd4a83f542 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.486654 Oct 31 15:31:55.290802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:55.302030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1863/3824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:54 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:55.307046 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdae139c-51fc-419d-bd3b-faa746f3dce4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.440251 Oct 31 15:31:55.308196 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1962/3825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:54 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:55.336194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca15608b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:55.802314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:55.803380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:55.831849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:55.834484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:55.835152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:55.838324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:55.839099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:55.841142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.140644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.149510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.150258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.157540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.158053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.158501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.299965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.303795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.304545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.308277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.310290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.310985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.473752 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-34d244ce-398f-498f-99a0-371e371fbeaf tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613?user_id=78383155a1eb4554b9c217b440114f83" status: 200 len: 328 microversion: 2.1 time: 1.140374 Oct 31 15:31:56.474505 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1864/3826] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:31:55 2022] PUT /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613?user_id=78383155a1eb4554b9c217b440114f83 => generated 328 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:56.488848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-93c9971a-2d38-414c-9352-bb8c1fb46d6a req-79bc709a-e67a-428b-8d1b-96ea3cb374a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-unplugged", "status": "completed", "tag": "db867e96-da3d-4e64-9050-b6856d593f29"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:56.513638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-93c9971a-2d38-414c-9352-bb8c1fb46d6a req-79bc709a-e67a-428b-8d1b-96ea3cb374a6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.514125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-93c9971a-2d38-414c-9352-bb8c1fb46d6a req-79bc709a-e67a-428b-8d1b-96ea3cb374a6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.514560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-93c9971a-2d38-414c-9352-bb8c1fb46d6a req-79bc709a-e67a-428b-8d1b-96ea3cb374a6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.542497 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-93c9971a-2d38-414c-9352-bb8c1fb46d6a req-79bc709a-e67a-428b-8d1b-96ea3cb374a6 service nova] Creating event network-vif-unplugged:db867e96-da3d-4e64-9050-b6856d593f29 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:31:56.550600 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-93c9971a-2d38-414c-9352-bb8c1fb46d6a req-79bc709a-e67a-428b-8d1b-96ea3cb374a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072528 Oct 31 15:31:56.558297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1865/3827] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:56.565513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-79391374-cb95-4a75-ab48-e4d56125771b req-0605db43-461b-492d-af47-35dcd14a7166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-deleted", "tag": "d733579d-e266-4f5a-84c0-90ffc337e6e0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:56.584546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-79391374-cb95-4a75-ab48-e4d56125771b req-0605db43-461b-492d-af47-35dcd14a7166 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.585072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-79391374-cb95-4a75-ab48-e4d56125771b req-0605db43-461b-492d-af47-35dcd14a7166 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.585497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-79391374-cb95-4a75-ab48-e4d56125771b req-0605db43-461b-492d-af47-35dcd14a7166 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.599104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-79391374-cb95-4a75-ab48-e4d56125771b req-0605db43-461b-492d-af47-35dcd14a7166 service nova] Creating event network-vif-deleted:d733579d-e266-4f5a-84c0-90ffc337e6e0 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:31:56.606749 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-79391374-cb95-4a75-ab48-e4d56125771b req-0605db43-461b-492d-af47-35dcd14a7166 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046238 Oct 31 15:31:56.607989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1866/3828] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:56.615419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:56.616493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:56.626052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.626976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.627595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.629183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.629932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.630553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.068276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.086918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.088787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.090468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb37e62a-f484-4317-aba1-8cdee6d8b7b5 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2865 microversion: 2.32 time: 1.293390 Oct 31 15:31:57.094076 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1963/3829] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:55 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2865 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:57.109781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.110533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:57.116761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.118383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.119047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.120513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.126058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.126536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.261353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.275405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa66cebd-0d65-4ad8-84d3-c817035c4fcd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.665360 Oct 31 15:31:57.276445 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1867/3830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:56 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:57.293084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-220c951a-9a65-41ec-88d2-b0bed0d9b4ee tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '.version_select at 0x7f5ca15a3a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.561844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.575667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-779f2665-16ea-42eb-b070-770179e61ee4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.480315 Oct 31 15:31:57.576396 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1964/3831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:57.621289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-220c951a-9a65-41ec-88d2-b0bed0d9b4ee tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613?user_id=78383155a1eb4554b9c217b440114f83" status: 200 len: 370 microversion: 2.1 time: 0.341786 Oct 31 15:31:57.622648 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1868/3832] 10.222.0.48 () {58 vars in 1323 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/v2.1/os-quota-sets/58837b88331d4bb194505a6ccdbc4613?user_id=78383155a1eb4554b9c217b440114f83 => generated 370 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:58.121996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d30ae33-ed01-4dd8-9389-7f8ed1759794 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Calling method '.version_select at 0x7f5ca14c49d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:58.133511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:58.134170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:58.152837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:58.153343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:58.158894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.160390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:58.161181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:58.167206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.467176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d30ae33-ed01-4dd8-9389-7f8ed1759794 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.348962 Oct 31 15:31:58.467840 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1965/3833] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:31:58 2022] GET /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea/defaults => generated 371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:58.521725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:58.524820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:58.539036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:58.539538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:58.542167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.544539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:58.545046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:58.545486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.859094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:58.871670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:58.886333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:58.895128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5e29a52-e5d9-4c1b-9572-acd6e741fedd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2657 microversion: 2.32 time: 0.769648 Oct 31 15:31:58.895987 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1869/3834] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:58 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2657 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:58.927734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca155ddc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:58.970232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:58.980451 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6000589-d7d1-419a-a880-6b9ea53c34aa tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.483890 Oct 31 15:31:58.992452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1966/3835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:58 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:59.006444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:59.007076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:59.031238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.033031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.035578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.036522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.038284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.039674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.566309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.567198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.570067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.571089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.571954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.574199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.787479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:59.802291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=11 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:59.804214 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-06ae0d79-626e-43b6-a703-250e95240e7f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.801332 Oct 31 15:31:59.805114 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1967/3836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:58 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:59.829631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-unplugged", "status": "completed", "tag": "66eea34d-40d4-4732-bad1-6c0d1884aa11"}, {"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-unplugged", "status": "completed", "tag": "fe825c21-039d-4e7e-85a3-44e44830203b"}, {"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0ceeb89c-6a35-4331-9ec3-a58e16847f0d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:59.874205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.877790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.878487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.908834 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Creating event network-vif-unplugged:66eea34d-40d4-4732-bad1-6c0d1884aa11 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:31:59.916726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Creating event network-vif-unplugged:fe825c21-039d-4e7e-85a3-44e44830203b for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:31:59.918426 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] Creating event network-vif-unplugged:0ceeb89c-6a35-4331-9ec3-a58e16847f0d for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:31:59.931096 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fb378ff7-1943-4cbf-b093-f224945cd549 req-e074e37a-b5ba-451b-92df-0ec789c5665e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.124602 Oct 31 15:31:59.934235 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1968/3837] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:59.942707 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81719ddf-6723-4b95-8223-a2480a6f1607 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea" status: 200 len: 329 microversion: 2.1 time: 1.042816 Oct 31 15:31:59.945357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-deleted", "tag": "db867e96-da3d-4e64-9050-b6856d593f29"}, {"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-deleted", "tag": "0ceeb89c-6a35-4331-9ec3-a58e16847f0d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:59.956314 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1870/3838] 10.222.0.48 () {60 vars in 1263 bytes} [Mon Oct 31 15:31:58 2022] PUT /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea => generated 329 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:59.959564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.960331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.961093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.968329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:59.971961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:59.983402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.983924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.984368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.985115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.986149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.986604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.996435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] Creating event network-vif-deleted:db867e96-da3d-4e64-9050-b6856d593f29 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:31:59.998030 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] Creating event network-vif-deleted:0ceeb89c-6a35-4331-9ec3-a58e16847f0d for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:32:00.009795 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-94062b89-c96c-4927-b15a-8d9a2f82ccb3 req-556038fd-1fb9-48d4-a909-6c3703d40eca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073861 Oct 31 15:32:00.018252 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1969/3839] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:00.024180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Action: 'update', calling method: .version_select at 0x7f5ca1b8bc10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:00.410494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.411157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.413097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.419450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.420266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.421053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.855788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=8,nova_api:UPDATE=7 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:01.008072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:01.035509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:01.040106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:01.046654 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9902c0b5-d282-4cb4-a9a4-51cc66a1ad17 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2610 microversion: 2.32 time: 1.088859 Oct 31 15:32:01.050249 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1871/3840] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:59 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2610 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:01.071000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:01.071968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:01.094472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.095635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.098392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.099724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.100458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.102944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.228929 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02afdcc0-6127-4b9d-84f5-bd34bf67abb6 tempest-QuotasAdminTestJSON-326270006 tempest-QuotasAdminTestJSON-326270006-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea" status: 200 len: 329 microversion: 2.1 time: 1.208650 Oct 31 15:32:01.239502 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1970/3841] 10.222.0.48 () {60 vars in 1263 bytes} [Mon Oct 31 15:32:00 2022] PUT /compute/v2.1/os-quota-sets/eeefe74c4e394eb099bb7e2eda7a62ea => generated 329 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:01.251108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:01.251873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:01.288574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.293193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.294970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.297717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.300772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.301245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.523163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:01.535236 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49c61d2f-c4f7-447b-acb0-208915f795c0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.481781 Oct 31 15:32:01.544004 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1872/3842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:01 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:01.964020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:01.974990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24ae26cb-380c-402e-9041-e2f0f7d87948 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.734191 Oct 31 15:32:01.998667 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1971/3843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:01 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:02.073894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4aab9639-cdaf-4b5f-ac28-697b9ebce634 req-6d537257-4c68-4c5d-906d-ad3d21443ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-deleted", "tag": "fe825c21-039d-4e7e-85a3-44e44830203b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:02.084474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:02.085501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:02.106513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.108187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.111095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.117339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4aab9639-cdaf-4b5f-ac28-697b9ebce634 req-6d537257-4c68-4c5d-906d-ad3d21443ef9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.118092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.120396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.122053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.122643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4aab9639-cdaf-4b5f-ac28-697b9ebce634 req-6d537257-4c68-4c5d-906d-ad3d21443ef9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.127445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4aab9639-cdaf-4b5f-ac28-697b9ebce634 req-6d537257-4c68-4c5d-906d-ad3d21443ef9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.194674 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4aab9639-cdaf-4b5f-ac28-697b9ebce634 req-6d537257-4c68-4c5d-906d-ad3d21443ef9 service nova] Creating event network-vif-deleted:fe825c21-039d-4e7e-85a3-44e44830203b for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:32:02.226336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4aab9639-cdaf-4b5f-ac28-697b9ebce634 req-6d537257-4c68-4c5d-906d-ad3d21443ef9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159747 Oct 31 15:32:02.227614 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1873/3844] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:02.387800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.408798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.411385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.421911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a99bbb71-f32c-4494-9871-9a69ace9d28a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 2314 microversion: 2.32 time: 0.339916 Oct 31 15:32:02.422532 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1972/3845] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:02 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 2314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:02.568369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:02.569415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:02.583252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.588595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.591922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.592812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.593183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.593893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.923817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.936886 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c767d965-d8aa-4002-a81a-f6a892eb2742 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.373272 Oct 31 15:32:02.938199 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1874/3846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:02 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:03.005911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:03.007150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:03.019739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.020558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.022067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.023123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.032284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.036569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.455276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:03.456057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:03.478107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.483331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.484158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.485669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.486936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.489591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.553990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:03.572197 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2de18a6-917f-49e4-bc70-9fb6a34a97ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.569969 Oct 31 15:32:03.574445 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1973/3847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:03 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:03.695137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:03.712155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:03.714174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:03.748382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2748fbd-cfc4-426d-a540-5d358da23872 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.265913 Oct 31 15:32:03.766328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1875/3848] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:03 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:03.968068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:03.968981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:03.988107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.988618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.989156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.989991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.002242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.003269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.332984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-871685e4-3ee3-4543-abca-e74b2868ad9a req-f08a6ea4-1b69-4a52-958b-34b45ba24205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c28824-87d6-455a-9765-06aa798221c1", "name": "network-vif-deleted", "tag": "66eea34d-40d4-4732-bad1-6c0d1884aa11"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:04.360119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-871685e4-3ee3-4543-abca-e74b2868ad9a req-f08a6ea4-1b69-4a52-958b-34b45ba24205 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.365922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-871685e4-3ee3-4543-abca-e74b2868ad9a req-f08a6ea4-1b69-4a52-958b-34b45ba24205 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.366364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-871685e4-3ee3-4543-abca-e74b2868ad9a req-f08a6ea4-1b69-4a52-958b-34b45ba24205 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.388237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:04.399231 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3713f0e1-535b-4ec9-90ff-0864e384ba6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.433738 Oct 31 15:32:04.403238 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1974/3849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:03 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:04.418958 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-871685e4-3ee3-4543-abca-e74b2868ad9a req-f08a6ea4-1b69-4a52-958b-34b45ba24205 service nova] Creating event network-vif-deleted:66eea34d-40d4-4732-bad1-6c0d1884aa11 for instance 26c28824-87d6-455a-9765-06aa798221c1 on n-h1-858383-17 Oct 31 15:32:04.423986 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-871685e4-3ee3-4543-abca-e74b2868ad9a req-f08a6ea4-1b69-4a52-958b-34b45ba24205 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096804 Oct 31 15:32:04.426383 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1876/3850] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:04.601865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:04.603894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:04.616131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.618039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.619080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.621778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.622580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.625599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.785722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:04.786973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:04.813839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.818558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.826784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.828610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.832064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.832939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:05.146930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:05.170525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:05.176602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:05.179151 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-121ca1df-7768-4010-bdae-d6c39a9034ae tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.399836 Oct 31 15:32:05.197980 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1877/3851] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:04 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:05.249856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:05.259011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a5de408-c2cc-451e-8998-8742da6b739f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.661946 Oct 31 15:32:05.262523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1975/3852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:04 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:05.425295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:05.426042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:05.435566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:05.436902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:05.443269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:05.444528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:05.445843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:05.448361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:05.458729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:05.556174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1372061354", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:05.644371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] validate_networks() for [('f6e21369-c9e2-4f9a-83b6-227ba8b0a8bd', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:06.056042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:06.065177 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af8e05f8-19db-4297-8b07-4bcba04d269e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.645311 Oct 31 15:32:06.070957 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1976/3853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:05 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:06.215119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:06.216060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:06.224276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.225244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.225893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.226799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.236131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.236953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.657432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:06.680483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:06.685815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:06.687144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bf07b85-5981-48ca-9c26-e5d7e8d78916 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.477031 Oct 31 15:32:06.706220 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1977/3854] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:06 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:06.711826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:06.712453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:06.722589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.723321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.723962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.724914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.725552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.726151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.956468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:06.957467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:06.958328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:06.958989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:06.959594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:06.983055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.991284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.999478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.000779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.001453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.002069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.063443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Getting quotas for project 3f8696603b19481abd8c8e15399851c5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:07.074196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.081392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Getting quotas for user c9b99145c96b4684952ac677bb25a076 and project 3f8696603b19481abd8c8e15399851c5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:07.087036 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f16f27d0-f992-494e-8996-73333b5c0606 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1656 microversion: 2.1 time: 0.379565 Oct 31 15:32:07.096855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1978/3855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:06 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1656 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:07.125947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:07.133340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:07.141278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:07.144298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:07.154281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.154785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.155232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.155960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.156428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.156901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.274447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6fe13b3b-95c8-4e7c-892b-49862e6115a3 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.075094 Oct 31 15:32:07.278961 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1878/3856] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:32:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:32:07.287084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-10e301d1-56ae-4948-89bf-a29bd504d449 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:07.305245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10e301d1-56ae-4948-89bf-a29bd504d449 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.309271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10e301d1-56ae-4948-89bf-a29bd504d449 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.309978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10e301d1-56ae-4948-89bf-a29bd504d449 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.392960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-10e301d1-56ae-4948-89bf-a29bd504d449 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Going to try to start instance {{(pid=120626) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:32:07.458734 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-10e301d1-56ae-4948-89bf-a29bd504d449 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.173886 Oct 31 15:32:07.459701 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1879/3857] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:07 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:07.469985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5e166f0-f94d-4121-876d-e0c216989f40 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:07.474004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c5e166f0-f94d-4121-876d-e0c216989f40 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:07.504811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.518745 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93599900-3206-4058-8bab-6bca44ed8f9a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.420073 Oct 31 15:32:07.519662 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1979/3858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:07 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:07.526858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:07.527813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:07.537176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.537970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.538795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.540199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.540899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.541499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.656530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c5e166f0-f94d-4121-876d-e0c216989f40 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.670247 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c5e166f0-f94d-4121-876d-e0c216989f40 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1214 microversion: 2.1 time: 0.208651 Oct 31 15:32:07.671463 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1880/3859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:07 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:07.722562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:07.723313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:07.736165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.743841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.744714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.753967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.755810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.756972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.808281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:07.901609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.911952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.919199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.924563 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a93d22ea-54e0-4657-b55d-64ad2c7d4d89 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.205998 Oct 31 15:32:07.925332 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1881/3860] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:07 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:08.007615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:08.019908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4139bdc-2d5e-4760-b698-edcbb68e3f85 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1665 microversion: 2.1 time: 0.498842 Oct 31 15:32:08.020647 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1980/3861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:07 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1665 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:08.547799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:08.548670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:08.560343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.562060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.563630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.565901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.568111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.570079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.696727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:08.698046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:08.714566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.717406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.720822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.725236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.732236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.733233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.026496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.052419 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f13aded8-f47a-454b-addc-13a5a2d1acf0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1210 microversion: 2.1 time: 0.359891 Oct 31 15:32:09.057013 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1981/3862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:08 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1210 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:09.090698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:09.092213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:09.116145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.127353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:09.129037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:09.129671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.130475 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef62b03b-0e8d-481c-96af-48b91013e062 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.586197 Oct 31 15:32:09.130860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:09.131633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:09.132317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.132814 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1882/3863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:08 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:09.150319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:09.158257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:09.187767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:09.192160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:09.193960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.194966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:09.195907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:09.196741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.303400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.323986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.332215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.332215 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f91a2fa6-2dd6-4e61-8057-702e0c373c39 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.252043 Oct 31 15:32:09.332558 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1982/3864] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:09 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:09.494670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.507300 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae553956-6a62-4a92-9083-3c8bfc506c84 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1665 microversion: 2.1 time: 0.373116 Oct 31 15:32:09.507912 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1883/3865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:09 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1665 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:09.736553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-785428733", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:09.847748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:10.086928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:10.088190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:10.096070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.096566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.097028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.099490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.099989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.100796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.226429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:10.243561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ddc145c6-53da-49c8-a130-cb58de854b68 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1272 microversion: 2.1 time: 0.165401 Oct 31 15:32:10.245201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1884/3866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:10 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:10.255154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:10.255833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:10.276657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.278224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.279204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.284126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.286174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.286726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.361895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:10.362403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:10.362970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:10.363462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:10.363959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:10.381092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.381839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.385453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.386304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.390810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.391303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.441159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Getting quotas for project 508b4a87c5854847a4e9bf053a40ed6c. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:10.447900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Getting quotas for user 24cabb0095dc4fa5b04e94e481c6ab96 and project 508b4a87c5854847a4e9bf053a40ed6c. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:10.476939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:10.485623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:10.563771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-397d68c5-6340-4247-8cf5-0324edc5d598 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229797 Oct 31 15:32:10.564890 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1983/3867] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:32:10.570331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:10.571274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:10.581331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.582098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.582744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.583658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.585366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.586012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.311567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.328833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.334831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.342112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-def93b10-e54d-45ae-9b87-c91c799ab4a2 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.771314 Oct 31 15:32:11.344038 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1984/3868] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:10 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:11.357037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:11.359007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:11.400773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.402615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.403862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.406224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.406806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.407312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.536517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.552441 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9a92093-f604-4afc-a32e-3c1a5df6dac1 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 1.300407 Oct 31 15:32:11.555154 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1885/3869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:10 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:11.581445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:11.582468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:11.590502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.591134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.591593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.592308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.592808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.593244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.864388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.878223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9c21c5c-0565-41b2-91c2-20546776f41e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1225 microversion: 2.1 time: 0.321648 Oct 31 15:32:11.880594 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1886/3870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:11 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1225 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:11.897534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:11.900744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:11.913272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.913987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.914676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.915615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.917127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.917980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.087444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:12.097070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39bfa3fa-1c9d-4654-97a3-baed065ab53e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.750882 Oct 31 15:32:12.098180 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1985/3871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:11 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:12.126419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:12.127323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:12.139256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.139881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.142120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.143182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.144567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.146429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.452877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:12.475553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-495ec8cc-1efb-454f-9968-773f268d9d01 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.593503 Oct 31 15:32:12.481052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1887/3872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:11 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:12.504264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:12.506900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:12.521065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:12.530449 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f7c947a-ebe3-48c9-a13a-f6dc05090de4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.409170 Oct 31 15:32:12.533327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.536414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.541860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.545330 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1986/3873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:12 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:12.545482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.552719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.552719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.559960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:12.560945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:12.570638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.570638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.573847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.575124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.576646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.577376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.631080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Unlocking {{(pid=120625) unlock /opt/stack/nova/nova/compute/api.py:4875}} Oct 31 15:32:12.711127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1928d53e-8444-4960-a77e-4fe2cf0e3eeb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.155493 Oct 31 15:32:12.722030 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1987/3874] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:12 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:12.726321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:12.726942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:12.744141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.744974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.745596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.746511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.747132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.747723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.016842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.027368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.034269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.040744 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f58e65cb-c17d-4b8b-911a-ad77ac974bad tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.557450 Oct 31 15:32:13.041611 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1888/3875] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:12 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:13.046654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:13.058288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:13.071232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.075070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.075743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.076670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.077418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.079736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.241576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.257225 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de9e6826-867f-48dc-b56e-a6c04fbaf060 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.535874 Oct 31 15:32:13.258652 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1988/3876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:12 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:13.268284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:13.271865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:13.297181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.298096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.299795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.301115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.303133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.303648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.441938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.453234 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-96a35d0f-acf6-411e-abf3-c6fd90fa0ebd tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1279 microversion: 2.1 time: 0.192599 Oct 31 15:32:13.465299 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1989/3877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:13 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:13.501603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:13.502514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:13.512101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.512944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.517988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.520778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.521610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.522913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.528017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.546834 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-43dca0ea-515e-4743-ba8c-1da1a12f9727 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.503127 Oct 31 15:32:13.551115 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1889/3878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:13 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:13.576408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:13.578070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:13.616969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.622331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.623056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.623978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.629732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.630375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.092770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.107023 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-618fc5e1-9fef-4f83-8828-af5dc8bd30f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.533751 Oct 31 15:32:14.114461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.118086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:14.119581 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1890/3879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:13 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:14.146982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:14.149496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:14.151895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64275e74-f44e-469b-bcdd-71e656e108fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.644934 Oct 31 15:32:14.164759 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1990/3880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:13 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:14.171871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:14.172498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:14.184593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.185117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.185567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.186290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.186759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.187193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.197115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.197632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.198274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.199601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.200082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.202585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.375468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.392179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.394575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.397259 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2290333e-e784-4900-a4c7-a0ab66838955 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.275578 Oct 31 15:32:14.406065 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1891/3881] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:14 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:14.428262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:14.429259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:14.453425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.454305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.454936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.457277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.458265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.460070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.821816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.835378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea08e9e8-451c-4d55-a1d1-d73f6d547198 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.426266 Oct 31 15:32:14.836719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1892/3882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:14 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:14.846334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:14.851186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:14.867788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.868443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.870207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.873215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.878110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.879030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.920451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.939498 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ea85318-67d6-4fc2-808b-4781c09ecb99 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.785203 Oct 31 15:32:14.948839 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1991/3883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:14 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:14.963377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0f7f362b-df56-4770-8c89-8c3b60ecbf5b req-e2b6671a-07f6-4002-89b6-d9d676cf85e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543c69d2-93b6-4ba0-8124-7909489b0b32", "tag": "3920e839-ea5f-4611-9409-4e62af409dd4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:15.009136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f7f362b-df56-4770-8c89-8c3b60ecbf5b req-e2b6671a-07f6-4002-89b6-d9d676cf85e4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.009646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f7f362b-df56-4770-8c89-8c3b60ecbf5b req-e2b6671a-07f6-4002-89b6-d9d676cf85e4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.010085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f7f362b-df56-4770-8c89-8c3b60ecbf5b req-e2b6671a-07f6-4002-89b6-d9d676cf85e4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.055189 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0f7f362b-df56-4770-8c89-8c3b60ecbf5b req-e2b6671a-07f6-4002-89b6-d9d676cf85e4 service nova] Creating event network-changed:3920e839-ea5f-4611-9409-4e62af409dd4 for instance 543c69d2-93b6-4ba0-8124-7909489b0b32 on n-h1-858383-17 Oct 31 15:32:15.076157 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0f7f362b-df56-4770-8c89-8c3b60ecbf5b req-e2b6671a-07f6-4002-89b6-d9d676cf85e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124424 Oct 31 15:32:15.076848 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1992/3884] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:15.082180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:15.082819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.123143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.123654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.124097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.124837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.127380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.129790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.208737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:15.217610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-512e84ce-795c-4d28-818c-be5d8d644c5f tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.379013 Oct 31 15:32:15.220627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1893/3885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:14 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:15.248008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:15.251797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.273046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.274094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.279900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.280804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.282018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.282018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.303746 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-376cc053-c3e3-4683-a1b6-38d0b52e31ca tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.208100 Oct 31 15:32:15.304469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1993/3886] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:15 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:15.348781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:15.349575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.385157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.397743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.398216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.398990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.399473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.400760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.807839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:15.815902 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d39b6014-3ed5-4e1f-bd80-a0a414aad340 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.578560 Oct 31 15:32:15.816826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1894/3887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:15 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:15.822296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:15.831604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.847441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.848234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.849114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.850035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.856513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.857393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.873766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:15.889992 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8be4bc6-90f8-4bbc-b574-920a8e7d3c28 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1674 microversion: 2.1 time: 0.577574 Oct 31 15:32:15.891148 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1994/3888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:15 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1674 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:15.896585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:15.902791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.922704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.927473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.928744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.936536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.938934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.939858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.110186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:16.131698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:16.138848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:16.142107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-31793f77-cca8-4a61-91f6-5808eb7eb85c tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.323613 Oct 31 15:32:16.144767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1895/3889] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:15 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:16.159657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b822039a-9e69-4427-94ff-8f851e046ae5 req-4bd07ac1-4486-46b7-8d08-149bd8228e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2706a9-93e9-4253-90c7-d2a1bf4b59c7", "tag": "93a7cee1-b3ff-44f3-aeb5-dd2eeef9e787"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:16.201584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b822039a-9e69-4427-94ff-8f851e046ae5 req-4bd07ac1-4486-46b7-8d08-149bd8228e68 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.206003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b822039a-9e69-4427-94ff-8f851e046ae5 req-4bd07ac1-4486-46b7-8d08-149bd8228e68 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.206748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b822039a-9e69-4427-94ff-8f851e046ae5 req-4bd07ac1-4486-46b7-8d08-149bd8228e68 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.234603 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b822039a-9e69-4427-94ff-8f851e046ae5 req-4bd07ac1-4486-46b7-8d08-149bd8228e68 service nova] Creating event network-changed:93a7cee1-b3ff-44f3-aeb5-dd2eeef9e787 for instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 on n-h2-858383-17 Oct 31 15:32:16.247003 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b822039a-9e69-4427-94ff-8f851e046ae5 req-4bd07ac1-4486-46b7-8d08-149bd8228e68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100687 Oct 31 15:32:16.251031 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1896/3890] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:16.268469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:16.271227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:16.284869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:16.287844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.288651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.291091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.292219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.293781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.294414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.296561 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-207f424c-d1e4-4635-8b03-85c0861137fd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.404129 Oct 31 15:32:16.309394 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1995/3891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:15 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:16.547685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:16.560647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a5b437a-95d8-49fd-891a-fd65e38c4f46 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.303317 Oct 31 15:32:16.568474 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1897/3892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:16 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:16.844046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:16.845088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:16.854308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.860771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.861717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.863468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.864743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.865482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.020774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=9 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:17.316056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.326921 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5b1c4e5-b297-4ef9-8b87-f79f0194fc41 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.486732 Oct 31 15:32:17.331742 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1996/3893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:16 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:17.340464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:17.343516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:17.356405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:UPDATE=7 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:17.361928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.364378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.370179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.371257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.371910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.379394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.407924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:17.408551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:17.419180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.420003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.420628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.423724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.424434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.425107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.559253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.576416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.579653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.581671 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1bb63bbd-0d61-46f7-a57f-938c429c8e06 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.246629 Oct 31 15:32:17.585848 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1997/3894] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:17 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:17.602314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:17.604323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:17.613748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.615399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.616736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.617476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.617952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.618426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.662345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=60 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:17.913264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.931463 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43e89595-db31-4013-a539-9c0c07b68512 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.343350 Oct 31 15:32:17.934460 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1998/3895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:17 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:17.951654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:17.952341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.953051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:17.954808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:17.968227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-653c46e1-1fdb-4e97-9c94-f30d78010a5f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1654 microversion: 2.1 time: 1.057387 Oct 31 15:32:17.971424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.972264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.972838 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1898/3896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:16 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1654 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:17.973993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.975154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:17.975859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:17.976950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.000874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:18.002331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:18.013297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.014414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.019054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.020278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.021055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.023990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.179504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-756c3aa7-dc45-49d6-abf3-596051892035 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.189517 Oct 31 15:32:18.180689 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1899/3897] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:17 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:32:18.204807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:18.206133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:18.214658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.215732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.216436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.217422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.218101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.219047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.796743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:18.808012 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-749789fb-aeb3-4087-862f-3fa35db56167 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.871799 Oct 31 15:32:18.808818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1999/3898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:17 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:18.814068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:18.815362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:18.827773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.829446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.831024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.832069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.833371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.834007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.061379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.079664 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60d9363d-595e-4dc7-9d35-af54363e90c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1661 microversion: 2.1 time: 0.893718 Oct 31 15:32:19.081021 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1900/3899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:18 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1661 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:19.089073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.089983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:19.098260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.098815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.100123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.100841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.101384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.101983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.247880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.262534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.266406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.270635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.278031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-189e908f-05d2-474d-90fc-6feb5a2bd147 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.467941 Oct 31 15:32:19.281374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5078d44-485e-483e-bfd9-6b3f53a8e050 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.197727 Oct 31 15:32:19.281820 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2000/3900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:18 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:19.284970 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1901/3901] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:19.293127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.294092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:19.301044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.302071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.302757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.303664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.304306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.304980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.668846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.680491 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-934b98b1-fb86-4ebb-86b7-8a8a29886c62 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.397116 Oct 31 15:32:19.682104 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2001/3902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:19.832836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.833683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:19.841432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.841929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.842565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.843465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.844451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.844851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.105509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.106136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.116828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.117334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.117932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.119069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.119530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.119953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.140618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.155489 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-398efcbc-0f01-4c61-a50d-caf690277276 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.327674 Oct 31 15:32:20.156634 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1902/3903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:20.316401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.317062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.328567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.329346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.329950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.330854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.331475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.337816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.409283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:20.470213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=60 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:20.557268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.568686 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1467d85b-0f6e-41ab-9e7d-486184b23750 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.466850 Oct 31 15:32:20.589249 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2002/3904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:20 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:20.596900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.597724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.606115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.606898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.607511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.609423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.610069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.610690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.658352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.670532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fadadefa-180e-46d2-b581-a5360887e50a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.358166 Oct 31 15:32:20.686838 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1903/3905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:20 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:20.698492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.699726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.708107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.708885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.709504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.711068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.711917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.713145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.736062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.751938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.756531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.762598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf0ab212-b891-4347-b5d5-187128042dfd tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.171896 Oct 31 15:32:20.763203 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2003/3906] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:20 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:20.793808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.803411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.812585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.813274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.813749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.814482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.814947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.815382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.130430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:21.139255 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e17a67d0-3a7a-431d-8927-949b1fb9f023 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.451046 Oct 31 15:32:21.140559 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1904/3907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:20 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:21.177021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:21.177821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:21.187463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.188036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.188547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.189304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:21.189804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.189915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.190470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.198850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47be64b0-8f3c-4550-b1ed-3639689d365c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.418888 Oct 31 15:32:21.201711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2004/3908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:20 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:21.216143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:21.220187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:21.229593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.233868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.234843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.235822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.236523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.237232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.527641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:21.542405 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c8099036-880e-4d55-9f3b-6e2dcfaa51b9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.337916 Oct 31 15:32:21.546072 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2005/3909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:21 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:21.599858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:21.614852 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b1ea128-2699-47d6-a2e4-aafb756a3b00 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.447946 Oct 31 15:32:21.615713 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1905/3910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:21 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:21.645380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:21.646003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:21.656231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.656759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.658886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.664113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.670134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.671350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.703053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:21.703915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:21.714865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:21.719782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.721417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.723655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.725482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.727321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.728724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.127396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.142117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2343ba32-562a-443f-8485-076c47b43c95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.441887 Oct 31 15:32:22.162181 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1906/3911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:21 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:22.171395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:22.172025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.189325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.189959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.190246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.190974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.191437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.191868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.217893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.230232 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67e8b5d1-5130-4abb-bac4-1a8b9cc5f00c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.588184 Oct 31 15:32:22.231333 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2006/3912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:21 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:22.236194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:22.237094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.244765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.245513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.246199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.247099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.248112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.248736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.295059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:22.336472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.354678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.356327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.359801 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-faa3b1fb-ab1d-4ead-ad3a-e2bf1fe4b843 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.196268 Oct 31 15:32:22.361784 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1907/3913] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:22 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:22.369978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:22.370898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.377991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.381571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.382252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.383169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.383803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.385073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.525655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.544597 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31cb1bdb-ccfb-44e1-a832-c8864e9cf7ff tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.311971 Oct 31 15:32:22.545230 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2007/3914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:22 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:22.566231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:22.567519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.588588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.591623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.594266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.595066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.595549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.595983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.702042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.710365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbb029a6-bd01-420e-9e15-c790ac583e0f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.347291 Oct 31 15:32:22.714823 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1908/3915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:22 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:22.750395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:22.751046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.762534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.764970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.765652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.767886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.768556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.770562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.895763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.905385 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e96a3548-c21b-4113-aedb-2de89542083e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.343535 Oct 31 15:32:22.941391 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2008/3916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:22 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:23.054802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-58c22e0f-cd92-4b1c-b07e-7a25a5b82722 req-6310b5a8-f9a5-46a1-82a2-81c3c2948c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543c69d2-93b6-4ba0-8124-7909489b0b32", "name": "network-vif-plugged", "status": "completed", "tag": "3920e839-ea5f-4611-9409-4e62af409dd4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:23.089960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-58c22e0f-cd92-4b1c-b07e-7a25a5b82722 req-6310b5a8-f9a5-46a1-82a2-81c3c2948c52 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.092611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-58c22e0f-cd92-4b1c-b07e-7a25a5b82722 req-6310b5a8-f9a5-46a1-82a2-81c3c2948c52 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.092998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-58c22e0f-cd92-4b1c-b07e-7a25a5b82722 req-6310b5a8-f9a5-46a1-82a2-81c3c2948c52 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.121779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:23.136094 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-58c22e0f-cd92-4b1c-b07e-7a25a5b82722 req-6310b5a8-f9a5-46a1-82a2-81c3c2948c52 service nova] Creating event network-vif-plugged:3920e839-ea5f-4611-9409-4e62af409dd4 for instance 543c69d2-93b6-4ba0-8124-7909489b0b32 on n-h1-858383-17 Oct 31 15:32:23.146894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0af8a619-79e1-482f-85c3-7381b51b4a7c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.402539 Oct 31 15:32:23.148526 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1909/3917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:22 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:23.166819 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-58c22e0f-cd92-4b1c-b07e-7a25a5b82722 req-6310b5a8-f9a5-46a1-82a2-81c3c2948c52 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114518 Oct 31 15:32:23.167207 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2009/3918] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:23.179899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.181366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:23.190281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.193125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.193586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.196375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.199155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.199613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.395565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.396951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:23.433216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.434805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.434805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.435679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.436654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.437748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.593092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:23.612929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:23.614571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:23.616398 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56f6f3bf-2171-4c6d-9cb7-e36e11fc2ba4 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.225854 Oct 31 15:32:23.636875 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2010/3919] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:23.642580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.643548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:23.675529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:23.678255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.681268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.683568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.685005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.685972 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcb234dd-2922-4f57-9937-cd724793bfc9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.520991 Oct 31 15:32:23.688580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.689586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.700893 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1910/3920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:23.929812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.930596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:23.940868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.943852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.944438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.945323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.948926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.949567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.986399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:23.998315 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-638c5ec9-5022-4cae-9493-76e0dc840eb4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1514 microversion: 2.1 time: 0.359778 Oct 31 15:32:24.007305 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2011/3921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:24.227934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.239993 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e16c084-88cd-4004-9914-563202e1343b tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.313137 Oct 31 15:32:24.254934 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1911/3922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:24.638605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:24.639141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:24.643881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:24.644506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:24.648484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.649284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.650178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.651670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.652396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.653099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.654739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.655242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.655689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.656399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.660097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.660579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.687903 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80fa4c2e-7060-43c2-8208-a1544a10590c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/ips" status: 200 len: 153 microversion: 2.20 time: 0.582030 Oct 31 15:32:24.689171 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2012/3923] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Oct 31 15:32:24 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/ips => generated 153 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:32:24.720676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:24.721606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:24.739432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.740105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.740651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.741984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.745686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.746930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.796740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.810072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.811506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.812772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38a0f80d-d2b0-4eb1-a8ac-efb4bdda6120 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1603 microversion: 2.32 time: 0.173216 Oct 31 15:32:24.816127 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1912/3924] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:24 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1603 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:25.034928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:25.036044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:25.049143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.051648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.053405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.054646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.057302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.058114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.127450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:25.145981 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dde32a35-e4e8-4cf3-9b4f-afd743724145 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1314 microversion: 2.1 time: 0.436497 Oct 31 15:32:25.152424 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2013/3925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:24 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:25.244984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-bfa989af-d209-438e-aff8-ec77742403c8 req-b67b616f-6a88-47a8-9baa-437b8850f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2706a9-93e9-4253-90c7-d2a1bf4b59c7", "name": "network-vif-plugged", "status": "completed", "tag": "93a7cee1-b3ff-44f3-aeb5-dd2eeef9e787"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:25.272891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bfa989af-d209-438e-aff8-ec77742403c8 req-b67b616f-6a88-47a8-9baa-437b8850f451 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.284182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bfa989af-d209-438e-aff8-ec77742403c8 req-b67b616f-6a88-47a8-9baa-437b8850f451 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.286698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bfa989af-d209-438e-aff8-ec77742403c8 req-b67b616f-6a88-47a8-9baa-437b8850f451 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.315631 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-bfa989af-d209-438e-aff8-ec77742403c8 req-b67b616f-6a88-47a8-9baa-437b8850f451 service nova] Creating event network-vif-plugged:93a7cee1-b3ff-44f3-aeb5-dd2eeef9e787 for instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 on n-h2-858383-17 Oct 31 15:32:25.329667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-bfa989af-d209-438e-aff8-ec77742403c8 req-b67b616f-6a88-47a8-9baa-437b8850f451 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094910 Oct 31 15:32:25.338519 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2014/3926] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:25.351227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:25.352284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:25.361110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.369420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.373110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.374955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.377108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.378577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.407348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:25.419419 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-44bf0668-3945-4157-90b7-efa3dd819dc2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.388953 Oct 31 15:32:25.422065 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1913/3927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:25 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:25.659973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:25.670388 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-341dcb72-3797-4e9e-ad8f-0e7491f235d3 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.330203 Oct 31 15:32:25.671001 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2015/3928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:25 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:25.843188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:25.844225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:25.856325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.859019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.859709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.861517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.864311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.865042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.897431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:25.970513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.971551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.973427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.974086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lazy-loading 'fault' on Instance uuid 26c28824-87d6-455a-9765-06aa798221c1 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:26.054286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.077886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.079986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc162776e60407ab14cc14a454f9b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd520540ecfc445c8fd4db77895713d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.086240 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3414f989-662b-4836-a9d6-5d8c632f770a tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 200 len: 1608 microversion: 2.32 time: 0.247458 Oct 31 15:32:26.088203 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1914/3929] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:25 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 1608 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:26.174702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:26.175489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:26.189582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.192721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.193590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.194686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.196002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.197543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.421827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.440069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ea625e5-9577-47de-8a42-992f4d562c9e tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1501 microversion: 2.1 time: 0.260762 Oct 31 15:32:26.446986 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2016/3930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:26 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1501 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:26.471163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:26.471344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:26.472616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:26.474308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:26.487672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.489600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.490408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.491799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.493632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.494268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.512091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.512804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.527753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.531235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.531235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.531235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.605136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lazy-loading 'flavor' on Instance uuid 543c69d2-93b6-4ba0-8124-7909489b0b32 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:26.735549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.753596 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9720360-aa3a-42f6-a422-1207969ce240 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.307899 Oct 31 15:32:26.754517 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1915/3931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:26 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:26.759457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:26.760070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:26.773806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.775182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.781480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.782580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.783277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.783881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.817571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35132d8f-17cb-4a71-bc0f-121b35f9d9c5 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "POST /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32/action" status: 200 len: 32 microversion: 2.1 time: 0.350771 Oct 31 15:32:26.818740 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2017/3932] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:26 2022] POST /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:32:26.841063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:26.841975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:26.856219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.857065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.857659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.858531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:26.862356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:26.865012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.258231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:27.280862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a961e0bc-294a-4680-917e-5b6fea19f59c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1321 microversion: 2.1 time: 0.524996 Oct 31 15:32:27.282646 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1916/3933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:26 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:27.292317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:27.297690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:27.298587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:27.302144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc38f303-76b4-4871-9ffb-91482d7a207c tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.475629 Oct 31 15:32:27.307474 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2018/3934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:26 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:27.317495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.318430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.319151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.320109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.320948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.323532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.356816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] HTTP exception thrown: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Request method failure captured: Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 HTTP/1.1 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-jsS6qJtzJBTRyN9MD2pFmobSKxJ23WLvsTxxObIu5HDs78ynfneggb_yGua_SQqYb-nAI8s9_Muppcawpj8OwZqPadIPh8a8t2SjMbyr8Pjaz0ZeQjy816KkhESccSv7HGHcY68CPgOJvZjSET2DxcKpDCAmYkc5KU-9lQrapyOnY Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: fd520540ecfc445c8fd4db77895713d1 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: fd520540ecfc445c8fd4db77895713d1 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TaggedBootDevicesTest-1130337495-project Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ebc162776e60407ab14cc14a454f9b88 Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TaggedBootDevicesTest-1130337495-project Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '26c28824-87d6-455a-9765-06aa798221c1'} Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:27.359479 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Returning 404 to user: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4acaf07-87b8-4a44-9e24-a312937f5fcc tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 404 len: 111 microversion: 2.32 time: 0.080230 Oct 31 15:32:27.366350 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1917/3935] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:27 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:27.375779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-135176aa-577d-4be9-af95-fc64d93e1c05 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '.version_select at 0x7f5ca15419d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:27.411501 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-135176aa-577d-4be9-af95-fc64d93e1c05 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815098709" status: 204 len: 0 microversion: 2.32 time: 0.039631 Oct 31 15:32:27.412689 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2019/3936] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Oct 31 15:32:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815098709 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:32:27.782767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:27.784123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:27.800968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.801751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.802390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.803415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.804053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.804474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.058638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:28.067233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:28.079112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.079609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.080282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.081025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.081482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.081909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.122643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lazy-loading 'flavor' on Instance uuid a0e1b2ef-972b-42d2-a19e-052e922dd445 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:28.547058 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec471345-73ab-4103-b242-d5bc5b8173d1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/action" status: 202 len: 0 microversion: 2.20 time: 0.492117 Oct 31 15:32:28.547989 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2020/3937] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:32:28 2022] POST /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:32:28.562566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:28.567369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:28.594103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.594733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.595282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.596110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.596680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.597414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.627587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:28.637619 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09c6a850-e55f-4da0-9329-b6eda56a66e5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.859537 Oct 31 15:32:28.646451 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1918/3938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:27 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:28.656765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:28.663658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:28.672160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.672956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.674230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.675280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.675942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.676545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.039775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:29.048458 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d32a3a51-0ed5-4ccc-bcfc-f21d34eae519 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.400570 Oct 31 15:32:29.059560 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1919/3939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:28 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:29.080308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:29.092583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:29.092837 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ede4b96-d005-400a-90af-c52b65841b95 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1471 microversion: 2.1 time: 0.538319 Oct 31 15:32:29.093420 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2021/3940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:28 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:29.094096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:29.103429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.103931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.104422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.105156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.105612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.106033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.121535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3b1fcaec-0c05-4367-a418-52f231255102 req-66e31ed5-02a9-4651-a7e0-3e9fb58f68b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c", "name": "network-vif-unplugged", "status": "completed", "tag": "994ba79a-be9e-4b61-938f-64b69e61e2ee"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:29.148804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b1fcaec-0c05-4367-a418-52f231255102 req-66e31ed5-02a9-4651-a7e0-3e9fb58f68b0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.151664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b1fcaec-0c05-4367-a418-52f231255102 req-66e31ed5-02a9-4651-a7e0-3e9fb58f68b0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.153382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3b1fcaec-0c05-4367-a418-52f231255102 req-66e31ed5-02a9-4651-a7e0-3e9fb58f68b0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.186850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3b1fcaec-0c05-4367-a418-52f231255102 req-66e31ed5-02a9-4651-a7e0-3e9fb58f68b0 service nova] Creating event network-vif-unplugged:994ba79a-be9e-4b61-938f-64b69e61e2ee for instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c on n-h2-858383-17 Oct 31 15:32:29.194511 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3b1fcaec-0c05-4367-a418-52f231255102 req-66e31ed5-02a9-4651-a7e0-3e9fb58f68b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099571 Oct 31 15:32:29.198258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2022/3941] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:29.455274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:29.469694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:29.474641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:29.476213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c559055f-1f4e-421f-816d-a4bb4be20607 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.401429 Oct 31 15:32:29.479430 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1920/3942] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:29 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:29.661979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:29.662649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:29.677964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.681920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.683720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.685701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.688137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.689426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.773343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f1ff400-5d6f-4149-9389-505f245fda04 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:29.774159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f1ff400-5d6f-4149-9389-505f245fda04 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] [instance: 10aa6df8-9207-4b26-b979-1c705725e9fb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:29.791778 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0f1ff400-5d6f-4149-9389-505f245fda04 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] HTTP exception thrown: Instance 10aa6df8-9207-4b26-b979-1c705725e9fb could not be found. Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f1ff400-5d6f-4149-9389-505f245fda04 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Request method failure captured: Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/10aa6df8-9207-4b26-b979-1c705725e9fb/action HTTP/1.1 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 15 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-p42muxjKvo7KP9Elz0xmQg9VvS_xDNFsWsn8yggH0z41suMp9hY6OE3v4dwsEGZDClENKWmdsTtpzDrSvs_xNwWR7j6zbMEMpRkFK4c-IYJF8LSFabMZWreCq1TTfLhTbaIYNr5ELOpp0bGgX34vs5wdZSD5lYNKRSHgXfBo9-bCU Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: acf942d4b2c64e3db97bbe203ea4cef6 Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: {"migrate": {}} Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 10aa6df8-9207-4b26-b979-1c705725e9fb could not be found. Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '10aa6df8-9207-4b26-b979-1c705725e9fb', 'body': {'migrate': {}}} Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10aa6df8-9207-4b26-b979-1c705725e9fb could not be found. Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10aa6df8-9207-4b26-b979-1c705725e9fb could not be found. Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:29.813886 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10aa6df8-9207-4b26-b979-1c705725e9fb could not be found. Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f1ff400-5d6f-4149-9389-505f245fda04 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Returning 404 to user: Instance 10aa6df8-9207-4b26-b979-1c705725e9fb could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f1ff400-5d6f-4149-9389-505f245fda04 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/10aa6df8-9207-4b26-b979-1c705725e9fb/action" status: 404 len: 111 microversion: 2.1 time: 0.617991 Oct 31 15:32:29.823722 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2023/3943] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:29 2022] POST /compute/v2.1/servers/10aa6df8-9207-4b26-b979-1c705725e9fb/action => generated 111 bytes in 621 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:32:30.005725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-286383325", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:30.115562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:30.137094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.147020 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04e7a209-d5c9-4514-b2bd-9adfe387c081 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.489953 Oct 31 15:32:30.163218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1921/3944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:29 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:30.171913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:30.172537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:30.186719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:30.187440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:30.188081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.188986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:30.189610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:30.190201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.559322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.568360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7088df81-1360-4a3e-bf2a-1572697b2f61 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.400177 Oct 31 15:32:30.569908 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1922/3945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:30 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:30.575645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:30.576474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:30.583447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:30.584298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:30.584980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.585865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:30.587009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:30.587448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.629621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:30.630413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:30.631080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:30.631491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:30.631902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:30.645284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:30.646053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:30.646713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.647818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:30.648622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:30.649476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.664519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:30.677857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Getting quotas for project 508b4a87c5854847a4e9bf053a40ed6c. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:30.686480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Getting quotas for user 24cabb0095dc4fa5b04e94e481c6ab96 and project 508b4a87c5854847a4e9bf053a40ed6c. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:30.701028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:30.703350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:30.760102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc06084c-466e-455d-9355-725ba5bf3dfc tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760208 Oct 31 15:32:30.767469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2024/3946] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:32:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:32:30.775666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20b6b66f-98b6-4cb1-9128-3f9fcbc07250 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:30.776440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20b6b66f-98b6-4cb1-9128-3f9fcbc07250 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:30.901058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-20b6b66f-98b6-4cb1-9128-3f9fcbc07250 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.909255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.917855 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20b6b66f-98b6-4cb1-9128-3f9fcbc07250 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1221 microversion: 2.1 time: 0.148547 Oct 31 15:32:30.923503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.925840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.926954 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2025/3947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:30 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:30.929016 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ed6fcd12-2e72-43c6-ba45-c03ce353aa3c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.356989 Oct 31 15:32:30.946376 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1923/3948] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:30 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:31.174582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:31.175368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:31.195035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.195035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.196870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.197778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.199805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.200336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.428647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:31.439052 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d91ca670-1fc3-4ccd-b3df-1ca06ecfc712 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.269292 Oct 31 15:32:31.440736 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2026/3949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:31 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:31.619146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:31.623401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:31.637073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.638007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.639136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.641074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.642403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.643088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.827668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:31.836875 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3469dc0c-bacd-407d-86ec-963dfc35937f tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.245373 Oct 31 15:32:31.856068 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1924/3950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:31 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:31.953156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:31.954846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:31.960373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:31.961016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:31.966485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.967418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.967938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.969055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.970760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.971355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.975544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.976041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.977424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.978746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.980000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.981014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.229596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:32.242420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99afa9fe-6bd7-438c-85ef-b798922fb0d6 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1273 microversion: 2.1 time: 0.291658 Oct 31 15:32:32.247488 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2027/3951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:31 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:32.298055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:32.312358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:32.314305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:32.318107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b7e5e838-aea5-43eb-9f9b-c1bc8149887d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.362408 Oct 31 15:32:32.333819 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1925/3952] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:31 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:32.465046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:32.466373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:32.479693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.481301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.482058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.485111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.486390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.487062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.599042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-08e17487-42a3-4fcb-8831-527324c30cb7 req-16372966-9cb9-4d05-b5e6-b04750a20089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c", "name": "network-vif-plugged", "status": "completed", "tag": "994ba79a-be9e-4b61-938f-64b69e61e2ee"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:32.626466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-08e17487-42a3-4fcb-8831-527324c30cb7 req-16372966-9cb9-4d05-b5e6-b04750a20089 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.627930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-08e17487-42a3-4fcb-8831-527324c30cb7 req-16372966-9cb9-4d05-b5e6-b04750a20089 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.630460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-08e17487-42a3-4fcb-8831-527324c30cb7 req-16372966-9cb9-4d05-b5e6-b04750a20089 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.683763 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-08e17487-42a3-4fcb-8831-527324c30cb7 req-16372966-9cb9-4d05-b5e6-b04750a20089 service nova] Creating event network-vif-plugged:994ba79a-be9e-4b61-938f-64b69e61e2ee for instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c on n-h2-858383-17 Oct 31 15:32:32.691489 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-08e17487-42a3-4fcb-8831-527324c30cb7 req-16372966-9cb9-4d05-b5e6-b04750a20089 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096397 Oct 31 15:32:32.700071 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1926/3953] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:32.757264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:32.776196 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0198d7fe-0c88-4ebb-baa0-059df9a8cb0b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.315611 Oct 31 15:32:32.779214 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2028/3954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:32 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:32.864767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:32.865717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:32.882478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.882986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.883425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.884208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.884670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.885120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.170285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.186057 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c389279e-15aa-4a5d-b066-138f11ed946d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.326471 Oct 31 15:32:33.186752 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1927/3955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:32 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:33.270523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:33.271702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:33.281995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.282777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.283388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.286682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.287843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.288490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.350378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:33.351021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:33.361492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.362701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.362701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.369728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.370485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.370932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.451297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.469230 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e80e511-56f7-443f-a8f3-02b1811ff85c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1279 microversion: 2.1 time: 0.202802 Oct 31 15:32:33.470424 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2029/3956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:33 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:33.681100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.692859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.701127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.702584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0856641-d9bc-4c1e-ba5e-6a98e288d943 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.356584 Oct 31 15:32:33.703334 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1928/3957] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:33 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:33.805589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:33.806226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:33.814736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.815485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.816147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.817084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.817548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.818280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.099555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.108534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b421d708-67b9-417f-bb63-f28fa5a2674d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1520 microversion: 2.1 time: 0.306834 Oct 31 15:32:34.112243 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2030/3958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:33 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:34.210934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.212206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.226869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.228856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.231283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.235101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.235917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.236669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.326174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.327572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.335047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.346030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.346944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.348096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.348947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.349936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.404011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] HTTP exception thrown: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Request method failure captured: Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 HTTP/1.1 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-jsS6qJtzJBTRyN9MD2pFmobSKxJ23WLvsTxxObIu5HDs78ynfneggb_yGua_SQqYb-nAI8s9_Muppcawpj8OwZqPadIPh8a8t2SjMbyr8Pjaz0ZeQjy816KkhESccSv7HGHcY68CPgOJvZjSET2DxcKpDCAmYkc5KU-9lQrapyOnY Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: fd520540ecfc445c8fd4db77895713d1 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: fd520540ecfc445c8fd4db77895713d1 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TaggedBootDevicesTest-1130337495-project Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ebc162776e60407ab14cc14a454f9b88 Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TaggedBootDevicesTest-1130337495-project Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '26c28824-87d6-455a-9765-06aa798221c1'} Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:34.408394 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Returning 404 to user: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b9bd6a3-fe76-4d09-bb18-35bc9513117f tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 404 len: 111 microversion: 2.32 time: 0.088996 Oct 31 15:32:34.414242 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2031/3959] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:32:34 2022] DELETE /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:32:34.429819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.431702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] [instance: 26c28824-87d6-455a-9765-06aa798221c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.440553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.441341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.441954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.442874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.443635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.444239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.465608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] HTTP exception thrown: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Request method failure captured: Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 HTTP/1.1 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-jsS6qJtzJBTRyN9MD2pFmobSKxJ23WLvsTxxObIu5HDs78ynfneggb_yGua_SQqYb-nAI8s9_Muppcawpj8OwZqPadIPh8a8t2SjMbyr8Pjaz0ZeQjy816KkhESccSv7HGHcY68CPgOJvZjSET2DxcKpDCAmYkc5KU-9lQrapyOnY Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: fd520540ecfc445c8fd4db77895713d1 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd520540ecfc445c8fd4db77895713d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: fd520540ecfc445c8fd4db77895713d1 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1130337495 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TaggedBootDevicesTest-1130337495-project Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ebc162776e60407ab14cc14a454f9b88 Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TaggedBootDevicesTest-1130337495-project Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '26c28824-87d6-455a-9765-06aa798221c1'} Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.468027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. Oct 31 15:32:34.474452 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:32:34.483872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] Returning 404 to user: Instance 26c28824-87d6-455a-9765-06aa798221c1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:34.485145 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21a51f8b-5699-4846-83c5-509ac9e5a890 tempest-TaggedBootDevicesTest-1130337495 tempest-TaggedBootDevicesTest-1130337495-project] 10.222.0.48 "GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1" status: 404 len: 111 microversion: 2.32 time: 0.060960 Oct 31 15:32:34.486057 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2032/3960] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:34 2022] GET /compute/v2.1/servers/26c28824-87d6-455a-9765-06aa798221c1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:34.510912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.511700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.533627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.534125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.534578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.535283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.535751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.536171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.613972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.630715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-556cd9e2-5eb7-46c4-bc52-31bbea9b68ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.419725 Oct 31 15:32:34.647071 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1929/3961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:34 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:34.733782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.735194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.745398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.746568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.747567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.749205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.750613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.751388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.930792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.949342 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-807e57c6-1f1b-4e27-a598-e22a1978de42 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.454999 Oct 31 15:32:34.950768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2033/3962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:34 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:35.051083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:35.061332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:35.063154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:35.064582 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a0b7818-a7fa-4c4f-82ab-caaa423db135 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.335459 Oct 31 15:32:35.084207 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1930/3963] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:34 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:35.139786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:35.140474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:35.153390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.153903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.155001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.156108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.156654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.157266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.340743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:35.357095 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8c4fc70-b89e-4a6b-be8e-9cf63c6021b5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1505 microversion: 2.1 time: 0.221291 Oct 31 15:32:35.357980 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2034/3964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:35 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:35.387832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:35.388769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:35.405776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.406478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.407307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.408325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.409088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.409769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.661814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:35.663247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:35.675882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.676897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.677541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.678619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.679436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.681381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.866230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:35.881630 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e3879e1e-b3cd-4a06-9214-b7ecefac88e7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 200 len: 1505 microversion: 2.1 time: 0.497786 Oct 31 15:32:35.882409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1931/3965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:35 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:35.914488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:35.915837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:35.930429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.932501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.933761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.936835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.940534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.943374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.954119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:36.009441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:32:36.184440 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb6da8e2-c301-4ac9-883b-1dadb8cbda07 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 204 len: 0 microversion: 2.1 time: 0.281801 Oct 31 15:32:36.189066 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1932/3966] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:32:35 2022] DELETE /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:32:36.199488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:36.213696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:36.220096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.220595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.221076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.221795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.222265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.222704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.257810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.266832 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f58cec5e-9262-452f-aa41-574aab650915 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.611202 Oct 31 15:32:36.271432 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2035/3967] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:35 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:36.282427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d87578fe-216d-4a41-b173-1d91296f1a3f req-9b854956-ca96-443d-bf6f-6eb36eeba808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d", "tag": "4c5514e2-b52e-4740-b7d3-ef225041afe5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:36.311129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d87578fe-216d-4a41-b173-1d91296f1a3f req-9b854956-ca96-443d-bf6f-6eb36eeba808 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.315107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d87578fe-216d-4a41-b173-1d91296f1a3f req-9b854956-ca96-443d-bf6f-6eb36eeba808 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.315738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d87578fe-216d-4a41-b173-1d91296f1a3f req-9b854956-ca96-443d-bf6f-6eb36eeba808 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.329031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d87578fe-216d-4a41-b173-1d91296f1a3f req-9b854956-ca96-443d-bf6f-6eb36eeba808 service nova] Creating event network-changed:4c5514e2-b52e-4740-b7d3-ef225041afe5 for instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d on n-h2-858383-17 Oct 31 15:32:36.334476 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d87578fe-216d-4a41-b173-1d91296f1a3f req-9b854956-ca96-443d-bf6f-6eb36eeba808 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061615 Oct 31 15:32:36.340017 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2036/3968] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:36.345983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:36.347351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:36.355943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.356872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.357535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.358471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.359106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.359709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.548090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.576584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-627aa0dc-94dd-4ad6-af47-ad1c0417b55a tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.383464 Oct 31 15:32:36.584833 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1933/3969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:36 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:36.587634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-355139017", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "c434093f-3fbe-495e-a69d-5d6525f3d51c"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:36.661558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.689323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] validate_networks() for [('c434093f-3fbe-495e-a69d-5d6525f3d51c', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:36.692732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.694290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.695513 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45110aa5-c608-4d4b-b527-483f07c03a73 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.354119 Oct 31 15:32:36.696682 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2037/3970] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:36 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:37.119374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:37.119863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:37.120435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:37.121820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:37.122421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:37.136981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.137473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.138346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.139193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.139698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.140142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.168009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Getting quotas for project 45f6b73c45784731bdf32b36378474de. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:37.178679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Getting quotas for user d56792ab8451481f82bb4d87b29ff9df and project 45f6b73c45784731bdf32b36378474de. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:37.193581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:37.196739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:37.244095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3308cbc3-6c9f-4747-86aa-473745690a2f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665021 Oct 31 15:32:37.245097 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1934/3971] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:32:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:32:37.256301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b171e88-039d-4a8f-a87e-786518d818c9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:37.256869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b171e88-039d-4a8f-a87e-786518d818c9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:37.260677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:37.308124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:37.309390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:37.333190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.334081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.334922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.335234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b171e88-039d-4a8f-a87e-786518d818c9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:37.336107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.339378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.340139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.342902 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b171e88-039d-4a8f-a87e-786518d818c9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1217 microversion: 2.1 time: 0.090529 Oct 31 15:32:37.343511 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2038/3972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:37 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:37.601108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:37.603385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:37.620654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.622821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.625354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.626325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.627221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.628725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.024931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.034322 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1de145a7-965c-43fd-9d1e-6563ebc77258 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.739226 Oct 31 15:32:38.035170 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1935/3973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:37 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:38.040393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:38.045259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:38.054364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.054872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.055893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.056793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.057269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.057708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.100330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.119257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f039164-982c-4d8c-bf2b-69d0aa6b38e9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.519320 Oct 31 15:32:38.139391 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2039/3974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:37 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:38.330822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.348886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.353243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.355167 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d620bad0-77be-4199-b89d-1a4a106280da tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.318528 Oct 31 15:32:38.370188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:38.370188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:38.378730 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1936/3975] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:38 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:38.384556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.385741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.386996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.387937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.388621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.389309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.478833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.487358 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c83182e2-8c2f-41ee-9fbc-0837ff899ce0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1213 microversion: 2.1 time: 0.123916 Oct 31 15:32:38.488316 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2040/3976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:38 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:39.062318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:39.063247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:39.073940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.074872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.075746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.076992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.077875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.078485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.152336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:39.156075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:39.202010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.202526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.204591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.205726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.207203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.208668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.975217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:39.989837 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e686a98-7256-458e-8327-fee42c500d17 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.840683 Oct 31 15:32:39.992189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2041/3977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:39 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:40.015669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:40.025603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:40.034283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.044327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.044856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.045291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.046244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b03a606-a692-4701-8597-6247519151f0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.988092 Oct 31 15:32:40.050414 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1937/3978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:39 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:40.064207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.064723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.069232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.073924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:40.078769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:40.097701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.099442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.099996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.102878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.103656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.104792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.258142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.267559 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01bd6531-4f8b-4ecc-a39c-82d8fa654774 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1275 microversion: 2.1 time: 0.215801 Oct 31 15:32:40.271755 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1938/3979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:40 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:40.289250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5601f8f7-32f5-4eec-96be-72d213c6569f req-c3bb2a12-96a1-443c-9afa-76e09a4b8ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c", "name": "network-vif-deleted", "tag": "994ba79a-be9e-4b61-938f-64b69e61e2ee"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:40.310204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5601f8f7-32f5-4eec-96be-72d213c6569f req-c3bb2a12-96a1-443c-9afa-76e09a4b8ea1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.311459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5601f8f7-32f5-4eec-96be-72d213c6569f req-c3bb2a12-96a1-443c-9afa-76e09a4b8ea1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.313348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5601f8f7-32f5-4eec-96be-72d213c6569f req-c3bb2a12-96a1-443c-9afa-76e09a4b8ea1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.353230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5601f8f7-32f5-4eec-96be-72d213c6569f req-c3bb2a12-96a1-443c-9afa-76e09a4b8ea1 service nova] Creating event network-vif-deleted:994ba79a-be9e-4b61-938f-64b69e61e2ee for instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c on n-h2-858383-17 Oct 31 15:32:40.402583 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5601f8f7-32f5-4eec-96be-72d213c6569f req-c3bb2a12-96a1-443c-9afa-76e09a4b8ea1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129181 Oct 31 15:32:40.403608 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1939/3980] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:40.660974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:40.916490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.928337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.929930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.936463 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b44599c2-3cb1-4998-8b98-b3445946e8a8 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.942272 Oct 31 15:32:40.937390 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2042/3981] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:39 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:41.020234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:41.021227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:41.033099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.034329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.035452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.037192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.038825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.040924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.076919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:41.077726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:41.098963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.099719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.100323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.104152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.106569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.107254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.491016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:41.499343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:41.502796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a97f8472-b45f-4fbb-85e9-ff31b68698da tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.432514 Oct 31 15:32:41.507335 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2043/3982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:41 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:41.509800 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-205d2277-ac5d-41b4-a8e6-ff82756cf11e tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.495115 Oct 31 15:32:41.520760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:41.521397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:41.535563 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1940/3983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:41 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:41.540099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.543388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.544444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.548144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.550788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.552711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.969617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:41.970238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:41.986732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.987570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.988191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.990385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.991867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.993643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.106254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.121456 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba35808a-dc5d-44d5-96f0-671e69fd0c4a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 0.611236 Oct 31 15:32:42.137472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2044/3984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:41 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:42.446623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.459611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.468465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.478302 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e313a45-4f24-4fb9-8d73-1467cc43a96f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1746 microversion: 2.20 time: 0.513468 Oct 31 15:32:42.478940 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1941/3985] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:41 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1746 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:42.533695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:42.534396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:42.542052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:42.543130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:42.558683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.559182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.559624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.565907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.576733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.577733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.578415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.579052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.580671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.581393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.592173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.593044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.653595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:43.425887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.439468 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-15638a88-96ec-4910-b460-a34bc52191f9 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.899514 Oct 31 15:32:43.440741 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1942/3986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:42 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:43.456742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:43.460263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:43.476584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:43.479488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:43.481128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.485636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:43.486363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:43.487634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.529222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.557362 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b02bc7a-18f8-414b-80f7-9efea0c0a810 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 1.027458 Oct 31 15:32:43.571893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2045/3987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:42 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:43.594293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:43.599845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:43.622164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:43.622749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:43.624639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.626250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:43.626956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:43.627852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.956572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.977759 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a5a5906b-1e55-4e9c-aec4-e2fcc2fb0693 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 0.535489 Oct 31 15:32:43.978376 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1943/3988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:43 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:44.005058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:44.025452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:44.030678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:44.034677 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5828401f-b2d6-40b8-b640-b5d96876c1a5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1746 microversion: 2.20 time: 0.458253 Oct 31 15:32:44.038522 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2046/3989] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:43 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1746 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:44.208085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-197821344", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:44.209180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-84e33c84-5230-4542-b8bc-c56266354a39 req-da5efb4b-6f82-44a8-80e0-53a55833b71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "name": "network-vif-plugged", "status": "completed", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:44.226162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-84e33c84-5230-4542-b8bc-c56266354a39 req-da5efb4b-6f82-44a8-80e0-53a55833b71c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.226990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-84e33c84-5230-4542-b8bc-c56266354a39 req-da5efb4b-6f82-44a8-80e0-53a55833b71c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.227537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-84e33c84-5230-4542-b8bc-c56266354a39 req-da5efb4b-6f82-44a8-80e0-53a55833b71c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:44.246813 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-84e33c84-5230-4542-b8bc-c56266354a39 req-da5efb4b-6f82-44a8-80e0-53a55833b71c service nova] Creating event network-vif-plugged:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:32:44.253559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-84e33c84-5230-4542-b8bc-c56266354a39 req-da5efb4b-6f82-44a8-80e0-53a55833b71c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052271 Oct 31 15:32:44.266070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2047/3990] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:44.286803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] validate_networks() for [('9049b64f-3457-4bbb-a057-f27d24fb2139', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:44.294483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-420eefe4-da05-4aba-87dd-5e334c0d8151 req-cf411f09-9657-404a-afa8-6ec709475229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78e2e5f-8adc-444d-94e2-5618e5ebdf76", "tag": "1b09d647-c034-4a99-96f0-bfea491241ea"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:44.306798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-420eefe4-da05-4aba-87dd-5e334c0d8151 req-cf411f09-9657-404a-afa8-6ec709475229 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.307693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-420eefe4-da05-4aba-87dd-5e334c0d8151 req-cf411f09-9657-404a-afa8-6ec709475229 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.308605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-420eefe4-da05-4aba-87dd-5e334c0d8151 req-cf411f09-9657-404a-afa8-6ec709475229 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:44.322874 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-420eefe4-da05-4aba-87dd-5e334c0d8151 req-cf411f09-9657-404a-afa8-6ec709475229 service nova] Creating event network-changed:1b09d647-c034-4a99-96f0-bfea491241ea for instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 on n-h1-858383-17 Oct 31 15:32:44.342538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-420eefe4-da05-4aba-87dd-5e334c0d8151 req-cf411f09-9657-404a-afa8-6ec709475229 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052317 Oct 31 15:32:44.357221 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2048/3991] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:44.467223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:44.471025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:44.507329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.507844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.508328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:44.513414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.516232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.517325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.307660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.317914 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9db96a7-83fe-449d-9173-a2b7d8dcad73 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.855980 Oct 31 15:32:45.326062 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2049/3992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:44 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:45.345822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:45.349578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:45.369526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.373520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.375682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.379826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.384821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.387137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.097793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:46.098313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:46.098819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:46.099240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:46.099662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:46.103137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:46.141080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.141589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.152169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.156172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.160032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.169550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.179184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.197648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6391b86-4e87-45c9-b053-ab0f7a800a91 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.865849 Oct 31 15:32:46.213748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2050/3993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:45 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:46.221375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:46.222272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:46.229045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.229886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.230495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.231384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.232016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.232622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.238275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Getting quotas for project 3b0c22c3c8e84f4b823afe9a5cff03af. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:46.255424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Getting quotas for user ea99dd7011b94e0a988ef0807c9d649a and project 3b0c22c3c8e84f4b823afe9a5cff03af. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:46.307104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:46.312500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:46.400661 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fec3a822-1e8d-4ba0-ade6-24860f556bac tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.420874 Oct 31 15:32:46.409395 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1944/3994] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:32:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:32:46.431918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:46.438975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:46.454845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.463900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.471537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.474982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.475704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.476152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.543491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.552880 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80ce6080-d35c-49c3-ba9b-7393a26ac3c7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 0.337665 Oct 31 15:32:46.562794 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2051/3995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:46 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:46.583539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:46.587526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:46.607365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.616557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.617072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.620547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.621365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.622011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.031369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.046212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.051664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.056303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.058003 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0300574-12a4-4094-9363-e513c80ac07d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.647259 Oct 31 15:32:47.058314 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ba39d8c-9d81-4699-9621-4b2fc23c7d58 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 0.493630 Oct 31 15:32:47.058979 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1945/3996] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:46 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:47.059658 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2052/3997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:46 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:47.064753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58da882a-4a3d-46f7-9dcd-3e0375efc2e1 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.065434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58da882a-4a3d-46f7-9dcd-3e0375efc2e1 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.065709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e00ed98c-895c-4646-84c8-e4012ba2c55f req-22f6346f-d21e-4c2c-9117-1613f059410c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d", "name": "network-vif-plugged", "status": "completed", "tag": "4c5514e2-b52e-4740-b7d3-ef225041afe5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:47.088935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e00ed98c-895c-4646-84c8-e4012ba2c55f req-22f6346f-d21e-4c2c-9117-1613f059410c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.097651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e00ed98c-895c-4646-84c8-e4012ba2c55f req-22f6346f-d21e-4c2c-9117-1613f059410c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.098601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e00ed98c-895c-4646-84c8-e4012ba2c55f req-22f6346f-d21e-4c2c-9117-1613f059410c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.133097 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e00ed98c-895c-4646-84c8-e4012ba2c55f req-22f6346f-d21e-4c2c-9117-1613f059410c service nova] Creating event network-vif-plugged:4c5514e2-b52e-4740-b7d3-ef225041afe5 for instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d on n-h2-858383-17 Oct 31 15:32:47.156501 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e00ed98c-895c-4646-84c8-e4012ba2c55f req-22f6346f-d21e-4c2c-9117-1613f059410c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095532 Oct 31 15:32:47.157657 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1946/3998] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:47.166925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:47.182214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.190562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.191287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.191910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.200114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.201150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58da882a-4a3d-46f7-9dcd-3e0375efc2e1 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.201895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.203471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.230041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58da882a-4a3d-46f7-9dcd-3e0375efc2e1 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1222 microversion: 2.1 time: 0.168298 Oct 31 15:32:47.246995 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2053/3999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:47.255091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.255729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.332026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.334589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.335800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.341581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.342400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.344644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.497433 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bef771d1-2a2c-4f4f-bd51-10e219b15ffb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.337864 Oct 31 15:32:47.498838 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1947/4000] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:47 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:47.527735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.528472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.537116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.538953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.540076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.541337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.542051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.543296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.845119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.870496 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-187b1b6d-0655-486c-900a-824009ebd79b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.632854 Oct 31 15:32:47.875690 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2054/4001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:47.906199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.911479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.934511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.935141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.937885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.941046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.941777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.943196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.969047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.983043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:48.008539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-007a29ff-c16f-49ce-8ea7-11db7589e6ee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1671 microversion: 2.1 time: 0.503623 Oct 31 15:32:48.012046 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1948/4002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1671 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:48.090402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:48.091310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:48.110144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:48.111309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:48.111981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:48.112980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:48.113842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:48.115126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:49.177177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.188289 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02d47ce0-09e1-449d-ac11-2b3d3f0c7ae8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 1.306859 Oct 31 15:32:49.193046 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2055/4003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:49.228663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:49.231124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:49.251706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.252734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.255700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:49.259156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.264372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.270358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.012754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.030880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-452a24f9-6e76-43a5-a006-c2edd032beb0 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1321 microversion: 2.1 time: 1.947105 Oct 31 15:32:50.031487 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1949/4004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:48 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1321 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:50.053777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:50.054621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:50.058449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.088283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.097868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.099347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b40d9828-dad0-4893-b534-d5284da72657 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.905102 Oct 31 15:32:50.104237 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2056/4005] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:49 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:50.109370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:50.112253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:50.131563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.132171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.132633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.134484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.135188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.135836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.136422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.136956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.137658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.138272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.139727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.140269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.394877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.406084 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90f9d632-3053-405c-aa20-c13ef67f3fde tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1280 microversion: 2.1 time: 0.358547 Oct 31 15:32:50.407599 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1950/4006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:50 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1280 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:50.413630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:50.415485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:50.425831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.426915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.427736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.428949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.429740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.430923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.485280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.495373 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0db2b98b-0151-4b1c-8faf-4d25e48cb3ea tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.389758 Oct 31 15:32:50.501511 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2057/4007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:50 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:50.513055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:50.521872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:50.546724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.549591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.551473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.553568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.556008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.557217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.000134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:51.012365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8262dd77-3982-40f1-af92-409c433724f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1671 microversion: 2.1 time: 0.602868 Oct 31 15:32:51.013390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1951/4008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:50 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1671 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:51.058979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.060244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.071171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.076751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.080621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.081801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.084854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.085656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.122166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:51.138161 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-093f8ade-f180-4713-bbf3-38154e87149e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 0.628615 Oct 31 15:32:51.140542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2058/4009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:50 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:51.156515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.161393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.189050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.193579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.196591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.198451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.201747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.202857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.676484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:51.690875 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd49cfb3-bdf6-4773-aaaf-b7e9a695d051 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1471 microversion: 2.1 time: 0.635952 Oct 31 15:32:51.709212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1952/4010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:51 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1471 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:51.716193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.716780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.725363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.726251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.727025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.727991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.728662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.729657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.113409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:52.123803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:52.132801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:52.145260 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9eb9817b-b93e-4553-a11e-390c74ffc34a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.999559 Oct 31 15:32:52.146182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2059/4011] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:51 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:52.154663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:52.189952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:52.194570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:52.208738 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fbcf40b8-baf8-4759-81b3-1c41fe9bc570 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1322 microversion: 2.1 time: 0.498157 Oct 31 15:32:52.210044 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1953/4012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:51 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:52.223360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.225979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:52.226941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:52.230916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.233040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.234460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.236180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.237545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.238716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.239550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.240180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.241257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.241899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.243537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.283861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lazy-loading 'flavor' on Instance uuid 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:52.460358 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b4592fe-5fd4-4204-9685-d8d090a00336 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d/action" status: 202 len: 0 microversion: 2.1 time: 0.248651 Oct 31 15:32:52.464592 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1954/4013] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:52 2022] POST /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:52.470919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:52.472192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:52.482702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.537336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.537336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.537336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.537336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.537336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.161407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.195136 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d3d8766-d512-477b-a326-5ccae788aa52 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 1.044328 Oct 31 15:32:53.213074 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2060/4014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:52 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:53.219360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:53.220247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:53.240997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.242880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.243350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.244114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.244588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.249990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.339655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.362434 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41404413-1966-440b-a771-c519f405568f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.889742 Oct 31 15:32:53.381847 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1955/4015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:52 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:53.387398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:53.390598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:53.401150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.401828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.402408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.403279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.403870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.404476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.769682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.778490 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71b83aad-d495-4747-8620-44e578d351c3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 0.563729 Oct 31 15:32:53.784309 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2061/4016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:53 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:53.823017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-673ce4be-c276-4426-9c48-7ad6b1443566 req-f9f1ca3b-9212-4622-adce-d97b22e099bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78e2e5f-8adc-444d-94e2-5618e5ebdf76", "name": "network-vif-plugged", "status": "completed", "tag": "1b09d647-c034-4a99-96f0-bfea491241ea"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:53.850463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-673ce4be-c276-4426-9c48-7ad6b1443566 req-f9f1ca3b-9212-4622-adce-d97b22e099bb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.851334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-673ce4be-c276-4426-9c48-7ad6b1443566 req-f9f1ca3b-9212-4622-adce-d97b22e099bb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.852057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-673ce4be-c276-4426-9c48-7ad6b1443566 req-f9f1ca3b-9212-4622-adce-d97b22e099bb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.897433 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-673ce4be-c276-4426-9c48-7ad6b1443566 req-f9f1ca3b-9212-4622-adce-d97b22e099bb service nova] Creating event network-vif-plugged:1b09d647-c034-4a99-96f0-bfea491241ea for instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 on n-h1-858383-17 Oct 31 15:32:53.911421 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-673ce4be-c276-4426-9c48-7ad6b1443566 req-f9f1ca3b-9212-4622-adce-d97b22e099bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124959 Oct 31 15:32:53.916634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2062/4017] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:53.964746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:53.967442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:53.983806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.984338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.984772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.985497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.997513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.998289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.441458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:54.458728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:54.466560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:54.471168 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba5c2e8a-2d91-49c9-ac49-b2429127dc36 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.552712 Oct 31 15:32:54.475868 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2063/4018] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:53 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:54.499526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:54.500588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:54.516842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.517554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.518827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.525378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.526479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.527207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.778336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-531229ce-e079-4080-bee1-8cb8b812ad91 tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1615 microversion: 2.1 time: 1.395140 Oct 31 15:32:54.784240 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1956/4019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:53 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1615 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:54.790398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:54.798097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:54.817590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.818334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.819028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.820001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.821794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.822492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.037115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:55.045351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87948e2b-d34a-4d54-9191-85350a191779 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1322 microversion: 2.1 time: 0.564826 Oct 31 15:32:55.057487 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2064/4020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:54 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:55.062445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0447c227-6d56-473f-a4bd-0ba0a7858caa req-795f68fe-f5b0-4711-84af-cf9c7dce64cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:55.088045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0447c227-6d56-473f-a4bd-0ba0a7858caa req-795f68fe-f5b0-4711-84af-cf9c7dce64cb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.088769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0447c227-6d56-473f-a4bd-0ba0a7858caa req-795f68fe-f5b0-4711-84af-cf9c7dce64cb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.089343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0447c227-6d56-473f-a4bd-0ba0a7858caa req-795f68fe-f5b0-4711-84af-cf9c7dce64cb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.094296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:55.115738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0447c227-6d56-473f-a4bd-0ba0a7858caa req-795f68fe-f5b0-4711-84af-cf9c7dce64cb service nova] Creating event network-changed:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:32:55.130534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0447c227-6d56-473f-a4bd-0ba0a7858caa req-795f68fe-f5b0-4711-84af-cf9c7dce64cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071529 Oct 31 15:32:55.131916 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2065/4021] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:55.138092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.138985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.156544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.157541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.158210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.159761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.160462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.161154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.271537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:55.282395 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-233a7f71-e595-41c1-8cfe-4daa6f49af4a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.496313 Oct 31 15:32:55.283858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1957/4022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:54 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:55.289984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:55.290741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.298199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.298899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.299492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.300521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.301223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.301692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.343096 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] HTTP exception thrown: Cannot 'migrate' instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d while it is in vm_state suspended Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Request method failure captured: Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d/action HTTP/1.1 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 15 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-p42muxjKvo7KP9Elz0xmQg9VvS_xDNFsWsn8yggH0z41suMp9hY6OE3v4dwsEGZDClENKWmdsTtpzDrSvs_xNwWR7j6zbMEMpRkFK4c-IYJF8LSFabMZWreCq1TTfLhTbaIYNr5ELOpp0bGgX34vs5wdZSD5lYNKRSHgXfBo9-bCU Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: acf942d4b2c64e3db97bbe203ea4cef6 Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: {"migrate": {}} Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'migrate' instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d while it is in vm_state suspended Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d', 'body': {'migrate': {}}} Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d in vm_state suspended. Cannot resize while the instance is in this state. Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:32:55.345587 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d while it is in vm_state suspended Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d while it is in vm_state suspended Oct 31 15:32:55.348654 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.352295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Returning 409 to user: Cannot 'migrate' instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d while it is in vm_state suspended {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:55.353754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c2ce116e-4bcf-49fc-ae33-9e90cab9cc6b tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d/action" status: 409 len: 148 microversion: 2.1 time: 0.068758 Oct 31 15:32:55.354563 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1958/4023] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:55 2022] POST /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d/action => generated 148 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:32:55.371677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc800e45-798b-49f3-b860-648d04ceacff tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc800e45-798b-49f3-b860-648d04ceacff tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Request method failure captured: Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7/action HTTP/1.1 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 39 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-p42muxjKvo7KP9Elz0xmQg9VvS_xDNFsWsn8yggH0z41suMp9hY6OE3v4dwsEGZDClENKWmdsTtpzDrSvs_xNwWR7j6zbMEMpRkFK4c-IYJF8LSFabMZWreCq1TTfLhTbaIYNr5ELOpp0bGgX34vs5wdZSD5lYNKRSHgXfBo9-bCU Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: acf942d4b2c64e3db97bbe203ea4cef6 Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: {"os-resetState": {"state": "invalid"}} Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'fe2706a9-93e9-4253-90c7-d2a1bf4b59c7', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:32:55.376423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 15:32:55.379688 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.381430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc800e45-798b-49f3-b860-648d04ceacff tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:55.382423 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc800e45-798b-49f3-b860-648d04ceacff tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7/action" status: 400 len: 144 microversion: 2.1 time: 0.020658 Oct 31 15:32:55.384129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1959/4024] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:55 2022] POST /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:32:55.394870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df7dfb38-a76c-4aed-8bf7-de8fe458ec1e tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df7dfb38-a76c-4aed-8bf7-de8fe458ec1e tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Request method failure captured: Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7/action HTTP/1.1 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 31 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-p42muxjKvo7KP9Elz0xmQg9VvS_xDNFsWsn8yggH0z41suMp9hY6OE3v4dwsEGZDClENKWmdsTtpzDrSvs_xNwWR7j6zbMEMpRkFK4c-IYJF8LSFabMZWreCq1TTfLhTbaIYNr5ELOpp0bGgX34vs5wdZSD5lYNKRSHgXfBo9-bCU Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: acf942d4b2c64e3db97bbe203ea4cef6 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: {"os-resetState": {"state": 1}} Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'fe2706a9-93e9-4253-90c7-d2a1bf4b59c7', 'body': {'os-resetState': {'state': 1}}} Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 1 Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 15:32:55.399750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 15:32:55.402921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.404916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df7dfb38-a76c-4aed-8bf7-de8fe458ec1e tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:55.406215 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df7dfb38-a76c-4aed-8bf7-de8fe458ec1e tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7/action" status: 400 len: 120 microversion: 2.1 time: 0.016806 Oct 31 15:32:55.407150 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1960/4025] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:55 2022] POST /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7/action => generated 120 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:32:55.418807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0412ec88-5ddf-439d-9855-b78c709c2efb tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:55.421084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0412ec88-5ddf-439d-9855-b78c709c2efb tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Failed to fetch instance by id 999 {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:32:55.421768 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0412ec88-5ddf-439d-9855-b78c709c2efb tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0412ec88-5ddf-439d-9855-b78c709c2efb tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Request method failure captured: Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 37 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-p42muxjKvo7KP9Elz0xmQg9VvS_xDNFsWsn8yggH0z41suMp9hY6OE3v4dwsEGZDClENKWmdsTtpzDrSvs_xNwWR7j6zbMEMpRkFK4c-IYJF8LSFabMZWreCq1TTfLhTbaIYNr5ELOpp0bGgX34vs5wdZSD5lYNKRSHgXfBo9-bCU Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a7c44d968e04452cb01bd55cb4ee2a23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a7c44d968e04452cb01bd55cb4ee2a23 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1131444667 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: acf942d4b2c64e3db97bbe203ea4cef6 Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1131444667-project-admin Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: {"os-resetState": {"state": "error"}} Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 999 could not be found. Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:55.431459 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:55.434835 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:55.434835 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 31 15:32:55.434835 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:32:55.434835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0412ec88-5ddf-439d-9855-b78c709c2efb tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:55.434835 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0412ec88-5ddf-439d-9855-b78c709c2efb tempest-ServersAdminNegativeTestJSON-1131444667 tempest-ServersAdminNegativeTestJSON-1131444667-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.020245 Oct 31 15:32:55.435611 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1961/4026] 10.222.0.48 () {60 vars in 1179 bytes} [Mon Oct 31 15:32:55 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:32:55.445318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.447238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.453862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.454639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.455274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.456098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.456674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.457239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.490115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:32:55.565252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:55.583768 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3baeb3f7-8bb6-4cc3-a5ca-72ed7f35d918 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1317 microversion: 2.1 time: 0.447198 Oct 31 15:32:55.587730 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2066/4027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:55 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:55.598458 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b08f423-6e2e-4e17-a1f7-86950ba61718 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "DELETE /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 204 len: 0 microversion: 2.1 time: 0.155670 Oct 31 15:32:55.599726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.600686 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1962/4028] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:32:55 2022] DELETE /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:32:55.600957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.610126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.611112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.611861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.612398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.613271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.613767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.614726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.615582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.624124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.624124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.640667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.641525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.641959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.642402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.205396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:56.300986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:56.545588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.558299 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32edeac4-9a21-40f7-b884-aee206307920 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1468 microversion: 2.1 time: 0.951752 Oct 31 15:32:56.559641 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1963/4029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:55 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1468 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:56.572688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:56.573417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:56.583425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.583930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.584377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.585114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.585581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.586050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.627760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.670097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.671931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.673194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5c6701b-6a3b-45cc-b026-4101f58c447a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 1.084182 Oct 31 15:32:56.700848 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2067/4030] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:55 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:56.707741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:56.708357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:56.729030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.730147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.730733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.731606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.732071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.732503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:57.224742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:57.321942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:57.334097 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ca4b9c5e-4302-4c73-b818-5e53bea8351b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1322 microversion: 2.1 time: 0.773366 Oct 31 15:32:57.337614 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1964/4031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:56 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1322 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:57.347600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:57.349528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:57.373065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:57.373931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:57.374597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:57.375507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:57.376045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:57.376553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:57.443368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:57.451196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:57.469958 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63347019-f263-48c2-9199-e20ab2b167fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1507 microversion: 2.1 time: 0.766446 Oct 31 15:32:57.474412 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2068/4032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:56 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1507 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:57.585450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:57.586607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:57.597308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:57.598062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:57.603580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:57.604828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:57.605831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:57.606695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.120784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.132102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f85e67f4-464e-4840-bd9d-5e95e7b975b1 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1468 microversion: 2.1 time: 0.551431 Oct 31 15:32:58.135925 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2069/4033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:57 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1468 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:58.149294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.154820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.172574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.173415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.174092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.174572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.175234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.175804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.176860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.190346 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e2145dd-9227-41d6-8193-32209e73db00 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1507 microversion: 2.1 time: 0.851392 Oct 31 15:32:58.191183 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1965/4034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:57 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1507 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:58.216241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.217056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.234471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.235941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.236738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.239807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.241321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.242825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.744708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.759784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9fc6ea0-3d9f-40d6-befb-6240b85973bb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1507 microversion: 2.1 time: 0.548479 Oct 31 15:32:58.780461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1966/4035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:58.791744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.792399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.807451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.807974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.811423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.812217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.812788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.816476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.908804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.919050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.923587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.928609 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0bc21023-11bb-44a1-950e-f604a1939a42 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.790547 Oct 31 15:32:58.929393 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2070/4036] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:58.939907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.943067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.957492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.960097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.961837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.966911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.967708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.968418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.409853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.424603 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21d9b355-3eab-43ff-881a-53d516f4781b tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1322 microversion: 2.1 time: 0.641092 Oct 31 15:32:59.426168 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1967/4037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:59.433657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:59.437691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.458173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.463660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.467248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.469228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.470652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.471165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.528667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.540445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bfa256e-95e4-480d-babc-84574f6feb7b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1487 microversion: 2.1 time: 0.608899 Oct 31 15:32:59.545809 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2071/4038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1487 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:59.561647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:59.563170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.582617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.587139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.591330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.592580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.593296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.595406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.700249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1979afd5-8abc-497c-86b4-9cd9715eb1dd tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "PUT /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1079 microversion: 2.1 time: 0.272696 Oct 31 15:32:59.701332 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1968/4039] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:32:59 2022] PUT /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1079 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:59.724651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:59.725552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.737321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.738198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.739835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.740841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.744367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.745107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.120069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:00.139028 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c32aa612-76d4-4654-a815-e4d16141ca42 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1505 microversion: 2.1 time: 0.415010 Oct 31 15:33:00.139868 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1969/4040] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:59 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:00.181380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1956098003", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:00.201595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:00.212485 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ccfc79c-7e85-4b4e-9e8f-1cdcf27c78eb tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 200 len: 1468 microversion: 2.1 time: 0.665129 Oct 31 15:33:00.213882 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2072/4041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:59 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 1468 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:00.225769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:00.230110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:00.237085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.238306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.239419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.240412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.241602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.244003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.336359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] validate_networks() for [('f6e21369-c9e2-4f9a-83b6-227ba8b0a8bd', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:01.370394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.388764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.391579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.393989 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e122069-fbbf-4084-ae83-88325366a4be tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 1.178903 Oct 31 15:33:01.397404 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2073/4042] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:00 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:01.411273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-61889cd0-7841-4abd-b66c-108a9e584fdd req-cf936456-8032-4312-ad13-be735fa3602f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d", "name": "network-vif-deleted", "tag": "4c5514e2-b52e-4740-b7d3-ef225041afe5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:01.437799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-61889cd0-7841-4abd-b66c-108a9e584fdd req-cf936456-8032-4312-ad13-be735fa3602f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.444437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-61889cd0-7841-4abd-b66c-108a9e584fdd req-cf936456-8032-4312-ad13-be735fa3602f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.445255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-61889cd0-7841-4abd-b66c-108a9e584fdd req-cf936456-8032-4312-ad13-be735fa3602f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.461473 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-61889cd0-7841-4abd-b66c-108a9e584fdd req-cf936456-8032-4312-ad13-be735fa3602f service nova] Creating event network-vif-deleted:4c5514e2-b52e-4740-b7d3-ef225041afe5 for instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d on n-h2-858383-17 Oct 31 15:33:01.496456 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-61889cd0-7841-4abd-b66c-108a9e584fdd req-cf936456-8032-4312-ad13-be735fa3602f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095512 Oct 31 15:33:01.497710 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2074/4043] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:01.511094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:01.515017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:01.530700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.534021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.535461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.537154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.539772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.543051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.062430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.090403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7fd79686-76a7-4522-8235-0d5670d5e97b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1505 microversion: 2.1 time: 0.585438 Oct 31 15:33:02.091597 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2075/4044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:01 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:02.116025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.126428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.139404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.140320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.143054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.144077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.145791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.148688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.281916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:02.282441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:02.283230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:02.283746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:02.284640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:02.318018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.321556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.325233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.328463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.331559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.333287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.363733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Getting quotas for project 3f8696603b19481abd8c8e15399851c5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:02.371324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Getting quotas for user c9b99145c96b4684952ac677bb25a076 and project 3f8696603b19481abd8c8e15399851c5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:02.386726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:02.390112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:02.425646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.437033 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d826038b-ea6e-4f1f-a16b-c80e71915933 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1322 microversion: 2.1 time: 0.342643 Oct 31 15:33:02.438024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2076/4045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:02.463587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.464214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.480005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.480502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.480981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.481692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.482180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.482586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.485070 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-37c4a374-3797-48bf-aa4b-fe2f5f368894 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.343052 Oct 31 15:33:02.490109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1970/4046] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:02.501897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5b81da45-5ea5-414c-82c5-42a4b56c27b5 req-29fb12e4-b18c-4b53-ba92-b50143c1cf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "name": "network-vif-plugged", "status": "completed", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:02.518380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] HTTP exception thrown: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d could not be found. Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Request method failure captured: Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d HTTP/1.1 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-p3s5IxlZhrtQs8YgFMLzbG8-6loxvs0ekAn8QDj7OSNnCGbZc7hj-2gfECMWQf4Psbe1dL_8nh_gd1RUZnEFWJW1wfHIlLo0msFQin_1W1Z5pWZIX4jFeBlAKH4gIc_VMqTOYWLDsLVbPbMjU-EQt0pxe1tQy7O74s29avrZwIibw Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 508b4a87c5854847a4e9bf053a40ed6c Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1415860972 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1415860972 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 508b4a87c5854847a4e9bf053a40ed6c Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1415860972 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersAdminNegativeTestJSON-1415860972-project Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 24cabb0095dc4fa5b04e94e481c6ab96 Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1415860972-project Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d could not be found. Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d'} Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d could not be found. Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d could not be found. Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:33:02.520606 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d could not be found. Oct 31 15:33:02.523724 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:33:02.527245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5b81da45-5ea5-414c-82c5-42a4b56c27b5 req-29fb12e4-b18c-4b53-ba92-b50143c1cf96 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.528227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Returning 404 to user: Instance 330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:02.528934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5b81da45-5ea5-414c-82c5-42a4b56c27b5 req-29fb12e4-b18c-4b53-ba92-b50143c1cf96 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.530644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5b81da45-5ea5-414c-82c5-42a4b56c27b5 req-29fb12e4-b18c-4b53-ba92-b50143c1cf96 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.531174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6662b271-d3fe-48a1-a5bf-f55b367b5576 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d" status: 404 len: 111 microversion: 2.1 time: 0.090740 Oct 31 15:33:02.534067 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2077/4047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/330f76fa-8ff6-47d1-8cbe-b3f4a9bc363d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:02.541417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:02.551885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.559318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5b81da45-5ea5-414c-82c5-42a4b56c27b5 req-29fb12e4-b18c-4b53-ba92-b50143c1cf96 service nova] Creating event network-vif-plugged:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:33:02.566393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.567404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.569345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5b81da45-5ea5-414c-82c5-42a4b56c27b5 req-29fb12e4-b18c-4b53-ba92-b50143c1cf96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077724 Oct 31 15:33:02.570008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.573007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.573818 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1971/4048] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:02.574478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.575066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.593092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.594700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.606839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.613064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.613552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.614438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.614783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.615220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.725031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:02.725817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:02.729295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:02.730135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:02.735726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:02.881997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.898637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.899226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.900002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.901002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.901681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.902254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.969889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19bfdf67-05f3-44d5-9da0-889273436ac7 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "POST /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76/action" status: 202 len: 1111 microversion: 2.1 time: 0.434490 Oct 31 15:33:02.975888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2078/4049] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:02 2022] POST /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76/action => generated 1111 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:33:02.985679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9a99aeb-e4fc-4115-9a57-b242ee2aa90d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.986394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9a99aeb-e4fc-4115-9a57-b242ee2aa90d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.990126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:03.006640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:03.011952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:03.017838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03cf61ae-2b4c-4d5e-b1cf-ab2bd0a05573 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.432141 Oct 31 15:33:03.019244 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1972/4050] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:03.035598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.037349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.069295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.069838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.076211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.078231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.078728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.079166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.220546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:33:03.230267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9a99aeb-e4fc-4115-9a57-b242ee2aa90d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:03.246719 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9a99aeb-e4fc-4115-9a57-b242ee2aa90d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1214 microversion: 2.1 time: 0.268641 Oct 31 15:33:03.261024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2079/4051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:03.293477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.295519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.323923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.329009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.330438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.346843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.349037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.352930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.550105 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd67bd32-59d7-4c05-a83e-c917ada78f9c tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 204 len: 0 microversion: 2.1 time: 0.528302 Oct 31 15:33:03.556772 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1973/4052] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:33:03 2022] DELETE /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:33:03.564932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.565735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.574525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.575158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.575671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.576468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.577959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.578821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.813549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:03.826349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb8961f7-73da-4bb0-beb0-d1901971a3de tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.558423 Oct 31 15:33:03.833249 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2080/4053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:03.843427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.844633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.865078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.865858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.866467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.867711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.868183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.869162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.118201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.133146 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-270be8ce-9b33-4a10-8b3d-8c65873738d6 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1322 microversion: 2.1 time: 0.573159 Oct 31 15:33:04.153266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1974/4054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:04.178392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:04.179392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:04.187026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.188125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.189232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.190755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.191817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.192842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.380041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.401453 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf28ed55-e6c0-4a76-abdc-be233b135722 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1477 microversion: 2.1 time: 0.554070 Oct 31 15:33:04.402413 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2081/4055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1477 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:04.427669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:04.430634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:04.442607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.443110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.443546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.444254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.444722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.445211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.500936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.519156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.530823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.532849 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7213e6a8-f87c-4145-bebb-88df2670e8fc tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.377617 Oct 31 15:33:04.550091 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1975/4056] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:04 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:04.592495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.599087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:04.614855 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81c9b102-12e6-4c62-8815-246525906487 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1218 microversion: 2.1 time: 0.194308 Oct 31 15:33:04.616162 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2082/4057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:04 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:04.853900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:04.855409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:04.862579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.863441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.864130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.865295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.866004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.866640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.169941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.171429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.190998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:05.196910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.197782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.199135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.202114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.202865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.205261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.389235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:05.397656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84286b4d-d6f2-4851-86e0-ef40583d1164 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.547966 Oct 31 15:33:05.414517 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1976/4058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:04 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:05.437580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.438213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.455711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.456208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.456650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.457387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.457849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.458281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.511407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:05.536297 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6d38a2e-3ce7-4c10-a37f-985925251901 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1517 microversion: 2.1 time: 0.372802 Oct 31 15:33:05.538325 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2083/4059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:05 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:05.563756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.564764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.572130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.572622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.573238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.574095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.574763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.575390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.952008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24cabb0095dc4fa5b04e94e481c6ab96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508b4a87c5854847a4e9bf053a40ed6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:05.965624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89016083-194a-4e2c-812b-ef68a393b5c7 tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 200 len: 1477 microversion: 2.1 time: 0.534480 Oct 31 15:33:05.966717 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1977/4060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:05 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 1477 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:05.980424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:05.987349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.994999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:06.005710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.006610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.007819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.009486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.014630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.015271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.052273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.065687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.083484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.085070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25f5ffe1-36cf-4b26-9033-76348c776a56 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1741 microversion: 2.20 time: 0.525339 Oct 31 15:33:06.089300 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2084/4061] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:05 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1741 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:06.131523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:06.138872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.148943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lazy-loading 'flavor' on Instance uuid 76e6853a-7e2f-43f0-8051-033977b9cea5 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:33:06.175034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.177657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.178419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.179475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.182756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.184388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.370344 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45c14646-bada-4f3e-a775-5111d2d66306 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action" status: 200 len: 32 microversion: 2.1 time: 0.402057 Oct 31 15:33:06.371124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1978/4062] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:05 2022] POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:33:06.384762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-50b9b811-3f2c-466f-a618-1d7ff272a7e7 req-9d8ee5f2-1b41-454e-91e6-e05efb780bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2706a9-93e9-4253-90c7-d2a1bf4b59c7", "name": "network-vif-deleted", "tag": "93a7cee1-b3ff-44f3-aeb5-dd2eeef9e787"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:06.410884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-50b9b811-3f2c-466f-a618-1d7ff272a7e7 req-9d8ee5f2-1b41-454e-91e6-e05efb780bd0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.411840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-50b9b811-3f2c-466f-a618-1d7ff272a7e7 req-9d8ee5f2-1b41-454e-91e6-e05efb780bd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.412557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-50b9b811-3f2c-466f-a618-1d7ff272a7e7 req-9d8ee5f2-1b41-454e-91e6-e05efb780bd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.430018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:06.432797 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-50b9b811-3f2c-466f-a618-1d7ff272a7e7 req-9d8ee5f2-1b41-454e-91e6-e05efb780bd0 service nova] Creating event network-vif-deleted:93a7cee1-b3ff-44f3-aeb5-dd2eeef9e787 for instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 on n-h2-858383-17 Oct 31 15:33:06.470402 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-50b9b811-3f2c-466f-a618-1d7ff272a7e7 req-9d8ee5f2-1b41-454e-91e6-e05efb780bd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089863 Oct 31 15:33:06.470402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1979/4063] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:06.471910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.472617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:06.473543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.515962 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe939264-8266-4900-8468-24609bfd367d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1266 microversion: 2.1 time: 0.393912 Oct 31 15:33:06.515962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2085/4064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:06 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:06.516135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.516135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.516135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.516135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.516135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.516135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.516861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:06.516861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.557459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.559086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.559540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.563477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.566890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.567399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.587044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:07.595600 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32b20101-25af-43af-93a7-5848b7f1259e tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 1.130302 Oct 31 15:33:07.596251 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1980/4065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:06 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:07.616456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:07.617588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] [instance: fe2706a9-93e9-4253-90c7-d2a1bf4b59c7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:07.631229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.631742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.632193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.634454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.634938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.635903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.642072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:07.667287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ce01c2e-ed1e-4b72-931b-e1351b344864 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 1.169616 Oct 31 15:33:07.668171 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2086/4066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:06 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:07.679471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:07.681618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:07.688892 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] HTTP exception thrown: Instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 could not be found. Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Request method failure captured: Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 HTTP/1.1 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-p3s5IxlZhrtQs8YgFMLzbG8-6loxvs0ekAn8QDj7OSNnCGbZc7hj-2gfECMWQf4Psbe1dL_8nh_gd1RUZnEFWJW1wfHIlLo0msFQin_1W1Z5pWZIX4jFeBlAKH4gIc_VMqTOYWLDsLVbPbMjU-EQt0pxe1tQy7O74s29avrZwIibw Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 508b4a87c5854847a4e9bf053a40ed6c Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1415860972 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/508b4a87c5854847a4e9bf053a40ed6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1415860972 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 508b4a87c5854847a4e9bf053a40ed6c Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1415860972 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-1415860972-project Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 24cabb0095dc4fa5b04e94e481c6ab96 Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1415860972-project Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 could not be found. Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'fe2706a9-93e9-4253-90c7-d2a1bf4b59c7'} Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 could not be found. Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 could not be found. Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:33:07.692777 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 could not be found. Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:33:07.697053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] Returning 404 to user: Instance fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:07.697739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.697739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.697739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.698110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.698981 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7b638f6f-5809-4f1f-905f-218d5cd11eef tempest-ServersAdminNegativeTestJSON-1415860972 tempest-ServersAdminNegativeTestJSON-1415860972-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7" status: 404 len: 111 microversion: 2.1 time: 0.095166 Oct 31 15:33:07.699897 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1981/4067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:07 2022] GET /compute/v2.1/servers/fe2706a9-93e9-4253-90c7-d2a1bf4b59c7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:07.702912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.703420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.709544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:07.710170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:07.727253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.727759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.731162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.731954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.732436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.733439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.977032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:07.988680 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-82ce3cdb-e591-418d-a206-bf8603f105ab tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1272 microversion: 2.1 time: 0.286257 Oct 31 15:33:07.990286 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1982/4068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:07 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:08.375270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.385024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.392507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.393788 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a530317-c5ad-458b-bad7-a032e4ad5773 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1723 microversion: 2.20 time: 0.724606 Oct 31 15:33:08.399927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2087/4069] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:07 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1723 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:08.622664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:08.623091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:08.651644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.655468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.656075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:08.659309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.661552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.662079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:08.696488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:08.697392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:08.718326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.725394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.726023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:08.726879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.727425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.733200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.217542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:09.231333 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27dc0aad-3dfe-4a3b-8177-733866ce5c01 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.610017 Oct 31 15:33:09.231970 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1983/4070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:08 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:09.242897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:09.245418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:09.255882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.259748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.261083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.263832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.265752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.267740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.395684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:09.416991 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2cfbfce-537b-4d9b-b97b-59e1e9985d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.724703 Oct 31 15:33:09.418724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2088/4071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:08 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:09.428483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:09.431532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:09.439931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.441819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.442467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.443857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.444527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.445885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.743509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:09.752208 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ddaa30dd-8167-49ff-bb0c-27b3bb6ebdca tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.518905 Oct 31 15:33:09.752743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1984/4072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:09 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:10.239571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.250975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.253027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.254637 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-628ab836-d51a-4f51-a564-89a68a5f8f0e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1723 microversion: 2.20 time: 0.832016 Oct 31 15:33:10.255593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:10.256514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:10.265738 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2089/4073] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:09 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1723 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:10.269771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.270500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.271296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.272219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.273446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.274628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.306828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e9dff578-c074-4c71-9c03-ca91f36c6e81 req-f443c6cb-f80e-42eb-97b3-79630ce24110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a940bb7b-7e68-460e-ab09-c554a7eb6e9c", "tag": "0ce3a0e8-2959-41e8-840c-6353a6fcf0b5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:10.326326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e9dff578-c074-4c71-9c03-ca91f36c6e81 req-f443c6cb-f80e-42eb-97b3-79630ce24110 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.326804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e9dff578-c074-4c71-9c03-ca91f36c6e81 req-f443c6cb-f80e-42eb-97b3-79630ce24110 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.327282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e9dff578-c074-4c71-9c03-ca91f36c6e81 req-f443c6cb-f80e-42eb-97b3-79630ce24110 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.346815 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e9dff578-c074-4c71-9c03-ca91f36c6e81 req-f443c6cb-f80e-42eb-97b3-79630ce24110 service nova] Creating event network-changed:0ce3a0e8-2959-41e8-840c-6353a6fcf0b5 for instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c on n-h2-858383-17 Oct 31 15:33:10.353184 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e9dff578-c074-4c71-9c03-ca91f36c6e81 req-f443c6cb-f80e-42eb-97b3-79630ce24110 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050465 Oct 31 15:33:10.354111 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2090/4074] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:10.442285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:10.443223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:10.450742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.451401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.451993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.453011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.453638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.454076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.536741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.546540 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7bba9e4-0425-4d1f-b44a-336d6fa723d3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.295127 Oct 31 15:33:10.547413 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1985/4075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:10 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:10.763349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.776622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:10.777268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:10.778147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3d6dea7-8f92-452b-a559-4bbe64e435e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.339899 Oct 31 15:33:10.778935 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2091/4076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:10 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:10.787876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.789448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.789911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.797210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.797904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.798504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.101029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:11.114461 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7fcaaa95-20d8-4bd3-bade-e3bf25aba441 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.342721 Oct 31 15:33:11.115271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1986/4077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:10 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:11.286404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:11.287762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:11.298539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.299282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.299970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.301257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.301905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.302336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.573890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:11.574700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:11.576613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:11.584807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.585294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.586738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.587459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.587926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.588363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.597676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:11.600629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:11.602954 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf27728a-ed36-4b13-ab1c-87bb509d55ef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1723 microversion: 2.20 time: 0.321185 Oct 31 15:33:11.603624 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2092/4078] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:11 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:11.805618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:11.806578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:11.817025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.817723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.818515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.820814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.821622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.822582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.890395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:11.904922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1cfbc1e7-188f-4d37-a185-7f4ec0dbdb61 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.336173 Oct 31 15:33:11.905744 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1987/4079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:11 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:12.116106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:12.137206 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e461c23-76cc-4156-9106-2c4ba833aca3 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.338444 Oct 31 15:33:12.140119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:12.141098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:12.146125 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2093/4080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:11 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:12.154204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.156510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.158448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.159260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.162455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.163307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.363185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:12.379129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:12.403020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:12.416127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7de3c62b-c50a-466f-bd44-0a3f6f0fba5d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.280122 Oct 31 15:33:12.417507 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1988/4081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:12 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:12.446201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-66cfcafa-98ae-4957-8efc-48db449d2227 req-24771763-7078-4150-beee-a6e64e4b9bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "name": "network-vif-unplugged", "status": "completed", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:12.468496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-66cfcafa-98ae-4957-8efc-48db449d2227 req-24771763-7078-4150-beee-a6e64e4b9bd7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.469684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-66cfcafa-98ae-4957-8efc-48db449d2227 req-24771763-7078-4150-beee-a6e64e4b9bd7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.470293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-66cfcafa-98ae-4957-8efc-48db449d2227 req-24771763-7078-4150-beee-a6e64e4b9bd7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.490968 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-66cfcafa-98ae-4957-8efc-48db449d2227 req-24771763-7078-4150-beee-a6e64e4b9bd7 service nova] Creating event network-vif-unplugged:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:33:12.497660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-66cfcafa-98ae-4957-8efc-48db449d2227 req-24771763-7078-4150-beee-a6e64e4b9bd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055413 Oct 31 15:33:12.498599 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2094/4082] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:12.631861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:12.634604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:12.652506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.653223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.653802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.654514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.655056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.655663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.831436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:12.844250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:12.846037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:12.849252 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00b285e5-c0e6-481f-83b3-989a551cc491 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1726 microversion: 2.20 time: 0.222349 Oct 31 15:33:12.862221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1989/4083] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:12 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1726 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:12.891484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "801154fc-84e1-429f-8eb3-c51f92bfd3b2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:12.896181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:12.906611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.907363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.907980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.909182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.909918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.911067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.931411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:12.934280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:12.943252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.944396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.945641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.946837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.948773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.949390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.240607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:13.246012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:13.255639 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6b6a8879-d708-4a3e-8e65-7d6cfe6d0f87 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.329376 Oct 31 15:33:13.269980 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1990/4084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:12 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:13.301048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:13.301692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:13.311092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:13.311810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:13.312889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.313797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:13.314413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:13.314848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.412364 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41cc4fa7-c528-4f1b-8dc6-6bda872ffb09 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.534856 Oct 31 15:33:13.434180 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2095/4085] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Oct 31 15:33:12 2022] POST /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-volume_attachments => generated 188 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:33:13.450917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:13.455495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:13.465882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:13.466798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:13.467655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.469725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:13.470456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:13.471100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.637451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:13.652123 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-175614e3-f648-432c-ba1e-9e26005a37b0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.379469 Oct 31 15:33:13.653266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1991/4086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:13 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:13.673538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:13.674426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:13.684548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:13.685171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:13.685683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.687169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:13.687714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:13.688214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:13.863492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:13.873318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8df565ab-6878-4eb0-a6fb-2ac8320b8385 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.430632 Oct 31 15:33:13.884867 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2096/4087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:13 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:14.121673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4631aeea-f01b-43d8-881b-920b32e5ca66 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-volume_attachments/801154fc-84e1-429f-8eb3-c51f92bfd3b2" status: 202 len: 0 microversion: 2.20 time: 0.466668 Oct 31 15:33:14.126591 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1992/4088] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Oct 31 15:33:13 2022] DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-volume_attachments/801154fc-84e1-429f-8eb3-c51f92bfd3b2 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:33:14.211492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:14.212375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:14.220999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.221563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.222159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.223021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.223476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.223897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.282748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:14.283511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:14.293761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.296221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.298634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.301198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.302023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.304477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.378779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:33:14.435061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:14.515456 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0692294-9b5c-4afe-b456-494fa850d22a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "POST /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/action" status: 202 len: 0 microversion: 2.20 time: 0.308366 Oct 31 15:33:14.519300 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2097/4089] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:33:14 2022] POST /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:33:14.533221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:14.544377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:14.562781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.563667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.565638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.567561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.569060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.570493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.696909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:14.707906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1986156e-3f17-4205-8977-6a63423f4880 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.430555 Oct 31 15:33:14.710424 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1993/4090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:14 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:14.730280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:14.731236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:14.742832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.743673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.744266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.745830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.749050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.749698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.786804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:15.000501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:15.016176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:15.017788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:15.021773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1cb3c3b0-5ec7-4c9f-a5d2-91eaf7cca70d tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1674 microversion: 2.20 time: 0.495255 Oct 31 15:33:15.025934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2098/4091] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:14 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1674 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:15.041436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:15.042017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:15.067053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:15.074342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:15.074848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:15.075615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:15.076098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:15.076533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:15.242113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:15.266273 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-102494ed-7592-4f43-9267-9c36ef699f52 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.553004 Oct 31 15:33:15.267101 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1994/4092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:14 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:15.519025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:15.535679 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c8c93cb2-7529-4f4b-a05d-09768f9a04fd tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.509852 Oct 31 15:33:15.548723 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2099/4093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:15 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:15.736622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:15.738857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:15.753747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:15.754571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:15.755262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:15.756497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:15.757934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:15.758738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.054520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:16.055590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:16.068095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.069190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.070806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.072292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.073546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.075677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.521299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:16.530262 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9e62eae-26a9-42a2-8e93-29c88379a865 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.798115 Oct 31 15:33:16.533380 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1995/4094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:15 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:16.551395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:16.552014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:16.558808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.560217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.569000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.570685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.571424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.572005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.643476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:16.657224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:16.665086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:16.666623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ba045a9-8ae6-4572-b7b8-289fc99cf075 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1674 microversion: 2.20 time: 0.616745 Oct 31 15:33:16.669449 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2100/4095] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:16 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1674 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:16.724168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:16.727628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:16.752975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.754980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.757952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.760384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.761726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.764464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.801985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:16.811697 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5196daaa-028b-4f6b-a226-d017ed885f69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.274792 Oct 31 15:33:16.815687 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1996/4096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:16 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:17.117792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:17.127606 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71b97472-f118-435c-b46a-bcbf2c92e9f9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.456576 Oct 31 15:33:17.154679 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2101/4097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:16 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:17.554836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:17.556749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:17.567130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:17.568050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:17.570408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:17.571351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:17.573530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:17.574916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:17.702700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:17.703309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:17.729989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:17.730717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:17.732333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:17.733298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:17.733780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:17.734222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:18.302758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.312467 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1007a5f7-252b-44fe-af18-8e408f444e48 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.762486 Oct 31 15:33:18.316415 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1997/4098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:17 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:18.330733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.340621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.341629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:18.342468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:18.353304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.355435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4438c66a-f8a1-4681-9935-3cfb15d13181 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.657341 Oct 31 15:33:18.356011 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2102/4099] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:17 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:18.365518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:18.374375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:18.375063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:18.375636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:18.376501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:18.377243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:18.377867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:18.381258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:18.390126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:18.390619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:18.391054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:18.391755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:18.392211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:18.392634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.216647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.230463 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e858354b-d40e-4abc-9fcb-06f908f3a6a0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.912731 Oct 31 15:33:19.247271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1998/4100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:18 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:19.254351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-960d9aa0-0649-4402-9698-0cda1c33a10f req-8d059ee0-002b-4f1d-bdee-f13c73e63a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a940bb7b-7e68-460e-ab09-c554a7eb6e9c", "name": "network-vif-plugged", "status": "completed", "tag": "0ce3a0e8-2959-41e8-840c-6353a6fcf0b5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:19.265083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-960d9aa0-0649-4402-9698-0cda1c33a10f req-8d059ee0-002b-4f1d-bdee-f13c73e63a37 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.265662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-960d9aa0-0649-4402-9698-0cda1c33a10f req-8d059ee0-002b-4f1d-bdee-f13c73e63a37 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.266166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-960d9aa0-0649-4402-9698-0cda1c33a10f req-8d059ee0-002b-4f1d-bdee-f13c73e63a37 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.287162 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-960d9aa0-0649-4402-9698-0cda1c33a10f req-8d059ee0-002b-4f1d-bdee-f13c73e63a37 service nova] Creating event network-vif-plugged:0ce3a0e8-2959-41e8-840c-6353a6fcf0b5 for instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c on n-h2-858383-17 Oct 31 15:33:19.298177 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-960d9aa0-0649-4402-9698-0cda1c33a10f req-8d059ee0-002b-4f1d-bdee-f13c73e63a37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048499 Oct 31 15:33:19.299469 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 1999/4101] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:19.309667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.319282 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7110cba-7d19-4151-bc71-a4f33754933d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.957462 Oct 31 15:33:19.323995 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2103/4102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:18 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:19.347257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:19.348262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:19.359622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.360434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.361105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.362046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.362833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.363727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.387227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:19.388004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:19.396555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.397095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.398118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.407130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.407800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.408252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.831347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.832759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.869265 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89e32085-273f-4a2d-814a-a74224ceedb5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.522623 Oct 31 15:33:19.869808 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2000/4103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:19 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:19.881749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.881749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.881749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58ed28d5-2f45-47c8-a7b4-a21b992dc6fe tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.495173 Oct 31 15:33:19.881749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2104/4104] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:19 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:33:20.259339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:20.260008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:20.271335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.272046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.273211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.274065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.274709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.275522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.350238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:20.352259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:20.361139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.362962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.364203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.373761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.374869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.375515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.443721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:20.452750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-493b5ea2-2745-4225-9386-2e73d236d288 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.198595 Oct 31 15:33:20.458416 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2001/4105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:20 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:20.753179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:20.765989 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-694ddf82-92e4-4447-9c51-20a738a6e47a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1314 microversion: 2.1 time: 0.420387 Oct 31 15:33:20.774591 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2105/4106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:20 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:20.922765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:20.923590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:20.937813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:20.938668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:20.947324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.949381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.951259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.952497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.955445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.958058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.980431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.983565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.984256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.985287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:20.987989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:20.994538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:21.374019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:21.391406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:21.395736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:21.400477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-734d324b-b71b-4d93-8df1-3f512c1597ca tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.480508 Oct 31 15:33:21.402346 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2106/4107] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:20 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:21.416193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:21.429689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ea9de63-095b-46f0-9a21-d05f3e684ab5 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.535729 Oct 31 15:33:21.439529 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2002/4108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:20 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:21.495756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:21.512238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:21.526420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:21.527276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:21.529158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:21.531542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:21.532886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:21.537519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:21.808794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:21.809880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:21.822129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:21.823670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:21.826940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:21.828753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:21.831254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:21.834855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:21.937753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:21.954078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6151a2cd-b530-447d-8e7d-573862ae952a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.468034 Oct 31 15:33:21.954795 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2107/4109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:21 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:22.270609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.281959 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-96517b37-fd83-428b-a6a1-295cc1730b57 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1500 microversion: 2.1 time: 0.478338 Oct 31 15:33:22.304933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2003/4110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:21 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1500 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:22.309512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:22.312401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:22.322172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.322914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.323508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.324399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.325665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.326381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.362615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lazy-loading 'flavor' on Instance uuid a940bb7b-7e68-460e-ab09-c554a7eb6e9c {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:33:22.427977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:22.429976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:22.442701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.443421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.446488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.447439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.448060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.448630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.566437 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46a1949e-3c6a-4c01-a9a3-6a3e4c8e9aba tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "POST /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c/action" status: 200 len: 32 microversion: 2.1 time: 0.261888 Oct 31 15:33:22.572596 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2108/4111] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:22 2022] POST /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:33:22.589638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:22.592881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:22.638348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.641622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.642129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.642908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.645857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.646220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.732294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.750080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.752212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.754785 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e2be30b-78dc-4c5e-981c-fff06975d09b tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.330601 Oct 31 15:33:22.757416 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2004/4112] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:22 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:22.766882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:22.772879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:22.782700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.786884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.787622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.789715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.796003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.797511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.152739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:23.165375 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50298061-f32c-45dc-a62a-a811e778da82 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.593486 Oct 31 15:33:23.184752 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2109/4113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:22 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:23.200509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:23.203171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:23.228673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:23.237539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-767a316e-04eb-4340-80d6-8fcacf9ee5fc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.478537 Oct 31 15:33:23.237749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.238162 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2005/4114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:22 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:23.238291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.240465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.242622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.243142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.243591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.784445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:23.785686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:23.799124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.802316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.803053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.810154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.813488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.814188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.901336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:23.933517 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e8401f0-f0fd-4663-bb8b-93d183c2ce14 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.758228 Oct 31 15:33:23.934677 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2110/4115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:23 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:24.201515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:24.202509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:24.214524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.215210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.219350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.220672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.221413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.222123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.586717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.628075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.636839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.638171 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8dd2c1da-9b7e-45f3-a25f-f154a0d5d9e3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.858466 Oct 31 15:33:24.638907 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2006/4116] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:23 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:24.654586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:24.655969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:24.682324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.682995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.683620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.684494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.685276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.686368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.861665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.865563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:24.871117 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ee799e4-cdaa-4fb2-8ec9-2f5473d41fa4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.674248 Oct 31 15:33:24.871890 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2111/4117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:24 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:24.963403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:24.964549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:24.979372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.979876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.980314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.981239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.982102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.982801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.031823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:25.045997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-458da74c-3171-4144-8f0e-b490c4ba7611 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.402218 Oct 31 15:33:25.047126 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2007/4118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:24 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:25.550384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:25.570675 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c64e5e66-0192-412c-8502-53b0e893d7b2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.611419 Oct 31 15:33:25.593771 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2112/4119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:24 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:25.671896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:25.672731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:25.707078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.707604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.708032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.708776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.719951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.720409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.897763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:25.898856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:25.917724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.921445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.922148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.926714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.927469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.936575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.876276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:26.894876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:26.896849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:26.901422 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-340930b0-635b-4ab9-a052-fd0081ab71cd tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 1.237301 Oct 31 15:33:26.903407 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2008/4120] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:25 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:26.912671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:26.915596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:26.937676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.942279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.942908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.945674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.946957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.947587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.588901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:27.598419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:27.609638 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25ea1eb7-fca2-40d0-b8b3-35a482613421 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 1.716119 Oct 31 15:33:27.612986 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d1067e30-c4d3-4a68-9f4f-41cc24f47445 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.704904 Oct 31 15:33:27.615574 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2009/4121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:26 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:27.626239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2113/4122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:25 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:27.636856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:27.639384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:27.670967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.672439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.675944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.680993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:27.681750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.684469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.685081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:27.685827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.703374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.704054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.704635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.705630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.706238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.706810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.718164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:28.734997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f86325c-f1b2-4703-9cf5-b27f4fa689be tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 1.112143 Oct 31 15:33:28.735881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:28.743542 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2010/4123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:27 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:28.750160 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-702d30df-dcab-4a1c-a373-7ba75bf317e2 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 1.090518 Oct 31 15:33:28.750794 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2114/4124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:27 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:28.761996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:28.762625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:28.771822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:28.774674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:28.789094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.793995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.794733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.799918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.801130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.801130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.808048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.808838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.809442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.813343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.815577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.817854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.616815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.621601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:29.633223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1255149c-b5f1-4f34-9bf1-04deab1ce708 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.880086 Oct 31 15:33:29.637767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2011/4125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:28 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:29.647086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:29.648596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:29.672310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.673810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.674469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.675437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.676043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.682098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.755444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.775365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.780940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.783351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27941384-fe3b-4f91-9057-35f42e45e998 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 1.031601 Oct 31 15:33:29.786595 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2115/4126] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:28 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:29.806540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:29.807487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:29.826104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.829825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.830597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.831577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.833282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.835042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.515552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:30.551107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2968c5da-7340-467d-9517-f6e36122e934 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.911969 Oct 31 15:33:30.551972 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2012/4127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:29 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:30.578796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:30.579776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:30.598732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.599690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.600575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.603059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.603784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.604436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.867314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:31.894728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13586a56-f1fe-4654-91a6-326e6fe7f3fb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 2.106071 Oct 31 15:33:31.895361 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2116/4128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:29 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:31.917729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:31.920206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:31.939256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.940832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.945443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.948334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.950017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.950640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.027722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.055519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27949d66-572e-49ec-aedf-6b7af14457e0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 1.486215 Oct 31 15:33:32.068724 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2013/4129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:30 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:32.077298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:32.081684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:32.105642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.107459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.108027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.109105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.111087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.112544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.961335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.974135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57a9730c-b8bd-4d17-b977-cdd06ab76db9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 1.076916 Oct 31 15:33:32.982309 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2117/4130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:31 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:32.988412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:32.998310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:33.023395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.026681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.027452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.028478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.038186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.044631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.149997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:33.185869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:33.192268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:33.196733 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8e98691-5ebe-4629-830f-482e600763f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 1.136753 Oct 31 15:33:33.198318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2014/4131] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:32 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:33.211696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:33.213366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:33.233711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.234405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.235012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.236062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.236678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.237376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.577313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:33.591873 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a06cf06d-c900-46c7-8658-795c33dd1716 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.392032 Oct 31 15:33:33.592987 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2015/4132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:33 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:33.599903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:33.618128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa98c22b-17a1-495f-be8a-466a5200a5f2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1523 microversion: 2.1 time: 0.624110 Oct 31 15:33:33.629469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2118/4133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:32 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1523 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:33.643694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:33.646302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:33.668323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.668783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.674791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.679866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.680581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.683571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:34.179335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:34.191578 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e25c5c59-d177-4f21-adb1-4a7822704d29 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.558037 Oct 31 15:33:34.192179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2119/4134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:33 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:34.226639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2048284836", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "8c999eef-3ab4-4489-9119-8b9357d0c054"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:34.353244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] validate_networks() for [('8c999eef-3ab4-4489-9119-8b9357d0c054', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:34.368141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1193327167", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "140c58cb-449d-4e75-8be3-200ed509582a"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:34.504473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] validate_networks() for [('140c58cb-449d-4e75-8be3-200ed509582a', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:35.525179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:35.526831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:35.527495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:35.528075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:35.528487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:35.537108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:35.537669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:35.537922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.538127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:35.538751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:35.538874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.539289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:35.539687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.540634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.542532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:35.543223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.543822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.562289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.563066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.563714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.564787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.565558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.566429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.594222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:35.601156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for user 6b1695b4d61d40de8272561b0cf3362e and project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:35.602425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Getting quotas for project 31ea0189550c47429908ce5bbccada43. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:35.612598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Getting quotas for user 5e857b042afa482eb69eb2ff26634919 and project 31ea0189550c47429908ce5bbccada43. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:35.636976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:35.644341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:35.671297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:35.679595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:35.827405 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-efebd99d-417f-4bac-80ab-dff7d5686cc8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.629371 Oct 31 15:33:35.828748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2120/4135] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:35.835725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:35.836966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:35.843590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.844768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.845735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.846765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.847408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.848024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.865229 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dae55fb6-8996-4181-ba9b-d069b6d0bf0c tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.270416 Oct 31 15:33:35.866599 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2016/4136] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:35.917121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:35.919388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:35.944161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.944656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.949391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.950135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.950604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.951035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.369390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.381935 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5539915a-e8b8-4bef-9c54-513df53374e8 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.551757 Oct 31 15:33:36.383908 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2121/4137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:35 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:36.392679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.401176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:36.401900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:36.408239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.408561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.409573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.410250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.411736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.413383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.414438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.429048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.433435 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-46f1437a-d2a9-4cbe-914c-dff7e81ed811 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.538895 Oct 31 15:33:36.434620 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2017/4138] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:35 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:36.445289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:36.446479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:36.455614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:36.473693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.476219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.476711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.477464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.477930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.478365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.859528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.869708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-301d975c-ea6f-481f-b5e5-452eb72a57a4 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1503 microversion: 2.1 time: 0.483964 Oct 31 15:33:36.869708 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2122/4139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:36 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:36.910819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d513bdd-ab2e-4a08-b2a6-016bd149e529 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:36.918277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d513bdd-ab2e-4a08-b2a6-016bd149e529 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.007958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:37.031703 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c60621cc-b1c0-46eb-9270-cceaceb55847 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1516 microversion: 2.1 time: 0.595294 Oct 31 15:33:37.034118 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2018/4140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:36 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1516 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.036159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d513bdd-ab2e-4a08-b2a6-016bd149e529 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:37.040473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-31fb6358-8974-4f6c-a2b2-31e2297e34a9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:37.044346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-31fb6358-8974-4f6c-a2b2-31e2297e34a9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.046647 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d513bdd-ab2e-4a08-b2a6-016bd149e529 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1215 microversion: 2.1 time: 0.153099 Oct 31 15:33:37.049985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2123/4141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:36 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.059300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-88f00d6d-5d8c-4f90-95aa-1a62e716c84d tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'create', calling method: .version_select at 0x7f5ca169cd30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-341182128", "description": "tempest-description-1033344049"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:37.171556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31fb6358-8974-4f6c-a2b2-31e2297e34a9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:37.178944 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-31fb6358-8974-4f6c-a2b2-31e2297e34a9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1225 microversion: 2.1 time: 0.143648 Oct 31 15:33:37.192015 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2019/4142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:37 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.364445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-88f00d6d-5d8c-4f90-95aa-1a62e716c84d tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.312459 Oct 31 15:33:37.373760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2124/4143] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:33:37 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:37.383369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-341182128"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:37.384216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.402943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.403495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.403944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.405743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.406233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.409315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.410494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:37.411134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.425138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.425850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.426821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.428880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.429531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.431588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.815966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Adding security group fa74a1da-1a3e-4890-8380-ce4bf3133500 to port bff871fa-7ab5-4d0f-979e-e2c0c494ccdb Oct 31 15:33:37.860924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:37.869382 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f266f18a-e5f6-47aa-bd01-38709631fc5b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.465007 Oct 31 15:33:37.876876 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2125/4144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:37 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.893088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:37.893716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.910539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.916794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.917660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.918650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.919268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.919868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.233015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.248645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.254942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.261383 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb741255-46c5-4454-a17e-0effdf7a44b6 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.382856 Oct 31 15:33:38.264814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2126/4145] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:37 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:38.279626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:38.280783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:38.297793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.300285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.301118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.302082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.304877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.305357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.928100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.945219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de095d51-3c86-4f8c-abaf-9897e7b8578d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.676092 Oct 31 15:33:38.949184 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2127/4146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:38 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:38.964291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:38.965767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:38.978991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.979721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.980305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.991161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.992287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.992917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:39.066704 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3af9f203-0bf9-420a-8e58-9562f5a0e646 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action" status: 202 len: 0 microversion: 2.1 time: 1.689806 Oct 31 15:33:39.071400 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2020/4147] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:37 2022] POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:33:39.106442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:39.107575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:39.117260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:39.118261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:39.118862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:39.119955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:39.121037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:39.122002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.207921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:40.225236 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49db8fe4-70e8-4410-9203-73f41a50637e tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1277 microversion: 2.1 time: 1.156559 Oct 31 15:33:40.242485 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2021/4148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:39 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1277 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:40.260805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:40.276022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3116818-8f8a-49b7-82b4-5553eca97b31 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1211 microversion: 2.1 time: 1.325269 Oct 31 15:33:40.293322 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2128/4149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:38 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1211 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:40.295410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:40.296368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:40.302625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-341182128"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:40.316805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:40.330776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.332026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.337634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.345131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.345961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.364006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.370318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.372020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.373822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.378330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.381635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.388019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.710832 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.network.security_group_api [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Removing security group fa74a1da-1a3e-4890-8380-ce4bf3133500 from port bff871fa-7ab5-4d0f-979e-e2c0c494ccdb Oct 31 15:33:40.787385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:40.796375 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a033640b-2a7f-4805-8e53-06f42cd78e07 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.552347 Oct 31 15:33:40.801428 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2022/4150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:40 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:40.807303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-98c7cfef-12d6-4349-89a8-c12fed4e88c8 req-9156d370-5285-4e4c-9b5c-8f5aa62858ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:40.840025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-98c7cfef-12d6-4349-89a8-c12fed4e88c8 req-9156d370-5285-4e4c-9b5c-8f5aa62858ec service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.845184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-98c7cfef-12d6-4349-89a8-c12fed4e88c8 req-9156d370-5285-4e4c-9b5c-8f5aa62858ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.845913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-98c7cfef-12d6-4349-89a8-c12fed4e88c8 req-9156d370-5285-4e4c-9b5c-8f5aa62858ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.883821 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-98c7cfef-12d6-4349-89a8-c12fed4e88c8 req-9156d370-5285-4e4c-9b5c-8f5aa62858ec service nova] Creating event network-changed:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:33:40.899234 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-98c7cfef-12d6-4349-89a8-c12fed4e88c8 req-9156d370-5285-4e4c-9b5c-8f5aa62858ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095660 Oct 31 15:33:40.900202 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2023/4151] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:40.911286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:40.914746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:40.932981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.938581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.939302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.940246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.941273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.944570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.229332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:41.239782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:41.245734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:41.252951 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afda5793-e30f-4d58-bbff-315d9df00d6a tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.345613 Oct 31 15:33:41.254051 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2024/4152] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:40 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:41.272450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:41.304914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:41.347058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.347805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.348407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.350902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.352326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.354367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.727383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:41.756823 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13e744ef-d180-4995-8aa5-e54fb50c1cef tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.483088 Oct 31 15:33:41.791712 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2025/4153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:41 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:41.798313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2497e5bb-0b11-41d8-b7c0-fda75ab61a17 req-6bae96d2-97d6-46af-9d87-3dd248679c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78e2e5f-8adc-444d-94e2-5618e5ebdf76", "name": "network-vif-unplugged", "status": "completed", "tag": "1b09d647-c034-4a99-96f0-bfea491241ea"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:41.836371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2497e5bb-0b11-41d8-b7c0-fda75ab61a17 req-6bae96d2-97d6-46af-9d87-3dd248679c52 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.837406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2497e5bb-0b11-41d8-b7c0-fda75ab61a17 req-6bae96d2-97d6-46af-9d87-3dd248679c52 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.838517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2497e5bb-0b11-41d8-b7c0-fda75ab61a17 req-6bae96d2-97d6-46af-9d87-3dd248679c52 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.880168 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2497e5bb-0b11-41d8-b7c0-fda75ab61a17 req-6bae96d2-97d6-46af-9d87-3dd248679c52 service nova] Creating event network-vif-unplugged:1b09d647-c034-4a99-96f0-bfea491241ea for instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 on n-h1-858383-17 Oct 31 15:33:41.891766 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2497e5bb-0b11-41d8-b7c0-fda75ab61a17 req-6bae96d2-97d6-46af-9d87-3dd248679c52 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098668 Oct 31 15:33:41.896587 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2026/4154] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:41.909053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:41.910015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:41.926442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.960560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.961794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.963292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.963937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.965944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.181086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:42.211850 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-96555351-3a3d-4070-93d2-0206d50fbef9 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1277 microversion: 2.1 time: 0.313031 Oct 31 15:33:42.222000 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2027/4155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:41 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:42.241821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:42.243437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:42.261179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.265475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.266179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.271245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.284610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.286155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.698640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:42.715477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-858f1bf2-db41-44f7-870a-eac2b7c1b3ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1211 microversion: 2.1 time: 0.490095 Oct 31 15:33:42.716279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2028/4156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:42 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1211 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:42.729401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:42.731723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:42.740498 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc4759c8-6a5d-4228-ba44-94a4f024cec7 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action" status: 202 len: 0 microversion: 2.1 time: 2.445523 Oct 31 15:33:42.742448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2129/4157] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:40 2022] POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action => generated 0 bytes in 2448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:33:42.753777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.755850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:42.757098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:42.757888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.758361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.760432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.761825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.764604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.786013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.786515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.793959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.806992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.811921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.817615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.430733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.440583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.446748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.448515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.450464 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5d41c21-f9d6-4f77-8eef-201cdb33e742 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.700972 Oct 31 15:33:43.451345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2130/4158] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:42 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:43.460371 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ba63ea5c-e8a0-4376-ae6a-045028fc21f1 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.739777 Oct 31 15:33:43.462747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66002596-1420-4ba2-9a54-e371d7a8467a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'create', calling method: .version_select at 0x7f5ca66bee50>, body: {"pool": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:43.473362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2029/4159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:42 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:43.485629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:43.486258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:43.500555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.503903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.504358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.505123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.505590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.506559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.597998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:44.610827 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1fa3a6c3-f0ba-43e2-b1ba-7f19d22f09ae tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 1.136332 Oct 31 15:33:44.616873 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2030/4160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:43 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:44.626367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f2349332-8274-40a8-98f6-eb6d36271fa4 req-a38a8d3a-2172-42bd-800d-1905cf2d870e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:44.640833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2349332-8274-40a8-98f6-eb6d36271fa4 req-a38a8d3a-2172-42bd-800d-1905cf2d870e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.642198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2349332-8274-40a8-98f6-eb6d36271fa4 req-a38a8d3a-2172-42bd-800d-1905cf2d870e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.642920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2349332-8274-40a8-98f6-eb6d36271fa4 req-a38a8d3a-2172-42bd-800d-1905cf2d870e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.656632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f2349332-8274-40a8-98f6-eb6d36271fa4 req-a38a8d3a-2172-42bd-800d-1905cf2d870e service nova] Creating event network-changed:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:33:44.666831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f2349332-8274-40a8-98f6-eb6d36271fa4 req-a38a8d3a-2172-42bd-800d-1905cf2d870e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046881 Oct 31 15:33:44.668036 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2031/4161] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:44.676311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:44.691858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:44.705481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.706769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.708050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.708980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.711055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.711688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.744941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:44.861208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:44.870328 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-222ebd93-1f2f-48de-bd5d-51d5b2a6c4f0 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1283 microversion: 2.1 time: 0.200709 Oct 31 15:33:44.881982 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2032/4162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:44 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:44.895273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:44.897220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:44.904246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.905059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.905708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.906842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.907512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.908149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:45.019572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:45.033523 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2063bd3c-f158-4908-b335-9e231b6a81ec tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1273 microversion: 2.1 time: 0.149860 Oct 31 15:33:45.046145 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2033/4163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:44 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:45.058431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:45.061621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:45.077687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:45.078477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:45.079556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:45.081887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:45.082968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:45.084679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:45.558822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:45.582998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:45.868881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:45.893831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:45.898856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:45.900439 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bc233538-ce6f-47c4-9479-6c7be0d0e022 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.851599 Oct 31 15:33:45.901785 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2034/4164] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:45 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:45.908029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:45.909469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:45.919360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:45.920140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:45.921378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:45.922360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:45.922973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:45.923565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:46.514174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:46.535133 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-394e8716-58d6-48de-807d-955aa04815cb tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.632171 Oct 31 15:33:46.545193 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2035/4165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:45 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:46.573492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:46.573492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:46.573492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:46.573857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:46.574252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:46.574974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:46.586205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:46.586665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:47.040663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:47.175795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:47.755005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:47.771825 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b8da680f-0cc7-4d74-adea-f8835a19ab69 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 1.224387 Oct 31 15:33:47.774600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2036/4166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:46 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:47.782018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:47.783061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:47.794733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:47.795592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:47.796498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:47.797760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:47.798964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:47.799623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:48.779199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:48.792841 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a161c7ce-918f-47d7-bd38-0b633aeb51df tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 1.016165 Oct 31 15:33:48.802555 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2037/4167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:47 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:48.817631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:48.819217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:48.830396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:48.847021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:48.847996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:48.849017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:48.851524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:48.852273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.679206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:49.697526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-72afe5f7-e659-48dc-84ff-5e73c09dc1d7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.892361 Oct 31 15:33:49.698834 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2038/4168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:48 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:49.704069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:49.705012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:49.725946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.727526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.728211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.729242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.729916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.737696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.104854 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66002596-1420-4ba2-9a54-e371d7a8467a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 6.651397 Oct 31 15:33:50.106586 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2131/4169] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Oct 31 15:33:43 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 6654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:50.155755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6f70a024-00e5-4205-b6f5-7575b557be39 req-bc5cc21c-ff47-494d-b0bd-2f13bc076c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "name": "network-vif-plugged", "status": "completed", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:50.187360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f70a024-00e5-4205-b6f5-7575b557be39 req-bc5cc21c-ff47-494d-b0bd-2f13bc076c34 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.192029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f70a024-00e5-4205-b6f5-7575b557be39 req-bc5cc21c-ff47-494d-b0bd-2f13bc076c34 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.194619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f70a024-00e5-4205-b6f5-7575b557be39 req-bc5cc21c-ff47-494d-b0bd-2f13bc076c34 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.225781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6f70a024-00e5-4205-b6f5-7575b557be39 req-bc5cc21c-ff47-494d-b0bd-2f13bc076c34 service nova] Creating event network-vif-plugged:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:33:50.253080 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6f70a024-00e5-4205-b6f5-7575b557be39 req-bc5cc21c-ff47-494d-b0bd-2f13bc076c34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114708 Oct 31 15:33:50.253871 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2132/4170] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:50.268351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:50.270935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:50.293242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.295935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.296767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.297737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.298432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.299079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.305515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:50.393901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.419524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.423771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.429534 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f63a3830-f44a-4105-89c9-cda11a616361 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 0.729175 Oct 31 15:33:50.430773 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2039/4171] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:49 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:50.439228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:50.442870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:50.459843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.460721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.461366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.462313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.462826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.463278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.898282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.925144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bb2e919-a7d4-42a8-94ca-8a07239d70f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.668763 Oct 31 15:33:50.933247 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2133/4172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:50 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:50.940245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:50.941283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:50.952572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.953676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.954526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.955881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.956914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.957507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.051635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:51.066454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-651393f8-acf1-4d79-89ce-0745b861742d tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.633825 Oct 31 15:33:51.067319 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2040/4173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:50 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:51.083657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.5"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:51.087596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:51.097230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.097995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.098620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.099975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.100792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.101380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.197873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "refresh_cache-76e6853a-7e2f-43f0-8051-033977b9cea5" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:33:51.198782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquired lock "refresh_cache-76e6853a-7e2f-43f0-8051-033977b9cea5" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:33:51.376858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:51.391482 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-335aba50-a786-422c-8ae8-bcc660450631 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.456399 Oct 31 15:33:51.393215 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2134/4174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:50 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:51.404954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:51.407769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:51.419799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.424195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.425389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.426081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.426568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.427010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.056086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:52.076930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66985454-8b3c-4195-90df-a04164a3fce3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.682241 Oct 31 15:33:52.095790 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2135/4175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:51 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:52.105589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:52.106494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:52.115645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.116505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.117209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.118648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.119309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.119917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.463490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.481756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.484015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.486598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6731a059-dc5b-43c2-854f-7a92390574f3 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1732 microversion: 2.20 time: 1.388763 Oct 31 15:33:53.503182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2136/4176] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:52 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1732 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:53.514572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-92fa5212-6293-4f92-b643-b53ee27a8dc7 req-15952852-bd11-4078-beb0-9af459a275ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b885f1-1341-44cc-8ad8-892c4098d51e", "tag": "aff6a97c-3b1a-4612-8c2e-96e1058d097d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:53.529795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92fa5212-6293-4f92-b643-b53ee27a8dc7 req-15952852-bd11-4078-beb0-9af459a275ca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.530514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92fa5212-6293-4f92-b643-b53ee27a8dc7 req-15952852-bd11-4078-beb0-9af459a275ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.531164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92fa5212-6293-4f92-b643-b53ee27a8dc7 req-15952852-bd11-4078-beb0-9af459a275ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.559793 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-92fa5212-6293-4f92-b643-b53ee27a8dc7 req-15952852-bd11-4078-beb0-9af459a275ca service nova] Creating event network-changed:aff6a97c-3b1a-4612-8c2e-96e1058d097d for instance 00b885f1-1341-44cc-8ad8-892c4098d51e on n-h1-858383-17 Oct 31 15:33:53.580624 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-92fa5212-6293-4f92-b643-b53ee27a8dc7 req-15952852-bd11-4078-beb0-9af459a275ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073076 Oct 31 15:33:53.581393 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2137/4177] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:53.590439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:53.591437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:53.621980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.629092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.632130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.633377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.634382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.635144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.429967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.447390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91c51f0d-85af-4788-b9ff-ad04cce923b0 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.864768 Oct 31 15:33:54.447988 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2138/4178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:53 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:54.465300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:54.466735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:54.482554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.483057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.484464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.485220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.485681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.486116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.904407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.913447 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-277f369f-1541-4895-84b8-f9444bea2cdf tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.464232 Oct 31 15:33:54.914039 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2139/4179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:54 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:54.926782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:54.930225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:54.936958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.937661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.938439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.939628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.940298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.941195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.156181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Building network info cache for instance {{(pid=120626) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:33:55.186102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:55.195441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b8325f7-7c9d-49b4-8975-d9e8ca6027a6 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.274338 Oct 31 15:33:55.196670 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2140/4180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:54 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:55.211603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e6566267-7dd5-470b-be70-627fcb203a2c req-f275d498-3210-44f8-91f0-806075eb84de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78e2e5f-8adc-444d-94e2-5618e5ebdf76", "name": "network-vif-plugged", "status": "completed", "tag": "1b09d647-c034-4a99-96f0-bfea491241ea"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:55.233537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e6566267-7dd5-470b-be70-627fcb203a2c req-f275d498-3210-44f8-91f0-806075eb84de service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.234025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e6566267-7dd5-470b-be70-627fcb203a2c req-f275d498-3210-44f8-91f0-806075eb84de service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.234449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e6566267-7dd5-470b-be70-627fcb203a2c req-f275d498-3210-44f8-91f0-806075eb84de service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.252507 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e6566267-7dd5-470b-be70-627fcb203a2c req-f275d498-3210-44f8-91f0-806075eb84de service nova] Creating event network-vif-plugged:1b09d647-c034-4a99-96f0-bfea491241ea for instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 on n-h1-858383-17 Oct 31 15:33:55.267672 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e6566267-7dd5-470b-be70-627fcb203a2c req-f275d498-3210-44f8-91f0-806075eb84de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067249 Oct 31 15:33:55.268866 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2141/4181] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:55.278188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:55.278904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:55.292180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.292684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.293161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.293873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.294328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.294758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.612241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:55.620641 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23f63a33-1d99-4d92-bf4e-4275066c81cb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.350397 Oct 31 15:33:55.624082 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2142/4182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:55 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:55.632374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:55.637426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:55.647837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.648549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.649277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.650169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.650791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.651215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.898896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:55.913039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:55.915057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:55.916780 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-73d85f59-40d2-4bf2-b470-bee56cb8d82e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1719 microversion: 2.20 time: 0.291450 Oct 31 15:33:55.918117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2143/4183] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:55 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1719 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:55.923793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:55.924669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:55.931822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.932587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.933207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.934215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.934826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.935398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.144070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Updating instance_info_cache with network_info: [{"id": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb", "address": "fa:16:3e:c9:60:d7", "network": {"id": "9049b64f-3457-4bbb-a057-f27d24fb2139", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-575368835-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3b0c22c3c8e84f4b823afe9a5cff03af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbff871fa-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:33:56.194366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Releasing lock "refresh_cache-76e6853a-7e2f-43f0-8051-033977b9cea5" {{(pid=120626) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:33:56.195557 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea134574-9ebb-4b24-81d1-ee590cd159b2 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action" status: 202 len: 0 microversion: 2.1 time: 5.123466 Oct 31 15:33:56.200282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2041/4184] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:51 2022] POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action => generated 0 bytes in 5130 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:33:56.223151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2713e930-444c-4372-a341-c5c999a4689e", "tag": "f4bed278-848f-45f1-ab57-576b80dcd1e7"}, {"name": "network-changed", "server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:56.281081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.284036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.284930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.322558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] Creating event network-changed:f4bed278-848f-45f1-ab57-576b80dcd1e7 for instance 2713e930-444c-4372-a341-c5c999a4689e on n-h1-858383-17 Oct 31 15:33:56.323904 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] Creating event network-changed:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:33:56.342291 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8ad524b3-af6a-4939-b2a6-90075e4adc3d req-a4b6552a-e0bd-4f4f-a41f-1b55bfe5ca99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.141303 Oct 31 15:33:56.344414 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2042/4185] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:56.356438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:56.357435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:56.364241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.365828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.366707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.367622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.368251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.368891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.844262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:56.859862 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60154f33-e26a-46eb-ae66-2a80f8d5c26b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1486 microversion: 2.1 time: 0.940409 Oct 31 15:33:56.892884 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2144/4186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:55 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1486 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:56.910333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.5"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:57.158686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.198982 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ba074c16-93b0-4629-81a9-e2c2ee5310d9 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.853140 Oct 31 15:33:57.209014 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2043/4187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:56 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:57.229314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:57.235174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.250666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.254540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.256193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.257631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.260766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.261409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.448311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.454970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.455626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.456485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.457360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.464988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.465827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.572388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.580442 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94ef2bd0-aff0-43f5-b5ad-11e59b55133d tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.368492 Oct 31 15:33:57.585252 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2044/4188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:57 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:57.590151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:57.590779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.607469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.607968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.608404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.609136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.609589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.610013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.860169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.868654 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7b583f08-910f-498e-993b-78153564aa87 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.282092 Oct 31 15:33:57.869580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2045/4189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:57 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:57.873439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "refresh_cache-76e6853a-7e2f-43f0-8051-033977b9cea5" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:33:57.874354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquired lock "refresh_cache-76e6853a-7e2f-43f0-8051-033977b9cea5" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:33:57.886116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:57.886890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.895237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.895972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.896770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.897646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.898264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.898693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.992739 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8b0bf11-0248-47fd-98c5-2cc7c6958f95 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "POST /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c/action" status: 202 len: 0 microversion: 2.1 time: 0.121619 Oct 31 15:33:57.993496 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2046/4190] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:57 2022] POST /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:33:58.003740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:58.004954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:58.011758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.012252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.013182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.014123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.015886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.015886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.357859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:58.366047 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5b0db08-7d38-4aed-83ee-69c2e3a89c10 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1494 microversion: 2.1 time: 0.366511 Oct 31 15:33:58.366650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2047/4191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:57 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1494 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:58.391997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:58.392655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:58.408109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.408592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.416454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.417471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.418100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.418674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.423837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:58.700652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:58.719629 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-508975e6-e683-4310-99ea-c3c0b02abb74 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.350974 Oct 31 15:33:58.723529 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2048/4192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:58 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:58.741935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:58.742544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:58.768570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.769762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.769965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.770955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.782961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.785016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.081156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.102523 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-517e8f97-5d62-4a00-893b-669de91939d7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.377800 Oct 31 15:33:59.107419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Building network info cache for instance {{(pid=120625) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:33:59.126575 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2049/4193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:58 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:59.134197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:59.137151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:59.150279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.150814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.152774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.153945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.159886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.176966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.643619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.658610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7788a616-6ca9-4a3e-8547-b59755de0007 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.529999 Oct 31 15:33:59.660335 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2050/4194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:59 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:59.673927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-834c7297-99e9-4a2d-9c06-aa579e755b85 req-75e56379-9345-4492-8913-ea8d3ec46ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:59.699257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-834c7297-99e9-4a2d-9c06-aa579e755b85 req-75e56379-9345-4492-8913-ea8d3ec46ec6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.700228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-834c7297-99e9-4a2d-9c06-aa579e755b85 req-75e56379-9345-4492-8913-ea8d3ec46ec6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.701080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-834c7297-99e9-4a2d-9c06-aa579e755b85 req-75e56379-9345-4492-8913-ea8d3ec46ec6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.739061 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-834c7297-99e9-4a2d-9c06-aa579e755b85 req-75e56379-9345-4492-8913-ea8d3ec46ec6 service nova] Creating event network-changed:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:33:59.751874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-834c7297-99e9-4a2d-9c06-aa579e755b85 req-75e56379-9345-4492-8913-ea8d3ec46ec6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087351 Oct 31 15:33:59.753947 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2051/4195] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:59.767333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:59.768138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:59.784547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.788433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.788979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.792479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.793764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.795408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.119198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.142781 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-502adb79-82db-4135-a268-50cd727cd3f6 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1494 microversion: 2.1 time: 0.379531 Oct 31 15:34:00.147870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2052/4196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:59 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1494 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:00.175760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:00.176685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:00.199497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.200243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.200680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.201413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.201859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.202426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.399551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Updating instance_info_cache with network_info: [{"id": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb", "address": "fa:16:3e:c9:60:d7", "network": {"id": "9049b64f-3457-4bbb-a057-f27d24fb2139", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-575368835-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3b0c22c3c8e84f4b823afe9a5cff03af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbff871fa-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120625) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:34:00.418989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Releasing lock "refresh_cache-76e6853a-7e2f-43f0-8051-033977b9cea5" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:34:00.420333 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4fde93d9-8f1a-4578-a0a5-d9065353938c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action" status: 202 len: 0 microversion: 2.1 time: 3.525764 Oct 31 15:34:00.421504 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2145/4197] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:56 2022] POST /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5/action => generated 0 bytes in 3528 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:34:00.437683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:00.441972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:00.459214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.462605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.463232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.464155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.468384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.469320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.473431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.487150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb7e71b2-65b8-4774-886a-6598a164586e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1522 microversion: 2.1 time: 0.336416 Oct 31 15:34:00.497678 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2053/4198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:00 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:00.512132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8b211f4-211d-4bc1-a1ab-432bc0852141 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '.version_select at 0x7f5ca6739790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:01.033093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:01.050755 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a805792-751a-46e1-b2aa-48bb23355b6b tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.625653 Oct 31 15:34:01.051365 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2146/4199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:00 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:01.060259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:01.064866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:01.087474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:01.087985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:01.090368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:01.093451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:01.095175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:01.095797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.092579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.101750 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-089bf4e6-ff86-41f9-a30c-d41fb2956ca8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 1.049350 Oct 31 15:34:02.102495 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2147/4200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:01 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:02.108518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:02.109574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:02.116465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.117690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.118664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.119855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.120596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.121256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.640263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.658015 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd63f452-c886-4634-b3df-6d1f67ff342a tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1500 microversion: 2.1 time: 0.554183 Oct 31 15:34:02.659164 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2148/4201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:02 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1500 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:02.663847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c5c614c7-5c74-419f-82fb-f0f22fa626b2 req-d4dd93ea-3eef-4d7d-84c8-cb2cc5cb7605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b885f1-1341-44cc-8ad8-892c4098d51e", "name": "network-vif-plugged", "status": "completed", "tag": "aff6a97c-3b1a-4612-8c2e-96e1058d097d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:02.686143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5c614c7-5c74-419f-82fb-f0f22fa626b2 req-d4dd93ea-3eef-4d7d-84c8-cb2cc5cb7605 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.686915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5c614c7-5c74-419f-82fb-f0f22fa626b2 req-d4dd93ea-3eef-4d7d-84c8-cb2cc5cb7605 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.687514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5c614c7-5c74-419f-82fb-f0f22fa626b2 req-d4dd93ea-3eef-4d7d-84c8-cb2cc5cb7605 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.713122 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c5c614c7-5c74-419f-82fb-f0f22fa626b2 req-d4dd93ea-3eef-4d7d-84c8-cb2cc5cb7605 service nova] Creating event network-vif-plugged:aff6a97c-3b1a-4612-8c2e-96e1058d097d for instance 00b885f1-1341-44cc-8ad8-892c4098d51e on n-h1-858383-17 Oct 31 15:34:02.730521 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c5c614c7-5c74-419f-82fb-f0f22fa626b2 req-d4dd93ea-3eef-4d7d-84c8-cb2cc5cb7605 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069959 Oct 31 15:34:02.731692 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2149/4202] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:02.741445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:02.741445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:02.745471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.745967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.746407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.747114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.747581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.748010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.074633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.089468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-127c87ab-d108-40db-9257-5562ef347d99 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1507 microversion: 2.1 time: 0.356402 Oct 31 15:34:03.090388 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2150/4203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:02 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:03.102176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.102800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.118408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.118917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.119366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.120091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.120558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.121022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.124290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:03.320800 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8b211f4-211d-4bc1-a1ab-432bc0852141 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/cb31db6d-1292-4469-bee6-a59716089eae" status: 202 len: 0 microversion: 2.1 time: 2.821970 Oct 31 15:34:03.322321 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2054/4204] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:34:00 2022] DELETE /compute/v2.1/os-floating-ips/cb31db6d-1292-4469-bee6-a59716089eae => generated 0 bytes in 2824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:03.328817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.329580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.341064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.341825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.342274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.342994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.343462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.344163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.360966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.372181 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c85979fb-a05c-4b66-84f6-005e9a02bd65 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.280693 Oct 31 15:34:03.372803 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2151/4205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:03.378903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.379687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.386207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.386906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.387499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.388361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.389008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.389585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.402397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:03.542588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-789ff0f9-de2b-4ac0-966e-b55196d25623 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 204 len: 0 microversion: 2.1 time: 0.218377 Oct 31 15:34:03.543987 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2055/4206] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:03 2022] DELETE /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:03.550549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.551613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.559031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.559973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.559973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.560730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.561310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.561638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.595872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.604778 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-545fcdce-94de-429f-bea0-341848aeed7f tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 200 len: 1507 microversion: 2.1 time: 0.229753 Oct 31 15:34:03.624146 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2152/4207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:03.632678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83ecadba-4206-4fe6-aa86-929b095b6479 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '.version_select at 0x7f5ca235c670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.829618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.839436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e6efcc1-caf5-4832-a50d-263ced78e141 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.293999 Oct 31 15:34:03.840039 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2056/4208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:03.867157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.868207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.878007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.878931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.879647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.880642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.881305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.882064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.038653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83ecadba-4206-4fe6-aa86-929b095b6479 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/fa74a1da-1a3e-4890-8380-ce4bf3133500" status: 202 len: 0 microversion: 2.1 time: 0.413085 Oct 31 15:34:04.039477 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2153/4209] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:34:03 2022] DELETE /compute/v2.1/os-security-groups/fa74a1da-1a3e-4890-8380-ce4bf3133500 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:04.047542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.048268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.061173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.061904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.063237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.064157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.066395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.067108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.105425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:04.118878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e001c1d-8278-4fb3-82ff-1c267d4ba05b tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.258158 Oct 31 15:34:04.125049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:04.140181 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2057/4210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:04.149592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.150133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.156333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.157016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.157464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.158175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.158641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.159073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.216405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:04.270969 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bcb69dba-b3ec-489a-af2d-c129784e5db5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 204 len: 0 microversion: 2.1 time: 0.226938 Oct 31 15:34:04.272529 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2154/4211] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:04 2022] DELETE /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:04.397594 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f134680-dffc-4ead-be8b-5eee79198eb3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "DELETE /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 204 len: 0 microversion: 2.1 time: 0.254914 Oct 31 15:34:04.398813 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2058/4212] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:04 2022] DELETE /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:04.403241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.403963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.409109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.413742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.419686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.419863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.420201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.420650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.420817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.421327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.421431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.421845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.422276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.422434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.423041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.423538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.680312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:04.693375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:04.703137 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49fbc9aa-fa3a-4122-ba9e-aac370281feb tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.307819 Oct 31 15:34:04.714624 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2155/4213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:04 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:04.727579 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac2cb010-99e2-4286-90a3-b77df4f7ed6c tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1509 microversion: 2.1 time: 0.324686 Oct 31 15:34:04.728422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2059/4214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:04 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:04.737111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1944201517", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "c434093f-3fbe-495e-a69d-5d6525f3d51c"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:04.863360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] validate_networks() for [('c434093f-3fbe-495e-a69d-5d6525f3d51c', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:04.871858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.872498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.889343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.889880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.890310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.891032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.895210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.895516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.197846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.212634 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bbe6590c-d590-4c84-aed9-db56577a2bdf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.344314 Oct 31 15:34:05.227523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2060/4215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:04 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:05.240265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:05.242085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:05.248450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.248966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.249403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.250166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.250682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.251039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.517373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.530190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e0a71460-a53d-4707-98fd-b9a2491322b9 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.296555 Oct 31 15:34:05.544867 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2061/4216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:05 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:05.554730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f9393f94-b99e-432d-ad9e-5d2d26e2bfb2 req-33cf9ef4-e764-4882-a235-4460561d16ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2713e930-444c-4372-a341-c5c999a4689e", "name": "network-vif-plugged", "status": "completed", "tag": "f4bed278-848f-45f1-ab57-576b80dcd1e7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:05.564586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:05.569740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f9393f94-b99e-432d-ad9e-5d2d26e2bfb2 req-33cf9ef4-e764-4882-a235-4460561d16ec service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.570390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f9393f94-b99e-432d-ad9e-5d2d26e2bfb2 req-33cf9ef4-e764-4882-a235-4460561d16ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.570847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f9393f94-b99e-432d-ad9e-5d2d26e2bfb2 req-33cf9ef4-e764-4882-a235-4460561d16ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.587043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f9393f94-b99e-432d-ad9e-5d2d26e2bfb2 req-33cf9ef4-e764-4882-a235-4460561d16ec service nova] Creating event network-vif-plugged:f4bed278-848f-45f1-ab57-576b80dcd1e7 for instance 2713e930-444c-4372-a341-c5c999a4689e on n-h1-858383-17 Oct 31 15:34:05.588936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:05.589385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:05.589615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:05.590055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:05.590588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:05.593211 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f9393f94-b99e-432d-ad9e-5d2d26e2bfb2 req-33cf9ef4-e764-4882-a235-4460561d16ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046818 Oct 31 15:34:05.594506 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2062/4217] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:05.595527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:05.603736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.604232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.604670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.607884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.607884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.607884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.627186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Getting quotas for project 45f6b73c45784731bdf32b36378474de. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:05.633750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Getting quotas for user d56792ab8451481f82bb4d87b29ff9df and project 45f6b73c45784731bdf32b36378474de. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:05.648267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:05.648970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:05.698648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c6c5443-85a3-4da2-8769-96d3e9fff6f4 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992955 Oct 31 15:34:05.706319 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2156/4218] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:34:05.713148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c28355a5-5a01-485d-92a5-e7aaad9d1015 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:05.713893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c28355a5-5a01-485d-92a5-e7aaad9d1015 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:05.734738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:05.735367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:05.745704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.746463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.749124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.749124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.749124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.749124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.794616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c28355a5-5a01-485d-92a5-e7aaad9d1015 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.801671 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c28355a5-5a01-485d-92a5-e7aaad9d1015 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1218 microversion: 2.1 time: 0.093925 Oct 31 15:34:05.803982 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2063/4219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:05 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:05.809890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:05.809890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:05.831522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.832221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.850335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.851241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.853643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.853643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.022870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.037053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-caab2118-bba5-4fb1-a1e9-08f61d155d7f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1325 microversion: 2.1 time: 0.300939 Oct 31 15:34:06.037053 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2157/4220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:05 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:06.127090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.129431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:06.137136 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2071a1f8-d4fa-4a6c-b992-3658839277e3 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1509 microversion: 2.1 time: 0.332086 Oct 31 15:34:06.164752 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2064/4221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:05 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:06.240223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:06.249000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:06.257052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.258055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.258444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.262233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.263118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.263854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.556495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:06.557920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:06.574963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.575531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.575982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.577390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.577859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.578344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.636403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.648490 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dad3371c-8eed-4a2a-a900-ef5c57fccf0a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.412890 Oct 31 15:34:06.652396 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2158/4222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:06 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:06.827534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:06.828151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:06.839644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.840587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.841059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.841777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.842239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.842658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.887323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.900436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9be8fe50-ad25-415a-8b23-05687e3fac47 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.348642 Oct 31 15:34:06.914535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2065/4223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:06 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:06.995107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:07.006437 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f00ac82-c967-467d-bf2c-d503172e1359 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1222 microversion: 2.1 time: 0.182597 Oct 31 15:34:07.024428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2159/4224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:06 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:07.060568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.063412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.075163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.075834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.076430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.077313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.078141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.078906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.183195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.183827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.195113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.195955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.196608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.197557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.198389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.199061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.540887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:07.551129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:07.554545 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c6f66b9-7cf3-4800-ac0f-340039a5e64a tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1509 microversion: 2.1 time: 0.380881 Oct 31 15:34:07.555392 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2160/4225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:07.560309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-22251e79-1c6e-495b-8e5a-f254c6cf2527 req-171b0560-92a3-483f-a3ca-c9c36316353e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78e2e5f-8adc-444d-94e2-5618e5ebdf76", "name": "network-vif-deleted", "tag": "1b09d647-c034-4a99-96f0-bfea491241ea"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:07.572369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22251e79-1c6e-495b-8e5a-f254c6cf2527 req-171b0560-92a3-483f-a3ca-c9c36316353e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.573070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22251e79-1c6e-495b-8e5a-f254c6cf2527 req-171b0560-92a3-483f-a3ca-c9c36316353e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.573584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-22251e79-1c6e-495b-8e5a-f254c6cf2527 req-171b0560-92a3-483f-a3ca-c9c36316353e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.574361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e07d4082-8a1f-4e44-a1f1-2f145c0365e7 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1522 microversion: 2.1 time: 0.518344 Oct 31 15:34:07.574968 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2066/4226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:07.593255 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-22251e79-1c6e-495b-8e5a-f254c6cf2527 req-171b0560-92a3-483f-a3ca-c9c36316353e service nova] Creating event network-vif-deleted:1b09d647-c034-4a99-96f0-bfea491241ea for instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 on n-h1-858383-17 Oct 31 15:34:07.599021 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-22251e79-1c6e-495b-8e5a-f254c6cf2527 req-171b0560-92a3-483f-a3ca-c9c36316353e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041952 Oct 31 15:34:07.599795 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2161/4227] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:07.601635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.602187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.608620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.609163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.609608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.610315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.610950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.611381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.644792 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] HTTP exception thrown: Action 999 not found Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Request method failure captured: Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e/os-instance-actions/999 HTTP/1.1 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-rMdHbkwS8P0g9vziw0aktQ2toDCuLXuVcwGr1jUeYUIs9Eabcvr7qYu_K-SbOSjNX8AbK2a39RU7tzrzl-4naRjfR02f83gx7d1XicruxWuXecSvSdbh5d2qCp2S0Ku2cJliJuVXHbG3LxqP1c6-M8AF9QP6BGjdqb5JwXL9FkQHk Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 31ea0189550c47429908ce5bbccada43 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/31ea0189550c47429908ce5bbccada43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/31ea0189550c47429908ce5bbccada43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_31ea0189550c47429908ce5bbccada43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/31ea0189550c47429908ce5bbccada43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 31ea0189550c47429908ce5bbccada43 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-InstanceActionsNegativeTestJSON-525532351-project Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 5e857b042afa482eb69eb2ff26634919 Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-525532351-project Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: exception: Action 999 not found Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': '00b885f1-1341-44cc-8ad8-892c4098d51e', 'id': '999'} Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 31 15:34:07.660387 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.664018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Returning 404 to user: Action 999 not found {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:07.664018 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d00a552-981f-4fe9-a56d-cf15b9f59a4a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.065305 Oct 31 15:34:07.664018 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2067/4228] 10.222.0.48 () {58 vars in 1308 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e/os-instance-actions/999 => generated 66 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:34:07.671290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.671902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.679924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.680413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.680876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.681571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.682021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.682612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.827370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-884ce90b-9ff8-407c-bce2-456efdef71b5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Action: 'create', calling method: .version_select at 0x7f5ca24794c0>, body: {"keypair": {"name": "tempest-keypair-1086877626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH2EZFNj5izNgeZY77ropYGAul/qLIzGJttk59j9zOFCMPvCf082LyLB641JD2FgRnUvXs8XD3pkO4vonwLjnrRv6dufDnaApXp1Ckc/1SrEgSj4qWdTk6CiIVt6KbC0g=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:07.848947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-884ce90b-9ff8-407c-bce2-456efdef71b5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Getting quotas for project 4e7ffa79fc114100a66fbfce1fa7c933. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:07.855238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-884ce90b-9ff8-407c-bce2-456efdef71b5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Getting quotas for user 293a79873d9b4695aab79f6c9cde33e8 and project 4e7ffa79fc114100a66fbfce1fa7c933. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:07.856864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:07.867195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94d611b7-f8e7-4ef6-899a-2a898097ea47 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1315 microversion: 2.1 time: 0.199836 Oct 31 15:34:07.868871 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2068/4229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:07.873593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2260cb30-7458-443e-a400-20f493f814a8 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '.version_select at 0x7f5ca174fc10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.874239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2260cb30-7458-443e-a400-20f493f814a8 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: ea34bacf-dc28-47f2-ae45-865b93be24d2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.879773 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2260cb30-7458-443e-a400-20f493f814a8 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] HTTP exception thrown: Instance ea34bacf-dc28-47f2-ae45-865b93be24d2 could not be found. Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2260cb30-7458-443e-a400-20f493f814a8 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Request method failure captured: Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/ea34bacf-dc28-47f2-ae45-865b93be24d2/os-instance-actions HTTP/1.1 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-rMdHbkwS8P0g9vziw0aktQ2toDCuLXuVcwGr1jUeYUIs9Eabcvr7qYu_K-SbOSjNX8AbK2a39RU7tzrzl-4naRjfR02f83gx7d1XicruxWuXecSvSdbh5d2qCp2S0Ku2cJliJuVXHbG3LxqP1c6-M8AF9QP6BGjdqb5JwXL9FkQHk Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 31ea0189550c47429908ce5bbccada43 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/31ea0189550c47429908ce5bbccada43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/31ea0189550c47429908ce5bbccada43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_31ea0189550c47429908ce5bbccada43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/31ea0189550c47429908ce5bbccada43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 31ea0189550c47429908ce5bbccada43 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-InstanceActionsNegativeTestJSON-525532351-project Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 5e857b042afa482eb69eb2ff26634919 Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-525532351-project Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance ea34bacf-dc28-47f2-ae45-865b93be24d2 could not be found. Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': 'ea34bacf-dc28-47f2-ae45-865b93be24d2'} Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea34bacf-dc28-47f2-ae45-865b93be24d2 could not be found. Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:07.882944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea34bacf-dc28-47f2-ae45-865b93be24d2 could not be found. Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea34bacf-dc28-47f2-ae45-865b93be24d2 could not be found. Oct 31 15:34:07.886246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.887743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2260cb30-7458-443e-a400-20f493f814a8 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Returning 404 to user: Instance ea34bacf-dc28-47f2-ae45-865b93be24d2 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:07.889367 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2260cb30-7458-443e-a400-20f493f814a8 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/ea34bacf-dc28-47f2-ae45-865b93be24d2/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018774 Oct 31 15:34:07.889816 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2069/4230] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/ea34bacf-dc28-47f2-ae45-865b93be24d2/os-instance-actions => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:07.891987 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-884ce90b-9ff8-407c-bce2-456efdef71b5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.288303 Oct 31 15:34:07.893357 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2162/4231] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:34:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:07.899953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.900400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.908465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.909391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.909839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.910564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.911032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.911515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.933981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.934745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.946985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.947492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.948115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.948993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.949548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.949985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.955541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:08.073303 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d9abde4d-694e-4b1d-ab8c-4aa33d6b0f99 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 204 len: 0 microversion: 2.1 time: 0.177485 Oct 31 15:34:08.074190 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2070/4232] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:07 2022] DELETE /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:34:08.080068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.080792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:08.089153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.089915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.090364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.091083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.091610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.092216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.201765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:08.209436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:08.214121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c50fcbf-a8e8-4f0a-85c1-e3f6223b9034 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1506 microversion: 2.1 time: 0.289253 Oct 31 15:34:08.215933 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2163/4233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:08.225417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.226248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:08.236194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.236461 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4804eaa7-528e-47ad-943a-e24f10698b6e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1222 microversion: 2.1 time: 0.161007 Oct 31 15:34:08.237186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.237815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.239066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.239811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.240634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.258750 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2071/4234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:08.582885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.584725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:08.587998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:08.600086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.600690 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e443a900-727f-4f43-ba2c-99a5850b3a8f tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1528 microversion: 2.1 time: 0.383222 Oct 31 15:34:08.601335 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2164/4235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1528 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:08.617023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.618311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.618429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.618878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.619824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.894043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.894675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:08.910899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.913988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.915427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.916467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.917521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.918184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.288138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.297880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a90f4c63-9abb-4bac-aa22-aa465b019642 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1509 microversion: 2.1 time: 0.722161 Oct 31 15:34:09.303457 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2072/4236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1509 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:09.308457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:09.325622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.332807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.333706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.334346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.337800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.338540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.339174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.593534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.610881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e13fa778-1b2b-4a90-b31f-bb041c44d8bc tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 200 len: 1464 microversion: 2.1 time: 0.306119 Oct 31 15:34:09.613807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2073/4237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:09 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:09.619692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:09.620555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.638101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.641663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.642322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.643272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.643931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.654023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.883607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.888278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.896967 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2d3e78e2-1b24-4297-aa6a-619e700d0555 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1276 microversion: 2.1 time: 0.280431 Oct 31 15:34:09.899678 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2074/4238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:09 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1276 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:09.900512 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12b32ea8-7224-4678-b9a9-53e02741452e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1502 microversion: 2.1 time: 1.010365 Oct 31 15:34:09.917065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bfeeac02-74f0-47c1-a346-bc70419f1f35 req-3d322747-4fb0-4b95-863f-097808a1cb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a940bb7b-7e68-460e-ab09-c554a7eb6e9c", "name": "network-vif-deleted", "tag": "0ce3a0e8-2959-41e8-840c-6353a6fcf0b5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:09.918512 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2165/4239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1502 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:09.927713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:09.929130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.933302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bfeeac02-74f0-47c1-a346-bc70419f1f35 req-3d322747-4fb0-4b95-863f-097808a1cb51 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.933881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bfeeac02-74f0-47c1-a346-bc70419f1f35 req-3d322747-4fb0-4b95-863f-097808a1cb51 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.934479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bfeeac02-74f0-47c1-a346-bc70419f1f35 req-3d322747-4fb0-4b95-863f-097808a1cb51 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.941087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.941657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.942175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.944203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.946850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.947310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.952181 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bfeeac02-74f0-47c1-a346-bc70419f1f35 req-3d322747-4fb0-4b95-863f-097808a1cb51 service nova] Creating event network-vif-deleted:0ce3a0e8-2959-41e8-840c-6353a6fcf0b5 for instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c on n-h2-858383-17 Oct 31 15:34:09.962113 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bfeeac02-74f0-47c1-a346-bc70419f1f35 req-3d322747-4fb0-4b95-863f-097808a1cb51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060930 Oct 31 15:34:09.962857 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2075/4240] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:09.970533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:09.971490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.980402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.981394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.982084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.983172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.983873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.984379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.334618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:10.350413 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65ca3807-fa55-442b-96d7-77e84bc93070 tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1528 microversion: 2.1 time: 0.430494 Oct 31 15:34:10.351273 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2166/4241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:09 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1528 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:10.370052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:10.372232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.386744 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Removing security group 191ec53e-fcd5-4687-9054-0d61ba67c971 from port f4bed278-848f-45f1-ab57-576b80dcd1e7 Oct 31 15:34:10.387054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.388287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.388935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.389852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.390958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.393898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.445907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.446670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.447458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.448070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lazy-loading 'fault' on Instance uuid 76e6853a-7e2f-43f0-8051-033977b9cea5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:10.596272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea99dd7011b94e0a988ef0807c9d649a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0c22c3c8e84f4b823afe9a5cff03af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:10.610825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3717ec2-2042-4e1d-a52e-95a023529729 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 200 len: 1312 microversion: 2.1 time: 0.256060 Oct 31 15:34:10.631286 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2167/4242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:10 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:10.642009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:10.643439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: a940bb7b-7e68-460e-ab09-c554a7eb6e9c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.654551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.655196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.655843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.656873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.657655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.658377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.705517 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] HTTP exception thrown: Instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c could not be found. Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Request method failure captured: Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c HTTP/1.1 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-p0ZEl0r0IZINDc69ojgyNgZJxXwE44ilD1Lp5xsZ0B9vXEWetMdQfo08M5EU2e8gKvhvMKFRHVNDp1G9UAfO8dQet5nFIgaFGuVIgMURBX68Ub9crqMqu9aXFGbqpqOmP8iWlNYFV-dzdSMwpZ9Uf2qLSmmgf-gnfbQVZLjR1VI2A Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3f8696603b19481abd8c8e15399851c5 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueTestJSON-871984072 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3f8696603b19481abd8c8e15399851c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3f8696603b19481abd8c8e15399851c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3f8696603b19481abd8c8e15399851c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3f8696603b19481abd8c8e15399851c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueTestJSON-871984072 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3f8696603b19481abd8c8e15399851c5 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueTestJSON-871984072 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueTestJSON-871984072-project Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c9b99145c96b4684952ac677bb25a076 Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueTestJSON-871984072-project Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c could not be found. Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a940bb7b-7e68-460e-ab09-c554a7eb6e9c'} Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c could not be found. Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c could not be found. Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:10.710124 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c could not be found. Oct 31 15:34:10.714932 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:10.724940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Returning 404 to user: Instance a940bb7b-7e68-460e-ab09-c554a7eb6e9c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:10.728617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6eb37347-8ab5-40d2-ba1c-f58fd6a37cda tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c" status: 404 len: 111 microversion: 2.1 time: 0.094434 Oct 31 15:34:10.730805 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2168/4243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:10 2022] GET /compute/v2.1/servers/a940bb7b-7e68-460e-ab09-c554a7eb6e9c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:10.742635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:10.743362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.759243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.760090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.761296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.762231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.763061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.763498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.809978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:10.818457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:10.961756 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f882852b-e5ab-4e57-bd21-7e13d1552a32 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "DELETE /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 204 len: 0 microversion: 2.1 time: 0.226612 Oct 31 15:34:10.964318 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2169/4244] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:10 2022] DELETE /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:10.969445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:10.970332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.977595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.978065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.978833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.979241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.980058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.980807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.179954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.190550 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0042a6f9-c5fb-408c-9311-efe235c52ce8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1276 microversion: 2.1 time: 0.226534 Oct 31 15:34:11.200727 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2170/4245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:10 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:11.214012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.216410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.224004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.224479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.224945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.225805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.226246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.226670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.520120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6bbe21f2-ac6e-4ad0-b5eb-b0ee3c9a9313 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e/action" status: 202 len: 0 microversion: 2.1 time: 1.555808 Oct 31 15:34:11.522384 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2076/4246] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:09 2022] POST /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e/action => generated 0 bytes in 1559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:11.530973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.536073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.550148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.557873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.558713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.559902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.560781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.561442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.652904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.678502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34bafe26-7f45-4246-9ebc-c00ca0d05e39 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1493 microversion: 2.1 time: 0.484708 Oct 31 15:34:11.682331 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2171/4247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1493 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:11.699440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.702718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.714760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.719822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.720500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.721243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.721698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.722130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.950277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.966169 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1de2b3db-0459-402e-bae2-7e9c922e8a6d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1460 microversion: 2.1 time: 0.280672 Oct 31 15:34:11.990716 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2172/4248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1460 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:12.001460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fc100f4f-eaec-463c-8a10-dd0fc7aa440c req-efd889b2-ccbb-4a9c-b774-41bc6ad4197d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2713e930-444c-4372-a341-c5c999a4689e", "tag": "f4bed278-848f-45f1-ab57-576b80dcd1e7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:12.014420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fc100f4f-eaec-463c-8a10-dd0fc7aa440c req-efd889b2-ccbb-4a9c-b774-41bc6ad4197d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.015149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fc100f4f-eaec-463c-8a10-dd0fc7aa440c req-efd889b2-ccbb-4a9c-b774-41bc6ad4197d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.015755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fc100f4f-eaec-463c-8a10-dd0fc7aa440c req-efd889b2-ccbb-4a9c-b774-41bc6ad4197d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.032510 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fc100f4f-eaec-463c-8a10-dd0fc7aa440c req-efd889b2-ccbb-4a9c-b774-41bc6ad4197d service nova] Creating event network-changed:f4bed278-848f-45f1-ab57-576b80dcd1e7 for instance 2713e930-444c-4372-a341-c5c999a4689e on n-h1-858383-17 Oct 31 15:34:12.038198 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fc100f4f-eaec-463c-8a10-dd0fc7aa440c req-efd889b2-ccbb-4a9c-b774-41bc6ad4197d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045954 Oct 31 15:34:12.039144 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2173/4249] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:12.045697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.046735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] [instance: 76e6853a-7e2f-43f0-8051-033977b9cea5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.056204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.057198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.057956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.060207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.062058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.062729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.092572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] HTTP exception thrown: Instance 76e6853a-7e2f-43f0-8051-033977b9cea5 could not be found. Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Request method failure captured: Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 HTTP/1.1 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-qbmeVVqLEYWTudBO88sPay-n7kbCkslZbsfTIZoG-I6PeiwUSxuF1smZakbSvNb4L0HPCBQ3rNFdZ-OD0RVZshK7u2AE890VPot2Dbj1PFZZhGKgYt6uAucQ9eA3gyayslvExVDMYzgz6ApU_Wbhw9-2NodCFI7Eawovn_h6ZlmI0 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3b0c22c3c8e84f4b823afe9a5cff03af Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-705874637 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b0c22c3c8e84f4b823afe9a5cff03af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b0c22c3c8e84f4b823afe9a5cff03af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b0c22c3c8e84f4b823afe9a5cff03af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b0c22c3c8e84f4b823afe9a5cff03af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-705874637 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3b0c22c3c8e84f4b823afe9a5cff03af Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-705874637 Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueTestJSONUnderV235-705874637-project Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ea99dd7011b94e0a988ef0807c9d649a Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-705874637-project Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 76e6853a-7e2f-43f0-8051-033977b9cea5 could not be found. Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '76e6853a-7e2f-43f0-8051-033977b9cea5'} Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e6853a-7e2f-43f0-8051-033977b9cea5 could not be found. Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e6853a-7e2f-43f0-8051-033977b9cea5 could not be found. Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:12.096493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e6853a-7e2f-43f0-8051-033977b9cea5 could not be found. Oct 31 15:34:12.101097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:12.103028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] Returning 404 to user: Instance 76e6853a-7e2f-43f0-8051-033977b9cea5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:12.103967 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27f121d3-e03b-4988-89fe-a430ce7f85b9 tempest-ServerRescueTestJSONUnderV235-705874637 tempest-ServerRescueTestJSONUnderV235-705874637-project] 10.222.0.48 "GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5" status: 404 len: 111 microversion: 2.1 time: 0.063511 Oct 31 15:34:12.105285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2174/4250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/76e6853a-7e2f-43f0-8051-033977b9cea5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:12.111268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.111999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.121930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.122678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.123341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.124153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.124680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.125366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.136488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:12.145071 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d317d3bd-cff2-43bb-a627-b161a2db261a tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1528 microversion: 2.1 time: 0.617850 Oct 31 15:34:12.152822 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2077/4251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1528 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:12.165111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a6db0f8d-9ceb-41d6-b51e-c5e7b79a6a31 req-773a5822-89e5-40f4-aaa0-e7df40f7ac69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e6853a-7e2f-43f0-8051-033977b9cea5", "name": "network-vif-deleted", "tag": "bff871fa-7ab5-4d0f-979e-e2c0c494ccdb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:12.193009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a6db0f8d-9ceb-41d6-b51e-c5e7b79a6a31 req-773a5822-89e5-40f4-aaa0-e7df40f7ac69 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.193810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a6db0f8d-9ceb-41d6-b51e-c5e7b79a6a31 req-773a5822-89e5-40f4-aaa0-e7df40f7ac69 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.194453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a6db0f8d-9ceb-41d6-b51e-c5e7b79a6a31 req-773a5822-89e5-40f4-aaa0-e7df40f7ac69 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.225483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a6db0f8d-9ceb-41d6-b51e-c5e7b79a6a31 req-773a5822-89e5-40f4-aaa0-e7df40f7ac69 service nova] Creating event network-vif-deleted:bff871fa-7ab5-4d0f-979e-e2c0c494ccdb for instance 76e6853a-7e2f-43f0-8051-033977b9cea5 on n-h2-858383-17 Oct 31 15:34:12.231387 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a6db0f8d-9ceb-41d6-b51e-c5e7b79a6a31 req-773a5822-89e5-40f4-aaa0-e7df40f7ac69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077094 Oct 31 15:34:12.234955 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2078/4252] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:12.243450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.248888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.266640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.267236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.267645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.268357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.268842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.269269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.267377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.278091 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dbfd21b-9d6b-4375-961c-ee6624743d64 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 1.041585 Oct 31 15:34:13.280295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.298375 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2079/4253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:13.300515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d4b9ed0-119c-4213-8dcf-f839895d7598 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 1.194079 Oct 31 15:34:13.301438 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2175/4254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:13.306140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:13.307349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:13.314567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:13.315195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:13.326052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.326563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.327014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.327734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.328200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.328634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.338222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.339188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.339879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.340879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.343098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.343784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.399140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.399736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.401061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.402310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lazy-loading 'fault' on Instance uuid 00b885f1-1341-44cc-8ad8-892c4098d51e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:13.538103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e857b042afa482eb69eb2ff26634919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0189550c47429908ce5bbccada43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.547309 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f35e836e-7b4f-4be8-9a8b-5984294fa8aa tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 200 len: 1315 microversion: 2.1 time: 0.244094 Oct 31 15:34:13.547916 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2176/4255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:13 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:13.562167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:13.565293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:13.580841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.581343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.581803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.582508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.585362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.585833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.895376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.918589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2894eea-e2cf-4d8a-a7bf-9143bc28e67d tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1493 microversion: 2.1 time: 0.618913 Oct 31 15:34:13.934099 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2080/4256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:13 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1493 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:13.934099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1029403767", "imageRef": "15120593-3157-4b44-ab8a-1ed5747d0092", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3de87b82-bb2e-4dec-af06-5fa87abdd656"}], "security_groups": [{"name": "tempest-securitygroup--755130953"}], "key_name": "tempest-keypair-1086877626", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:14.328648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.345455 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2dddbf5-9631-447b-8f61-e44ce82b1688 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.786853 Oct 31 15:34:14.350488 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2177/4257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:13 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:14.360074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-64a73a32-5506-4901-9de6-b9828e446022 req-3152e5f4-3d5d-479b-bdd7-a644d92907be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b885f1-1341-44cc-8ad8-892c4098d51e", "name": "network-vif-deleted", "tag": "aff6a97c-3b1a-4612-8c2e-96e1058d097d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:14.411443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-64a73a32-5506-4901-9de6-b9828e446022 req-3152e5f4-3d5d-479b-bdd7-a644d92907be service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.415326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-64a73a32-5506-4901-9de6-b9828e446022 req-3152e5f4-3d5d-479b-bdd7-a644d92907be service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.415975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-64a73a32-5506-4901-9de6-b9828e446022 req-3152e5f4-3d5d-479b-bdd7-a644d92907be service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.445691 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-64a73a32-5506-4901-9de6-b9828e446022 req-3152e5f4-3d5d-479b-bdd7-a644d92907be service nova] Creating event network-vif-deleted:aff6a97c-3b1a-4612-8c2e-96e1058d097d for instance 00b885f1-1341-44cc-8ad8-892c4098d51e on n-h1-858383-17 Oct 31 15:34:14.462355 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-64a73a32-5506-4901-9de6-b9828e446022 req-3152e5f4-3d5d-479b-bdd7-a644d92907be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098654 Oct 31 15:34:14.463500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2178/4258] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:14.471052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:14.472641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:14.492904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.493566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.494195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.495054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.495945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.496662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.511783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] validate_networks() for [('3de87b82-bb2e-4dec-af06-5fa87abdd656', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:15.074219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:15.082220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25ba5429-3b05-42e8-95fe-24ae14d09337 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 0.616200 Oct 31 15:34:15.082799 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2179/4259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:14 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:15.088401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:15.089043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:15.108320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.108905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.109313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.110034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.110503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.110942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.616787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:15.716927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:15.737442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dde11d74-69fa-489a-9fb3-a37c5b40d2b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.652830 Oct 31 15:34:15.762139 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2180/4260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:15 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:15.777989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:15.783286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] [instance: 00b885f1-1341-44cc-8ad8-892c4098d51e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:15.801270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:15.818544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.819562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.820180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.821133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.822916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.825081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.868468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] HTTP exception thrown: Instance 00b885f1-1341-44cc-8ad8-892c4098d51e could not be found. Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Request method failure captured: Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e HTTP/1.1 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-rMdHbkwS8P0g9vziw0aktQ2toDCuLXuVcwGr1jUeYUIs9Eabcvr7qYu_K-SbOSjNX8AbK2a39RU7tzrzl-4naRjfR02f83gx7d1XicruxWuXecSvSdbh5d2qCp2S0Ku2cJliJuVXHbG3LxqP1c6-M8AF9QP6BGjdqb5JwXL9FkQHk Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 31ea0189550c47429908ce5bbccada43 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/31ea0189550c47429908ce5bbccada43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/31ea0189550c47429908ce5bbccada43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_31ea0189550c47429908ce5bbccada43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/31ea0189550c47429908ce5bbccada43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 31ea0189550c47429908ce5bbccada43 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-525532351 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-InstanceActionsNegativeTestJSON-525532351-project Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 5e857b042afa482eb69eb2ff26634919 Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-525532351-project Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 00b885f1-1341-44cc-8ad8-892c4098d51e could not be found. Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '00b885f1-1341-44cc-8ad8-892c4098d51e'} Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b885f1-1341-44cc-8ad8-892c4098d51e could not be found. Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b885f1-1341-44cc-8ad8-892c4098d51e could not be found. Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:15.877090 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b885f1-1341-44cc-8ad8-892c4098d51e could not be found. Oct 31 15:34:15.881968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:15.896840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] Returning 404 to user: Instance 00b885f1-1341-44cc-8ad8-892c4098d51e could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:15.898218 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0cf056a1-ea48-4eac-99fc-3ec0db8a86cc tempest-InstanceActionsNegativeTestJSON-525532351 tempest-InstanceActionsNegativeTestJSON-525532351-project] 10.222.0.48 "GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e" status: 404 len: 111 microversion: 2.1 time: 0.134346 Oct 31 15:34:15.909331 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2181/4261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:15 2022] GET /compute/v2.1/servers/00b885f1-1341-44cc-8ad8-892c4098d51e => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:15.935087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:15.938250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:15.957461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.958250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.958921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.964604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.965431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.966392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.921525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:16.922518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:16.923144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:16.923702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:16.924303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:16.946745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:16.947231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:16.948006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.949656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:16.950407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:16.950987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.955523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b99145c96b4684952ac677bb25a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8696603b19481abd8c8e15399851c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:16.968587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-670d9554-9ad6-4c27-9efa-abf100ca1e49 tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 200 len: 1285 microversion: 2.1 time: 1.057179 Oct 31 15:34:16.969865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2182/4262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:15 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 1285 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:16.975143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:16.975761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:16.997277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.005273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.005754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.006602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.007107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.007382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.017104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Getting quotas for project 4e7ffa79fc114100a66fbfce1fa7c933. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:17.025840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Getting quotas for user 293a79873d9b4695aab79f6c9cde33e8 and project 4e7ffa79fc114100a66fbfce1fa7c933. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:17.041759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:17.044351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15120593-3157-4b44-ab8a-1ed5747d0092',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:17.105207 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4515e91-36fb-404f-ac46-dcae561b195a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.179052 Oct 31 15:34:17.112230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2081/4263] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 3192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:34:17.118027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:17.118882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:17.127638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.128393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.129078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.130516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.131268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.131839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.787154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:17.787676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:17.802891 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-be8cee21-e3f6-4be8-a6af-fbe5436a1229 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 0.689255 Oct 31 15:34:17.805990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc07bfb8-1cc0-4ec2-b660-36ca10357c54 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.834996 Oct 31 15:34:17.806910 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2082/4264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:17 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:17.808641 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2183/4265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:16 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:17.820970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543c69d2-93b6-4ba0-8124-7909489b0b32", "name": "network-vif-deleted", "tag": "3920e839-ea5f-4611-9409-4e62af409dd4"}, {"name": "network-changed", "server_uuid": "981fb01c-6a7d-4bf7-b5de-e7569109a87b", "tag": "b779f73c-62ce-4339-a939-3f78dd62b7fd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:17.823271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:17.830340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:17.845212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.848990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.850995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.851839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.852391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.853600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.853972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.857090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.857376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.866005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:17.885908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:17.889810 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] Creating event network-vif-deleted:3920e839-ea5f-4611-9409-4e62af409dd4 for instance 543c69d2-93b6-4ba0-8124-7909489b0b32 on n-h1-858383-17 Oct 31 15:34:17.890883 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] Creating event network-changed:b779f73c-62ce-4339-a939-3f78dd62b7fd for instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b on n-h2-858383-17 Oct 31 15:34:17.907511 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5fc27d7d-5d0a-4585-8b87-8efe62c963c7 req-265b5c14-30fb-4043-86b1-b9267d5c2e94 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098686 Oct 31 15:34:17.908438 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2083/4266] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:17.993958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1689946875", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "8c999eef-3ab4-4489-9119-8b9357d0c054"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:18.065878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] validate_networks() for [('8c999eef-3ab4-4489-9119-8b9357d0c054', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:18.104110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:18.111954 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6ca9769-2dd7-430a-85bf-3b53aa779829 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1250 microversion: 2.1 time: 0.301992 Oct 31 15:34:18.112534 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2184/4267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:17 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1250 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:18.125638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:18.126472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] [instance: 543c69d2-93b6-4ba0-8124-7909489b0b32] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:18.132808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.133492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.134106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.135130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.135732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.136304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.153480 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] HTTP exception thrown: Instance 543c69d2-93b6-4ba0-8124-7909489b0b32 could not be found. Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Request method failure captured: Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 HTTP/1.1 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-p0ZEl0r0IZINDc69ojgyNgZJxXwE44ilD1Lp5xsZ0B9vXEWetMdQfo08M5EU2e8gKvhvMKFRHVNDp1G9UAfO8dQet5nFIgaFGuVIgMURBX68Ub9crqMqu9aXFGbqpqOmP8iWlNYFV-dzdSMwpZ9Uf2qLSmmgf-gnfbQVZLjR1VI2A Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3f8696603b19481abd8c8e15399851c5 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueTestJSON-871984072 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3f8696603b19481abd8c8e15399851c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3f8696603b19481abd8c8e15399851c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3f8696603b19481abd8c8e15399851c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3f8696603b19481abd8c8e15399851c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueTestJSON-871984072 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3f8696603b19481abd8c8e15399851c5 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueTestJSON-871984072 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueTestJSON-871984072-project Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c9b99145c96b4684952ac677bb25a076 Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueTestJSON-871984072-project Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 543c69d2-93b6-4ba0-8124-7909489b0b32 could not be found. Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '543c69d2-93b6-4ba0-8124-7909489b0b32'} Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543c69d2-93b6-4ba0-8124-7909489b0b32 could not be found. Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543c69d2-93b6-4ba0-8124-7909489b0b32 could not be found. Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:18.155274 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543c69d2-93b6-4ba0-8124-7909489b0b32 could not be found. Oct 31 15:34:18.159449 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:18.178847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] Returning 404 to user: Instance 543c69d2-93b6-4ba0-8124-7909489b0b32 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:18.179922 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8980a13d-cb40-4cbb-8eb5-f25c9dd6a9ff tempest-ServerRescueTestJSON-871984072 tempest-ServerRescueTestJSON-871984072-project] 10.222.0.48 "GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32" status: 404 len: 111 microversion: 2.1 time: 0.058133 Oct 31 15:34:18.180649 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2185/4268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:18 2022] GET /compute/v2.1/servers/543c69d2-93b6-4ba0-8124-7909489b0b32 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:18.848447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:18.849431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:18.860166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.869505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.870268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.871237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.871952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.873156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.875611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:19.876253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:19.876478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:19.877093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:19.877650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:19.903009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:19.903716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:19.904437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.909633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:19.910400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:19.911851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.997829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:20.009807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Getting quotas for user 6b1695b4d61d40de8272561b0cf3362e and project 2b75b127e3924430bc27f7f311747382. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:20.050565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:20.060496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:20.064863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:20.074713 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e57b754-3155-4ad8-85a4-8431cba9890e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 1.241173 Oct 31 15:34:20.077993 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2186/4269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:18 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:20.086667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:20.092007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:20.107993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.108826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.109525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.110520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.111240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.111867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.240035 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-529279b7-7c39-4b27-bcc4-2ef21d037185 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.257768 Oct 31 15:34:20.241500 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2084/4270] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:34:20.252281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5c3a9f3-17ae-47fc-a655-09b44c26bff3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:20.253445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5c3a9f3-17ae-47fc-a655-09b44c26bff3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:20.498782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:20.507359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:20.519902 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ba326a9-f90e-413e-b10e-bad3deb27617 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1304 microversion: 2.1 time: 0.437004 Oct 31 15:34:20.522787 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2187/4271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:20 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1304 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:20.630515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5c3a9f3-17ae-47fc-a655-09b44c26bff3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:20.642097 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5c3a9f3-17ae-47fc-a655-09b44c26bff3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1215 microversion: 2.1 time: 0.392551 Oct 31 15:34:20.654267 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2085/4272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:20 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1215 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:21.105981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:21.106614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:21.156621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.158355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.158829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.182792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.183434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.191180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.553500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:21.554242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:21.578732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.587509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.590096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.591491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.595572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.596267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.451191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:22.460317 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8fab7497-89b1-4da9-a0ee-111eb00a1d23 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1304 microversion: 2.1 time: 0.913680 Oct 31 15:34:22.470843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2086/4273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:21 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1304 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:22.476378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:22.477026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:22.506611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:22.511803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:22.515911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:22.521572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.522375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:22.522857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:22.523297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.538447 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d2d983a-9317-497d-8b22-0b1ace7347e6 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 1.436340 Oct 31 15:34:22.545073 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2188/4274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:21 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:22.902350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:22.916230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27eb19aa-a81b-419a-90c7-04d3a0cfc7f5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1267 microversion: 2.1 time: 0.444154 Oct 31 15:34:22.916858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2087/4275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:22 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1267 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:23.492578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:23.493247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:23.514217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.514720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.515171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.515899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.527092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.528389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.563313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:23.563941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:23.579391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.581651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.584051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.584876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.595817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.596277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.013056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:24.028024 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b0fcc98-0248-4085-9a5e-64b92a65d339 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1304 microversion: 2.1 time: 0.540090 Oct 31 15:34:24.043476 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2189/4276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:23 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1304 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:24.069931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-51640897-4801-4f08-a4ce-e53f2624a936 req-e4a030ed-6a45-4ef2-a1c7-79ad9fc53971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981fb01c-6a7d-4bf7-b5de-e7569109a87b", "name": "network-vif-plugged", "status": "completed", "tag": "b779f73c-62ce-4339-a939-3f78dd62b7fd"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:24.106058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:24.110953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-51640897-4801-4f08-a4ce-e53f2624a936 req-e4a030ed-6a45-4ef2-a1c7-79ad9fc53971 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.111916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-51640897-4801-4f08-a4ce-e53f2624a936 req-e4a030ed-6a45-4ef2-a1c7-79ad9fc53971 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.112938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-51640897-4801-4f08-a4ce-e53f2624a936 req-e4a030ed-6a45-4ef2-a1c7-79ad9fc53971 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.187468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-51640897-4801-4f08-a4ce-e53f2624a936 req-e4a030ed-6a45-4ef2-a1c7-79ad9fc53971 service nova] Creating event network-vif-plugged:b779f73c-62ce-4339-a939-3f78dd62b7fd for instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b on n-h2-858383-17 Oct 31 15:34:24.216484 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-51640897-4801-4f08-a4ce-e53f2624a936 req-e4a030ed-6a45-4ef2-a1c7-79ad9fc53971 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171309 Oct 31 15:34:24.222076 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2190/4277] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:24.248619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:24.250432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:24.276668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.286557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.289289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.291048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.293285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.295372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.114760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:25.124345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-26676b09-80fa-458f-94be-01d1ab49a722 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 1.565081 Oct 31 15:34:25.141813 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2088/4278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:23 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:25.184232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:25.185261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:25.202635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:25.203318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:25.203953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.205012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:25.208404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:25.213395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.249845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:25.267387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02f8057f-e8cc-4fc0-8b33-fd331cb2a26b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1273 microversion: 2.1 time: 1.035435 Oct 31 15:34:25.288445 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2191/4279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:24 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1273 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:25.711757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:25.724004 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eece3231-de60-4920-9c28-df2cef5e82ae tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.579853 Oct 31 15:34:25.727038 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2089/4280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:25 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:26.170631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:26.171433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:26.189481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.190257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.190856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.193767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.194678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.195403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.331062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:26.332384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:26.363882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.365628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.369021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.370455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.371421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.372177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.712215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:26.725246 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b42fd26-ba49-4b77-a6fb-1367f00879fe tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1273 microversion: 2.1 time: 0.432089 Oct 31 15:34:26.725858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2090/4281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:26 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1273 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:26.766044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:26.769777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:26.805089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.808078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.809179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.810899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.813155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.814495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.685279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.711708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ca1e9ed-6412-41d7-8265-ebd649daba9b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1318 microversion: 2.1 time: 1.545204 Oct 31 15:34:27.715268 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2192/4282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:26 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1318 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:27.757229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:27.757887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:27.771937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.774194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.775905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.778490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.780349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.781500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.104385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:28.122310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad225637-02fd-4c63-b01e-d732d02604f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1273 microversion: 2.1 time: 0.374256 Oct 31 15:34:28.122934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2193/4283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:27 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1273 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:28.203765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:28.213814 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e1409fc-a177-497c-b9d1-7854afbc1406 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 1.465539 Oct 31 15:34:28.225086 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2091/4284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:26 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:28.744531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:28.745968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:28.760685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.763121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.764368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.767058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.767838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.769710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.152518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:29.153367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:29.157334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:29.176025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.177123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.182617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.184321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.186830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.190057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.717139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.741144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69e485bd-4f43-4692-9b42-bd5decc714ca tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1508 microversion: 2.1 time: 0.993819 Oct 31 15:34:29.741144 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2194/4285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:28 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1508 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:29.741144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:29.741144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:29.744425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.745232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.746347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.747279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.747973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.748618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.951683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:30.163446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:30.174898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38f68a6a-7e2a-4acc-8de5-9e138c703a64 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 1.027603 Oct 31 15:34:30.178437 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2092/4286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:29 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:30.191430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:30.221413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:30.240562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.243390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.244738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.246338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.247996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.248622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:30.260820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3831fe5f-459c-478e-9ed2-b7fba4b2ce5a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.526422 Oct 31 15:34:30.262079 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2195/4287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:29 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:30.284508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.375347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f1f0f5c8-ca8c-4836-8197-9b0dda797df0 req-978fd142-7779-42ec-b0df-f7a0ab9d09c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82", "tag": "766be369-b20c-4cee-b5a8-6f76eb40471a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:30.393829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f1f0f5c8-ca8c-4836-8197-9b0dda797df0 req-978fd142-7779-42ec-b0df-f7a0ab9d09c8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.398013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f1f0f5c8-ca8c-4836-8197-9b0dda797df0 req-978fd142-7779-42ec-b0df-f7a0ab9d09c8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.399090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f1f0f5c8-ca8c-4836-8197-9b0dda797df0 req-978fd142-7779-42ec-b0df-f7a0ab9d09c8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.425039 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f1f0f5c8-ca8c-4836-8197-9b0dda797df0 req-978fd142-7779-42ec-b0df-f7a0ab9d09c8 service nova] Creating event network-changed:766be369-b20c-4cee-b5a8-6f76eb40471a for instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 on n-h1-858383-17 Oct 31 15:34:30.440913 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f1f0f5c8-ca8c-4836-8197-9b0dda797df0 req-978fd142-7779-42ec-b0df-f7a0ab9d09c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069158 Oct 31 15:34:30.442313 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2196/4288] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:34:30.638304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=14 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:30.762140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:30.791019 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6bc55f2-0883-408e-a43b-69cb65e9797a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1508 microversion: 2.1 time: 0.609800 Oct 31 15:34:30.791619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2093/4289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:30 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1508 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:30.821283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:30.827012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:30.848147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.848986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.850811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.853198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.854912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.856056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.096266 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd93c18e-ec1e-489b-90a3-206f8aca2d34 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "PUT /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1080 microversion: 2.1 time: 0.281516 Oct 31 15:34:31.106420 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2197/4290] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:34:30 2022] PUT /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1080 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:31.126151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:31.126810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:31.138581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.153727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.154362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.157952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.158526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.158982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.206770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:31.208118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:31.216908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.225509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.227079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.229675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.231026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.231895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.978762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:32.991944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4fab41d8-9824-4a02-b78a-bea9e2a0b8d5 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 1.787575 Oct 31 15:34:32.992583 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2198/4291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:31 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:33.058110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:33.059129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:33.073566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.074071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.074517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.075248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.101080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.101524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.327459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.347289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da73dfe4-cb46-4817-b693-3b7ce3516602 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1506 microversion: 2.1 time: 2.222896 Oct 31 15:34:33.350552 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2094/4292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:31 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1506 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:33.363368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-175c98e1-c5fe-4b1f-b6e6-9a3fac17eeec req-70fd2fb3-e7fd-49da-b4df-143d1739b166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dac6d21-02b7-452e-b43a-2bd0df50bd33", "tag": "95f62970-c242-4cb2-a6fd-907d92c60a36"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:33.409232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-175c98e1-c5fe-4b1f-b6e6-9a3fac17eeec req-70fd2fb3-e7fd-49da-b4df-143d1739b166 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.409722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-175c98e1-c5fe-4b1f-b6e6-9a3fac17eeec req-70fd2fb3-e7fd-49da-b4df-143d1739b166 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.410369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-175c98e1-c5fe-4b1f-b6e6-9a3fac17eeec req-70fd2fb3-e7fd-49da-b4df-143d1739b166 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.428226 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-175c98e1-c5fe-4b1f-b6e6-9a3fac17eeec req-70fd2fb3-e7fd-49da-b4df-143d1739b166 service nova] Creating event network-changed:95f62970-c242-4cb2-a6fd-907d92c60a36 for instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 on n-h2-858383-17 Oct 31 15:34:33.442389 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-175c98e1-c5fe-4b1f-b6e6-9a3fac17eeec req-70fd2fb3-e7fd-49da-b4df-143d1739b166 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089232 Oct 31 15:34:33.443003 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2095/4293] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:33.818331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-226378211", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:33.924922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.943905 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2d98462-bcec-45e8-885f-d3d0e32a39be tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.927198 Oct 31 15:34:33.944795 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2199/4294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:32 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:33.951600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:33.967723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:33.980613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:33.981605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:33.982541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:33.983791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:33.983995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.984525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.985190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.985649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:33.986459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.987430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.988190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.008910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.009414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.009863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.011463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.011463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.011463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.061051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Getting quotas for project 172b81adfe32419db747de919d03fb0e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:34.077195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Getting quotas for user 740876c7d35b4fab9d042126285a8b9c and project 172b81adfe32419db747de919d03fb0e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:34.109518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:34.121010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:34.276336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6cc73b4d-326b-4259-b861-69109a316d64 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.821583 Oct 31 15:34:34.277295 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2096/4295] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:34:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:34:34.289452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:34.290236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:34.299268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.299631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.300279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.302872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.303800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.304757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.646797 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:34:34.647733 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 15:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 (ip 10.222.0.48) !!! Oct 31 15:34:35.147677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.160900 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1036cfe-9544-4d0f-baeb-95d7986d5bc0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1506 microversion: 2.1 time: 1.213486 Oct 31 15:34:35.161967 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2200/4296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:33 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1506 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.168154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bab5a396-d57e-4ea6-acf0-f696b548e840 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:35.169367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bab5a396-d57e-4ea6-acf0-f696b548e840 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.215229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.225018 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02a06580-4fb8-4672-8edb-3f16af261a33 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 0.945748 Oct 31 15:34:35.237899 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2097/4297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:34 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.244081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:35.244962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.258382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.269203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.270189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.271250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.271890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.272524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.319924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bab5a396-d57e-4ea6-acf0-f696b548e840 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.344924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bab5a396-d57e-4ea6-acf0-f696b548e840 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.347563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bab5a396-d57e-4ea6-acf0-f696b548e840 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.349648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bab5a396-d57e-4ea6-acf0-f696b548e840 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1277 microversion: 2.57 time: 0.186428 Oct 31 15:34:35.368906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2201/4298] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:35 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:35.397653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:35.406366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.422047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.428959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.432306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.436210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.439725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.440666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.567338 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47a99d7b-d5e3-49f0-b783-63c407f102f0 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "PUT /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1082 microversion: 2.1 time: 0.194017 Oct 31 15:34:35.569096 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2202/4299] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:34:35 2022] PUT /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1082 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.605747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:35.607470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.622496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.624602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.625366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.626336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.626978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.627589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.665758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.677067 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-769bb8dc-4040-4db0-8918-f5a917785791 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.434467 Oct 31 15:34:35.679541 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2098/4300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:35 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.913408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.924862 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d6a2509-4646-4387-bfbb-602d2ec2ae04 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1508 microversion: 2.1 time: 0.335450 Oct 31 15:34:35.925809 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2203/4301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:35 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.950681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:35.951944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.959644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.960222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.960853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.961805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.962545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.963052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.262128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:36.264203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:36.275054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.275822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.278936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.280095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.281400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.289378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.365086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:36.378413 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b93f3220-aa9b-49c9-8a0f-702f39f5314e tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1508 microversion: 2.1 time: 0.430297 Oct 31 15:34:36.380045 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2099/4302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:35 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:36.389305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:36.395456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:36.417723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.418397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.421163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.423515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.424937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.425924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.711917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:36.742644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:36.747256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:36.754919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ca6cbb05-2c5a-4e42-970b-2f552da11dde tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1337 microversion: 2.57 time: 0.369868 Oct 31 15:34:36.759770 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2100/4303] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:36 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1337 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:36.768942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:36.772229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:36.787683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:36.805996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e734674-013d-4166-98c7-60874b014273 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 0.547533 Oct 31 15:34:36.807697 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2204/4304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:36 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:36.817286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.825167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:36.826313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.827136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.827431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:36.827902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.828379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.838237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.847832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.849554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.850589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.853371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.854868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.855423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.896749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:36.914865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:37.055588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:37.100989 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b56e05e7-a3ff-43f8-aedb-ff821cfd0649 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 204 len: 0 microversion: 2.1 time: 0.339503 Oct 31 15:34:37.107858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2101/4305] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:36 2022] DELETE /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:37.114876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.124106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7d8aa38-8736-4284-978c-a514dec673e6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.315076 Oct 31 15:34:37.126959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.128411 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2205/4306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:36 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:37.130435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.141866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.142361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.142802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.143511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.144047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.144485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.179843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:37.230916 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Instance is already in deleting state, ignoring this request Oct 31 15:34:37.231718 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c93ab6c5-e165-4c25-ae88-676372e5c92b tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 204 len: 0 microversion: 2.1 time: 0.122365 Oct 31 15:34:37.235687 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2102/4307] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:37 2022] DELETE /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:37.241757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.242537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.249338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.249522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.249968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.250684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.251147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.251764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.429648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.440550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ddd3af7-9016-4ebb-bad1-2995c995012c tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1514 microversion: 2.1 time: 0.203663 Oct 31 15:34:37.448593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2017740519", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:37.453756 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2103/4308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:37.530891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:37.532726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:37.533384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:37.533991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:37.534590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:37.556055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.557111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.557813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.558794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.560019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.560631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.592401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Getting quotas for project 780d6df74f6148a0a650bfb87f1812c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:37.602866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Getting quotas for user 9a874c6d8fbc42118ffcd61582f2b7e7 and project 780d6df74f6148a0a650bfb87f1812c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:37.623643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:37.627298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:37.713204 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9474c07d-584c-4091-9bbb-0b56cdc8542e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.579409 Oct 31 15:34:37.714673 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2206/4309] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:34:37.726755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6c9c965-f490-40ed-a3c2-f94887f758d0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.727646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6c9c965-f490-40ed-a3c2-f94887f758d0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.799576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.800678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.821483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.822878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.824553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.825879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.827597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.828725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.871710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6c9c965-f490-40ed-a3c2-f94887f758d0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.894979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6c9c965-f490-40ed-a3c2-f94887f758d0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.899210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6c9c965-f490-40ed-a3c2-f94887f758d0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.903869 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6c9c965-f490-40ed-a3c2-f94887f758d0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1278 microversion: 2.54 time: 0.179897 Oct 31 15:34:37.906650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2104/4310] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:37.922902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.924414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.942413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.944490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.945974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.948530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.950263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.953512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.096403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.147754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.153622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.158281 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23d216ae-75e0-4fa4-bf85-59f99f1be78e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1335 microversion: 2.57 time: 0.363492 Oct 31 15:34:38.172732 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2207/4311] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1335 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:38.188973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:38.192164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:38.209500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.212632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.217097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.221340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.224185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.224761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.316862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.335356 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-969ad5f6-202e-47d6-91ce-0132f896ed06 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 0.421612 Oct 31 15:34:38.340218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2105/4312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:38.463559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.474428 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc80fa9d-2536-4821-85ce-6f2009b847c6 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.314485 Oct 31 15:34:38.483189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2208/4313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:38 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:38.492762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:38.493535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:38.505203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.505729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.507761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.508837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.509650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.510101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.690351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.700381 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ffcc1a89-5efe-4ba9-99d7-03eb999f85a8 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1514 microversion: 2.1 time: 0.220510 Oct 31 15:34:38.701119 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2106/4314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:38 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:38.939882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:38.942596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:38.950511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.951292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.952716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.955089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.955894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.956591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.205033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:39.205710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:39.221628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.224724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.226605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.228724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.229459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.236563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.652126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.665139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.668079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.669613 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3105a6eb-fcbf-415a-bb35-b2247309b64d tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1282 microversion: 2.54 time: 0.737609 Oct 31 15:34:39.675883 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2209/4315] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:38 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1282 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:39.716420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.721213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.722832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.724131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5aae3140-09c1-4764-ba84-07184bbaf2f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1335 microversion: 2.57 time: 0.525629 Oct 31 15:34:39.737757 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2107/4316] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:39 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1335 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:39.749650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:39.750303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:39.757792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.758512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.759141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.760008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.760623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.761120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1071907635", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:39.761297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.829630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] validate_networks() for [('12bd35e8-2dc1-4927-aa68-3c6ddba518d5', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:40.030323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.042130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75d27f16-f5b7-466c-a00e-5e3104974afd tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 0.303108 Oct 31 15:34:40.045371 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2108/4317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:39 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:40.050103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-73d70ea1-8d24-4c94-891b-0de994586ddd req-b3d110fe-128f-47d5-bf3d-ed016257344d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dac6d21-02b7-452e-b43a-2bd0df50bd33", "name": "network-vif-plugged", "status": "completed", "tag": "95f62970-c242-4cb2-a6fd-907d92c60a36"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:40.060482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-73d70ea1-8d24-4c94-891b-0de994586ddd req-b3d110fe-128f-47d5-bf3d-ed016257344d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.061240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-73d70ea1-8d24-4c94-891b-0de994586ddd req-b3d110fe-128f-47d5-bf3d-ed016257344d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.061859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-73d70ea1-8d24-4c94-891b-0de994586ddd req-b3d110fe-128f-47d5-bf3d-ed016257344d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.074555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-73d70ea1-8d24-4c94-891b-0de994586ddd req-b3d110fe-128f-47d5-bf3d-ed016257344d service nova] Creating event network-vif-plugged:95f62970-c242-4cb2-a6fd-907d92c60a36 for instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 on n-h2-858383-17 Oct 31 15:34:40.080164 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-73d70ea1-8d24-4c94-891b-0de994586ddd req-b3d110fe-128f-47d5-bf3d-ed016257344d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033413 Oct 31 15:34:40.081082 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2109/4318] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:40.086654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:40.087521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:40.094377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.094908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.095352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.096090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.096761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.097232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.545286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.557747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b098a7be-11b1-4cd8-b943-199fb7cd9957 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.475576 Oct 31 15:34:40.559843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2110/4319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:40.568152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:40.569107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:40.590834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.593420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.594264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.595346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.600060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.600748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.649586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.650472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.651087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.652119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lazy-loading 'fault' on Instance uuid 981fb01c-6a7d-4bf7-b5de-e7569109a87b {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:40.757983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56792ab8451481f82bb4d87b29ff9df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45f6b73c45784731bdf32b36378474de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.768888 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-88fbb17e-07d8-4de9-948c-aacc274dc7eb tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 200 len: 1308 microversion: 2.1 time: 0.205721 Oct 31 15:34:40.774938 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2111/4320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:40.780994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-83c0578c-9ef3-4d97-b54f-92bf749f68c9 req-2523c3b9-a365-43c0-9b14-3db522f9a510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981fb01c-6a7d-4bf7-b5de-e7569109a87b", "name": "network-vif-deleted", "tag": "b779f73c-62ce-4339-a939-3f78dd62b7fd"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:40.804279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:40.805087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:40.806260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:40.806676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:40.808149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-83c0578c-9ef3-4d97-b54f-92bf749f68c9 req-2523c3b9-a365-43c0-9b14-3db522f9a510 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.809429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:40.811020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-83c0578c-9ef3-4d97-b54f-92bf749f68c9 req-2523c3b9-a365-43c0-9b14-3db522f9a510 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.811714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-83c0578c-9ef3-4d97-b54f-92bf749f68c9 req-2523c3b9-a365-43c0-9b14-3db522f9a510 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.829323 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-83c0578c-9ef3-4d97-b54f-92bf749f68c9 req-2523c3b9-a365-43c0-9b14-3db522f9a510 service nova] Creating event network-vif-deleted:b779f73c-62ce-4339-a939-3f78dd62b7fd for instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b on n-h2-858383-17 Oct 31 15:34:40.836523 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-83c0578c-9ef3-4d97-b54f-92bf749f68c9 req-2523c3b9-a365-43c0-9b14-3db522f9a510 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059685 Oct 31 15:34:40.837580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2112/4321] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:40.845914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:40.852430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.855759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.856427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.857418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.859414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:40.860430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.861140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.873196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.876596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.877371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.878380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.879042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.879631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.915713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for project ca2dcd238bdf4ac994999771f8478dff. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:40.922694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for user 3b26002fe48044e7bc31993c6698a22e and project ca2dcd238bdf4ac994999771f8478dff. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:40.938399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:40.940739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:40.973163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.983251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.984591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.985832 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57e92c81-73ac-4b4b-b367-f21fa9c73118 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1336 microversion: 2.54 time: 0.147011 Oct 31 15:34:40.986397 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2113/4322] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1336 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:41.005885 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41e19eca-d5ba-4010-a28f-bd1b4d367e93 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.328420 Oct 31 15:34:41.006561 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2210/4323] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:34:41.013381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.014057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.020651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74253cda-743d-4adc-9cc6-0e5db3166a3b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.021850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.021850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.022227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.022795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74253cda-743d-4adc-9cc6-0e5db3166a3b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.022981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.023397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.023827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.117824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74253cda-743d-4adc-9cc6-0e5db3166a3b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.118001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.126993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.128606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.130514 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dadb7d8e-897f-4856-8582-0f0781ba212f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1356 microversion: 2.57 time: 0.120920 Oct 31 15:34:41.131231 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2114/4324] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1356 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:41.133926 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74253cda-743d-4adc-9cc6-0e5db3166a3b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1222 microversion: 2.1 time: 0.117941 Oct 31 15:34:41.134786 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2211/4325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:41.156272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.158304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.166686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.167394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.167804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:41.168029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.168881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.169469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.170001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.177559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.193841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.194310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.194763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.195484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.195956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.196385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.307581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:41.308002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:41.308480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:41.308915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:41.309484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:41.367721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.377562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75f0d036-89a0-4f58-96da-92f90e458627 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1315 microversion: 2.1 time: 0.231511 Oct 31 15:34:41.378789 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2115/4326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:41.384199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-666776342", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:41.407683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.415517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.416325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.417107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.418171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.418781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.419358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.452485 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9fbd5f44-e715-4551-839a-f69b50a2c5e3 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "POST /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb/action" status: 202 len: 1137 microversion: 2.57 time: 0.296350 Oct 31 15:34:41.453901 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2212/4327] 10.222.0.48 () {62 vars in 1320 bytes} [Mon Oct 31 15:34:41 2022] POST /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb/action => generated 1137 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 31 15:34:41.477534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.478380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.485346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.485842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.486453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.487329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.488129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.488733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.701275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] validate_networks() for [('12bd35e8-2dc1-4927-aa68-3c6ddba518d5', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:41.788617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.798209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.801126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.802798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-956abc34-1c13-4ddb-ba27-b614b59c9279 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.330842 Oct 31 15:34:41.803679 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2213/4328] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:41.808864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.810532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.824274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.824810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.826851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.828958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.829644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.831233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.065075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.081723 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d080eab-02f8-461f-951a-5785c9bf690e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.276797 Oct 31 15:34:42.083181 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2214/4329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:42.101786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.102406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 981fb01c-6a7d-4bf7-b5de-e7569109a87b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.116289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.120570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.124536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.125548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.126218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.126916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.153598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] HTTP exception thrown: Instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b could not be found. Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Request method failure captured: Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b HTTP/1.1 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pTbAaGZQIQNnje9B-crRpHbmaE140LPP4O7NyVZ1RbcGhRiKlOjVSLIlagbic7uXj81tIX549bJ1rp0Wu--5FJfdGLzLnZMG86A2HBznB0weJHuTlTNO8VlkWrzPqfRJ7VNKuly8HehZtX20Vlw-yPKNRg9tHQajnGmSfGZmacE6Y Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/45f6b73c45784731bdf32b36378474de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_45f6b73c45784731bdf32b36378474de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d56792ab8451481f82bb4d87b29ff9df Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b could not be found. Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '981fb01c-6a7d-4bf7-b5de-e7569109a87b'} Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b could not be found. Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b could not be found. Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.170673 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b could not be found. Oct 31 15:34:42.174481 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.177134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Returning 404 to user: Instance 981fb01c-6a7d-4bf7-b5de-e7569109a87b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:42.178251 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5232d0ee-825a-48bc-8ef5-dbe3ce305174 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b" status: 404 len: 111 microversion: 2.1 time: 0.093879 Oct 31 15:34:42.179210 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2215/4330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/981fb01c-6a7d-4bf7-b5de-e7569109a87b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:42.185158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.189522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.202924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.203837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.208547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.209755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.210472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.211120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.327431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.352233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.354766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.356364 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db998bdd-7143-4877-92e8-88e8928d9f8c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1336 microversion: 2.54 time: 0.175345 Oct 31 15:34:42.362602 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2216/4331] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1336 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:42.368143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.373111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.382634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.383142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.383584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.384345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.387030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.387496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.407991 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] HTTP exception thrown: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Request method failure captured: Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 HTTP/1.1 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pTbAaGZQIQNnje9B-crRpHbmaE140LPP4O7NyVZ1RbcGhRiKlOjVSLIlagbic7uXj81tIX549bJ1rp0Wu--5FJfdGLzLnZMG86A2HBznB0weJHuTlTNO8VlkWrzPqfRJ7VNKuly8HehZtX20Vlw-yPKNRg9tHQajnGmSfGZmacE6Y Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/45f6b73c45784731bdf32b36378474de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_45f6b73c45784731bdf32b36378474de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d56792ab8451481f82bb4d87b29ff9df Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e78e2e5f-8adc-444d-94e2-5618e5ebdf76'} Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:42.409670 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Returning 404 to user: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0745adf-f3b6-4ed6-acb3-78ea93933b73 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 404 len: 111 microversion: 2.1 time: 0.047512 Oct 31 15:34:42.414347 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2217/4332] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:42 2022] DELETE /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:42.417744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.418378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.424572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.425097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.425537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.426784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.427594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.428117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.434087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:42.435283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:42.436127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:42.437170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:42.438209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:42.457336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.458289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.458730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.459610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.460066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.460660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.485273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for project ca2dcd238bdf4ac994999771f8478dff. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:42.492053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for user 3b26002fe48044e7bc31993c6698a22e and project ca2dcd238bdf4ac994999771f8478dff. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:42.506149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:42.508507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:42.563481 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7114d15-4969-4d56-84ee-dee5f2bdce61 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.183189 Oct 31 15:34:42.571667 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2116/4333] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:34:42.575250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.576115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.576848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: e78e2e5f-8adc-444d-94e2-5618e5ebdf76] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.585043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.585533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.585969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.586777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.587537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.587718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.601839 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30077a91-8677-4a3b-9b1b-5351f1b56ff4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1502 microversion: 2.1 time: 0.185153 Oct 31 15:34:42.603812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2218/4334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:42.610640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-daa2e068-62c5-4c16-8cd8-dff5358de2d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.611552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-daa2e068-62c5-4c16-8cd8-dff5358de2d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.617454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] HTTP exception thrown: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Request method failure captured: Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 HTTP/1.1 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-pTbAaGZQIQNnje9B-crRpHbmaE140LPP4O7NyVZ1RbcGhRiKlOjVSLIlagbic7uXj81tIX549bJ1rp0Wu--5FJfdGLzLnZMG86A2HBznB0weJHuTlTNO8VlkWrzPqfRJ7VNKuly8HehZtX20Vlw-yPKNRg9tHQajnGmSfGZmacE6Y Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/45f6b73c45784731bdf32b36378474de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_45f6b73c45784731bdf32b36378474de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: d56792ab8451481f82bb4d87b29ff9df Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e78e2e5f-8adc-444d-94e2-5618e5ebdf76'} Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.623288 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Returning 404 to user: Instance e78e2e5f-8adc-444d-94e2-5618e5ebdf76 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:42.626734 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-decc9c53-bb8f-4e56-a1d0-4b1d3a446cc5 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76" status: 404 len: 111 microversion: 2.1 time: 0.059264 Oct 31 15:34:42.627243 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2117/4335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/e78e2e5f-8adc-444d-94e2-5618e5ebdf76 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:42.637209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:42.637766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.645217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.645720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.646166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.647271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.648001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.648456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.695888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-daa2e068-62c5-4c16-8cd8-dff5358de2d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.705108 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-daa2e068-62c5-4c16-8cd8-dff5358de2d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1221 microversion: 2.1 time: 0.098870 Oct 31 15:34:42.707740 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2219/4336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:42.715020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.722126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.729510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.730171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.730917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.731983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.734039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.734616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.753349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] HTTP exception thrown: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Request method failure captured: Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c HTTP/1.1 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pTbAaGZQIQNnje9B-crRpHbmaE140LPP4O7NyVZ1RbcGhRiKlOjVSLIlagbic7uXj81tIX549bJ1rp0Wu--5FJfdGLzLnZMG86A2HBznB0weJHuTlTNO8VlkWrzPqfRJ7VNKuly8HehZtX20Vlw-yPKNRg9tHQajnGmSfGZmacE6Y Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/45f6b73c45784731bdf32b36378474de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_45f6b73c45784731bdf32b36378474de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d56792ab8451481f82bb4d87b29ff9df Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c'} Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:42.755493 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.759775 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.760373 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c65831e-e5ae-4c20-abc2-e0d8c6a164ef tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33/action" status: 202 len: 0 microversion: 2.1 time: 0.128747 Oct 31 15:34:42.760373 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2118/4337] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:42 2022] POST /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:42.760941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Returning 404 to user: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:42.762584 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5f1c41f-51e1-4aa9-a742-51cb1120224a tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 404 len: 111 microversion: 2.1 time: 0.053071 Oct 31 15:34:42.766447 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2220/4338] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:42 2022] DELETE /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:42.773923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.775148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] [instance: 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.776335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.778377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.790589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:42.794545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.795414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.795766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.796428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.797494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.798013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.799229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.799945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.801306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.801505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.802071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.802571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.841307 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] HTTP exception thrown: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.842755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Request method failure captured: Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c HTTP/1.1 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-pTbAaGZQIQNnje9B-crRpHbmaE140LPP4O7NyVZ1RbcGhRiKlOjVSLIlagbic7uXj81tIX549bJ1rp0Wu--5FJfdGLzLnZMG86A2HBznB0weJHuTlTNO8VlkWrzPqfRJ7VNKuly8HehZtX20Vlw-yPKNRg9tHQajnGmSfGZmacE6Y Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/45f6b73c45784731bdf32b36378474de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_45f6b73c45784731bdf32b36378474de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/45f6b73c45784731bdf32b36378474de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 45f6b73c45784731bdf32b36378474de Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1681393298 Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d56792ab8451481f82bb4d87b29ff9df Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiskConfigTestJSON-1681393298-project Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c'} Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:42.853382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. Oct 31 15:34:42.858370 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:34:42.861081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] Returning 404 to user: Instance 2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:42.862182 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35b5e5e3-51e2-4ca2-8cbe-d58e478ad786 tempest-ServerDiskConfigTestJSON-1681393298 tempest-ServerDiskConfigTestJSON-1681393298-project] 10.222.0.48 "GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c" status: 404 len: 111 microversion: 2.1 time: 0.094607 Oct 31 15:34:42.865595 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2221/4339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/2e8d6a83-6a1a-4b32-8bd4-e03bfc64a42c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:42.892402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.893020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.907077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.907544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.912715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.915803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.917448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.917448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.110390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.124174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.129755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.132970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94b2c81f-d9fb-4507-b168-2174381ed363 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.263909 Oct 31 15:34:43.134870 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2222/4340] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:43.156277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:43.157444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:43.179009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.179584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.180040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.180808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.181282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.181712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.568588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.578251 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8ba4b73-c88b-4355-ba9a-4cc231473b80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1507 microversion: 2.1 time: 0.813025 Oct 31 15:34:43.583855 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2119/4341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1507 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:43.588726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:43.589365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:43.605951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.606709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.607333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.608224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.608935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.609558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.712559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.719952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.727154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.728894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.731050 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3845ce41-1b97-4413-b375-62c509c9f405 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1336 microversion: 2.54 time: 0.145919 Oct 31 15:34:43.731813 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2120/4342] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:43 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:43.736718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:43.738788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:43.744579 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91b50d19-9616-43a0-9742-a3ca8b7174e3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.607509 Oct 31 15:34:43.747455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.748715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.749343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.751416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.752039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.752625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.754920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2223/4343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:43 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:43.852991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.861084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2b2bdc39-3c66-41e8-a272-136388acdffd req-b6a05d82-f3b1-4e97-b0df-1cd4bfcfe0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82", "name": "network-vif-plugged", "status": "completed", "tag": "766be369-b20c-4cee-b5a8-6f76eb40471a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:43.882943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2b2bdc39-3c66-41e8-a272-136388acdffd req-b6a05d82-f3b1-4e97-b0df-1cd4bfcfe0ba service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.883658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2b2bdc39-3c66-41e8-a272-136388acdffd req-b6a05d82-f3b1-4e97-b0df-1cd4bfcfe0ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.887589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2b2bdc39-3c66-41e8-a272-136388acdffd req-b6a05d82-f3b1-4e97-b0df-1cd4bfcfe0ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.932290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2b2bdc39-3c66-41e8-a272-136388acdffd req-b6a05d82-f3b1-4e97-b0df-1cd4bfcfe0ba service nova] Creating event network-vif-plugged:766be369-b20c-4cee-b5a8-6f76eb40471a for instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 on n-h1-858383-17 Oct 31 15:34:43.939193 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32275154-144f-4e2d-ae2f-ebd3b7afff42 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1217 microversion: 2.1 time: 0.205853 Oct 31 15:34:43.953023 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2b2bdc39-3c66-41e8-a272-136388acdffd req-b6a05d82-f3b1-4e97-b0df-1cd4bfcfe0ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087301 Oct 31 15:34:43.953023 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2224/4344] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:43.957667 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2121/4345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:43 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:44.164407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:44.165293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:44.180471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.181009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.181450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.182174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.182634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.183065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.354822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:44.370107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:44.372097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:44.375235 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2c7c22e-6a93-4a91-8305-ecbc174c043c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.216377 Oct 31 15:34:44.377070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2225/4346] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:44 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:44.610146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:44.611026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:44.632365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.632910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.633373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.634110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.634575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.635095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.761539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:44.762596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:44.772050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.776216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.779078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.780043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.780846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.781600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.071404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.073803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:45.093260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.097273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.100758 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccc15d5d-9407-425c-a914-f39717e34373 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1336 microversion: 2.54 time: 0.343293 Oct 31 15:34:45.106008 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2226/4347] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:44 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1336 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:45.117027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.117968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.130597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.133338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.136772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.137439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.137914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.138377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.174100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.195457 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcd179e2-6ddb-4cb3-a988-15ffa8913c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1487 microversion: 2.1 time: 0.587551 Oct 31 15:34:45.204946 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2122/4348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:44 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1487 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:45.218482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.219485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.223687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:45.228326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.230195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.230856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.231870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.233230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.233925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.412473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.425126 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2709fa8-befe-4bab-98ef-fa571f44ff4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1273 microversion: 2.1 time: 0.218533 Oct 31 15:34:45.426366 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2123/4349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:45.450319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:45.453599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.474550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.481285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.482702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.483853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.485789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.489167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.529158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lazy-loading 'flavor' on Instance uuid 2dac6d21-02b7-452e-b43a-2bd0df50bd33 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:45.538163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.547557 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f96e6d3d-9a57-463c-a8d0-f9c6b21174f0 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1371 microversion: 2.1 time: 0.440136 Oct 31 15:34:45.548160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2227/4350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:45.556674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.560142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.580590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.581136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.581582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.584181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.584917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.585512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.694674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.708508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.710064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.711475 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0911fa4f-fd9b-4568-8ae3-c66e2456f91b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.162363 Oct 31 15:34:45.712429 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2228/4351] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:45.826222 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6399d22b-f251-4147-a5ba-5d4b2e035bc3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33/action" status: 202 len: 0 microversion: 2.1 time: 0.396653 Oct 31 15:34:45.826853 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2124/4352] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:45 2022] POST /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:45.839727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.843750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.855188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.857093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.858870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.861268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.864816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.865473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.137878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.138970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.147563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.148419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.149094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.150014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.150692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.151321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.295103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.304201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.305698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.306894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9b75780-b8e6-41f3-ab93-50442cb9dccb tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1357 microversion: 2.54 time: 0.174582 Oct 31 15:34:46.308104 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2125/4353] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:46.323296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.336196 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34682239-17ea-44db-9644-04449daa4198 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1493 microversion: 2.1 time: 0.504519 Oct 31 15:34:46.356721 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2229/4354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1493 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:46.357461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17497a0c-99b1-4ef2-84ca-d2222374215a tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Action: 'create', calling method: .version_select at 0x7f5ca1179c10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-81501405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeIdE73YyRFOSOvBtvW8TQZLXKX2hukHROqg8YxPbzjpv6Bh2p1xaX9/+TfRD0jU1angQ6Q8Rpm6kij+Y5EH4t4OjFBwpmXPjU9i5vfECfUAH45qjEYHZr3mU3jt7Ycag=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:46.375884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-17497a0c-99b1-4ef2-84ca-d2222374215a tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Getting quotas for project 780d6df74f6148a0a650bfb87f1812c3. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:46.382571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-17497a0c-99b1-4ef2-84ca-d2222374215a tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Getting quotas for user 9a874c6d8fbc42118ffcd61582f2b7e7 and project 780d6df74f6148a0a650bfb87f1812c3. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:46.429777 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17497a0c-99b1-4ef2-84ca-d2222374215a tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.090463 Oct 31 15:34:46.430685 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2126/4355] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Oct 31 15:34:46 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:34:46.445450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-81501405", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:46.448768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.449715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.450512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.462537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.463290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.465030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.466901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.467498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.471606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.471771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.472462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.472838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.472955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.473360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.473766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.651497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.676436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-86d91f8c-1b10-4bc9-89a9-d2cb4d57dd5d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1273 microversion: 2.1 time: 0.228472 Oct 31 15:34:46.680770 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2127/4356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:46.690554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.694218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.702047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.702838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.703462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:46.703844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.703969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:46.704401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:46.704845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:46.705263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:46.705586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.706220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.707011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.836326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.843170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.843677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.844379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.845119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.845631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.846245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.878105 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09c7b45f-281d-4ad2-96fe-7ae6b043e4a3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "POST /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694/action" status: 202 len: 1138 microversion: 2.54 time: 0.439760 Oct 31 15:34:46.879440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2230/4357] 10.222.0.48 () {62 vars in 1320 bytes} [Mon Oct 31 15:34:46 2022] POST /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694/action => generated 1138 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:34:46.891629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.892266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.900943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.901440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.901878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.902625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.903162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.903596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.197632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.207578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.223387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.224865 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8550a068-a483-4e72-ab75-486e5950f869 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.343503 Oct 31 15:34:47.238647 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2231/4358] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:47.250389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.251008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.258055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.258771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.259250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.260222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.261005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.261592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.423435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.432716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.434491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.435703 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99e20248-dbc1-43d0-8ff1-28ad738f2153 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.196007 Oct 31 15:34:47.448776 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2232/4359] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:47.448776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.448776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.449419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.450163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.450810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.451715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.452375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.453117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.597492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.606157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c62d839b-4f95-4843-a41d-dd128ee6351e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1557 microversion: 2.1 time: 0.923690 Oct 31 15:34:47.607564 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2128/4360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1557 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:47.632497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.633224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.641788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.642667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.643259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.644258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.644912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.645481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.919540 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79988efa-3c53-4c1f-850e-8ba58d98c710 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.292668 Oct 31 15:34:47.930251 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2129/4361] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:34:47.934990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.935638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.973813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.975124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.975598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.977814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.978932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.980195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.040253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.057220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9335a38-58d6-48a3-a686-009892e1ded0 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1514 microversion: 2.1 time: 0.619199 Oct 31 15:34:48.057819 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2233/4362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1514 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:48.073937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6a04f9c6-451a-4ad3-b9c1-c3163e427f0a req-11abc542-4ad9-49b8-a6bc-06a1cc982071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb4a0f0-3b54-4012-bfde-2176e14f7711", "tag": "b147bbb4-e537-45aa-b9d9-374f2973e0fe"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:48.093382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6a04f9c6-451a-4ad3-b9c1-c3163e427f0a req-11abc542-4ad9-49b8-a6bc-06a1cc982071 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.094140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6a04f9c6-451a-4ad3-b9c1-c3163e427f0a req-11abc542-4ad9-49b8-a6bc-06a1cc982071 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.094580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6a04f9c6-451a-4ad3-b9c1-c3163e427f0a req-11abc542-4ad9-49b8-a6bc-06a1cc982071 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.110442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6a04f9c6-451a-4ad3-b9c1-c3163e427f0a req-11abc542-4ad9-49b8-a6bc-06a1cc982071 service nova] Creating event network-changed:b147bbb4-e537-45aa-b9d9-374f2973e0fe for instance efb4a0f0-3b54-4012-bfde-2176e14f7711 on n-h2-858383-17 Oct 31 15:34:48.127911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6a04f9c6-451a-4ad3-b9c1-c3163e427f0a req-11abc542-4ad9-49b8-a6bc-06a1cc982071 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068776 Oct 31 15:34:48.129871 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2234/4363] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:48.259281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.265024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.267005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.272360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ec70f32-aea7-463b-b474-d89144d8115a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1279 microversion: 2.1 time: 0.341689 Oct 31 15:34:48.273002 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2130/4364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1279 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:48.296044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.302614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.303329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.304295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.305022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.305690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.465319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.466076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.483077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.484507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.485129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.488858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.491162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.491767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.591911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.607980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.609466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.610659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8f1ad96-279e-4548-9d92-330c0c5a2f6c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.360524 Oct 31 15:34:48.616013 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2235/4365] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:48 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:48.667698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.687899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.693649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.697677 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cd1ab2d-a772-446d-b15c-336c81cc6552 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.237421 Oct 31 15:34:48.702514 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2131/4366] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:48 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:49.082510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.083389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:49.094839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.097720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.099536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.101365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.104034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.106494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.302288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.305162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:49.336782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.344371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.348871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.349985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.350687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.355478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.753578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.765952 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-abb5b514-36ac-4bcb-8214-0bf038189b79 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1279 microversion: 2.1 time: 0.471190 Oct 31 15:34:49.769002 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2132/4367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1279 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:49.788527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.789706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:49.808980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.809692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.810286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.811185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.811796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.812374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.947931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.961008 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50576f1b-87f6-40f1-9b3e-3a6f06e1767f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.882579 Oct 31 15:34:49.982237 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2236/4368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:49.995017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.997285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:50.018872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.020225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.021023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.021942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.027609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.028262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.088854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.099062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.101988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.103464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd2173cc-f020-4bac-8dbd-6d602697527a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.332523 Oct 31 15:34:50.109609 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2133/4369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:50.146445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ef039db3-d4ff-4632-9c98-2088c0160b7b req-12c40b4b-0aeb-416c-9ecb-90d82044f853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82", "tag": "766be369-b20c-4cee-b5a8-6f76eb40471a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:50.194537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ef039db3-d4ff-4632-9c98-2088c0160b7b req-12c40b4b-0aeb-416c-9ecb-90d82044f853 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.199885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ef039db3-d4ff-4632-9c98-2088c0160b7b req-12c40b4b-0aeb-416c-9ecb-90d82044f853 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.200401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ef039db3-d4ff-4632-9c98-2088c0160b7b req-12c40b4b-0aeb-416c-9ecb-90d82044f853 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.235446 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ef039db3-d4ff-4632-9c98-2088c0160b7b req-12c40b4b-0aeb-416c-9ecb-90d82044f853 service nova] Creating event network-changed:766be369-b20c-4cee-b5a8-6f76eb40471a for instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 on n-h1-858383-17 Oct 31 15:34:50.247874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ef039db3-d4ff-4632-9c98-2088c0160b7b req-12c40b4b-0aeb-416c-9ecb-90d82044f853 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136375 Oct 31 15:34:50.254318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2134/4370] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:50.292009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.313014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.323186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.324442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-598f3af5-a750-484d-9a14-d0c0294da861 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.340347 Oct 31 15:34:50.335026 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2237/4371] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:50.797049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:50.798131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:50.820413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.824448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.825524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.827259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.828060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.828814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.988203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:50.995993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:50.996879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:51.030335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:51.031614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:51.032546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:51.035298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:51.038827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:51.042981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.157948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.173126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7994442a-5685-44e5-8501-a9a2d92c1576 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 1.186500 Oct 31 15:34:52.187492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2238/4372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:50 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:52.210800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:52.211812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:52.220180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.221165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.221833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.223866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.224558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.225256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.253239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.265448 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-53df85b4-344a-4b98-8e89-e63741a9f181 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 1.474463 Oct 31 15:34:52.281877 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2135/4373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:50 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:52.294965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:52.295910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:52.306929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.307439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.307944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.309125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.309911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.310791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.348362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:52.475324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:52.483995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.499186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.512411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.515052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.528377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.529661 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26c1d72e-8016-4b3f-b769-fb26b9bbe46f tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.339875 Oct 31 15:34:52.530243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.531453 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e1540a9f-0b85-4537-b36c-5147a52ec519 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.248452 Oct 31 15:34:52.538106 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2239/4374] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:52 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:52.540905 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2136/4375] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:52 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:53.201601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.204094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.217276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:53.226934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.228922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.229699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.235533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.236534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.237280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.290099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.291893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.314562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.318252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.321781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.326608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.332783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.335399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.731132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:54.756287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45f13cab-f195-4f9d-8a51-adfc1fa6dfb9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 1.558925 Oct 31 15:34:54.765258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2240/4376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:54.777434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:54.785945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:54.802314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.807169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.808531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.810227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.810920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.811519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.967014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:54.980380 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dff43fc5-7105-4cf8-b9cc-8da24cb5c51d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 1.694098 Oct 31 15:34:54.980815 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2137/4377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:54.992796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:55.003886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:55.023322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.024060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.024649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.025631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.026236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.026809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.066843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.070436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:55.081172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.084012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.087779 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b69b4bcc-6c83-42bc-834c-1b9c44e9ef61 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.321447 Oct 31 15:34:55.093092 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2241/4378] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:54 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:55.115640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-bc3fdad6-84ec-4d83-904a-a529bde9eb24 req-8d0ffcc1-b22e-462e-8733-290eac5a5157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dac6d21-02b7-452e-b43a-2bd0df50bd33", "name": "network-vif-plugged", "status": "completed", "tag": "95f62970-c242-4cb2-a6fd-907d92c60a36"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:55.142916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc3fdad6-84ec-4d83-904a-a529bde9eb24 req-8d0ffcc1-b22e-462e-8733-290eac5a5157 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.146576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc3fdad6-84ec-4d83-904a-a529bde9eb24 req-8d0ffcc1-b22e-462e-8733-290eac5a5157 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.147473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc3fdad6-84ec-4d83-904a-a529bde9eb24 req-8d0ffcc1-b22e-462e-8733-290eac5a5157 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.197143 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-bc3fdad6-84ec-4d83-904a-a529bde9eb24 req-8d0ffcc1-b22e-462e-8733-290eac5a5157 service nova] Creating event network-vif-plugged:95f62970-c242-4cb2-a6fd-907d92c60a36 for instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 on n-h2-858383-17 Oct 31 15:34:55.203396 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-bc3fdad6-84ec-4d83-904a-a529bde9eb24 req-8d0ffcc1-b22e-462e-8733-290eac5a5157 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108561 Oct 31 15:34:55.204572 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2242/4379] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:55.213366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f299c973-7b08-4b02-a4cf-24b47d4051e6 req-536ffd19-de23-4eb4-82a9-92e5c1c2f356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66b783d-f29a-49cd-901c-f7c5682e1651", "tag": "e006f6a5-48b0-44fe-9f2b-9106e43004d1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:55.224887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f299c973-7b08-4b02-a4cf-24b47d4051e6 req-536ffd19-de23-4eb4-82a9-92e5c1c2f356 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.225733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f299c973-7b08-4b02-a4cf-24b47d4051e6 req-536ffd19-de23-4eb4-82a9-92e5c1c2f356 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.226375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f299c973-7b08-4b02-a4cf-24b47d4051e6 req-536ffd19-de23-4eb4-82a9-92e5c1c2f356 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.240350 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f299c973-7b08-4b02-a4cf-24b47d4051e6 req-536ffd19-de23-4eb4-82a9-92e5c1c2f356 service nova] Creating event network-changed:e006f6a5-48b0-44fe-9f2b-9106e43004d1 for instance a66b783d-f29a-49cd-901c-f7c5682e1651 on n-h1-858383-17 Oct 31 15:34:55.245756 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f299c973-7b08-4b02-a4cf-24b47d4051e6 req-536ffd19-de23-4eb4-82a9-92e5c1c2f356 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039556 Oct 31 15:34:55.246970 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2243/4380] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:55.276024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.293872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.295634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.304654 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d6ec7b0-e386-4b31-b500-d5a38ec1464e tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.315276 Oct 31 15:34:55.305491 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2138/4381] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:54 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:55.780757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:55.782029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:55.792894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.793737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.794193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.795066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.795896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.797041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.004239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.004914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.018473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.019551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.020424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.023211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.023704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.024146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.275153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.316913 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0acb4f7c-ef9a-4db9-8a14-fa58862192f1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.508245 Oct 31 15:34:56.317922 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2244/4382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:55 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:56.336518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.340516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.343557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.348079 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-26bb3a1a-fbdb-4cf3-8e0a-39f70eef68be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.348105 Oct 31 15:34:56.349160 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2139/4383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:55 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:56.354802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.356394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.364712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.365577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.366260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.367234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.367913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.368574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.376010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.376610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.377092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.382714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.383619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.384350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.404440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=18 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:56.467631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.493747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.496513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.498521 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7fcd0da9-eecb-48ac-992b-5822b3a234d8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.148024 Oct 31 15:34:56.512733 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2140/4384] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:56 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:56.575356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.587944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.596003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.600799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f75e437-f3eb-41be-ba28-ad14e3c1f86e tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.281454 Oct 31 15:34:56.602844 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2245/4385] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:56 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:57.226110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e57cc88c-59e1-456f-8f2e-29d3188484de req-3c000cac-fb41-42b2-ade7-6270f9cb916a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb4a0f0-3b54-4012-bfde-2176e14f7711", "name": "network-vif-plugged", "status": "completed", "tag": "b147bbb4-e537-45aa-b9d9-374f2973e0fe"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:57.246265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e57cc88c-59e1-456f-8f2e-29d3188484de req-3c000cac-fb41-42b2-ade7-6270f9cb916a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.246749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e57cc88c-59e1-456f-8f2e-29d3188484de req-3c000cac-fb41-42b2-ade7-6270f9cb916a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.247218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e57cc88c-59e1-456f-8f2e-29d3188484de req-3c000cac-fb41-42b2-ade7-6270f9cb916a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.264795 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e57cc88c-59e1-456f-8f2e-29d3188484de req-3c000cac-fb41-42b2-ade7-6270f9cb916a service nova] Creating event network-vif-plugged:b147bbb4-e537-45aa-b9d9-374f2973e0fe for instance efb4a0f0-3b54-4012-bfde-2176e14f7711 on n-h2-858383-17 Oct 31 15:34:57.275513 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e57cc88c-59e1-456f-8f2e-29d3188484de req-3c000cac-fb41-42b2-ade7-6270f9cb916a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052818 Oct 31 15:34:57.280904 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2141/4386] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:57.342628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.343257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.352439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.352977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.353417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.359357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.360078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.360681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.404400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.405422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.417072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.418243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.418900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.419868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.420548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.421216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.778506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:57.792913 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c5f21b35-3803-438b-bd8e-c9912949b3f6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.391167 Oct 31 15:34:57.795909 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2142/4387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:57.802772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:57.823327 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec387c8d-04ea-4e0e-8b45-4820d736780d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.485800 Oct 31 15:34:57.825587 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2246/4388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:57.847233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.848250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.853589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.854220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.861831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.862326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.863297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.863999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.864446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.866966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.871808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.872419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.872944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.873940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.874674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.879262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.018278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.027689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.029458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.036042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a923178-88d7-45ad-8dfc-55f93bb7e37b tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.233998 Oct 31 15:34:58.037352 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2143/4389] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:58.058848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.073636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.075220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.076486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f123978-f9ff-49da-ad99-ad0e29603d66 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.237676 Oct 31 15:34:58.077167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2247/4390] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:58.821189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:58.822515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:58.834951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.837991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.839232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.841356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.842949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.845242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.854095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:58.855447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:58.870407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.874995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.875641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.876573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.881271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.881920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.299661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.310556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-804130d7-0de4-4cd1-9263-f2df21f214ed tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.494891 Oct 31 15:34:59.314934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.324664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf79c3a6-beca-449d-b4c4-e36d13603a5d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.474650 Oct 31 15:34:59.325917 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2248/4391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:58 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:59.329297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2144/4392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:58 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:59.331963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:59.332833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:59.339353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.340333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.341101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.342020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.343297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.344273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.346087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:59.346810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:59.357780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.358277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.358720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.359794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.361442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.361882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.489280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.502023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.509351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.510939 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e2f991f-badb-4aef-85a6-73a2e654e2c6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.183678 Oct 31 15:34:59.513218 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2249/4393] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:59 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:59.551062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.564844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.576017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.578971 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f14bd471-3603-4107-a894-2667497b5d59 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.248497 Oct 31 15:34:59.581964 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2145/4394] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:59 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:00.345541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:00.347481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:00.353666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:00.354935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:00.363399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.365478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.367092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.368168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.370286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.370938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.377713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.378285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.378734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.379638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.380100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.380525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.869703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:00.878661 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d31df3c-4908-417c-a312-6081d2182d44 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.538035 Oct 31 15:35:00.882692 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2250/4395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:00 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:00.894707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:00.902118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:00.902739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:00.911857 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c59fc0b1-e8b0-4c0f-901c-2c8290c799f6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.561876 Oct 31 15:35:00.915547 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2146/4396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:00 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:00.936245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:00.943160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.943669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.944118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.945335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:00.948262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.952171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.952879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.962861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.963368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.963817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.964538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.965026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.965454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.136426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.152135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.154989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.158276 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9eb615fb-5270-463c-b060-d1ebb5f47b46 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.274534 Oct 31 15:35:01.169271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.178992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.183211 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2251/4397] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:00 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:01.189056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.190665 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1eec191d-5ffc-4b0e-9536-a5f9e157a2a7 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.274047 Oct 31 15:35:01.193449 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2147/4398] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:00 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:01.910796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:01.912765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:01.938245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:01.939293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:01.950738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.951253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.951703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.952194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.952426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.953186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.953873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.954842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.955538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.955879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.957171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.958494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.293593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.302930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df13e41c-fde4-4b53-a96f-0d5d25d203c7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.402212 Oct 31 15:35:02.310344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.318489 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2252/4399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:01 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:02.320783 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55c9bd3a-e6e8-40a8-ab5f-fbf13adcc188 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.385957 Oct 31 15:35:02.324860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:02.325838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:02.336976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.337477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2148/4400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:01 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:02.338162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.340047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.341206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.342354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:02.342581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.342975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:02.343463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.352329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.353124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.353772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.354681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.355326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.355940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.451436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.460338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.465415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.466902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.467228 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.128480 Oct 31 15:35:02.481483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2149/4401] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:02 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:02.483516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:02.490447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cab2ba3-496a-44fc-98bd-40e391a8a677 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002068 Oct 31 15:35:02.491644 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2150/4402] 10.222.0.48 () {56 vars in 886 bytes} [Mon Oct 31 15:35:02 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:35:02.494244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.496086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.497726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-280259f3-6c90-46fa-b48b-17f97c40c2b0 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.177743 Oct 31 15:35:02.509422 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2253/4403] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:02 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:03.286596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:03.289993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:03.309442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.310392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.313218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.314891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.315777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.316431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.411774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:03.421815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:03.453862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.460231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.461515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.462533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.463161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.463817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.476504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-72f70530-acc3-4318-ad26-e0677678de35 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.204401 Oct 31 15:35:03.485197 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2151/4404] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Oct 31 15:35:03 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:03.499940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:03.501085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:03.521324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.521324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.521324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.521324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.521324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.521324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.062675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.071345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-644e91a5-7c8b-48d3-b4ec-61722b184592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.728278 Oct 31 15:35:04.079423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2254/4405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:03 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:04.085508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:04.086129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:04.104748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.105296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.106008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.106776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.107246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.107856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.212725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.222954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01a60c98-509d-43ab-9618-bb9f6f137e4d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.733773 Oct 31 15:35:04.226947 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2152/4406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:03 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:04.238379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:04.238991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:04.252094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.252608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.253779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.255361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.255835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.256265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.269010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.279176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.287745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.291814 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a8611f4-5a47-44c2-ac49-d0aaa32375b0 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.211056 Oct 31 15:35:04.312236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2255/4407] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:04 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:04.317834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:04.318349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:04.324659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.325185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.325625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.326336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.326793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.327220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.367735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:04.415968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.427831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.434678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.446083 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f1e147a-30cd-4345-847a-ffbf6c0f46d4 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.218568 Oct 31 15:35:04.465350 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2153/4408] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:04 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:04.478815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b058cb60-5214-4a63-9096-df65eb8e126d req-a44bbe70-71ce-4133-8b02-0666585451d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66b783d-f29a-49cd-901c-f7c5682e1651", "name": "network-vif-plugged", "status": "completed", "tag": "e006f6a5-48b0-44fe-9f2b-9106e43004d1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:04.505206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b058cb60-5214-4a63-9096-df65eb8e126d req-a44bbe70-71ce-4133-8b02-0666585451d6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.507024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b058cb60-5214-4a63-9096-df65eb8e126d req-a44bbe70-71ce-4133-8b02-0666585451d6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.509062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b058cb60-5214-4a63-9096-df65eb8e126d req-a44bbe70-71ce-4133-8b02-0666585451d6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.513282 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0497ee6-115d-4ff9-a060-cd917bc4098e tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 204 len: 0 microversion: 2.20 time: 0.199356 Oct 31 15:35:04.516999 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2256/4409] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:35:04 2022] DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:04.523851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:04.543464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:04.559415 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b058cb60-5214-4a63-9096-df65eb8e126d req-a44bbe70-71ce-4133-8b02-0666585451d6 service nova] Creating event network-vif-plugged:e006f6a5-48b0-44fe-9f2b-9106e43004d1 for instance a66b783d-f29a-49cd-901c-f7c5682e1651 on n-h1-858383-17 Oct 31 15:35:04.571181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.571687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.572138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.572909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.573366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.573808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.577403 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b058cb60-5214-4a63-9096-df65eb8e126d req-a44bbe70-71ce-4133-8b02-0666585451d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107558 Oct 31 15:35:04.585167 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2154/4410] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:05.012486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:05.047741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:05.051659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:05.055946 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b87ccde9-9cb9-4206-8e2c-5eb6499616df tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.536851 Oct 31 15:35:05.056825 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2257/4411] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:04 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:05.105255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:05.106031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:05.114803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.115697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.116471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.117804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.118438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.121062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.200729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:05.246814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:05.247642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:05.255527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.255959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.256404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.264395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.265046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.265517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.276795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:06.187346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.210118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e848a915-9238-45c4-bd57-78bbc54a7c41 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 1.109967 Oct 31 15:35:06.213552 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2155/4412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:05 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:06.230013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:06.236934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:06.251553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.265175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.268174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.272099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.274486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.275212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.441450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.451669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70f3d5d4-8d48-4727-96d6-400e59235104 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 1.208649 Oct 31 15:35:06.464090 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2258/4413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:05 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:06.475947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:06.476578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:06.489902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.498889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.502007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.502551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.506182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.507820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.509275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.511257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.514150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.516020 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e317cbc2-e5e6-4229-b8e8-e7187fea7197 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.293315 Oct 31 15:35:06.518016 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2156/4414] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:06 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:06.550302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:06.554260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:06.570651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.576396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.577262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.578353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.578991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.580720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.701070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.710891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.713121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.714506 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12fd9c23-e28b-452f-8f30-0aa21ff0cdde tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.249123 Oct 31 15:35:06.734542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2259/4415] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:06 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:07.248048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:07.248048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:07.275483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.276144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.276598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.290620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.292035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.293287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.408813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.431013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.435853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.439173 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57425571-5d8f-4a32-abbc-b662d5ef37db tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1725 microversion: 2.20 time: 0.916989 Oct 31 15:35:07.439780 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2157/4416] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:06 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1725 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:07.479615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:07.480267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:07.489785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.490296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.490743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.492830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.493362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.493804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.681531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.702766 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e5f060b-c60b-4bc6-800e-3026130afd4f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1321 microversion: 2.1 time: 0.461011 Oct 31 15:35:07.706788 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2260/4417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:07 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:07.725058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:07.727706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:07.747649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.751527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.752782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.756392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.761804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.762604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.228050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.246426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.249885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.260587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f425c92d-2040-4cc1-8350-ed19cf8d3293 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1365 microversion: 2.57 time: 0.551499 Oct 31 15:35:08.261970 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2261/4418] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:07 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1365 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:08.266714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:08.267318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:08.288732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.289082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.289486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.290520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.290636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.291061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.356559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.366456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38bd0386-428f-4329-9273-33700e2e2e17 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.891778 Oct 31 15:35:08.372172 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2158/4419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:07 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:08.461364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.470575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.472207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.472561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:08.474126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8382856-4619-4e0c-bd29-32cf7596b131 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.210515 Oct 31 15:35:08.474126 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2262/4420] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:08 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:08.474876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:08.485568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.494081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.494661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.495278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.495720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.496152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.698717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.726048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.727972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:08.728736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:08.729853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b6ccb6f0514e0991864ec6a6417b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa76f3e952245dd89ecd0ba7ba44111', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.734773 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6b6fa79e-3538-49a5-acf0-4bb49523cda5 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 200 len: 1657 microversion: 2.20 time: 0.267619 Oct 31 15:35:08.749810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.753549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.757900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.762259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2159/4421] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:08 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 1657 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:08.766471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.775978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.777899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.290662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:09.291376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:09.292049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:09.307254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.308991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.310324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.312470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.313872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.313991 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dbe6d5d1-a3b0-4367-a481-2c25fe81384e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1515 microversion: 2.1 time: 0.585525 Oct 31 15:35:09.314874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.329438 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2263/4422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:08 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1515 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:09.340033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:09.342456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:09.351916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.352414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.352893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.353601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.354061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.354488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.412674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lazy-loading 'flavor' on Instance uuid a66b783d-f29a-49cd-901c-f7c5682e1651 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:09.567874 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ac9617d-9fb4-484b-8696-b554f160f028 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action" status: 200 len: 32 microversion: 2.1 time: 0.229303 Oct 31 15:35:09.568729 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2264/4423] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:09 2022] POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:35:09.587160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:09.588045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:09.595227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:09.610436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.611177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.613669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.615563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.617605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.618271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.884982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:09.902211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:09.907974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:09.910497 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-957dae52-6d7c-46c8-87c1-6289b42973ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1371 microversion: 2.57 time: 0.624287 Oct 31 15:35:09.913077 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2160/4424] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:09 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1371 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:09.924994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:09.930952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:09.946603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.949906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.951404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.952497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.954396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.956857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.368315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:10.378656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:10.380135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:10.404189 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2294f5ef-5d11-42f1-b693-3568e972aca2 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.489813 Oct 31 15:35:10.433283 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2161/4425] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:09 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:10.458722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:10.459351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:10.502556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.504188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.504647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.535019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.535625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.536076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.889524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:10.923262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19f136cb-9ea7-49aa-bc13-d16ab8b1aec8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 1.338958 Oct 31 15:35:10.941104 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2265/4426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:09 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:10.969792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:10.975737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:11.016871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.019708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.025656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.027745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.028538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.029903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.069533 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] HTTP exception thrown: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Request method failure captured: Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 HTTP/1.1 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-k_ZVTrXxQz0rCV_-d9Xk14Lr5dwuanE5FW_rKGEAtlba7ihkMci4COAa67MdPhZXLt0_ha7UkXO8lyzHeylQG_PUMA3wwgmNYZst5KsLD7nCJrArrU3rsiipDm0NJ8Bv2UE6RNFn35OAcO1QrNm268MvXNaQNZaEePKlNU96S6GZA Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 58b6ccb6f0514e0991864ec6a6417b45 Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a0e1b2ef-972b-42d2-a19e-052e922dd445'} Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:11.073361 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:11.079505 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:11.084336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Returning 404 to user: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:11.085851 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-933a4084-4a80-4751-87bf-25f2ba4b3dc1 tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 404 len: 111 microversion: 2.20 time: 0.143280 Oct 31 15:35:11.086711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2266/4427] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:10 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:11.098527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b7dc8392-a576-453a-9ce2-125e622ebb40 req-b3082695-368b-456a-820b-f039111a7fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e1b2ef-972b-42d2-a19e-052e922dd445", "name": "network-vif-deleted", "tag": "203d98fd-533a-40e2-b11d-54a3707d7604"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:11.115095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b7dc8392-a576-453a-9ce2-125e622ebb40 req-b3082695-368b-456a-820b-f039111a7fb2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.116134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b7dc8392-a576-453a-9ce2-125e622ebb40 req-b3082695-368b-456a-820b-f039111a7fb2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.116753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b7dc8392-a576-453a-9ce2-125e622ebb40 req-b3082695-368b-456a-820b-f039111a7fb2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.187527 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b7dc8392-a576-453a-9ce2-125e622ebb40 req-b3082695-368b-456a-820b-f039111a7fb2 service nova] Creating event network-vif-deleted:203d98fd-533a-40e2-b11d-54a3707d7604 for instance a0e1b2ef-972b-42d2-a19e-052e922dd445 on n-h1-858383-17 Oct 31 15:35:11.197431 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b7dc8392-a576-453a-9ce2-125e622ebb40 req-b3082695-368b-456a-820b-f039111a7fb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103437 Oct 31 15:35:11.198778 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2267/4428] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:11.207537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:11.209270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:11.220494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.222858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.225186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.228118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.230973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.233093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.297681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.315226 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aeb3214b-66b3-4a3c-a4f3-b8b68897df50 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.880576 Oct 31 15:35:11.319394 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2162/4429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:10 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:11.329924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da00681b-287c-426d-a605-79bffb6f08aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '.version_select at 0x7f5ca1130430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:11.374806 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da00681b-287c-426d-a605-79bffb6f08aa tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813753198" status: 204 len: 0 microversion: 2.20 time: 0.053644 Oct 31 15:35:11.378409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2163/4430] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Oct 31 15:35:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813753198 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:11.474724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.478615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:11.479486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:11.523286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.523286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.523715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.523715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.523867 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eeab742f-79b8-48f7-b0cc-75c45a33ca30 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1371 microversion: 2.57 time: 0.287512 Oct 31 15:35:11.523946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.523946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.523946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.523946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.524199 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2268/4431] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:11 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:11.889761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.909497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.911237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.912506 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa2fa385-2581-49bc-964d-e9cf4e79b4ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.474828 Oct 31 15:35:11.913910 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2164/4432] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:11 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:11.973127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:11.977681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:11.997629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.997629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.998115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.999157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.000442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.000982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.346347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:12.346821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:12.386048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.386552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.397059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.397870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.398366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.398838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.415620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:12.428918 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-042d3e02-eff5-42f1-b0ee-e06b2a49718c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.478202 Oct 31 15:35:12.430005 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2269/4433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:11 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:12.542180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:12.542796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:12.557470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.560551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.561267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.564503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.566526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.568360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.783648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:12.797982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:12.802299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:12.806798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f5be302-8ee5-4dba-9f26-3847167755ad tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1356 microversion: 2.57 time: 0.267996 Oct 31 15:35:12.823744 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2270/4434] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:12 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1356 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:12.842042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:12.842512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:12.850989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.851455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.851887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.852588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.853147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.853580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.896145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:12.989959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.008669 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1fb1945d-382d-4bde-8a0a-d2f172653607 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.670444 Oct 31 15:35:13.017075 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2165/4435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:12 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:13.041383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:13.042294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:13.054402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.055429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.056063 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-489c6a8e-57ab-4757-9836-78347138938b tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 204 len: 0 microversion: 2.57 time: 0.217646 Oct 31 15:35:13.056647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.056775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2271/4436] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:35:12 2022] DELETE /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:35:13.057882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.058573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.059216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.071069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:13.071829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:13.081401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.081902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.082346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.083057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.083516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.083943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.102787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:13.227187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.238968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.241875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.241994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.243462 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a1d9941-4644-45c0-a414-07dd20b01f7c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.206281 Oct 31 15:35:13.257074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.263649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.265218 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6734072-40ef-47c3-9c42-5ad743b3f77c tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1362 microversion: 2.57 time: 0.202781 Oct 31 15:35:13.267037 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2166/4437] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:13 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:13.269561 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2272/4438] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:13 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:13.457758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:13.458371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:13.465164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.465906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.466539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.467442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.468091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.469122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.043119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.044117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.052758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.054137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.055071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.056444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.057765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.058418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.228949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.247433 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e6bdcb1-e8b4-4f5c-87ad-c45c268b5dd8 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.794069 Oct 31 15:35:14.248735 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2167/4439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:13 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:14.278709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.282243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.286723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:14.300517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.300517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.300517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.305891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.306608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.309437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.341711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.352322 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e71631e-b4a7-4ca9-8d5f-8c9293c3f87a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.313166 Oct 31 15:35:14.357877 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2273/4440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:14.368548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.369324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.375616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.376116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.376549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.377273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.378735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.379667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.427688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.437513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.438945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.440856 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3947e096-e814-4476-a256-5bf341616ce8 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.168612 Oct 31 15:35:14.441885 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2168/4441] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:14.491357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.504648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.507186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.509356 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-705db4be-6f88-4949-b8dc-3ba20104f2ec tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1362 microversion: 2.57 time: 0.149090 Oct 31 15:35:14.524049 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2274/4442] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:15.272575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:15.273990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:15.288803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.290252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.292606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.293656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.302468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.302926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.379893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:15.380526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:15.396889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.397387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.404005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.404856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.412894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.414380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.847611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:15.859417 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7ce8b2d-038f-46ea-958d-72e7d06f76c4 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1506 microversion: 2.1 time: 0.590144 Oct 31 15:35:15.861120 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2169/4443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:15 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:15.871399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:15.873889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:15.883997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.884782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.885949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.887597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.888452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.888895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:15.889546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.897641 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f6a8b8f-829c-4075-ac23-5aab5d2c02af tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.524274 Oct 31 15:35:15.898718 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2275/4444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:15 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:15.904544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:15.905424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:15.911983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.912665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.913474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.914688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.916903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.916903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.958926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:15.959698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:15.960298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.960936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lazy-loading 'fault' on Instance uuid cf80f55f-e23f-490b-84e4-e1506ab3cdcb {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:16.015197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:16.029979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:16.032088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:16.033486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fc11756-8012-405e-a459-25cc500515f6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1367 microversion: 2.57 time: 0.133616 Oct 31 15:35:16.037353 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2276/4445] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:15 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1367 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:16.068133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1cf3f69c-5962-4692-a00f-a87a03645412 req-283c1508-0243-42d1-b4d6-edd1ba8df1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dac6d21-02b7-452e-b43a-2bd0df50bd33", "name": "network-vif-unplugged", "status": "completed", "tag": "95f62970-c242-4cb2-a6fd-907d92c60a36"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:16.091023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1cf3f69c-5962-4692-a00f-a87a03645412 req-283c1508-0243-42d1-b4d6-edd1ba8df1d3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.094148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1cf3f69c-5962-4692-a00f-a87a03645412 req-283c1508-0243-42d1-b4d6-edd1ba8df1d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.095140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1cf3f69c-5962-4692-a00f-a87a03645412 req-283c1508-0243-42d1-b4d6-edd1ba8df1d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.113646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:16.119599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1cf3f69c-5962-4692-a00f-a87a03645412 req-283c1508-0243-42d1-b4d6-edd1ba8df1d3 service nova] Creating event network-vif-unplugged:95f62970-c242-4cb2-a6fd-907d92c60a36 for instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 on n-h2-858383-17 Oct 31 15:35:16.125782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1cf3f69c-5962-4692-a00f-a87a03645412 req-283c1508-0243-42d1-b4d6-edd1ba8df1d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067839 Oct 31 15:35:16.131985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2277/4446] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:16.134983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:16.137458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:16.140339 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41498505-4074-4d72-ab1f-a75c1dfc81ba tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.276742 Oct 31 15:35:16.141398 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2170/4447] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:15 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:16.892990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:16.892990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:16.896609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.897136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.897575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.898275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.898729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.899147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.927978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:16.928608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:16.939108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.939611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.940642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.944129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.950036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.950879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.147831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.162777 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b31eb9f-b15d-4dce-b24a-92c0d01e664b tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1506 microversion: 2.1 time: 0.278421 Oct 31 15:35:17.184046 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2278/4448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:16 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:17.197532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:17.197806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.208057 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a4c059d-e7e3-4857-b8ef-0d97bfe8ad29 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.285251 Oct 31 15:35:17.208837 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2171/4449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:16 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:17.213679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:17.220630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.221995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.222613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.223576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.224272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.224969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.227476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:17.228131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:17.237735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.238470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.239065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.240016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.241310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.241900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.333198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.341657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:17.352766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.358429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.361332 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0eb8f997-8c1e-4b4f-8235-2d1107cf93a9 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.151263 Oct 31 15:35:17.363554 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2172/4450] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:17 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:17.369031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.369799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.370450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.371106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lazy-loading 'fault' on Instance uuid cf80f55f-e23f-490b-84e4-e1506ab3cdcb {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:17.423420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.434892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.436420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '740876c7d35b4fab9d042126285a8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172b81adfe32419db747de919d03fb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.437864 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63c92e3a-60aa-4682-b729-3c7cf82f604a tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 200 len: 1367 microversion: 2.57 time: 0.248747 Oct 31 15:35:17.438944 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2279/4451] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:17 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:17.539609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:17.540392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:17.547941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.548641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.549412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.550300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.550937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.552152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.566599 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] HTTP exception thrown: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Request method failure captured: Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 HTTP/1.1 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-k_ZVTrXxQz0rCV_-d9Xk14Lr5dwuanE5FW_rKGEAtlba7ihkMci4COAa67MdPhZXLt0_ha7UkXO8lyzHeylQG_PUMA3wwgmNYZst5KsLD7nCJrArrU3rsiipDm0NJ8Bv2UE6RNFn35OAcO1QrNm268MvXNaQNZaEePKlNU96S6GZA Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 58b6ccb6f0514e0991864ec6a6417b45 Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a0e1b2ef-972b-42d2-a19e-052e922dd445'} Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:17.568548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.571907 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.573928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Returning 404 to user: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:17.575183 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-073ffa93-b7f4-455d-8ccd-4b080fac5eef tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 404 len: 111 microversion: 2.20 time: 0.039605 Oct 31 15:35:17.585649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:17.586494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: a0e1b2ef-972b-42d2-a19e-052e922dd445] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:17.592054 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2173/4452] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:35:17 2022] DELETE /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:17.593146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.594359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.594979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.595872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:17.597385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:17.598019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.614836 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] HTTP exception thrown: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Request method failure captured: Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 HTTP/1.1 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-k_ZVTrXxQz0rCV_-d9Xk14Lr5dwuanE5FW_rKGEAtlba7ihkMci4COAa67MdPhZXLt0_ha7UkXO8lyzHeylQG_PUMA3wwgmNYZst5KsLD7nCJrArrU3rsiipDm0NJ8Bv2UE6RNFn35OAcO1QrNm268MvXNaQNZaEePKlNU96S6GZA Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 58b6ccb6f0514e0991864ec6a6417b45 Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a0e1b2ef-972b-42d2-a19e-052e922dd445'} Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.617381 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. Oct 31 15:35:17.620944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:17.625787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Returning 404 to user: Instance a0e1b2ef-972b-42d2-a19e-052e922dd445 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:17.626664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2740c81f-0635-4844-9212-2bdce634f90c tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445" status: 404 len: 111 microversion: 2.20 time: 0.045042 Oct 31 15:35:17.631235 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2280/4453] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:17 2022] GET /compute/v2.1/servers/a0e1b2ef-972b-42d2-a19e-052e922dd445 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:18.189436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.191151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.204879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.205390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.205868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.208656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.210547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.210987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.235070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.235826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.250979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.251888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.254569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.256649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.257839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.258892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.661542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:18.675184 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-048e2a1d-cd74-4c7b-b2e5-4df8a72b91e6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.443599 Oct 31 15:35:18.676369 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2281/4454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:18.695078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.698466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.716595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.718225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.720109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.723253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.724768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.725750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.749196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:18.783227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92a1ea40-6f3a-4785-b285-8c6362c73d55 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 200 len: 1509 microversion: 2.1 time: 0.598273 Oct 31 15:35:18.795810 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2174/4455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:18.806241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.806241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] [instance: cf80f55f-e23f-490b-84e4-e1506ab3cdcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.811235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.815697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:18.824555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:18.826790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.827365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.828144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.828736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.829178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.835561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:18.836972 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0de2ec4a-4491-426f-8eeb-7c31e26be5ca tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1407 microversion: 2.54 time: 0.158770 Oct 31 15:35:18.856750 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2282/4456] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:18.856750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.856750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.857105 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] HTTP exception thrown: Instance cf80f55f-e23f-490b-84e4-e1506ab3cdcb could not be found. Oct 31 15:35:18.860351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Request method failure captured: Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb HTTP/1.1 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-sIbqX6sdDMncBJyGLjyrS0uNPwYV5jh7M5PEsAfOiq0dYK6W0C1kXziR08W_Ux32lnhv0T6oTqyN4w1T9K8PfHyybLSaFQwTLe6ZQ_xkLwnMVTDEnRH9A7KZzEvPqGonMJ9MmHwcsXIXWg4naFdb3ydlwXRZtAo_2swVdLPjrS1TA Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.57 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 172b81adfe32419db747de919d03fb0e Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerShowV257Test-1055102568 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172b81adfe32419db747de919d03fb0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172b81adfe32419db747de919d03fb0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172b81adfe32419db747de919d03fb0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172b81adfe32419db747de919d03fb0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerShowV257Test-1055102568 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 172b81adfe32419db747de919d03fb0e Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerShowV257Test-1055102568 Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerShowV257Test-1055102568-project Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 740876c7d35b4fab9d042126285a8b9c Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerShowV257Test-1055102568-project Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance cf80f55f-e23f-490b-84e4-e1506ab3cdcb could not be found. Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'cf80f55f-e23f-490b-84e4-e1506ab3cdcb'} Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf80f55f-e23f-490b-84e4-e1506ab3cdcb could not be found. Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf80f55f-e23f-490b-84e4-e1506ab3cdcb could not be found. Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:18.863045 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf80f55f-e23f-490b-84e4-e1506ab3cdcb could not be found. Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] Returning 404 to user: Instance cf80f55f-e23f-490b-84e4-e1506ab3cdcb could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:18.871738 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ffda35d-c3b4-4681-bdad-645f6a1e24e6 tempest-ServerShowV257Test-1055102568 tempest-ServerShowV257Test-1055102568-project] 10.222.0.48 "GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb" status: 404 len: 111 microversion: 2.57 time: 0.078794 Oct 31 15:35:18.872624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.872624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.872624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.872624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.872624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.873140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2175/4457] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/cf80f55f-e23f-490b-84e4-e1506ab3cdcb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:19.074860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:19.089631 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cee86892-8bc4-4357-b63c-ada7bf196f80 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.250421 Oct 31 15:35:19.091537 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2283/4458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:19.124073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:19.124723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:19.134654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.135188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.135633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.136348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.139622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.140622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.432004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:19.444025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ed3b790-d1c5-4b6f-97ee-1cc0987809d6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.323802 Oct 31 15:35:19.445390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2176/4459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:19 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:19.468145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:19.469875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:19.479080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.480224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.480823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.481607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.482347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.483063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.700106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:19.701270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:19.717822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.725116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.725898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.726976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.729057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.731168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.810385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:19.823192 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdadefc8-c2f7-4a1f-8d24-31d1b239eff9 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.359770 Oct 31 15:35:19.843499 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2284/4460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:19 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:19.856242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:19.857335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:19.866832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.867771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.868417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.869509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.870277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.873645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.103191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.113553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b68ccd45-2165-496e-b852-b4ccbb64e281 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.417849 Oct 31 15:35:20.114190 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2177/4461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:19 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:20.129124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:20.130027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:20.139187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.139686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.142758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.147518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.148026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.148475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.190467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.201378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-210d80a1-6cad-4d0f-8742-44437ed0d0b3 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.349705 Oct 31 15:35:20.202231 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2285/4462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:19 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:20.231284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ecc69b5c-bb25-4e06-a54e-5bb36b1fce81 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:20.244861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecc69b5c-bb25-4e06-a54e-5bb36b1fce81 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.245988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecc69b5c-bb25-4e06-a54e-5bb36b1fce81 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.248170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecc69b5c-bb25-4e06-a54e-5bb36b1fce81 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.257557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.270589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.275045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ecc69b5c-bb25-4e06-a54e-5bb36b1fce81 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:35:20.275718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.278323 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-58204573-dbd2-40e9-b12d-01c4aed4fcd6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1413 microversion: 2.54 time: 0.162667 Oct 31 15:35:20.284183 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2178/4463] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:20 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1413 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:20.364349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ecc69b5c-bb25-4e06-a54e-5bb36b1fce81 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.138555 Oct 31 15:35:20.367145 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2286/4464] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:20 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:20.376456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:20.377573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:20.385348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.386033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.386633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.387608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.388224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.388938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.613263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.629845 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f89f47a-0e4e-4338-83d7-f82086e1ed18 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.258175 Oct 31 15:35:20.631625 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2179/4465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:20 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:21.140623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:21.141973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:21.154960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.155550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.156433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.162012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.162905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.163682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.311386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:21.312230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:21.324908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.331737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.331737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.331737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.331737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.333925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.484208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.494081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.499534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.504281 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e9bb5c3-92d8-4e71-83b7-094e7d1224a6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1413 microversion: 2.54 time: 0.196699 Oct 31 15:35:21.504995 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2180/4466] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:21 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1413 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:21.508119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.516605 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-019d1850-298a-44ce-98c6-5f6d88573150 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.380404 Oct 31 15:35:21.518254 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2287/4467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:21 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:21.656575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:21.657297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:21.664615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.665666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.666533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.667418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.668024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.668780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.869819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.881221 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-10562b78-ffc8-40b4-a152-2371f317a93d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.228904 Oct 31 15:35:21.882308 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2181/4468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:21 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:22.532779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:22.532779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:22.546970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:22.548599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:22.553900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.554392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.555123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:22.556153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.557317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.558003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:22.575403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.576982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.578428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:22.579632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.581119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.581815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:22.768973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:22.772917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:22.787430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:22.794955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:22.796889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dae7c426-168c-4b7a-a373-3a6e171b43a7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1413 microversion: 2.54 time: 0.269159 Oct 31 15:35:22.807164 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2288/4469] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:22 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1413 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:22.878653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:22.890195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55115241-6eab-4cb0-a284-66a84c834d32 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.351810 Oct 31 15:35:22.891393 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2182/4470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:22 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:22.913046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:22.913967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:22.926010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.926738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.927457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:22.928790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.929559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.930265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.089689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:23.110982 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-123b3d79-64f1-4c64-a30d-160d6c009bd1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.201818 Oct 31 15:35:23.113435 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2289/4471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:22 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:23.300514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:23.301303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:23.308664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.309253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.310012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.311075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.311825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.312452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.332274 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] HTTP exception thrown: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Request method failure captured: Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 HTTP/1.1 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-k_ZVTrXxQz0rCV_-d9Xk14Lr5dwuanE5FW_rKGEAtlba7ihkMci4COAa67MdPhZXLt0_ha7UkXO8lyzHeylQG_PUMA3wwgmNYZst5KsLD7nCJrArrU3rsiipDm0NJ8Bv2UE6RNFn35OAcO1QrNm268MvXNaQNZaEePKlNU96S6GZA Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 58b6ccb6f0514e0991864ec6a6417b45 Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b15880e4-0725-4b00-bb5d-99fea0b93694'} Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:23.334421 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.338194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.340419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Returning 404 to user: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:23.341562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4eac2e1-46b2-4395-99d0-b68cb9d4148f tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 404 len: 111 microversion: 2.20 time: 0.046860 Oct 31 15:35:23.342807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2183/4472] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:35:23 2022] DELETE /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:23.352768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:23.353994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] [instance: b15880e4-0725-4b00-bb5d-99fea0b93694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:23.363414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.364138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.364950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.365910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.366529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.367179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.389815 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] HTTP exception thrown: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Request method failure captured: Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 HTTP/1.1 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-k_ZVTrXxQz0rCV_-d9Xk14Lr5dwuanE5FW_rKGEAtlba7ihkMci4COAa67MdPhZXLt0_ha7UkXO8lyzHeylQG_PUMA3wwgmNYZst5KsLD7nCJrArrU3rsiipDm0NJ8Bv2UE6RNFn35OAcO1QrNm268MvXNaQNZaEePKlNU96S6GZA Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fa76f3e952245dd89ecd0ba7ba44111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 9fa76f3e952245dd89ecd0ba7ba44111 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-865480675 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 58b6ccb6f0514e0991864ec6a6417b45 Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-865480675-project Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b15880e4-0725-4b00-bb5d-99fea0b93694'} Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.392491 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:23.397622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] Returning 404 to user: Instance b15880e4-0725-4b00-bb5d-99fea0b93694 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:23.398972 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61d8cf06-8f4b-410d-afe0-e4100fd7facb tempest-AttachVolumeShelveTestJSON-865480675 tempest-AttachVolumeShelveTestJSON-865480675-project] 10.222.0.48 "GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694" status: 404 len: 111 microversion: 2.20 time: 0.051795 Oct 31 15:35:23.403370 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2290/4473] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:23 2022] GET /compute/v2.1/servers/b15880e4-0725-4b00-bb5d-99fea0b93694 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:23.832391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:23.833846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:23.848216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.849197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.849894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.852119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.853471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.853938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.920053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:23.921677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:23.938690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.939203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.940183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.940933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.941386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.941950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:24.052369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:24.066385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:24.069157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:24.070769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-acd9a3fe-5c6b-47e5-a5ec-b92611a6be3c tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1413 microversion: 2.54 time: 0.244816 Oct 31 15:35:24.072328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2184/4474] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:23 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1413 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:24.145438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:24.150435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:24.163452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:24.164446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:24.165288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:24.167310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:24.168257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:24.168954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:24.232329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:24.240746 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d048816a-9657-4ce1-8d27-98fc132e5d48 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.329309 Oct 31 15:35:24.241336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2291/4475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:23 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:24.470206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:24.481050 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7b9a315-5206-44f9-8a93-e450fa1ccc2d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.348245 Oct 31 15:35:24.482367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2185/4476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:24 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:25.110422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.110960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:25.161704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.162877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.164659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.166004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.170019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.171213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.270848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.272242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:25.282782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.284285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.285057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.286784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.287579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.288631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.334399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.344328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.346746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.348126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5caa640-0fa2-490a-8060-d1eb3b25e119 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1398 microversion: 2.54 time: 0.252100 Oct 31 15:35:25.349226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2292/4477] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:25 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1398 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:25.377781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-671ebae0-f727-4713-a46b-bec2b55ed1d6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '.version_select at 0x7f5ca15743a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.407765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-671ebae0-f727-4713-a46b-bec2b55ed1d6 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-81501405" status: 204 len: 0 microversion: 2.54 time: 0.036200 Oct 31 15:35:25.413864 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2293/4478] 10.222.0.48 () {60 vars in 1313 bytes} [Mon Oct 31 15:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-81501405 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:35:25.423544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.425535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:25.433220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.433873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.434380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.435101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.436018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.436908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.466370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:25.644219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.657259 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e6d1bf6e-9aba-42c3-9667-ea99059bc9be tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.393619 Oct 31 15:35:25.657943 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2186/4479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:25 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:25.678351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd1a31eb-8838-4759-bbbd-b60a917064db tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 204 len: 0 microversion: 2.54 time: 0.259293 Oct 31 15:35:25.678697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.679386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:25.681552 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2294/4480] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:35:25 2022] DELETE /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:35:25.688985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.689614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.690055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.690763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.691229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.693674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.695788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.698321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:25.714907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.717137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.717857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.722330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.723237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.724855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.903511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.917163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.919332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.920529 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56d29755-5bcf-48d6-bcfe-46cc7e617b45 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1404 microversion: 2.54 time: 0.234556 Oct 31 15:35:25.921125 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2295/4481] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:25 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:26.108626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:26.119800 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ca4fa4b4-7ec9-4121-b1d5-116c3c01608e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.460710 Oct 31 15:35:26.122405 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2187/4482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:25 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:26.681912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:26.683177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:26.697209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.697813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.698494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.701482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.702156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.707928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.958397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:26.961735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:26.989868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.991342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.992138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.993357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.994536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.996109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:27.068527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.079790 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd35d965-377f-4cc4-938a-702e977ec03f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.402151 Oct 31 15:35:27.092719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2296/4483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:26 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:27.123442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.139474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.142289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.146576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:27.147200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:27.151088 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c35d42a-8b69-4956-a155-05142d593ab7 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1404 microversion: 2.54 time: 0.204705 Oct 31 15:35:27.153514 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2188/4484] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:26 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:27.180465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:27.180995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:27.181652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:27.182281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:27.184877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:27.187506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:27.397782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.409478 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e8366d3-162b-4706-847d-097d02b4a099 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.266870 Oct 31 15:35:27.410607 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2297/4485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:27 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:28.108522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.109193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.125133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.125867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.126548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.128201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.129398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.130095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.188808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.190049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.210109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.213214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.214757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.216290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.220045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.221776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.305613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.306582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.307249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.307888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lazy-loading 'fault' on Instance uuid cf4a8cae-4bf6-4cf1-aeec-30b867d18694 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:28.386970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.396811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.402690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a874c6d8fbc42118ffcd61582f2b7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780d6df74f6148a0a650bfb87f1812c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.404274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bfbeaef-725d-4ebc-afb3-9a60cbb0eac3 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 200 len: 1409 microversion: 2.54 time: 0.224418 Oct 31 15:35:28.409352 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2298/4486] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:28.433231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.435492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.436482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.446101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.446486 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-82d30511-dedf-4e50-a6a5-088ba129852f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.341266 Oct 31 15:35:28.447080 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2189/4487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:28.449838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.450552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.451585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.452290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.452995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.661399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.670424 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27bf7a0f-555c-4172-bf39-5ad23ecb74eb tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.239233 Oct 31 15:35:28.672967 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2299/4488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:29.438931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:29.439711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] [instance: cf4a8cae-4bf6-4cf1-aeec-30b867d18694] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:29.457755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.458275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.458724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.459460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.459925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.460350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.471905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:29.473544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:29.501074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.503258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.505608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.510374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.511285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.512264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.527256 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] HTTP exception thrown: Instance cf4a8cae-4bf6-4cf1-aeec-30b867d18694 could not be found. Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Request method failure captured: Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 HTTP/1.1 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-sM6e7qKwa1kelqmtqvcV9q3bEB1fcxhjsXKjZg_W3u_3mBhHaksbqD1BBAfBdLtl0iDBGryjJCfoNy_rwDTIiZqJTKEpJtTbHniA6Ya6rEVJkGA1aYE_mrtA-0Wme1HjLcQzZNqLfY5QJzlJaTN_At7pSHuA7hcZoHkzwln_fuF7c Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.54 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 780d6df74f6148a0a650bfb87f1812c3 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerShowV254Test-785586445 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/780d6df74f6148a0a650bfb87f1812c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/780d6df74f6148a0a650bfb87f1812c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_780d6df74f6148a0a650bfb87f1812c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/780d6df74f6148a0a650bfb87f1812c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerShowV254Test-785586445 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 780d6df74f6148a0a650bfb87f1812c3 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerShowV254Test-785586445 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerShowV254Test-785586445-project Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9a874c6d8fbc42118ffcd61582f2b7e7 Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerShowV254Test-785586445-project Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance cf4a8cae-4bf6-4cf1-aeec-30b867d18694 could not be found. Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'cf4a8cae-4bf6-4cf1-aeec-30b867d18694'} Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4a8cae-4bf6-4cf1-aeec-30b867d18694 could not be found. Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4a8cae-4bf6-4cf1-aeec-30b867d18694 could not be found. Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:29.538642 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4a8cae-4bf6-4cf1-aeec-30b867d18694 could not be found. Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] Returning 404 to user: Instance cf4a8cae-4bf6-4cf1-aeec-30b867d18694 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:29.542818 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a93b58d4-2e79-4a4b-80bd-d555ff98f412 tempest-ServerShowV254Test-785586445 tempest-ServerShowV254Test-785586445-project] 10.222.0.48 "GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694" status: 404 len: 111 microversion: 2.54 time: 0.105603 Oct 31 15:35:29.545123 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2190/4489] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:29 2022] GET /compute/v2.1/servers/cf4a8cae-4bf6-4cf1-aeec-30b867d18694 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:35:29.704791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:29.706450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:29.716013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.717007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.717849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.719216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.719878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.720776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.874591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:29.889494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f082a4fd-7cda-4426-a63f-a38f92bd0d2a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.422849 Oct 31 15:35:29.890091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2300/4490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:29 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:29.944389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:29.953719 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e96e332-42ea-46ae-bc1d-7f6c788457de tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1679 microversion: 2.1 time: 0.255101 Oct 31 15:35:29.954300 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2191/4491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:29 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:30.915203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:30.916058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:30.928042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:30.936580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:30.937228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:30.940129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:30.942184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:30.942733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:30.987481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:30.988770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:31.006771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.014553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.015030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.018911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.019479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.022218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.037053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:31.279851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:31.305087 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62ca4f7a-acfb-4691-a8d0-caf4aabde601 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.380046 Oct 31 15:35:31.305087 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2301/4492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:30 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:31.367733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:31.377527 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3959f7c0-3bfd-4236-adae-9971064ac89e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1656 microversion: 2.1 time: 0.402621 Oct 31 15:35:31.378444 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2192/4493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:30 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1656 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:31.401072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d0aeb0c-a7e9-4476-b23a-68c509163c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:31.410653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d0aeb0c-a7e9-4476-b23a-68c509163c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.411464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d0aeb0c-a7e9-4476-b23a-68c509163c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.412095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d0aeb0c-a7e9-4476-b23a-68c509163c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.444019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3d0aeb0c-a7e9-4476-b23a-68c509163c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Going to try to start instance {{(pid=120625) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:35:31.503909 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d0aeb0c-a7e9-4476-b23a-68c509163c1a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.106462 Oct 31 15:35:31.508623 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2302/4494] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:31 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:31.513273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:31.513890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:31.521866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.522369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.522808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.523517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.524003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.524443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.695120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:31.705398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a234ee59-7f6c-4f24-a63d-a5ac2fda2a5c tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1665 microversion: 2.1 time: 0.195492 Oct 31 15:35:31.706839 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2193/4495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:31 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1665 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:32.321218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:32.321808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:32.336066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.336831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.337490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.338539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.339243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.339956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.555777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:32.565670 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07eebef9-f0bb-44cd-b81b-f034eced7f5c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.253931 Oct 31 15:35:32.568557 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2303/4496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:32 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:32.730923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:32.731724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:32.746047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.748666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.749222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.753637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.754340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.755886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.767085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:32.945614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ab767fc-adbd-4c40-a397-c490dad4ebab tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Action: 'create', calling method: .version_select at 0x7f5ca10e80d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-41332423"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:32.994464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:33.015276 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-acc0f3bb-4c54-4c59-b6dc-894cf314004d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1665 microversion: 2.1 time: 0.278831 Oct 31 15:35:33.016383 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2304/4497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:32 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1665 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:33.613398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ab767fc-adbd-4c40-a397-c490dad4ebab tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.262665 Oct 31 15:35:33.614944 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2194/4498] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Oct 31 15:35:32 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1265 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 15:35:33.620034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:33.621020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:33.632119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.633540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.634202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.635265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.635931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.636740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.671035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-515676d3-75aa-4608-a07a-0ea43dc3cc26 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Action: 'create', calling method: .version_select at 0x7f5ca16c03a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1799063530", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:33.911768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:33.921977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f421a476-b237-45bd-9e82-c7b2e566fd4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.305681 Oct 31 15:35:33.923821 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2195/4499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:33 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:33.953591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a66db4f9-b8cc-4bd8-9f21-ec62a3be24c0 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca10fc8b0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.134089 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a66db4f9-b8cc-4bd8-9f21-ec62a3be24c0 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 200 len: 343 microversion: 2.1 time: 0.190742 Oct 31 15:35:34.135440 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2196/4500] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:33 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 343 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:34.153737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.155062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.167607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.170275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.171453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.172396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.173135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.174545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.450735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-515676d3-75aa-4608-a07a-0ea43dc3cc26 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.982718 Oct 31 15:35:34.450735 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2305/4501] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Oct 31 15:35:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 984 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 15:35:34.467644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2fd6f1e-bc41-4818-8344-8923a0cb6008 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca1352dc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.519622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:34.529687 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92cf7ee7-175f-40fd-8d21-63166faf2770 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.385653 Oct 31 15:35:34.531632 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2197/4502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:34.558646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.559659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.567792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.568597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.569813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.571172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.571850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.572841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.594519 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2fd6f1e-bc41-4818-8344-8923a0cb6008 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 353 microversion: 2.1 time: 0.134061 Oct 31 15:35:34.595269 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2306/4503] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:34.796868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:34.806238 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5dbab23-13d5-4359-92d8-2b241223b7a1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.251763 Oct 31 15:35:34.808529 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2198/4504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:34.834949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.836306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.842338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:34.844964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.845814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.846926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.847844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.848329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.848781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.950194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.951158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.959358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.963408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.964007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.965163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.973440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.973985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.071055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.083538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0daec5c3-f660-48e7-9296-7e1662fa08ce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.252792 Oct 31 15:35:35.087191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2307/4505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:35.110045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.110893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:35.125515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.127970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.129700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.130755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.131979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.134442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.279864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.293997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79417d21-c65a-4f0a-baf9-8bdb9ba7f040 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.348014 Oct 31 15:35:35.301187 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2199/4506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:35.322768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1edfdd56-0af3-4eef-9e7d-f7dd3bca9184 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca11879d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.417749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.432961 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f569d0b9-91b1-496e-814d-5592330e5364 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.327309 Oct 31 15:35:35.433127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1edfdd56-0af3-4eef-9e7d-f7dd3bca9184 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 200 len: 344 microversion: 2.1 time: 0.130303 Oct 31 15:35:35.433870 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2308/4507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:35.442552 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2200/4508] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:35.450803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84ddec01-855d-426c-b601-3842ea548c42 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Action: 'create', calling method: .version_select at 0x7f5ca134e940>, body: {"snapshot": {"volume_id": "e888b4d3-77cc-4ba3-99cb-e7fe0a54593a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-621756418"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:35.471617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.472250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:35.480739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.481192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.481724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.482449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.482959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.484509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.798590 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84ddec01-855d-426c-b601-3842ea548c42 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.352072 Oct 31 15:35:35.803145 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2309/4509] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Oct 31 15:35:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:35.812383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8891479-5e47-4eaa-b736-339c2a1de23d tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca136c280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.813669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.824632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f580b54-a937-4993-92c2-718d09e4b931 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.358469 Oct 31 15:35:35.828271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2201/4510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:35.836379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d9df681-40c4-432a-844d-8ca23aa21440 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca170cb80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.913955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d9df681-40c4-432a-844d-8ca23aa21440 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 286 microversion: 2.1 time: 0.084450 Oct 31 15:35:35.920886 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2202/4511] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:35.927695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:35.928831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:35.937157 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8891479-5e47-4eaa-b736-339c2a1de23d tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 353 microversion: 2.1 time: 0.132274 Oct 31 15:35:35.949040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.949500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2310/4512] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:35.956677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b02dde01-8ce1-4f79-8b1b-a9c40c3d4de0 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca1352ee0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.956981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.957714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.958664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.959892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.962896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.016369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lazy-loading 'flavor' on Instance uuid 874df0b8-4d02-43ff-bc60-15b89e219abf {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:36.024956 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b02dde01-8ce1-4f79-8b1b-a9c40c3d4de0 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.073403 Oct 31 15:35:36.025786 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2311/4513] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:36.044807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d3703fc-abdf-4b04-9fb4-b864acb7aa03 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca134eaf0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.106715 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d3703fc-abdf-4b04-9fb4-b864acb7aa03 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 286 microversion: 2.1 time: 0.069437 Oct 31 15:35:36.108680 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2312/4514] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:36.165668 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f16ff62-419e-4aaa-aca6-ff9cb0cd3a8f tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.243462 Oct 31 15:35:36.167175 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2203/4515] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:35 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:36.177178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.178455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.193537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.194965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.197154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.198636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.200709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.201815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.325296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.326013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.342762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.343270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.343979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.344724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.345197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.345805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.620622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.631508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb3a0bf5-9337-44ae-a0eb-61e33ab6d481 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1677 microversion: 2.1 time: 0.460023 Oct 31 15:35:36.648937 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2313/4516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1677 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:36.665230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.673284 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1354501d-f011-4ad6-ba3f-cbb3689f2016 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.353368 Oct 31 15:35:36.694280 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2204/4517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:36.954578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2073b76-da10-4e08-af66-fd60983fa242 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca134e940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.022116 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2073b76-da10-4e08-af66-fd60983fa242 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 354 microversion: 2.1 time: 0.071831 Oct 31 15:35:37.028418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2314/4518] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:37.037221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73c1fe83-37ed-459f-a3c1-fb6b8ef19d74 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca2b7b4c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.106126 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73c1fe83-37ed-459f-a3c1-fb6b8ef19d74 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 354 microversion: 2.1 time: 0.074277 Oct 31 15:35:37.107524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2205/4519] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:37.125961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c750ec13-a8c4-483e-b2be-3fad41d51f5b tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca136cca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.129896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-821ca06a-10a3-4301-8d32-df7c0cdb032a tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca10cf310>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.191052 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-821ca06a-10a3-4301-8d32-df7c0cdb032a tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 286 microversion: 2.1 time: 0.073030 Oct 31 15:35:37.193259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2206/4520] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:37.298285 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c750ec13-a8c4-483e-b2be-3fad41d51f5b tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 202 len: 0 microversion: 2.1 time: 0.176327 Oct 31 15:35:37.299558 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2315/4521] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:35:37 2022] DELETE /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:37.307586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d9bde49-5352-4770-8d07-11d4888ca829 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca10e8f70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.404652 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d9bde49-5352-4770-8d07-11d4888ca829 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 353 microversion: 2.1 time: 0.101147 Oct 31 15:35:37.412912 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2207/4522] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:37.670066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.670679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.694206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.694736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.697610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.698369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.704367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.724481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.735362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.742923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.763186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.766791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.770326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.774919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.775829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.779442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.146002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.172459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.185492 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f64ed107-ea4f-40f0-9111-eea209fd667e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1660 microversion: 2.1 time: 0.526624 Oct 31 15:35:38.186594 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2316/4523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1660 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:38.190256 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1a9874bd-a657-47fe-9fe8-97deca22bb83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.483482 Oct 31 15:35:38.190897 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2208/4524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:38.217356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:38.218626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8951ca16-55ef-4884-8b01-41b0d40a1b1f tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca1366b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.224205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:38.236262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.236890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.237341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.241940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.242493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.242986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.259241 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8951ca16-55ef-4884-8b01-41b0d40a1b1f tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 287 microversion: 2.1 time: 0.045326 Oct 31 15:35:38.268422 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2317/4525] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:38 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:38.276244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56ed2b54-ffeb-469c-abd7-f761d778ac36 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca136c160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.399749 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-955cd271-14d1-41ba-9578-59227cebad3d tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action" status: 202 len: 0 microversion: 2.1 time: 0.188911 Oct 31 15:35:38.404743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2209/4526] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:38 2022] POST /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:38.419348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.420542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:38.429191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.430924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.431555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.432832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.433236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56ed2b54-ffeb-469c-abd7-f761d778ac36 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 202 len: 0 microversion: 2.1 time: 0.162237 Oct 31 15:35:38.433612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.433815 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2318/4527] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Oct 31 15:35:38 2022] DELETE /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:38.434355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.438694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4efd7ba-9050-4af4-b6be-1f48cc74f9f3 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca136cca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.572795 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4efd7ba-9050-4af4-b6be-1f48cc74f9f3 tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 353 microversion: 2.1 time: 0.137895 Oct 31 15:35:38.573672 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2319/4528] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:38 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:38.583795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6e9aefe-3179-426f-8bcd-e814a3a782a9 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca13669d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.653622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6e9aefe-3179-426f-8bcd-e814a3a782a9 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 286 microversion: 2.1 time: 0.078736 Oct 31 15:35:38.654194 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2320/4529] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:38 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:38.707375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.717553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-23195404-4ad8-43ac-b05a-07774a282e98 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1666 microversion: 2.1 time: 0.310059 Oct 31 15:35:38.718218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2210/4530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:38 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1666 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:39.220439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.222076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:39.239640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.240394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.241025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.241932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.242723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.243310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.505059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.527660 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ba2883c-3747-452b-88cb-6f4b96e6e671 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.311704 Oct 31 15:35:39.533195 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2321/4531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:39.588239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cee6b410-ff37-4f53-8c57-d021f466042f tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca10fc3a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.653205 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cee6b410-ff37-4f53-8c57-d021f466042f tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 200 len: 353 microversion: 2.1 time: 0.069288 Oct 31 15:35:39.654603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2211/4532] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:39.666719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f81899ae-251f-4c88-b229-1f23e5c18c97 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca1566d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.708159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f81899ae-251f-4c88-b229-1f23e5c18c97 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 286 microversion: 2.1 time: 0.045421 Oct 31 15:35:39.709318 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2322/4533] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:39.747314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.747925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:39.767052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.767751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.768387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.769934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.771930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.773443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.998963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.008945 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5181699a-59e7-4674-bf53-9ceed0870a1e tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1666 microversion: 2.1 time: 0.264767 Oct 31 15:35:40.011256 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2212/4534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1666 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:40.554614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.554614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:40.579399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.581228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.581877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.584585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.586349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.589399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.682556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85ad4328-44ca-4b4d-98e2-a056e29f47ca tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Calling method '.version_select at 0x7f5ca10fcb80>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.736968 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-85ad4328-44ca-4b4d-98e2-a056e29f47ca tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] HTTP exception thrown: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85ad4328-44ca-4b4d-98e2-a056e29f47ca tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Request method failure captured: Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a HTTP/1.1 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-tFlS_--VdnjChvoWl_Wm78UvQIqo6j5kPTH2GUhX7646QTJyyDVLKpMtV1O8FcRXn7kVAMYO8K5Ro1tfkSU3vE0ENi8SIjyjKy7W-1l-lnHIj-QpmAyPiVUBF0ki9jwWMenCVaOIDjOk2fXDcq_MQF9eiC4ct1fLzdURasqSplc7Q Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b33ec623646b45529fcdd7ec21055e63 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesGetTestJSON-1249541445 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b33ec623646b45529fcdd7ec21055e63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b33ec623646b45529fcdd7ec21055e63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b33ec623646b45529fcdd7ec21055e63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b33ec623646b45529fcdd7ec21055e63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesGetTestJSON-1249541445 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b33ec623646b45529fcdd7ec21055e63 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesGetTestJSON-1249541445 Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesGetTestJSON-1249541445-project Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 7d649f364dfd4334bb15f5acd47dddfe Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesGetTestJSON-1249541445-project Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: exception: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a'} Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. (HTTP 404) (Request-ID: req-2f0a2664-c81f-44d6-8de3-ad7b6047e406) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:35:40.749552 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. Oct 31 15:35:40.754279 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:40.758763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85ad4328-44ca-4b4d-98e2-a056e29f47ca tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] Returning 404 to user: Volume 7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:40.759849 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85ad4328-44ca-4b4d-98e2-a056e29f47ca tempest-VolumesGetTestJSON-1249541445 tempest-VolumesGetTestJSON-1249541445-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a" status: 404 len: 109 microversion: 2.1 time: 0.090915 Oct 31 15:35:40.761166 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2213/4535] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/os-volumes/7b640bc1-2c0a-4fa4-9ca6-7a39ae7a495a => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:40.769287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3709310-3681-45da-8449-d850b1956a49 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca26d0ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.845916 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3709310-3681-45da-8449-d850b1956a49 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 200 len: 286 microversion: 2.1 time: 0.083194 Oct 31 15:35:40.846598 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2214/4536] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:40.854394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.868459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd78951a-4144-4741-bd3d-9612f69750e7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1521 microversion: 2.1 time: 0.319043 Oct 31 15:35:40.869313 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2323/4537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:41.036845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.037825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:41.059906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.060914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.062945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.066944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.068377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.069344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.281330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:41.290917 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a653c55-4e93-4a1d-b006-de8f106214da tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.259337 Oct 31 15:35:41.295208 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2215/4538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:41 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:41.319414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.320035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:41.326998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.327818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.328471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.329428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.330643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.331324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.558391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:41.574830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61c0779f-2780-47b0-898b-0c4a84902442 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1669 microversion: 2.1 time: 0.259748 Oct 31 15:35:41.575723 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2324/4539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:41 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:41.606743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.607245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:41.615492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.615994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.616483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.617177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.617668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.618096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.633980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:41.682502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:41.699573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Working on deleting snapshot 960d1929-b9a0-427c-8efa-3e5fbe80fea4 from shelved instance... Oct 31 15:35:41.860117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8f00414-50bd-4fb1-98b8-dcb3b395a3e2 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca1352ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.918325 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d8f00414-50bd-4fb1-98b8-dcb3b395a3e2 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] HTTP exception thrown: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8f00414-50bd-4fb1-98b8-dcb3b395a3e2 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Request method failure captured: Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 HTTP/1.1 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-tEkE-FF_CLhDxaKWSz1myXwDPTZDwXQnG10YnKofwwu4ca59Jis77_TfG5Y_fMAy6wHL9CW-6vf2UAg-HoxZWa-T3AS8pXfb9Hco7iD7j4aAxb6UWRZp4ptLhOXkBJYjsje4dabXuI6sp3oHkD9usIfI06wefXCHPQR0CfUhs179g Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 39e6e7341dfd45d6a84afdc5742907a7 Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: exception: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '6b2a3b51-3296-4a3d-8587-9a7faa5ec078'} Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. (HTTP 404) (Request-ID: req-fa15c4e0-8aeb-487c-8ea8-e7735863716c) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:35:41.925968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8f00414-50bd-4fb1-98b8-dcb3b395a3e2 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Returning 404 to user: Snapshot 6b2a3b51-3296-4a3d-8587-9a7faa5ec078 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8f00414-50bd-4fb1-98b8-dcb3b395a3e2 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078" status: 404 len: 111 microversion: 2.1 time: 0.072360 Oct 31 15:35:41.929700 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2325/4540] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 15:35:41 2022] GET /compute/v2.1/os-snapshots/6b2a3b51-3296-4a3d-8587-9a7faa5ec078 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:35:41.934515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.935410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:41.956061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.957397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.958074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.959023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.959716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.961350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.214372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:42.228540 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dfd22e5f-9a56-4e09-b33d-59608946becf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1501 microversion: 2.1 time: 0.298936 Oct 31 15:35:42.229436 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2326/4541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:41 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:42.235172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ffd208cb-999f-4649-8671-388b478412ac tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca13665e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.329249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ffd208cb-999f-4649-8671-388b478412ac tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 202 len: 0 microversion: 2.1 time: 0.098056 Oct 31 15:35:42.330547 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2327/4542] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:35:42 2022] DELETE /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:42.355235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.355859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.364329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.364946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.365653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.366754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.367427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.368824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.622689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:42.633099 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e0e746a-d58c-4dd0-98b7-148d35b5a8fc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1516 microversion: 2.1 time: 0.301222 Oct 31 15:35:42.634408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2328/4543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:42 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:42.639462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2767ece0-af75-48a7-9ecb-a5a11920783f tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca13665e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.698602 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2767ece0-af75-48a7-9ecb-a5a11920783f tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 200 len: 343 microversion: 2.1 time: 0.062898 Oct 31 15:35:42.699345 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2329/4544] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:42 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 343 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:42.710750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87c4cb1f-063b-4674-af19-f9fe5eba74c9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:42.713784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87c4cb1f-063b-4674-af19-f9fe5eba74c9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 7f0ad150-b749-4503-a922-f625e363efe5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.730599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-87c4cb1f-063b-4674-af19-f9fe5eba74c9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Instance 7f0ad150-b749-4503-a922-f625e363efe5 could not be found. Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87c4cb1f-063b-4674-af19-f9fe5eba74c9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/7f0ad150-b749-4503-a922-f625e363efe5/action HTTP/1.1 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 14 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: {"rescue": {}} Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 7f0ad150-b749-4503-a922-f625e363efe5 could not be found. Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '7f0ad150-b749-4503-a922-f625e363efe5', 'body': {'rescue': {}}} Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0ad150-b749-4503-a922-f625e363efe5 could not be found. Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0ad150-b749-4503-a922-f625e363efe5 could not be found. Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.749287 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:42.756620 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:42.756620 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:42.756620 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:42.756620 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:42.756620 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0ad150-b749-4503-a922-f625e363efe5 could not be found. Oct 31 15:35:42.756620 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.761332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87c4cb1f-063b-4674-af19-f9fe5eba74c9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 404 to user: Instance 7f0ad150-b749-4503-a922-f625e363efe5 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:42.763672 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87c4cb1f-063b-4674-af19-f9fe5eba74c9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/7f0ad150-b749-4503-a922-f625e363efe5/action" status: 404 len: 111 microversion: 2.1 time: 0.062321 Oct 31 15:35:42.769813 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2330/4545] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:42 2022] POST /compute/v2.1/servers/7f0ad150-b749-4503-a922-f625e363efe5/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:42.775288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:42.776723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.785068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.785675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.786128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.786843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.787308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.787836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.878176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ee58926-bb48-49f4-af25-dba94e9a6fcc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action" status: 202 len: 0 microversion: 2.1 time: 0.106904 Oct 31 15:35:42.882170 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2331/4546] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:42 2022] POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:42.892399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.893615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.903011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.904031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.905376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.906577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.907300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.908380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.104420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.118789 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2a78680-9970-430f-9596-bd5ea034afc6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1521 microversion: 2.1 time: 0.232837 Oct 31 15:35:43.136816 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2332/4547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:42 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:43.294957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Doing local delete in cell 5f57b238-df31-4e1d-8756-1681193983c3(cell1) {{(pid=120626) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 31 15:35:43.296351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:43.297216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:43.297895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.299706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 31 15:35:43.304148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] deallocate_for_instance() {{(pid=120626) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 31 15:35:43.716057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01cf92f8-60fc-43df-be2d-1c472d52711c tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca136a820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:43.840662 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01cf92f8-60fc-43df-be2d-1c472d52711c tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 200 len: 343 microversion: 2.1 time: 0.129780 Oct 31 15:35:43.841962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2333/4548] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:43 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 343 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:44.148235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:44.150140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:44.167583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:44.172355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:44.173432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:44.174717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:44.177241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:44.179275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:44.259914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Updating instance_info_cache with network_info: [] {{(pid=120626) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:35:44.474077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:44.486724 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b93881a8-1832-491e-8a9e-8d4ed9823fff tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1501 microversion: 2.1 time: 0.344740 Oct 31 15:35:44.490899 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2334/4549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:44 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1501 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:44.761717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=80 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:44.981701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-deb85266-e42b-4d1f-94c3-2c9bfcab1211 req-a0cc2be8-98ff-4265-9794-b4ede5aeaf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dac6d21-02b7-452e-b43a-2bd0df50bd33", "name": "network-vif-deleted", "tag": "95f62970-c242-4cb2-a6fd-907d92c60a36"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:44.995158 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-45e31b22-0172-468e-a42a-88da3b49a9a6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 204 len: 0 microversion: 2.1 time: 3.391968 Oct 31 15:35:44.997231 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2216/4550] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:41 2022] DELETE /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 0 bytes in 3396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:45.006428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-deb85266-e42b-4d1f-94c3-2c9bfcab1211 req-a0cc2be8-98ff-4265-9794-b4ede5aeaf00 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.007177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-deb85266-e42b-4d1f-94c3-2c9bfcab1211 req-a0cc2be8-98ff-4265-9794-b4ede5aeaf00 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.008406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-deb85266-e42b-4d1f-94c3-2c9bfcab1211 req-a0cc2be8-98ff-4265-9794-b4ede5aeaf00 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.008942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:45.012821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.031217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.031722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.032168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.033088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.033550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.033988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.037465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-deb85266-e42b-4d1f-94c3-2c9bfcab1211 req-a0cc2be8-98ff-4265-9794-b4ede5aeaf00 service nova] Unable to find a host for instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33. Dropping event network-vif-deleted {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:35:45.039643 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-deb85266-e42b-4d1f-94c3-2c9bfcab1211 req-a0cc2be8-98ff-4265-9794-b4ede5aeaf00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.547717 Oct 31 15:35:45.055774 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2335/4551] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 561 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:35:45.074814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-565df25f-2ba2-419f-a3fc-24342b908f60 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca13b5d30>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.147350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lazy-loading 'flavor' on Instance uuid efb4a0f0-3b54-4012-bfde-2176e14f7711 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:45.191329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Cannot 'rescue' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state paused Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action HTTP/1.1 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 14 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: {"rescue": {}} Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'rescue' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state paused Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'efb4a0f0-3b54-4012-bfde-2176e14f7711', 'body': {'rescue': {}}} Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 in vm_state paused. Cannot rescue while the instance is in this state. Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state paused Oct 31 15:35:45.204788 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state paused Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 409 to user: Cannot 'rescue' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state paused {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:45.208615 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12982ec2-115e-4e80-af05-c95491d32a8b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action" status: 409 len: 144 microversion: 2.1 time: 0.208519 Oct 31 15:35:45.214788 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2217/4552] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:44 2022] POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action => generated 144 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:35:45.230649 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-565df25f-2ba2-419f-a3fc-24342b908f60 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 200 len: 343 microversion: 2.1 time: 0.173635 Oct 31 15:35:45.231607 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2336/4553] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:45 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 343 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:45.237844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:45.238384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.244492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.248757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2dac6d21-02b7-452e-b43a-2bd0df50bd33] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.265945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.266428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.266919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.272819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.276215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.277111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.278261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.279206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.281399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.281641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.283028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.285027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.337621 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] HTTP exception thrown: Instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 could not be found. Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Request method failure captured: Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 HTTP/1.1 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lT8sK3oZTS4fMh5oyg1sNzWBs-z6goGvayCXg_FfN37F3pf8jx5tM7xF3zh9pOf9ybk5DKiXGJFAmq871If8DP5Z_p2O0G9cmXG2CABNQmJYHsnOqJE6vlwrNUfqbvfomBGpMSndJZ-ECLFXOJjdH-rpchPAvxDIDqewWtfpm91xs Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b75b127e3924430bc27f7f311747382"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b75b127e3924430bc27f7f311747382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 6b1695b4d61d40de8272561b0cf3362e Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 could not be found. Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2dac6d21-02b7-452e-b43a-2bd0df50bd33'} Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 could not be found. Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 could not be found. Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:45.339540 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 could not be found. Oct 31 15:35:45.344780 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:45.346036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Returning 404 to user: Instance 2dac6d21-02b7-452e-b43a-2bd0df50bd33 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:45.347042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d1b51f1-15c0-49c5-a0a8-fb4f2edd5729 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33" status: 404 len: 111 microversion: 2.1 time: 0.132867 Oct 31 15:35:45.349084 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2218/4554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:45 2022] GET /compute/v2.1/servers/2dac6d21-02b7-452e-b43a-2bd0df50bd33 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:45.362932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.363707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.373566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.377357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.379382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.380278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.383042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.383715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.431042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:45.447979 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c26f968-0272-4997-b593-53588b210c26 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action" status: 202 len: 0 microversion: 2.1 time: 0.215065 Oct 31 15:35:45.448670 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2337/4555] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:45 2022] POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:45.474197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.474938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.509149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.538470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.539191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.540092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.540579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.541038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.639079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:45.667179 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f1fac91-d412-4486-91c9-869de5e8a3bf tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 204 len: 0 microversion: 2.1 time: 0.306515 Oct 31 15:35:45.676992 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2219/4556] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:45 2022] DELETE /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:45.698932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.700238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.735288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.736411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.741888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.745252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.745910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.751013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:46.008592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.022021 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a1ca611-d07c-4881-bfbb-740a2b1654b1 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1466 microversion: 2.1 time: 0.339500 Oct 31 15:35:46.029186 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2220/4557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:45 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1466 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:46.042987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.057973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a869a5c-80ec-42de-a2a5-18e31e0e5592 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1508 microversion: 2.1 time: 0.604643 Oct 31 15:35:46.090539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2338/4558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:45 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:46.246175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-59bd276f-4d56-4016-8057-386bde9427d4 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca11390d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:46.324677 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-59bd276f-4d56-4016-8057-386bde9427d4 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] HTTP exception thrown: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-59bd276f-4d56-4016-8057-386bde9427d4 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Request method failure captured: Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a HTTP/1.1 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-tEkE-FF_CLhDxaKWSz1myXwDPTZDwXQnG10YnKofwwu4ca59Jis77_TfG5Y_fMAy6wHL9CW-6vf2UAg-HoxZWa-T3AS8pXfb9Hco7iD7j4aAxb6UWRZp4ptLhOXkBJYjsje4dabXuI6sp3oHkD9usIfI06wefXCHPQR0CfUhs179g Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 39e6e7341dfd45d6a84afdc5742907a7 Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: exception: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e888b4d3-77cc-4ba3-99cb-e7fe0a54593a'} Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. (HTTP 404) (Request-ID: req-61fec02a-cffa-4e79-89e2-467f6c071d0e) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:35:46.326906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-59bd276f-4d56-4016-8057-386bde9427d4 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Returning 404 to user: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-59bd276f-4d56-4016-8057-386bde9427d4 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 404 len: 109 microversion: 2.1 time: 0.086082 Oct 31 15:35:46.332002 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2221/4559] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:46 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:35:46.340044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-637f251c-ea84-4733-b011-ceca6c6314f7 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca1378280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:46.402316 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-637f251c-ea84-4733-b011-ceca6c6314f7 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] HTTP exception thrown: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-637f251c-ea84-4733-b011-ceca6c6314f7 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Request method failure captured: Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a HTTP/1.1 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-tEkE-FF_CLhDxaKWSz1myXwDPTZDwXQnG10YnKofwwu4ca59Jis77_TfG5Y_fMAy6wHL9CW-6vf2UAg-HoxZWa-T3AS8pXfb9Hco7iD7j4aAxb6UWRZp4ptLhOXkBJYjsje4dabXuI6sp3oHkD9usIfI06wefXCHPQR0CfUhs179g Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 39e6e7341dfd45d6a84afdc5742907a7 Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: exception: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e888b4d3-77cc-4ba3-99cb-e7fe0a54593a'} Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. (HTTP 404) (Request-ID: req-9161591e-9f6d-45f3-9f8a-7ea91ef37876) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:35:46.404678 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-637f251c-ea84-4733-b011-ceca6c6314f7 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Returning 404 to user: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-637f251c-ea84-4733-b011-ceca6c6314f7 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 404 len: 109 microversion: 2.1 time: 0.070521 Oct 31 15:35:46.409577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2339/4560] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:35:46 2022] DELETE /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:46.416496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9caefa7f-e5ed-4fd3-b54c-3c8cbe6a03a1 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Calling method '.version_select at 0x7f5ca10a59d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:46.469790 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9caefa7f-e5ed-4fd3-b54c-3c8cbe6a03a1 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] HTTP exception thrown: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9caefa7f-e5ed-4fd3-b54c-3c8cbe6a03a1 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Request method failure captured: Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a HTTP/1.1 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-tEkE-FF_CLhDxaKWSz1myXwDPTZDwXQnG10YnKofwwu4ca59Jis77_TfG5Y_fMAy6wHL9CW-6vf2UAg-HoxZWa-T3AS8pXfb9Hco7iD7j4aAxb6UWRZp4ptLhOXkBJYjsje4dabXuI6sp3oHkD9usIfI06wefXCHPQR0CfUhs179g Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/360120caca814e9585b5f4cfb7a17a5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 360120caca814e9585b5f4cfb7a17a5b Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1292841467 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 39e6e7341dfd45d6a84afdc5742907a7 Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1292841467-project Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: exception: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e888b4d3-77cc-4ba3-99cb-e7fe0a54593a'} Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. (HTTP 404) (Request-ID: req-d6373bb1-6182-4fc9-9e25-d9296fac26f3) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:35:46.472441 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9caefa7f-e5ed-4fd3-b54c-3c8cbe6a03a1 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] Returning 404 to user: Volume e888b4d3-77cc-4ba3-99cb-e7fe0a54593a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9caefa7f-e5ed-4fd3-b54c-3c8cbe6a03a1 tempest-VolumesSnapshotsTestJSON-1292841467 tempest-VolumesSnapshotsTestJSON-1292841467-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a" status: 404 len: 109 microversion: 2.1 time: 0.062593 Oct 31 15:35:46.479157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2222/4561] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Oct 31 15:35:46 2022] GET /compute/v2.1/os-volumes/e888b4d3-77cc-4ba3-99cb-e7fe0a54593a => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:47.054160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:47.054798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:47.074066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.075819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.076595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.078089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.078890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.081160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.089715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:47.090326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:47.107319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.108067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.108738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.109723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.110397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.111609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.237384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:47.257328 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b23da50-d244-4581-9449-b4774fe9d779 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1466 microversion: 2.1 time: 0.201119 Oct 31 15:35:47.269123 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2340/4562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:47 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1466 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:47.391854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:47.401555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-65089e48-c49c-428f-a90d-f8b560d67ea6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1516 microversion: 2.1 time: 0.319799 Oct 31 15:35:47.402142 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2223/4563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:47 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:48.282152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:48.285610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:48.306210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.306717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.307157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.314913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.316113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.316584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.436982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a5756d0e-2ac9-41e1-bb29-0b8dbbd327f8 req-9c61d20d-7986-4ebe-af49-f4bdb1bbeade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2713e930-444c-4372-a341-c5c999a4689e", "name": "network-vif-deleted", "tag": "f4bed278-848f-45f1-ab57-576b80dcd1e7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:48.480808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a5756d0e-2ac9-41e1-bb29-0b8dbbd327f8 req-9c61d20d-7986-4ebe-af49-f4bdb1bbeade service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.482064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a5756d0e-2ac9-41e1-bb29-0b8dbbd327f8 req-9c61d20d-7986-4ebe-af49-f4bdb1bbeade service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.487612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a5756d0e-2ac9-41e1-bb29-0b8dbbd327f8 req-9c61d20d-7986-4ebe-af49-f4bdb1bbeade service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.513814 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a5756d0e-2ac9-41e1-bb29-0b8dbbd327f8 req-9c61d20d-7986-4ebe-af49-f4bdb1bbeade service nova] Creating event network-vif-deleted:f4bed278-848f-45f1-ab57-576b80dcd1e7 for instance 2713e930-444c-4372-a341-c5c999a4689e on n-h1-858383-17 Oct 31 15:35:48.524565 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a5756d0e-2ac9-41e1-bb29-0b8dbbd327f8 req-9c61d20d-7986-4ebe-af49-f4bdb1bbeade service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091421 Oct 31 15:35:48.527921 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2224/4564] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:48.547399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:48.556874 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-655ceb7e-9056-4145-a5fd-1f4aa6f8caee tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 200 len: 1466 microversion: 2.1 time: 0.278497 Oct 31 15:35:48.560448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2341/4565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:48 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:49.580448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:49.581388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 2713e930-444c-4372-a341-c5c999a4689e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:49.596510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.597082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.598031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.601053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.601757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.602201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.634148 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] HTTP exception thrown: Instance 2713e930-444c-4372-a341-c5c999a4689e could not be found. Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Request method failure captured: Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e HTTP/1.1 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lT8sK3oZTS4fMh5oyg1sNzWBs-z6goGvayCXg_FfN37F3pf8jx5tM7xF3zh9pOf9ybk5DKiXGJFAmq871If8DP5Z_p2O0G9cmXG2CABNQmJYHsnOqJE6vlwrNUfqbvfomBGpMSndJZ-ECLFXOJjdH-rpchPAvxDIDqewWtfpm91xs Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b75b127e3924430bc27f7f311747382"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b75b127e3924430bc27f7f311747382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 6b1695b4d61d40de8272561b0cf3362e Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2713e930-444c-4372-a341-c5c999a4689e could not be found. Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2713e930-444c-4372-a341-c5c999a4689e'} Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2713e930-444c-4372-a341-c5c999a4689e could not be found. Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2713e930-444c-4372-a341-c5c999a4689e could not be found. Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:49.636762 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2713e930-444c-4372-a341-c5c999a4689e could not be found. Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Returning 404 to user: Instance 2713e930-444c-4372-a341-c5c999a4689e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1833f492-9b6c-4d15-bb0a-15a340843765 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e" status: 404 len: 111 microversion: 2.1 time: 0.062439 Oct 31 15:35:49.645527 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2225/4566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:49 2022] GET /compute/v2.1/servers/2713e930-444c-4372-a341-c5c999a4689e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:49.648262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:49.650391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:49.661792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.664113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.665072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.666348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.666926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.667674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.724232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:49.858895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44eb15de-74bb-45aa-96ca-cc40e2cee704 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 204 len: 0 microversion: 2.1 time: 0.214514 Oct 31 15:35:49.861586 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2342/4567] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:49 2022] DELETE /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:35:49.873224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:49.874229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:49.884335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.885349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.886723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.887776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.888620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.889461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.066207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:50.074353 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f880d78-5ca0-499b-a02d-ffc9a63dbdac tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1507 microversion: 2.1 time: 0.207997 Oct 31 15:35:50.074930 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2226/4568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:49 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:50.101936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:50.104356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.110322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.110903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.111654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.112371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.112878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.113311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.137101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lazy-loading 'flavor' on Instance uuid efb4a0f0-3b54-4012-bfde-2176e14f7711 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:50.235625 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-afa28a3f-2e70-4efb-b82e-b241365c5b04 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action" status: 200 len: 32 microversion: 2.1 time: 0.137868 Oct 31 15:35:50.240893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2343/4569] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:50 2022] POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:35:50.247411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.249328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.257031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.257811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.258531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.259361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.259805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.260320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.449081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:50.458167 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d3c836d-4bcf-4a46-992d-b872a3e9d7e5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.216042 Oct 31 15:35:50.458886 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2227/4570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:50 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:51.100644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:51.101689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:51.110075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.111287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.111999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.112957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.113475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.114316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.296305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.306944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c37ddc6-7368-42cc-9f33-621560c5f654 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1507 microversion: 2.1 time: 0.211305 Oct 31 15:35:51.315985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2344/4571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:51 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:51.484435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:51.485168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:51.493627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.494322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.494846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.495667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.496333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.497011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.683999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.688460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:51.697116 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e8dd7424-552a-4c1e-8bc6-973e8deda3fe tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.217110 Oct 31 15:35:51.698294 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2228/4572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:51 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:52.200319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-864fd22c-69b3-4354-a790-41374475270c req-890d745e-1ded-4f12-a776-d36a564d6e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72ae79b-1d7f-476a-a78d-c87145499fa4", "name": "network-vif-deleted", "tag": "6e8e0815-df9d-4c8b-9c7b-d5b8a5dc7cfb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:52.219554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-864fd22c-69b3-4354-a790-41374475270c req-890d745e-1ded-4f12-a776-d36a564d6e14 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.220056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-864fd22c-69b3-4354-a790-41374475270c req-890d745e-1ded-4f12-a776-d36a564d6e14 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.223711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-864fd22c-69b3-4354-a790-41374475270c req-890d745e-1ded-4f12-a776-d36a564d6e14 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.243600 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-864fd22c-69b3-4354-a790-41374475270c req-890d745e-1ded-4f12-a776-d36a564d6e14 service nova] Creating event network-vif-deleted:6e8e0815-df9d-4c8b-9c7b-d5b8a5dc7cfb for instance f72ae79b-1d7f-476a-a78d-c87145499fa4 on n-h1-858383-17 Oct 31 15:35:52.251458 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-864fd22c-69b3-4354-a790-41374475270c req-890d745e-1ded-4f12-a776-d36a564d6e14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054592 Oct 31 15:35:52.256891 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2345/4573] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:52.330689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:52.331350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:52.337998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.338703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.339139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.340004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.340463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.341081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.380354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.381086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.381522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.382155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lazy-loading 'fault' on Instance uuid f72ae79b-1d7f-476a-a78d-c87145499fa4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:52.431542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.442656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7df6e745-fba3-4eeb-9fea-6c30d9cb067a tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 200 len: 1305 microversion: 2.1 time: 0.116261 Oct 31 15:35:52.443956 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2229/4574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:52 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:52.722813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:52.723960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:52.732223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.732914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.737923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.740389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.741247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.741852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.899332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.908606 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b182bd0f-6157-400c-8a1b-7b3559221e1e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.191167 Oct 31 15:35:52.909331 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2346/4575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:52 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:53.468145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.472476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: f72ae79b-1d7f-476a-a78d-c87145499fa4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.487519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.488330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.489149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.490407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.491035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.491770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.509069 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] HTTP exception thrown: Instance f72ae79b-1d7f-476a-a78d-c87145499fa4 could not be found. Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Request method failure captured: Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 HTTP/1.1 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lT8sK3oZTS4fMh5oyg1sNzWBs-z6goGvayCXg_FfN37F3pf8jx5tM7xF3zh9pOf9ybk5DKiXGJFAmq871If8DP5Z_p2O0G9cmXG2CABNQmJYHsnOqJE6vlwrNUfqbvfomBGpMSndJZ-ECLFXOJjdH-rpchPAvxDIDqewWtfpm91xs Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b75b127e3924430bc27f7f311747382"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b75b127e3924430bc27f7f311747382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 6b1695b4d61d40de8272561b0cf3362e Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f72ae79b-1d7f-476a-a78d-c87145499fa4 could not be found. Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f72ae79b-1d7f-476a-a78d-c87145499fa4'} Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f72ae79b-1d7f-476a-a78d-c87145499fa4 could not be found. Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f72ae79b-1d7f-476a-a78d-c87145499fa4 could not be found. Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:53.510749 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f72ae79b-1d7f-476a-a78d-c87145499fa4 could not be found. Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Returning 404 to user: Instance f72ae79b-1d7f-476a-a78d-c87145499fa4 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:53.516407 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-74ecbabc-ca5d-4258-b931-ced3adf7c230 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4" status: 404 len: 111 microversion: 2.1 time: 0.049759 Oct 31 15:35:53.522660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.523173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.529866 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2230/4576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/f72ae79b-1d7f-476a-a78d-c87145499fa4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:53.533726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.534351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.534788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.535626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.536348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.536789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.581715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:53.723441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-382f1068-4c8b-4e32-a436-a7ede4d5c6ed tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "DELETE /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 204 len: 0 microversion: 2.1 time: 0.205444 Oct 31 15:35:53.724235 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2347/4577] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:53 2022] DELETE /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:53.733688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.734369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.743187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.743683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.744182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.744885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.745643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.746237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.933240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.934084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.946403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.949373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.950073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.951675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.952370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.953120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.015477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.031204 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c37beb3e-ff81-443a-8dbd-93fdbc8ca773 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1495 microversion: 2.1 time: 0.299330 Oct 31 15:35:54.031823 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2231/4578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1495 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:54.214707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.224057 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70b6c8d5-b2e1-4e11-b426-2837aa787f21 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.295512 Oct 31 15:35:54.225571 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2348/4579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:55.059308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.060837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.069489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.070193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.070755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.071641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.072165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.072797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.129324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.129819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.130254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.130704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lazy-loading 'fault' on Instance uuid 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:55.162325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f9afdae5-3da2-4757-8acb-199be0d9d195 req-23708923-0143-4cf9-b41b-b9932e3832e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f713b0-f7f6-4dfb-8eea-6dfd87d0446d", "name": "network-vif-deleted", "tag": "bfa30e8d-ee64-455f-93d6-938773d694f8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:55.175591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f9afdae5-3da2-4757-8acb-199be0d9d195 req-23708923-0143-4cf9-b41b-b9932e3832e9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.176329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f9afdae5-3da2-4757-8acb-199be0d9d195 req-23708923-0143-4cf9-b41b-b9932e3832e9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.176950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f9afdae5-3da2-4757-8acb-199be0d9d195 req-23708923-0143-4cf9-b41b-b9932e3832e9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.190865 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f9afdae5-3da2-4757-8acb-199be0d9d195 req-23708923-0143-4cf9-b41b-b9932e3832e9 service nova] Creating event network-vif-deleted:bfa30e8d-ee64-455f-93d6-938773d694f8 for instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d on n-h2-858383-17 Oct 31 15:35:55.196474 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f9afdae5-3da2-4757-8acb-199be0d9d195 req-23708923-0143-4cf9-b41b-b9932e3832e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449135 Oct 31 15:35:55.197710 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2232/4580] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:55.203683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:55.213159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ada799d1-4163-4641-be53-25b8fdbd69e7 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 200 len: 1305 microversion: 2.1 time: 0.158234 Oct 31 15:35:55.214492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2349/4581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:55 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 1305 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:55.249669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.250584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.258904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.260172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.261172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.262177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.262876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.263704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.532775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:55.541736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f37bf04b-8150-4481-822a-eff2eea710f9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.297211 Oct 31 15:35:55.546038 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2233/4582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:55 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:56.242490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.244055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.253753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.254772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.255359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.257173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.257953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.258540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.278019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] HTTP exception thrown: Instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d could not be found. Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Request method failure captured: Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d HTTP/1.1 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-lT8sK3oZTS4fMh5oyg1sNzWBs-z6goGvayCXg_FfN37F3pf8jx5tM7xF3zh9pOf9ybk5DKiXGJFAmq871If8DP5Z_p2O0G9cmXG2CABNQmJYHsnOqJE6vlwrNUfqbvfomBGpMSndJZ-ECLFXOJjdH-rpchPAvxDIDqewWtfpm91xs Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b75b127e3924430bc27f7f311747382"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b75b127e3924430bc27f7f311747382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 6b1695b4d61d40de8272561b0cf3362e Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d could not be found. Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '47f713b0-f7f6-4dfb-8eea-6dfd87d0446d'} Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d could not be found. Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d could not be found. Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:56.279999 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d could not be found. Oct 31 15:35:56.284660 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:35:56.286954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Returning 404 to user: Instance 47f713b0-f7f6-4dfb-8eea-6dfd87d0446d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:56.288350 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3165011b-4f6e-4272-b52e-1dba989cd805 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d" status: 404 len: 111 microversion: 2.1 time: 0.051388 Oct 31 15:35:56.289375 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2350/4583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:56 2022] GET /compute/v2.1/servers/47f713b0-f7f6-4dfb-8eea-6dfd87d0446d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:56.299660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.300166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.315524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.316116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.316801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.317881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.318535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.318995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.351269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:56.460848 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b0ecd3e5-2e39-4230-95b8-5b3160269f40 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "DELETE /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 204 len: 0 microversion: 2.1 time: 0.164944 Oct 31 15:35:56.462569 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2234/4584] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:56 2022] DELETE /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:56.475531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.476543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.482660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.483154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.483593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.484295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.484775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.485914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.575232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.577178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.584854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.585338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.585828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.586672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.587436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.588103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.737974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:56.740449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:56.747388 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d05d69bb-62a6-45ad-ac8e-848894b19bce tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1675 microversion: 2.1 time: 0.276822 Oct 31 15:35:56.748357 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2351/4585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:56 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:56.804611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:56.812617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6c5e5a3-0fd7-4a75-896d-bcdf2d112945 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.247314 Oct 31 15:35:56.813270 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2235/4586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:56 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:57.773536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.774358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.784164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.785130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.785653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.786474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.787444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.788050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.838265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.839032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.853874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.854391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.854838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.859801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.860369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.861023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.432565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.443555 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f53fd97c-53be-44a8-9ec0-1c68ec02e391 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1675 microversion: 2.1 time: 0.675240 Oct 31 15:35:58.444148 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2352/4587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:57 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1675 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:58.451466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.460821 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42cb2880-3aad-4b15-b9f3-b0288bdb54e0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.629173 Oct 31 15:35:58.473358 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2236/4588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:57 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:59.047979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-893063dd-d021-495b-8ef3-777ed9dabd34 req-07c46283-08dd-4fcc-ac71-10470d6a1cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df0b8-4d02-43ff-bc60-15b89e219abf", "name": "network-vif-deleted", "tag": "ed9b64fc-4e74-4d51-9b2e-2e2edbf69005"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:59.076285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-893063dd-d021-495b-8ef3-777ed9dabd34 req-07c46283-08dd-4fcc-ac71-10470d6a1cf1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.077242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-893063dd-d021-495b-8ef3-777ed9dabd34 req-07c46283-08dd-4fcc-ac71-10470d6a1cf1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.078023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-893063dd-d021-495b-8ef3-777ed9dabd34 req-07c46283-08dd-4fcc-ac71-10470d6a1cf1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.114959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-893063dd-d021-495b-8ef3-777ed9dabd34 req-07c46283-08dd-4fcc-ac71-10470d6a1cf1 service nova] Creating event network-vif-deleted:ed9b64fc-4e74-4d51-9b2e-2e2edbf69005 for instance 874df0b8-4d02-43ff-bc60-15b89e219abf on n-h2-858383-17 Oct 31 15:35:59.125239 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-893063dd-d021-495b-8ef3-777ed9dabd34 req-07c46283-08dd-4fcc-ac71-10470d6a1cf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082088 Oct 31 15:35:59.130086 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2353/4589] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:59.470753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:59.471991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:59.486335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.486960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:59.487313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.487677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:59.488056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.489100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.489999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.490890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.496312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.498930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.499409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.502456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.502954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.503400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.535381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.537988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.539083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.540110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lazy-loading 'fault' on Instance uuid 874df0b8-4d02-43ff-bc60-15b89e219abf {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:59.644010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b1695b4d61d40de8272561b0cf3362e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b75b127e3924430bc27f7f311747382', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.657499 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3c379d1-c2b2-48ec-817f-4c0b9a019cd6 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 200 len: 1328 microversion: 2.1 time: 0.190413 Oct 31 15:35:59.658717 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2237/4590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:59 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 1328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:59.784051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.794858 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71779fd4-1c7d-4a5c-bb49-3ce9970c43a3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.312210 Oct 31 15:35:59.795657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2354/4591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:59 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:00.683180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.683861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] [instance: 874df0b8-4d02-43ff-bc60-15b89e219abf] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:00.696061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.696563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.701829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.701829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.701829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.701829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.736563 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] HTTP exception thrown: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf could not be found. Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Request method failure captured: Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf HTTP/1.1 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-lT8sK3oZTS4fMh5oyg1sNzWBs-z6goGvayCXg_FfN37F3pf8jx5tM7xF3zh9pOf9ybk5DKiXGJFAmq871If8DP5Z_p2O0G9cmXG2CABNQmJYHsnOqJE6vlwrNUfqbvfomBGpMSndJZ-ECLFXOJjdH-rpchPAvxDIDqewWtfpm91xs Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b75b127e3924430bc27f7f311747382"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b75b127e3924430bc27f7f311747382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b75b127e3924430bc27f7f311747382"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-132335233 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 2b75b127e3924430bc27f7f311747382 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-132335233 Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 6b1695b4d61d40de8272561b0cf3362e Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-132335233-project Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf could not be found. Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '874df0b8-4d02-43ff-bc60-15b89e219abf'} Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf could not be found. Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf could not be found. Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:00.741994 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf could not be found. Oct 31 15:36:00.746180 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:36:00.747973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Returning 404 to user: Instance 874df0b8-4d02-43ff-bc60-15b89e219abf could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:00.749256 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90d2ffbc-b435-49be-925d-5448371f2321 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf" status: 404 len: 111 microversion: 2.1 time: 0.070111 Oct 31 15:36:00.755649 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2238/4592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/servers/874df0b8-4d02-43ff-bc60-15b89e219abf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:36:00.760620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-605a16b7-ed01-4f19-be90-41f36c448363 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] Calling method '.version_select at 0x7f5ca130df70>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.787259 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-605a16b7-ed01-4f19-be90-41f36c448363 tempest-ServerActionsTestJSON-132335233 tempest-ServerActionsTestJSON-132335233-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045729152" status: 202 len: 0 microversion: 2.1 time: 0.030396 Oct 31 15:36:00.787854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2355/4593] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:36:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045729152 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:00.820468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.821275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:00.830659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.831180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.831627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.835568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.836081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.837891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:01.053947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:01.065931 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4c83539-fd64-4100-8162-c3d9fc57e61d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.250460 Oct 31 15:36:01.085746 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2239/4594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:02.103271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:02.107261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:02.134260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:02.142979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:02.149358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:02.153454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:02.159235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:02.159838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:02.726325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:02.738983 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d2b64c0-c8b7-4b6a-ab15-7a3a58562994 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.647511 Oct 31 15:36:02.740577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2356/4595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:02 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:03.766106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:03.767267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:03.780336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:03.781418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:03.783806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:03.787518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:03.788178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:03.790033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.192284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:04.204294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-88978edf-cfff-4957-87bc-2e16c67cebb5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.442468 Oct 31 15:36:04.211512 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2240/4596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:03 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:04.813964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "859f94ef-2934-4c7a-87ec-353e087dc020"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:04.817206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:04.825283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.826014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.826625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.827597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.828214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.829391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:05.241270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:05.242455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:05.256871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:05.262549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:05.269462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:05.272594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:05.276912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:05.277730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:05.498018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36966bdb-3ab8-4d60-8574-12a9a2a71d24 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "POST /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668799 Oct 31 15:36:05.498018 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2357/4597] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:36:04 2022] POST /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:06.081187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.095548 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-492796d1-90ec-4e91-8272-cb668acb7dee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.862091 Oct 31 15:36:06.096797 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2241/4598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:05 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:07.123916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:07.124750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:07.146344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:07.154443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:07.155282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:07.156574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:07.164164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:07.166948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:07.169834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:07.811782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:07.828998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52ea8f1f-a21e-4afa-8ca8-642f7562150a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.704715 Oct 31 15:36:07.835077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2358/4599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:07 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:08.863475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:08.865821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:08.887428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.888256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.888913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.891096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.892263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.894896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.561282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:09.575272 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3450fa5b-424a-4b84-9eed-0dd348193d81 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1502 microversion: 2.1 time: 0.712353 Oct 31 15:36:09.580879 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2242/4600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:08 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1502 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:09.606279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a68142-e710-4126-8efd-2131b16de365"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:09.608808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:09.632053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.632566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.637235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.638125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.638517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.638965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.725048 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Cannot 'attach_volume' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state rescued Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/os-volume_attachments HTTP/1.1 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 74 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: {"volumeAttachment": {"volumeId": "11a68142-e710-4126-8efd-2131b16de365"}} Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot 'attach_volume' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state rescued Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': 'efb4a0f0-3b54-4012-bfde-2176e14f7711', 'body': {'volumeAttachment': {'volumeId': '11a68142-e710-4126-8efd-2131b16de365'}}} Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 31 15:36:09.727704 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state rescued Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state rescued Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:09.732430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 409 to user: Cannot 'attach_volume' instance efb4a0f0-3b54-4012-bfde-2176e14f7711 while it is in vm_state rescued {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:09.738634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ef3c328-a69b-4ba4-a5b9-a6d1c8fba6eb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.131257 Oct 31 15:36:09.738634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2359/4601] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:36:09 2022] POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/os-volume_attachments => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:36:09.743848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:09.744635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:09.757806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.760436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.761010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.761872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.763901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.765063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.934153 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afeb3d6d-0514-44ef-86ab-cc9780d59b6b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action" status: 202 len: 0 microversion: 2.1 time: 0.192696 Oct 31 15:36:09.936276 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2243/4602] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:09 2022] POST /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:09.946730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:09.947567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:09.956225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.957188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.958335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.958863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.960126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.960464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.179237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:11.193896 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2801a7ee-e16d-4443-8442-3a317cf39e03 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1510 microversion: 2.1 time: 1.252949 Oct 31 15:36:11.206126 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2360/4603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:09 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1510 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:12.227920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:12.228635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:12.242210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:12.242725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:12.243174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:12.243895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:12.244419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:12.251043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:12.333374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:12.919903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:12.990935 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-062420c5-83a3-4de3-951e-8e0bf052d773 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1510 microversion: 2.1 time: 0.766845 Oct 31 15:36:12.991558 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2244/4604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:12 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1510 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:14.015159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:14.016630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:14.037574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:14.041777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:14.042457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:14.043363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:14.044738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:14.046698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:14.461728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:14.489067 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82de0721-6ff4-4c9e-8b46-61fbb23fdb67 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1516 microversion: 2.1 time: 0.476637 Oct 31 15:36:14.517646 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2361/4605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:14 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1516 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:17.826572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a59fda9a-a72e-4317-b4b5-c3e192c6e573 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'create', calling method: .version_select at 0x7f5ca11793a0>, body: {"keypair": {"name": "tempest-keypair-284758742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXIo6lsE7CkOL3QgObKzaqs1mDCIauwn3XmntjE+KKi5cl11Abxcme6DV/LKnBEkONZy5XaNxdQ6iaKj207Xh1oD9JUEATOC7nrpq903xe/k9eXq5PQziHQV3lrfv2mGg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:17.855826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:17.886368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a59fda9a-a72e-4317-b4b5-c3e192c6e573 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for project ca2dcd238bdf4ac994999771f8478dff. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:17.904929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a59fda9a-a72e-4317-b4b5-c3e192c6e573 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for user 3b26002fe48044e7bc31993c6698a22e and project ca2dcd238bdf4ac994999771f8478dff. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:17.934694 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a59fda9a-a72e-4317-b4b5-c3e192c6e573 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111821 Oct 31 15:36:17.936052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2245/4606] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:36:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:21.682085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-575805578", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12bd35e8-2dc1-4927-aa68-3c6ddba518d5"}], "security_groups": [{"name": "tempest-securitygroup--803004827"}], "key_name": "tempest-keypair-284758742", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:21.930985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] validate_networks() for [('12bd35e8-2dc1-4927-aa68-3c6ddba518d5', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:36:24.477973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:24.547515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:24.548306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:24.549767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:24.550524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:24.551096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:24.569155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.570887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.572593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.574713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.575197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.575633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.654712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for project ca2dcd238bdf4ac994999771f8478dff. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:24.716885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Getting quotas for user 3b26002fe48044e7bc31993c6698a22e and project ca2dcd238bdf4ac994999771f8478dff. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:24.786341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:36:24.789877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:36:24.847003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:24.849205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:24.855247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:24.873716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.884478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.886471 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c19ff66b-439c-4723-9e5d-57774d16648f tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.211148 Oct 31 15:36:24.900879 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2362/4607] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:36:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 3228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:36:24.904229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.905039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.905522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.906584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.919352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d0f25c6-3016-492f-b85a-90e5cd7b2fe7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:24.919989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d0f25c6-3016-492f-b85a-90e5cd7b2fe7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:25.038222 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7810b0fc-2480-4cf1-a984-8198997261a7 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188549 Oct 31 15:36:25.044459 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2246/4608] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:36:24 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:36:25.064669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:25.065525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:25.082014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.086148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.086747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.088844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.089745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.090602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.135362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d0f25c6-3016-492f-b85a-90e5cd7b2fe7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:25.147950 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d0f25c6-3016-492f-b85a-90e5cd7b2fe7 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1244 microversion: 2.1 time: 0.243797 Oct 31 15:36:25.148803 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2363/4609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:24 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1244 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:25.362702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lazy-loading 'services' on Instance uuid 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:36:25.781239 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-371a4727-145a-4007-b5a5-5fbd4805899e tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments/859f94ef-2934-4c7a-87ec-353e087dc020" status: 202 len: 0 microversion: 2.1 time: 0.704826 Oct 31 15:36:25.788622 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2247/4610] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:36:25 2022] DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments/859f94ef-2934-4c7a-87ec-353e087dc020 => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:26.176059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55119cd9-5fbf-4574-91e8-e3e393ec5494 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:26.177448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55119cd9-5fbf-4574-91e8-e3e393ec5494 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:26.277823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55119cd9-5fbf-4574-91e8-e3e393ec5494 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.288465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55119cd9-5fbf-4574-91e8-e3e393ec5494 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1244 microversion: 2.1 time: 0.116142 Oct 31 15:36:26.289310 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2364/4611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:26 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1244 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:27.317406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:27.318894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:27.340153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.343034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.345596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.347010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.353962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.355245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.614484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.630673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd402092-06ca-475f-a41e-893e25dabb4b tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1240 microversion: 2.1 time: 0.317525 Oct 31 15:36:27.648015 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2248/4612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:27 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1240 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:28.672022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.672938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:28.693844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.695410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.696960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.698556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.701026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.701753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.160031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.172601 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9bb9fec2-c10d-47c3-8332-9e2e0b219e4e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1302 microversion: 2.1 time: 0.513070 Oct 31 15:36:29.193394 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2365/4613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:28 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1302 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:30.209329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.210255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.218118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:30.233830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.234635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.235152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.235889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.236357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.241040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.346093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.372055 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f610a17f-287d-4eb3-80ea-0957beeec26c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 1.154660 Oct 31 15:36:31.375613 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2249/4614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:32.403807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:32.403807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:32.410519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.411085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.411430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.412216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.412584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.445764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.961473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b37aef59-904e-4841-b771-b9ae1ea62a03 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Action: 'create', calling method: .version_select at 0x7f5ca1319310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:33.086186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b37aef59-904e-4841-b771-b9ae1ea62a03 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Getting quotas for project b5f0772e0502463db14ef6ebb4ab8960. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:33.119308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b37aef59-904e-4841-b771-b9ae1ea62a03 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Getting quotas for user 680a1bfc216a4670ba635e4577b89009 and project b5f0772e0502463db14ef6ebb4ab8960. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:33.338712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b37aef59-904e-4841-b771-b9ae1ea62a03 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Getting quotas for project b5f0772e0502463db14ef6ebb4ab8960. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:33.364373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b37aef59-904e-4841-b771-b9ae1ea62a03 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Getting quotas for user 680a1bfc216a4670ba635e4577b89009 and project b5f0772e0502463db14ef6ebb4ab8960. Resources: {'server_groups'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:33.432278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b37aef59-904e-4841-b771-b9ae1ea62a03 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.471276 Oct 31 15:36:33.434451 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2366/4615] 10.222.0.48 () {62 vars in 1214 bytes} [Mon Oct 31 15:36:31 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:33.463164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26c86aeb-d40f-4db4-b7c8-df05e1c10f82 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.496998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26c86aeb-d40f-4db4-b7c8-df05e1c10f82 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.048620 Oct 31 15:36:33.506160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2367/4616] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Oct 31 15:36:33 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:33.520249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-cc5a96e9-b5f0-4280-9794-d9e0cc8189f3 req-c52cd070-8012-4a66-af6d-154629354d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713c7cb6-b332-4f57-b8a3-6b233e3b311a", "tag": "453f0fee-9b5b-40b8-85f4-c5304d8b4731"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:33.566618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cc5a96e9-b5f0-4280-9794-d9e0cc8189f3 req-c52cd070-8012-4a66-af6d-154629354d56 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.567510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cc5a96e9-b5f0-4280-9794-d9e0cc8189f3 req-c52cd070-8012-4a66-af6d-154629354d56 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.568184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cc5a96e9-b5f0-4280-9794-d9e0cc8189f3 req-c52cd070-8012-4a66-af6d-154629354d56 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.583617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-cc5a96e9-b5f0-4280-9794-d9e0cc8189f3 req-c52cd070-8012-4a66-af6d-154629354d56 service nova] Creating event network-changed:453f0fee-9b5b-40b8-85f4-c5304d8b4731 for instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a on n-h2-858383-17 Oct 31 15:36:33.590555 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-cc5a96e9-b5f0-4280-9794-d9e0cc8189f3 req-c52cd070-8012-4a66-af6d-154629354d56 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080994 Oct 31 15:36:33.592371 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2368/4617] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:33.599622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4869c00-8c1e-452a-9455-8b24977bd249 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.613888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4869c00-8c1e-452a-9455-8b24977bd249 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762" status: 200 len: 235 microversion: 2.64 time: 0.019137 Oct 31 15:36:33.622178 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2369/4618] 10.222.0.48 () {60 vars in 1304 bytes} [Mon Oct 31 15:36:33 2022] GET /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762 => generated 235 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:33.634131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94de6d26-4bad-41db-9351-f0afd28e4712 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.707598 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94de6d26-4bad-41db-9351-f0afd28e4712 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762" status: 204 len: 0 microversion: 2.64 time: 0.083764 Oct 31 15:36:33.713157 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2370/4619] 10.222.0.48 () {60 vars in 1307 bytes} [Mon Oct 31 15:36:33 2022] DELETE /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:36:33.719742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9468db6-00e2-4827-8151-6a68cf0a0ae7 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.737620 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d9468db6-00e2-4827-8151-6a68cf0a0ae7 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] HTTP exception thrown: Instance group fbb78f09-f586-4f38-820f-cd448d5a3762 could not be found. Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9468db6-00e2-4827-8151-6a68cf0a0ae7 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Request method failure captured: Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762 HTTP/1.1 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-t_44uJjZ-2oUcRlx2PcnPynxJ6Tq9VTCa7mBx7Td6EarBP4bq14OEfp8VGIOSR4-cQSdXSbPCkIS1UGhlItK-KAzu0J3IVo0CYy4QcclfbShf_UgxMPYquSRctRKeAqLs372MH1UXl35C39dK0GNG41zdbY6RS1AhuHNw3NGWimFE Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.64 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b5f0772e0502463db14ef6ebb4ab8960 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerGroup264TestJSON-1124453434 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b5f0772e0502463db14ef6ebb4ab8960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5f0772e0502463db14ef6ebb4ab8960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b5f0772e0502463db14ef6ebb4ab8960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b5f0772e0502463db14ef6ebb4ab8960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerGroup264TestJSON-1124453434 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b5f0772e0502463db14ef6ebb4ab8960 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1124453434 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerGroup264TestJSON-1124453434-project Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 680a1bfc216a4670ba635e4577b89009 Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerGroup264TestJSON-1124453434-project Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance group fbb78f09-f586-4f38-820f-cd448d5a3762 could not be found. Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'fbb78f09-f586-4f38-820f-cd448d5a3762'} Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fbb78f09-f586-4f38-820f-cd448d5a3762 could not be found. Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fbb78f09-f586-4f38-820f-cd448d5a3762 could not be found. Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:33.747389 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:33.752046 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:33.752046 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:33.752046 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:33.752046 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:33.752046 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fbb78f09-f586-4f38-820f-cd448d5a3762 could not be found. Oct 31 15:36:33.752046 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:33.756130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9468db6-00e2-4827-8151-6a68cf0a0ae7 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] Returning 404 to user: Instance group fbb78f09-f586-4f38-820f-cd448d5a3762 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:33.757580 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9468db6-00e2-4827-8151-6a68cf0a0ae7 tempest-ServerGroup264TestJSON-1124453434 tempest-ServerGroup264TestJSON-1124453434-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762" status: 404 len: 117 microversion: 2.64 time: 0.042963 Oct 31 15:36:33.758409 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2371/4620] 10.222.0.48 () {60 vars in 1307 bytes} [Mon Oct 31 15:36:33 2022] DELETE /compute/v2.1/os-server-groups/fbb78f09-f586-4f38-820f-cd448d5a3762 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:36:33.808388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.822472 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aad244ca-e530-4ab9-9dc8-b3eb8d4db012 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 1.424494 Oct 31 15:36:33.834024 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2250/4621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:32 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:34.849801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:34.851536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:34.872523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:34.877700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.879857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.883588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.885964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.886728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.887792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:36.039843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:36.057329 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-107dff47-36e0-436d-bf7c-f9411c89f0c4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 1.209217 Oct 31 15:36:36.064179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2372/4622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:34 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:37.087076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:37.087696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:37.099105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.099602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.100049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.100784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.101241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.101738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.564881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:37.575702 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3f2ab73c-9b1c-4c2d-a84b-7ae362fe3d96 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 0.492685 Oct 31 15:36:37.579679 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2251/4623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:37 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:37.848515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:37.850852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:37.866728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:37.880960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.881574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.882103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.882789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.883318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.883678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.972957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8cf1cf3-0d20-4bda-8d48-b01bada0eee5 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124149 Oct 31 15:36:37.978838 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2373/4624] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:36:37 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:38.128385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.134733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.153958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.156815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.157509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.173113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.173929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.174440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.288040 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc43e533-2544-4827-837a-37a0bd11a44f tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.163794 Oct 31 15:36:38.297235 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2252/4625] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:38.394250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.395011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.403021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.403672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.404260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.405158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.405860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.406437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.444762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:36:38.611856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.612550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.625986 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-417e2b98-1688-4191-8fbd-626362c3f67c tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 204 len: 0 microversion: 2.1 time: 0.238773 Oct 31 15:36:38.627312 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2374/4626] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:36:38 2022] DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:36:38.638853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.642341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.644843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.648745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.651590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.653434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.654112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.654817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.655602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.662124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.663096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.664101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.664825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.665529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:39.115314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:39.128918 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdeddeb4-9934-4007-88c0-0c02ef8273bd tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1682 microversion: 2.1 time: 0.497223 Oct 31 15:36:39.130022 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2375/4627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1682 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:39.336457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:39.349270 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eed2f02c-df85-4215-9616-3126b771bf89 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 0.747924 Oct 31 15:36:39.353577 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2253/4628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:40.154165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:40.154776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:40.189145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.189659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.190104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.190861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.191305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.191729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.381030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:40.381652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:40.404675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.406547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.412327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.412828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.414044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.415285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:42.596184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.610398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6d57a6e-806e-4732-bcad-c79cd5c24f2e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 2.231389 Oct 31 15:36:42.612977 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2254/4629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:40 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:42.644767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.661018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94fb41a6-f346-49dc-881d-9514ffd7b376 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1682 microversion: 2.1 time: 2.509626 Oct 31 15:36:42.663619 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2376/4630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:40 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1682 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:43.110953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0c63bbdf-886f-4aa6-bb03-6b949b3acc6a req-ecb2cade-df02-4738-8252-70ccb311b4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713c7cb6-b332-4f57-b8a3-6b233e3b311a", "name": "network-vif-plugged", "status": "completed", "tag": "453f0fee-9b5b-40b8-85f4-c5304d8b4731"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:43.135500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c63bbdf-886f-4aa6-bb03-6b949b3acc6a req-ecb2cade-df02-4738-8252-70ccb311b4a0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.143014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c63bbdf-886f-4aa6-bb03-6b949b3acc6a req-ecb2cade-df02-4738-8252-70ccb311b4a0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.145673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c63bbdf-886f-4aa6-bb03-6b949b3acc6a req-ecb2cade-df02-4738-8252-70ccb311b4a0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.181509 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0c63bbdf-886f-4aa6-bb03-6b949b3acc6a req-ecb2cade-df02-4738-8252-70ccb311b4a0 service nova] Creating event network-vif-plugged:453f0fee-9b5b-40b8-85f4-c5304d8b4731 for instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a on n-h2-858383-17 Oct 31 15:36:43.200790 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0c63bbdf-886f-4aa6-bb03-6b949b3acc6a req-ecb2cade-df02-4738-8252-70ccb311b4a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583382 Oct 31 15:36:43.204417 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2255/4631] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:43.639472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:43.641015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:43.653268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:43.689951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.691051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:43.697154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.697154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.697154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.697625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.698804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:43.699480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.711676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.712181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.712625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.713383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.720589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.721093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.718813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:44.735999 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9878b93-8a7f-467f-b1f5-c52cdb206ff1 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1682 microversion: 2.1 time: 1.047416 Oct 31 15:36:44.737322 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2256/4632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:43 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1682 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:44.785881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:44.796608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f609431-2b4d-408a-b79b-47e3f3cb1f60 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1369 microversion: 2.1 time: 1.161271 Oct 31 15:36:44.807714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2377/4633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:43 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1369 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:45.767682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:45.768462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:45.798694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.799805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.805515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.821433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.822238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.833399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.836479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:45.838136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:45.859454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.861477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.864473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.865672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.869565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.870543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.263369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:46.273021 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-340e504f-8bec-45c9-b886-3c5a9f173ce2 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1615 microversion: 2.1 time: 0.510495 Oct 31 15:36:46.300986 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2257/4634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:45 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1615 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:46.699591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:46.713698 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-585c92f1-8436-4c04-90f1-768d276503fd tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1563 microversion: 2.1 time: 0.881356 Oct 31 15:36:46.732560 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2378/4635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:45 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1563 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:46.743067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:46.743418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:46.749553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.750052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.750503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.751196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.751654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.771812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.261044 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e3c6acb9-8115-4d61-9571-17fda0774bf4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.522422 Oct 31 15:36:47.262215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2258/4636] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:36:46 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-interface => generated 284 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:47.321585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:47.323304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:47.348231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.349176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.349850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.352197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.353925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.359772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.770295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-324f1f20-5926-4559-8537-ec61853d4880 req-56501cb8-6b60-4e54-b454-b5a7f27771f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82", "name": "network-vif-deleted", "tag": "766be369-b20c-4cee-b5a8-6f76eb40471a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:47.797282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293a79873d9b4695aab79f6c9cde33e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ffa79fc114100a66fbfce1fa7c933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:47.803044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-324f1f20-5926-4559-8537-ec61853d4880 req-56501cb8-6b60-4e54-b454-b5a7f27771f2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.803584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-324f1f20-5926-4559-8537-ec61853d4880 req-56501cb8-6b60-4e54-b454-b5a7f27771f2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.806330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-324f1f20-5926-4559-8537-ec61853d4880 req-56501cb8-6b60-4e54-b454-b5a7f27771f2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.814378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3a7087e-23ad-43f2-be77-19e3eb04ed99 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 200 len: 1615 microversion: 2.1 time: 0.494500 Oct 31 15:36:47.815546 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2379/4637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:47 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 1615 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:47.833096 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-324f1f20-5926-4559-8537-ec61853d4880 req-56501cb8-6b60-4e54-b454-b5a7f27771f2 service nova] Creating event network-vif-deleted:766be369-b20c-4cee-b5a8-6f76eb40471a for instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 on n-h1-858383-17 Oct 31 15:36:47.840159 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-324f1f20-5926-4559-8537-ec61853d4880 req-56501cb8-6b60-4e54-b454-b5a7f27771f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075043 Oct 31 15:36:47.846355 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2259/4638] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:48.840126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:48.840779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:48.848782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.861189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.861990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.863161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.864111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.864799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.898460 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] HTTP exception thrown: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Request method failure captured: Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 HTTP/1.1 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-rAnkQaq4dGoFJVJLBHyIQX6ug7UAz23CqWeokQDtfLyoaiIATtLkyiLbA45JrjqFnKroOVQzIKM2SC6WOrhoVYoqgRE7-1dT3rifwumLnvSFv7SCANHDGgns1qdJbL_8hryE0uSAwTUgOzmw20TCfs-x_BeGOv_W5kUHL2nSase5A Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4e7ffa79fc114100a66fbfce1fa7c933 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4e7ffa79fc114100a66fbfce1fa7c933 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachSCSIVolumeTestJSON-1891575668-project Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 293a79873d9b4695aab79f6c9cde33e8 Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1891575668-project Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82'} Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:48.912890 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:36:48.917071 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:36:48.919011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Returning 404 to user: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:48.920130 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-415d7611-d2f7-4edd-8998-9a81b67c5d92 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 404 len: 111 microversion: 2.1 time: 0.083786 Oct 31 15:36:48.924854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2380/4639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:48 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:36:48.935610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-53b99afe-cb3f-406b-9df2-92bddb7486b3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '.version_select at 0x7f5ca1018430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:48.950418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:48.991515 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-53b99afe-cb3f-406b-9df2-92bddb7486b3 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086877626" status: 202 len: 0 microversion: 2.1 time: 0.061982 Oct 31 15:36:48.993030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2260/4640] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:36:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086877626 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:51.332592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d2836b02-ea67-414c-85a1-2fa93436a5fe req-81a55b09-b27b-4d79-b128-9fdbfc704a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713c7cb6-b332-4f57-b8a3-6b233e3b311a", "tag": "453f0fee-9b5b-40b8-85f4-c5304d8b4731"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:51.372844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d2836b02-ea67-414c-85a1-2fa93436a5fe req-81a55b09-b27b-4d79-b128-9fdbfc704a44 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.374344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d2836b02-ea67-414c-85a1-2fa93436a5fe req-81a55b09-b27b-4d79-b128-9fdbfc704a44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.379769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d2836b02-ea67-414c-85a1-2fa93436a5fe req-81a55b09-b27b-4d79-b128-9fdbfc704a44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.406043 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d2836b02-ea67-414c-85a1-2fa93436a5fe req-81a55b09-b27b-4d79-b128-9fdbfc704a44 service nova] Creating event network-changed:453f0fee-9b5b-40b8-85f4-c5304d8b4731 for instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a on n-h2-858383-17 Oct 31 15:36:51.422097 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d2836b02-ea67-414c-85a1-2fa93436a5fe req-81a55b09-b27b-4d79-b128-9fdbfc704a44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093227 Oct 31 15:36:51.422902 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2381/4641] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:00.370811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:00.372080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:00.377065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:00.377767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:00.395291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.396250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.396978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.397965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.398663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.399326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.417725 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] HTTP exception thrown: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Request method failure captured: Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 HTTP/1.1 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-rAnkQaq4dGoFJVJLBHyIQX6ug7UAz23CqWeokQDtfLyoaiIATtLkyiLbA45JrjqFnKroOVQzIKM2SC6WOrhoVYoqgRE7-1dT3rifwumLnvSFv7SCANHDGgns1qdJbL_8hryE0uSAwTUgOzmw20TCfs-x_BeGOv_W5kUHL2nSase5A Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4e7ffa79fc114100a66fbfce1fa7c933 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4e7ffa79fc114100a66fbfce1fa7c933 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachSCSIVolumeTestJSON-1891575668-project Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 293a79873d9b4695aab79f6c9cde33e8 Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1891575668-project Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82'} Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:00.419791 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.424681 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.427732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Returning 404 to user: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:00.428903 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e30f15c7-8a44-405a-970f-be6c1386eb2a tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 404 len: 111 microversion: 2.1 time: 0.060409 Oct 31 15:37:00.432344 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2261/4642] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:37:00 2022] DELETE /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:00.440796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:00.443570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] [instance: 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:00.458037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.460330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.461040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.470911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.471705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.472375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.477935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:00.503376 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] HTTP exception thrown: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Request method failure captured: Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 HTTP/1.1 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-rAnkQaq4dGoFJVJLBHyIQX6ug7UAz23CqWeokQDtfLyoaiIATtLkyiLbA45JrjqFnKroOVQzIKM2SC6WOrhoVYoqgRE7-1dT3rifwumLnvSFv7SCANHDGgns1qdJbL_8hryE0uSAwTUgOzmw20TCfs-x_BeGOv_W5kUHL2nSase5A Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4e7ffa79fc114100a66fbfce1fa7c933 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7ffa79fc114100a66fbfce1fa7c933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4e7ffa79fc114100a66fbfce1fa7c933 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1891575668 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachSCSIVolumeTestJSON-1891575668-project Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 293a79873d9b4695aab79f6c9cde33e8 Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1891575668-project Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82'} Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:00.505601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. Oct 31 15:37:00.509494 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:00.511615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] Returning 404 to user: Instance 5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:00.514581 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb0a301c-10b3-4828-8d2d-faf8938c2821 tempest-AttachSCSIVolumeTestJSON-1891575668 tempest-AttachSCSIVolumeTestJSON-1891575668-project] 10.222.0.48 "GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82" status: 404 len: 111 microversion: 2.1 time: 0.080418 Oct 31 15:37:00.521099 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2382/4643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:00 2022] GET /compute/v2.1/servers/5db55cb1-fd0f-4a6f-a9c8-93b44e4eec82 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:10.472187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:10.473388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:10.932795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1383833230", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:11.026721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] validate_networks() for [('3f354567-84af-4a9f-8236-939157585e8e', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:37:14.583416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:37:14.584101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:37:14.584293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:37:14.584942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:37:14.585510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:37:14.608162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:14.608652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:14.618970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:14.620110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:14.620949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:14.621797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:14.645464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Getting quotas for project 801193b145734707b663dfbc46eb4911. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:37:14.651675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Getting quotas for user 59009d5c914b472eb99d4d4b599d014a and project 801193b145734707b663dfbc46eb4911. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:37:14.679886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:37:14.685608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:37:14.843591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-38f3536e-0637-4b7f-aee9-465779ed0666 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.378060 Oct 31 15:37:14.846563 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2262/4644] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:37:14.860069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e88aef62-aa8f-4feb-96c8-6215d71cf811 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:14.863559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e88aef62-aa8f-4feb-96c8-6215d71cf811 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:14.888782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:15.151490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e88aef62-aa8f-4feb-96c8-6215d71cf811 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:15.164540 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e88aef62-aa8f-4feb-96c8-6215d71cf811 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1224 microversion: 2.1 time: 0.312853 Oct 31 15:37:15.198361 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2383/4645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:14 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1224 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:16.207755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:16.208605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:16.219914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.221002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.221707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.222642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.223211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.223963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.371462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Calling method '.version_select at 0x7f5ca1018e50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:16.374331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.374871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.375237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.398004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:16.413782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5c4b10d-337c-43da-b8a9-fa68aecd6b08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1228 microversion: 2.1 time: 0.209241 Oct 31 15:37:16.417752 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2384/4646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:16 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1228 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:16.424033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.440186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.440639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.459595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.460306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.476725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.485323 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7346f80b-e048-495b-8cf9-413722e07ae9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1356203871-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.558519 Oct 31 15:37:16.486254 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2263/4647] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:37:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:16.699526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "adc4247c-0f56-478d-8c93-c5b325fa7075"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:16.702667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:16.738352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.747244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.748549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.750226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.750891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.751733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:17.325096 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71c5b9ac-266a-43ec-b99b-96a240e44beb tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630732 Oct 31 15:37:17.327760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2385/4648] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:37:16 2022] POST /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:17.442618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:17.443225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:17.459669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:17.462054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:17.462556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:17.463293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:17.463756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:17.468971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:18.357421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:18.378703 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c10d3d5-5b47-4043-a955-28f51749075b tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1294 microversion: 2.1 time: 0.940244 Oct 31 15:37:18.381240 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2264/4649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:17 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1294 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:19.405968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:19.406830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:19.422600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:19.423876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:19.426036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:19.429296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:19.432048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:19.433008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:20.070727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:20.078656 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42102812-7b2e-40ec-a419-958046c0ca46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 0.677994 Oct 31 15:37:20.085814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2386/4650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:19 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:21.115246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:21.116069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:21.139811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:21.140260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:21.140752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:21.145488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:21.146146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:21.150373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:22.161044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:22.175307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2213af3c-6134-49ef-92e7-ff2f0c4cca24 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 1.066835 Oct 31 15:37:22.176390 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2265/4651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:21 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:23.204491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:23.205776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:23.219455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:23.221325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:23.222573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:23.223528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:23.224208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:23.224873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:24.047373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-603a73d5-ac83-4a93-8cf5-faab61bb67b9 req-90273737-c04f-4bbb-8c68-9cf095e3c986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e", "tag": "b3f7503f-4d59-46e8-8bf7-447989d85820"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:24.060320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-603a73d5-ac83-4a93-8cf5-faab61bb67b9 req-90273737-c04f-4bbb-8c68-9cf095e3c986 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:24.061788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-603a73d5-ac83-4a93-8cf5-faab61bb67b9 req-90273737-c04f-4bbb-8c68-9cf095e3c986 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:24.062432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-603a73d5-ac83-4a93-8cf5-faab61bb67b9 req-90273737-c04f-4bbb-8c68-9cf095e3c986 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:24.076652 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-603a73d5-ac83-4a93-8cf5-faab61bb67b9 req-90273737-c04f-4bbb-8c68-9cf095e3c986 service nova] Creating event network-changed:b3f7503f-4d59-46e8-8bf7-447989d85820 for instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e on n-h1-858383-17 Oct 31 15:37:24.082148 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-603a73d5-ac83-4a93-8cf5-faab61bb67b9 req-90273737-c04f-4bbb-8c68-9cf095e3c986 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039402 Oct 31 15:37:24.083344 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2266/4652] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:24.347933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:24.356094 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2cdf9b87-5b56-4a04-a213-db72a7edb74a tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 1.156843 Oct 31 15:37:24.361434 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2387/4653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:23 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:25.376246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:25.378968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:25.385717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:25.386722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:25.431853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:25.432430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:25.432926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:25.433964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:25.435171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:25.439461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:25.873640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:25.910086 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcc24e52-8686-4c41-a766-614a00d1735e tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 0.521599 Oct 31 15:37:25.910789 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2267/4654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:25 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:26.935402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:26.936832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:26.947823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:26.956414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:26.956943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:26.957441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:26.961674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:26.963390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:26.963849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:27.822256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:27.843925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c8267861-4353-4a2a-8a29-029b735c3eb8 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 0.912644 Oct 31 15:37:27.845986 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2388/4655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:26 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:28.873950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:28.874784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:28.886758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:28.887522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:28.888486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:28.889241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:28.889703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:28.890134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:29.740358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:29.753206 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5370cb24-f2be-40e7-af17-98f49347d057 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 0.883973 Oct 31 15:37:29.756988 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2268/4656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:28 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:30.783053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:30.783793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:30.799173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:30.799549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:30.800320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:30.802657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:30.803420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:30.803867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:30.846999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1231bb1a-42d8-43a9-bddd-2c284d65cbfa req-bc8b4057-fe2f-4060-ba6d-d58e8e53e800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e", "name": "network-vif-plugged", "status": "completed", "tag": "b3f7503f-4d59-46e8-8bf7-447989d85820"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:30.866900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1231bb1a-42d8-43a9-bddd-2c284d65cbfa req-bc8b4057-fe2f-4060-ba6d-d58e8e53e800 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:30.870722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1231bb1a-42d8-43a9-bddd-2c284d65cbfa req-bc8b4057-fe2f-4060-ba6d-d58e8e53e800 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:30.871343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1231bb1a-42d8-43a9-bddd-2c284d65cbfa req-bc8b4057-fe2f-4060-ba6d-d58e8e53e800 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:30.904406 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1231bb1a-42d8-43a9-bddd-2c284d65cbfa req-bc8b4057-fe2f-4060-ba6d-d58e8e53e800 service nova] Creating event network-vif-plugged:b3f7503f-4d59-46e8-8bf7-447989d85820 for instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e on n-h1-858383-17 Oct 31 15:37:30.915108 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1231bb1a-42d8-43a9-bddd-2c284d65cbfa req-bc8b4057-fe2f-4060-ba6d-d58e8e53e800 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072882 Oct 31 15:37:30.916852 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2269/4657] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:31.480087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:31.488634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a937ab1-3dd9-43b6-953b-a0b30935d73f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 0.712001 Oct 31 15:37:31.492791 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2389/4658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:30 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:32.205914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:32.209620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:32.218735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.219643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.220216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.221084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.221654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.222196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.276810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lazy-loading 'flavor' on Instance uuid 713c7cb6-b332-4f57-b8a3-6b233e3b311a {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:32.499182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ddd9e7b-ad93-4866-a91c-b174ea3d5854 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/action" status: 200 len: 32 microversion: 2.1 time: 0.297316 Oct 31 15:37:32.502174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2270/4659] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:37:32 2022] POST /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:37:32.509969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:32.510624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:32.523790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:32.524513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:32.525868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.526568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.527349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.529812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.530455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.534062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.559904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.560890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.561441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.562267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.562835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.563538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:34.355121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:34.368296 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ea6fba4-d60a-46f2-b011-d8fb7ea52ff5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 1.861625 Oct 31 15:37:34.385367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:34.396414 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2390/4660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:32 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:34.407965 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd79295c-263f-4ec1-bb92-376c38bad13f tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1324 microversion: 2.1 time: 1.894797 Oct 31 15:37:34.412168 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2271/4661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:32 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1324 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:35.397723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:35.398345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:35.416563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:35.417107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:35.417546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:35.418261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:35.419354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:35.419789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:35.433748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:35.435660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:35.447428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:35.448292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:35.448991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:35.450527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:35.453262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:35.453950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:35.832939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:35.859078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ea34c96-d402-4da8-bf85-3e8ce45998a9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.456221 Oct 31 15:37:35.859839 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2391/4662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:35 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:36.055131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:36.065239 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bf7578c-0633-4bdf-ab62-abf7047d99f4 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1520 microversion: 2.1 time: 0.635183 Oct 31 15:37:36.081025 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2272/4663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:35 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1520 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:36.250936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3e0b36c-affc-4ce9-805b-f3a381245641 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-323611508", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3e0b36c-affc-4ce9-805b-f3a381245641 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 242 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-323611508", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-323611508', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3f354567-84af-4a9f-8236-939157585e8e'}]}}} Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.255409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.259596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3e0b36c-affc-4ce9-805b-f3a381245641 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.262863 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3e0b36c-affc-4ce9-805b-f3a381245641 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011143 Oct 31 15:37:36.289119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3656ab43-ecb9-46bf-a4ba-eef3fb777b31 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:36.289773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3656ab43-ecb9-46bf-a4ba-eef3fb777b31 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: f55cb779-49a9-413d-98f0-1bfeecacbd45] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:36.297100 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2392/4664] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:37:36 2022] POST /compute/v2.1/servers => generated 175 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:36.297363 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3656ab43-ecb9-46bf-a4ba-eef3fb777b31 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] HTTP exception thrown: Instance f55cb779-49a9-413d-98f0-1bfeecacbd45 could not be found. Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3656ab43-ecb9-46bf-a4ba-eef3fb777b31 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f55cb779-49a9-413d-98f0-1bfeecacbd45/metadata HTTP/1.1 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f55cb779-49a9-413d-98f0-1bfeecacbd45 could not be found. Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': 'f55cb779-49a9-413d-98f0-1bfeecacbd45'} Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55cb779-49a9-413d-98f0-1bfeecacbd45 could not be found. Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55cb779-49a9-413d-98f0-1bfeecacbd45 could not be found. Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.306549 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.311922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:36.311922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:36.311922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55cb779-49a9-413d-98f0-1bfeecacbd45 could not be found. Oct 31 15:37:36.311922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.314154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3656ab43-ecb9-46bf-a4ba-eef3fb777b31 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 404 to user: Instance f55cb779-49a9-413d-98f0-1bfeecacbd45 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.315195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3656ab43-ecb9-46bf-a4ba-eef3fb777b31 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/f55cb779-49a9-413d-98f0-1bfeecacbd45/metadata" status: 404 len: 111 microversion: 2.1 time: 0.034849 Oct 31 15:37:36.316382 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2273/4665] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 15:37:36 2022] GET /compute/v2.1/servers/f55cb779-49a9-413d-98f0-1bfeecacbd45/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:36.403993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d262e0f2-6ce8-48d7-ae75-5e1982885ae2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-379918601", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d262e0f2-6ce8-48d7-ae75-5e1982885ae2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 498 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-379918601", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-379918601', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3f354567-84af-4a9f-8236-939157585e8e'}]}}} Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:37:36.411063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.414382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.418656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d262e0f2-6ce8-48d7-ae75-5e1982885ae2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.419799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d262e0f2-6ce8-48d7-ae75-5e1982885ae2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.020682 Oct 31 15:37:36.420926 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2393/4666] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:37:36 2022] POST /compute/v2.1/servers => generated 687 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:36.499851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02857e7a-52de-47e4-87c1-c0a68af6cb97 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1037539363", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02857e7a-52de-47e4-87c1-c0a68af6cb97 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 500 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1037539363", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1037539363', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3f354567-84af-4a9f-8236-939157585e8e'}]}}} Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:37:36.504753 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.508422 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.510936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02857e7a-52de-47e4-87c1-c0a68af6cb97 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.511705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02857e7a-52de-47e4-87c1-c0a68af6cb97 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017220 Oct 31 15:37:36.513557 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2274/4667] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:37:36 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:36.585356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f85b4486-e658-4aed-9ed0-7037df11e0d1 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-168004259", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f85b4486-e658-4aed-9ed0-7037df11e0d1 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 753 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-168004259", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-168004259', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3f354567-84af-4a9f-8236-939157585e8e'}]}}} Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:36.590409 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:36.594040 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:36.596603 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.596603 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.598881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f85b4486-e658-4aed-9ed0-7037df11e0d1 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.600046 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f85b4486-e658-4aed-9ed0-7037df11e0d1 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.020741 Oct 31 15:37:36.601327 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2394/4668] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:37:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 31 15:37:36.684579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd03c5f1-3078-4af3-a66f-b0c7653c0fa2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-332768936", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd03c5f1-3078-4af3-a66f-b0c7653c0fa2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 1265 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-332768936", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3f354567-84af-4a9f-8236-939157585e8e"}]}} Oct 31 15:37:36.695789 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-332768936', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3f354567-84af-4a9f-8236-939157585e8e'}]}}} Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.698493 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:36.699892 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:36.702094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:37:36.702094 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.703846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd03c5f1-3078-4af3-a66f-b0c7653c0fa2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.706466 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd03c5f1-3078-4af3-a66f-b0c7653c0fa2 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.029402 Oct 31 15:37:36.712067 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2275/4669] 10.222.0.48 () {60 vars in 1148 bytes} [Mon Oct 31 15:37:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 31 15:37:36.725020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-115d0d72-db6b-4b04-a34b-110b17a03d46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:36.725922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-115d0d72-db6b-4b04-a34b-110b17a03d46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 98da9541-2056-40fc-8d45-3fd0333acebe] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:36.734890 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-115d0d72-db6b-4b04-a34b-110b17a03d46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] HTTP exception thrown: Instance 98da9541-2056-40fc-8d45-3fd0333acebe could not be found. Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-115d0d72-db6b-4b04-a34b-110b17a03d46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/98da9541-2056-40fc-8d45-3fd0333acebe/metadata/test2 HTTP/1.1 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 98da9541-2056-40fc-8d45-3fd0333acebe could not be found. Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': '98da9541-2056-40fc-8d45-3fd0333acebe', 'id': 'test2'} Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98da9541-2056-40fc-8d45-3fd0333acebe could not be found. Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98da9541-2056-40fc-8d45-3fd0333acebe could not be found. Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:36.737329 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:36.742142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:36.742142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:36.742142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98da9541-2056-40fc-8d45-3fd0333acebe could not be found. Oct 31 15:37:36.742142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:37:36.743960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-115d0d72-db6b-4b04-a34b-110b17a03d46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 404 to user: Instance 98da9541-2056-40fc-8d45-3fd0333acebe could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:36.745278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-115d0d72-db6b-4b04-a34b-110b17a03d46 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/98da9541-2056-40fc-8d45-3fd0333acebe/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.025268 Oct 31 15:37:36.747019 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2395/4670] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Oct 31 15:37:36 2022] GET /compute/v2.1/servers/98da9541-2056-40fc-8d45-3fd0333acebe/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:36.760415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:36.760966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:36.779616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:36.780126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:36.780577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:36.781355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:36.781830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:36.782269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:36.833885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:36.886802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:36.888437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:36.901555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:36.902500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:36.903525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:36.906851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:36.909341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:36.910072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:37.007230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-adf039c9-c103-4094-9edc-ac6fac3afe89 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 204 len: 0 microversion: 2.1 time: 0.249095 Oct 31 15:37:37.009101 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2276/4671] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:37:36 2022] DELETE /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:37:37.028907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:37.029916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:37.037873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:37.038814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:37.039608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:37.055416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:37.056936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:37.062331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:37.812536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:37.828888 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a54e49ce-bee1-44f8-8865-de0212edbba0 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1526 microversion: 2.1 time: 0.813811 Oct 31 15:37:37.848154 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2277/4672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:37 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1526 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:37.907416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:37.915728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6eda2d3-fe91-45a4-b1fd-025f95f74a30 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 1.032903 Oct 31 15:37:37.916303 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2396/4673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:36 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:38.854555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:38.855609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:38.866672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:38.868235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:38.869545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:38.870614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:38.871480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:38.872297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:38.940534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:38.941826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:38.956160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:38.958248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:38.960428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:38.963495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:38.964888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:38.966659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:39.785991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:39.809900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e462d96-c1a4-4a4a-8d26-85d51fa43c08 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1526 microversion: 2.1 time: 0.957113 Oct 31 15:37:39.826092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2278/4674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:38 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1526 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:39.832681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:39.842781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-708c27cf-320b-454c-a800-19a1bd92d93e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.906636 Oct 31 15:37:39.848653 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2397/4675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:38 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:40.836155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:40.837131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:40.844769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:40.848228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:40.849043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:40.850076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:40.851049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:40.852303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:40.853007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:40.859329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:40.872009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:40.873890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:40.892885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:40.893621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:40.894342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:40.895319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:40.895967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:40.896560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:41.124056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59009d5c914b472eb99d4d4b599d014a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801193b145734707b663dfbc46eb4911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:41.131820 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52bd9d0a-fd96-4112-b82f-050ef35123a3 tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 200 len: 1484 microversion: 2.1 time: 0.300188 Oct 31 15:37:41.132746 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2279/4676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:40 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 1484 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:41.163090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-013a7a0d-6b3c-49f1-bc29-dfe1b2e730be req-bc39d60d-4afc-4ea0-a126-8d578e09d913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e", "name": "network-vif-deleted", "tag": "b3f7503f-4d59-46e8-8bf7-447989d85820"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:41.180276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-013a7a0d-6b3c-49f1-bc29-dfe1b2e730be req-bc39d60d-4afc-4ea0-a126-8d578e09d913 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:41.181894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-013a7a0d-6b3c-49f1-bc29-dfe1b2e730be req-bc39d60d-4afc-4ea0-a126-8d578e09d913 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:41.182338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-013a7a0d-6b3c-49f1-bc29-dfe1b2e730be req-bc39d60d-4afc-4ea0-a126-8d578e09d913 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:41.213816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-013a7a0d-6b3c-49f1-bc29-dfe1b2e730be req-bc39d60d-4afc-4ea0-a126-8d578e09d913 service nova] Creating event network-vif-deleted:b3f7503f-4d59-46e8-8bf7-447989d85820 for instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e on n-h1-858383-17 Oct 31 15:37:41.223248 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-013a7a0d-6b3c-49f1-bc29-dfe1b2e730be req-bc39d60d-4afc-4ea0-a126-8d578e09d913 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063052 Oct 31 15:37:41.225503 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2280/4677] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:37:41.374267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:41.389242 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b6a4ddb-a09d-4139-91f4-b418d4b6c5a0 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.521484 Oct 31 15:37:41.401553 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2398/4678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:40 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:42.158804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:42.176410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] [instance: 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:42.227065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:42.228027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:42.229919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:42.232386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:42.233426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:42.234305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:42.297737 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] HTTP exception thrown: Instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e could not be found. Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Request method failure captured: Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e HTTP/1.1 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-ulOqM6aLagXieDzlAEADdFDHvvLov5Wa7dGAwIvdVwAGTzAYD5R2vJ20Fv7oTTAlXsaxRKOJI_cRTsyBvnGwqepSoU3Zzhz8j0RLkj22g2TNNVyevwM_iU9AfwHJ-_coTd-4zcErutUDhxrg3zcqMPV0a0UuIz60hzO4JOTf5LlBU Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/801193b145734707b663dfbc46eb4911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_801193b145734707b663dfbc46eb4911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/801193b145734707b663dfbc46eb4911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 801193b145734707b663dfbc46eb4911 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1532517871 Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59009d5c914b472eb99d4d4b599d014a Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1532517871-project Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e could not be found. Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e'} Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e could not be found. Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e could not be found. Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.300350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e could not be found. Oct 31 15:37:42.305390 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.307535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] Returning 404 to user: Instance 2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:42.309622 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-908f0498-5c37-4f50-9d24-49e51750b31d tempest-ServerMetadataNegativeTestJSON-1532517871 tempest-ServerMetadataNegativeTestJSON-1532517871-project] 10.222.0.48 "GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e" status: 404 len: 111 microversion: 2.1 time: 0.156125 Oct 31 15:37:42.314516 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2281/4679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:42 2022] GET /compute/v2.1/servers/2aa9e8c7-0c79-4d5f-9edd-a87f9b1a3f8e => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:42.430768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:42.431471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:42.441294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:42.443584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:42.444258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:42.445201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:42.445995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:42.446840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:42.892913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:42.910106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-127de4e2-3fc1-46db-9eff-cd20e701afa8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.483747 Oct 31 15:37:42.944480 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2399/4680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:42 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:43.943444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:43.944175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:43.959431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:43.960073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:43.963330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:43.963330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:43.963330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:43.963330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:44.738231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:44.748480 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-636929fd-b466-474d-8e48-d1cd2ea976c5 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.811049 Oct 31 15:37:44.767662 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2282/4681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:43 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:45.797414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:45.798333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:45.806271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=31 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:45.823705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:45.826992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:45.827452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:45.831720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:45.846656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:45.847067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:45.850701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:46.783821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:46.821966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2cb99b60-ae99-4f7f-a6c4-c7e9d5214736 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 1.031872 Oct 31 15:37:46.823331 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2400/4682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:45 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:47.851455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:47.851455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:47.871263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:47.873763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:47.876219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:47.877173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:47.880301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:47.881058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.083939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:49.097040 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-05095338-fbf8-41b4-b283-6c0a76098d7a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 1.250403 Oct 31 15:37:49.097931 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2283/4683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:47 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:50.129716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:50.130350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:50.146197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:50.146699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:50.147140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.147870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:50.148332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:50.163271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.621550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:50.633257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15112f8a-04b1-4933-855a-2c288fd3efbf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.509017 Oct 31 15:37:50.642159 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2401/4684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:50 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:51.673543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:51.675896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:51.703275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:51.704686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:51.705751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:51.706982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:51.707562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:51.708101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.410563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:52.419925 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9b5e56a4-0669-4b4c-8b46-bf6fce88a7d3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1733 microversion: 2.1 time: 0.754236 Oct 31 15:37:52.434139 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2284/4685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:51 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1733 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:53.462725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:53.464135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:53.470936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:53.471495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:53.471932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:53.472685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:53.473779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:53.475199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:54.806233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:54.819464 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6838a1b7-7841-494c-b203-d9329fabacab tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1713 microversion: 2.1 time: 1.371575 Oct 31 15:37:54.832046 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2402/4686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:53 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1713 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:55.112181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:55.113544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:55.124581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.125250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.125800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.126785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.127443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.128161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.250639 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Cannot 'detach_volume' instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a while it is in vm_state rescued Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments/adc4247c-0f56-478d-8c93-c5b325fa7075 HTTP/1.1 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'detach_volume' instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a while it is in vm_state rescued Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': '713c7cb6-b332-4f57-b8a3-6b233e3b311a', 'id': 'adc4247c-0f56-478d-8c93-c5b325fa7075'} Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a while it is in vm_state rescued Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:55.252431 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:55.257046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:55.257046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:55.257046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:55.257046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:55.257046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a while it is in vm_state rescued Oct 31 15:37:55.257046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:37:55.258824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 409 to user: Cannot 'detach_volume' instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a while it is in vm_state rescued {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:55.260441 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63613d33-47a8-45a9-8fc9-0514e42a4ab8 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments/adc4247c-0f56-478d-8c93-c5b325fa7075" status: 409 len: 152 microversion: 2.1 time: 0.153882 Oct 31 15:37:55.261760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2285/4687] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:37:55 2022] DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments/adc4247c-0f56-478d-8c93-c5b325fa7075 => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:37:55.271535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:55.272406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:55.281620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.282620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.283664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.284951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.285696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.286366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.385604 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86787de7-7e1b-45c3-be0e-6826e79154b3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/action" status: 202 len: 0 microversion: 2.1 time: 0.118655 Oct 31 15:37:55.389451 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2403/4688] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:37:55 2022] POST /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:37:55.395147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:55.395777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:55.410442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.411250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.412901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.430789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.432259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.435038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.046025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:56.057771 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-397ee794-83c1-4911-a157-8c6cd2238f88 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1721 microversion: 2.1 time: 0.666584 Oct 31 15:37:56.061011 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2286/4689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:55 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1721 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:57.083012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:57.086760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:57.106334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.108954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.110315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.112683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.113492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.119195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.827590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:57.845743 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48ae65b1-da2a-4f85-a940-3e531359cfee tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1721 microversion: 2.1 time: 0.761798 Oct 31 15:37:57.847005 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2404/4690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:57 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1721 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:58.869804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:58.870934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:58.883542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:58.884039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:58.884484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:58.889016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:58.889517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:58.889964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.696388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:59.714881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-236d572c-5723-4180-b183-ac01ea91782a tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1721 microversion: 2.1 time: 0.843471 Oct 31 15:37:59.717047 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2287/4691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:58 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1721 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:00.748944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:00.750233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:00.769383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.770229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.770981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.772687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.776954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.777797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.542064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.564454 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ab0e5ad-6f69-4277-af85-107273502c23 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1727 microversion: 2.1 time: 0.823982 Oct 31 15:38:01.568420 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2405/4692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:00 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1727 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:01.595154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:01.595753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:01.610917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.612667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.614764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.615566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.616250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.616750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.025940 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc29c2f0-3e65-4d58-acb6-e4347384949d tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.435337 Oct 31 15:38:02.035189 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2288/4693] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:38:01 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-interface => generated 284 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:05.186454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3ad965ce-141b-4f34-bb84-c83401e3cd55 req-65c79b79-5a9e-4765-9e34-50bd9b0f6031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713c7cb6-b332-4f57-b8a3-6b233e3b311a", "tag": "453f0fee-9b5b-40b8-85f4-c5304d8b4731"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:05.215176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3ad965ce-141b-4f34-bb84-c83401e3cd55 req-65c79b79-5a9e-4765-9e34-50bd9b0f6031 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:05.215765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3ad965ce-141b-4f34-bb84-c83401e3cd55 req-65c79b79-5a9e-4765-9e34-50bd9b0f6031 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:05.216669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3ad965ce-141b-4f34-bb84-c83401e3cd55 req-65c79b79-5a9e-4765-9e34-50bd9b0f6031 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:05.240444 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3ad965ce-141b-4f34-bb84-c83401e3cd55 req-65c79b79-5a9e-4765-9e34-50bd9b0f6031 service nova] Creating event network-changed:453f0fee-9b5b-40b8-85f4-c5304d8b4731 for instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a on n-h2-858383-17 Oct 31 15:38:05.254741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3ad965ce-141b-4f34-bb84-c83401e3cd55 req-65c79b79-5a9e-4765-9e34-50bd9b0f6031 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074488 Oct 31 15:38:05.257735 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2406/4694] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:06.266610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9733c5d-9add-4f9e-8211-ac0cf483dc42 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Action: 'create', calling method: .version_select at 0x7f5ca10064c0>, body: {"keypair": {"name": "tempest-keypair-1789440691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71dL9mfdq9y8Gmra5c5LPYRlsDEydnRCECd587iGiBPLYHGDmp1g7K7NmV9pvA7aXl3Tv4aKku2WdOZdkGxG27RqJZhfmDvPlRoaV8zTuprHS6kFsRH3qeXmuOktflmQ=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:06.304317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f9733c5d-9add-4f9e-8211-ac0cf483dc42 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Getting quotas for project 8a296588291c4b7f9a069126f2219f5a. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:06.314786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f9733c5d-9add-4f9e-8211-ac0cf483dc42 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Getting quotas for user 35b871cb47154546b1fabb9a2b807b90 and project 8a296588291c4b7f9a069126f2219f5a. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:06.379941 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9733c5d-9add-4f9e-8211-ac0cf483dc42 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.634668 Oct 31 15:38:06.380686 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2289/4695] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:38:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:07.313579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0bb192a8-8c8c-45eb-b98e-847125d565cf req-53f93d79-63c3-4219-bf6b-74d47eade1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713c7cb6-b332-4f57-b8a3-6b233e3b311a", "tag": "453f0fee-9b5b-40b8-85f4-c5304d8b4731"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:07.337745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0bb192a8-8c8c-45eb-b98e-847125d565cf req-53f93d79-63c3-4219-bf6b-74d47eade1ef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:07.338156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0bb192a8-8c8c-45eb-b98e-847125d565cf req-53f93d79-63c3-4219-bf6b-74d47eade1ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:07.339084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0bb192a8-8c8c-45eb-b98e-847125d565cf req-53f93d79-63c3-4219-bf6b-74d47eade1ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:07.364577 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0bb192a8-8c8c-45eb-b98e-847125d565cf req-53f93d79-63c3-4219-bf6b-74d47eade1ef service nova] Creating event network-changed:453f0fee-9b5b-40b8-85f4-c5304d8b4731 for instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a on n-h2-858383-17 Oct 31 15:38:07.379674 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0bb192a8-8c8c-45eb-b98e-847125d565cf req-53f93d79-63c3-4219-bf6b-74d47eade1ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069479 Oct 31 15:38:07.383811 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2407/4696] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:14.770654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1654442535", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "092d85d1-c91e-4e1a-9d2e-5561e4167dea"}], "security_groups": [{"name": "tempest-securitygroup--555914998"}], "key_name": "tempest-keypair-1789440691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:14.820316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=49 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:14.824380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:15.188301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] validate_networks() for [('092d85d1-c91e-4e1a-9d2e-5561e4167dea', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:38:16.341489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:16.941421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1293252875", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "ac99e611-7e63-4477-891b-9d4f26274dcf"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:16.965239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:17.052434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] validate_networks() for [('ac99e611-7e63-4477-891b-9d4f26274dcf', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:38:17.350058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:20.515610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:38:20.517372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:38:20.518091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:38:20.518721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:38:20.519479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:38:20.534132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:20.535042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:20.535847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:20.537213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:20.537956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:20.538644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:20.607517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Getting quotas for project 8a296588291c4b7f9a069126f2219f5a. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:20.615834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Getting quotas for user 35b871cb47154546b1fabb9a2b807b90 and project 8a296588291c4b7f9a069126f2219f5a. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:20.635493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:38:20.638896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:38:20.750111 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75bd3f7d-b8e9-4233-9787-ddbe8a29fce3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.983818 Oct 31 15:38:20.751278 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2290/4697] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:38:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 5986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:38:20.763691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-632953ab-eefc-4858-8d85-5bfd8afc3047 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:20.769597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-632953ab-eefc-4858-8d85-5bfd8afc3047 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:20.984972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-632953ab-eefc-4858-8d85-5bfd8afc3047 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:20.992673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-632953ab-eefc-4858-8d85-5bfd8afc3047 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1242 microversion: 2.1 time: 0.234535 Oct 31 15:38:20.995651 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2291/4698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:20 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1242 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:21.456623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:38:21.457725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:38:21.458801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:38:21.459439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:38:21.460789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:38:21.490309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:21.491804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:21.492397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:21.496077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:21.500753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:21.501386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:21.565521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Getting quotas for project 73712f1170a949a8a98bbe83fc059554. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:21.590496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Getting quotas for user 9d32ae2c313940bb9d704bcf64a22be4 and project 73712f1170a949a8a98bbe83fc059554. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:21.634361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:38:21.643713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:38:21.787202 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59e8ccf0-d636-4a25-a287-90b51d5b7bae tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.097407 Oct 31 15:38:21.788784 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2408/4699] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:38:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:38:21.800633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-366a8391-6783-4399-944c-90732fb5dbe2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:21.801977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-366a8391-6783-4399-944c-90732fb5dbe2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:22.017960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:22.018588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:22.036995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.041875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.042596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.043375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.043862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.044308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.152194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-366a8391-6783-4399-944c-90732fb5dbe2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:22.168686 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-366a8391-6783-4399-944c-90732fb5dbe2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1216 microversion: 2.1 time: 0.368657 Oct 31 15:38:22.169389 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2292/4700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:21 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1216 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:22.480137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:22.496190 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c48bf5be-5a04-48ca-ad8d-3ba7fc2c1786 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1246 microversion: 2.1 time: 0.480035 Oct 31 15:38:22.498742 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2409/4701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:22 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1246 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:23.196173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:23.198917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:23.216251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.218554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.220370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.221673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.222165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.226356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.523191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:23.523950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:23.539833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:23.549025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.559127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-971fbd2c-9611-4150-9a37-bee80d0b7442 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1212 microversion: 2.1 time: 0.367157 Oct 31 15:38:23.563752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.566389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.574483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.575225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.575841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.612944 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2293/4702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:23 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1212 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:24.085816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:24.098502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a75bd2e9-e399-4e9c-a91d-4cbdfe549a21 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1294 microversion: 2.1 time: 0.581508 Oct 31 15:38:24.109077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2410/4703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:23 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1294 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:24.600490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:24.602752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:24.624259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:24.626191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:24.627112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:24.630167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:24.632154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:24.632918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:24.848729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:24.858511 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d03e98a9-6274-429a-a13e-0e880b82cf6a tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1276 microversion: 2.1 time: 0.262007 Oct 31 15:38:24.866194 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2294/4704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:24 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:25.124804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:25.125530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:25.140525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.141446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.142150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.145302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.146086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.147851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.374318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:25.386851 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b688903a-5871-4fc5-967b-17ae16e5d1b6 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1300 microversion: 2.1 time: 0.265994 Oct 31 15:38:25.389964 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2411/4705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:25 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:25.894433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:25.895656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:25.918258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.918771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.919402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.920298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.920957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.921572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.142901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:26.154814 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-603c2fef-5671-4352-894c-d4b04c3db845 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1274 microversion: 2.1 time: 0.264787 Oct 31 15:38:26.158977 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2295/4706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:25 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:26.413186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:26.413838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:26.430581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:26.431479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:26.434438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.435533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:26.437040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:26.441545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.186584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:27.187524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:27.205774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.209421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.210156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.212032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.214120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.214931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.414182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.422496 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50c9fde3-33c6-474a-a5cf-dd3de55b3d23 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1300 microversion: 2.1 time: 1.013530 Oct 31 15:38:27.425456 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2412/4707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:26 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1300 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:27.536123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.551311 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de4b701f-2f9b-40cb-b6bc-ecfc5faab438 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1274 microversion: 2.1 time: 0.373132 Oct 31 15:38:27.552849 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2296/4708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:27 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:28.454586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:28.455755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:28.483534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.484159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.484854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.485617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.493138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.495420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.580077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:28.580716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:28.589123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.589935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.590544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.591694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.592345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.593238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.712073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:28.727053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b5624f8-9927-4ddf-ab9a-39cd58a37fda tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1300 microversion: 2.1 time: 0.276031 Oct 31 15:38:28.727975 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2413/4709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:28 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:29.063205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:29.082737 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fd115fbe-6ea0-4861-9e2c-ef88d9baae15 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1274 microversion: 2.1 time: 0.506375 Oct 31 15:38:29.088609 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2297/4710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:28 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1274 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:29.754458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:29.755651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:29.773124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:29.774950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:29.777953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:29.780249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:29.782212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:29.784684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.107826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:30.109770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:30.118215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.119526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.120782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.123638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.124281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.125030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.561214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:30.678369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:30.687147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7ea15b2-0ea4-4e16-8cf1-1306db891339 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.939096 Oct 31 15:38:30.694125 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2414/4711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:29 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:31.475274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:31.488085 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22b0ff16-1aec-42d9-ae88-6641228dfa12 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 1.383763 Oct 31 15:38:31.488926 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2298/4712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:30 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:31.717772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:31.718656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:31.721455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:31.722131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:31.737391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.738168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.738803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.739687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.740313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.741166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.456394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:32.465242 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf87f75b-07de-4396-b456-e855bd9ee09f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.751167 Oct 31 15:38:32.465765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2415/4713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:31 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:32.512003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:32.513365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:32.516907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:32.523828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:32.524622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:32.525409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.526385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:32.527085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:32.527728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.988845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:33.012577 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c40ee92e-5895-4d34-bb35-4436c2296163 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.505497 Oct 31 15:38:33.028505 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2299/4714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:32 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:33.488286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:33.488959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:33.502585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:33.503863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:33.504824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:33.506051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:33.506749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:33.507930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.054476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:34.055105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:34.069000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:34.069654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:34.070149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.079802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:34.080347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:34.084899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.935479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:34.950507 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a76eec4-c9e6-4213-9598-0a80c38222fa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 1.465872 Oct 31 15:38:34.951116 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2416/4715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:33 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:35.207400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0", "tag": "2042c267-fde3-4ed4-ab06-bf4ebfd32ca4"}, {"name": "network-changed", "server_uuid": "340e5d24-3b01-4b22-8daa-41e8c8afa7b7", "tag": "74a46185-35cb-4927-8fed-4f0ed54f9cba"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:35.235730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:35.236607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:35.237250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:35.278985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] Creating event network-changed:2042c267-fde3-4ed4-ab06-bf4ebfd32ca4 for instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 on n-h1-858383-17 Oct 31 15:38:35.281842 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] Creating event network-changed:74a46185-35cb-4927-8fed-4f0ed54f9cba for instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 on n-h1-858383-17 Oct 31 15:38:35.299329 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-04d124de-e7b6-4114-83cf-123bb6c38eb4 req-ded8301a-ed0c-4419-b1db-8a783dfacca8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.101280 Oct 31 15:38:35.299969 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2417/4716] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:35.808624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:35.819009 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da56657c-43d3-4d29-998c-c1a6946cd8e2 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 1.768636 Oct 31 15:38:35.830377 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2300/4717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:34 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:35.978975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:35.979690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:35.992883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.005511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.006925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.007896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.008563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.009930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.414543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:36.432459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12b0a102-349e-4bb7-a60b-b529099d00c5 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.457887 Oct 31 15:38:36.450580 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2418/4718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:35 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:36.854504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:36.855145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:36.872204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.876462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.877263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.879107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.879793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.881248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.091811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.092374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.111500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.112262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.112918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.113805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.114458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.115051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.190845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:37.222355 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b5ee3ab-7b2c-4acb-b99d-46977b0e8b29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.372348 Oct 31 15:38:37.225685 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2301/4719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:36 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:37.354314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lazy-loading 'services' on Instance uuid 713c7cb6-b332-4f57-b8a3-6b233e3b311a {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:38:37.468807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.470013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.520159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-007a5205-d8fa-4660-b702-ecb335eed77c tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments/adc4247c-0f56-478d-8c93-c5b325fa7075" status: 202 len: 0 microversion: 2.1 time: 0.432073 Oct 31 15:38:37.521642 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2419/4720] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:38:37 2022] DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments/adc4247c-0f56-478d-8c93-c5b325fa7075 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:38:37.522211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.524283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.532461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.536046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.545061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.548749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.552420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.557556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.560296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.560840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.561286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.567422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.569708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.570175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.668272 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6004d24e-52d2-4892-8a09-9df23ac69d14 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142306 Oct 31 15:38:37.669582 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2420/4721] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:37 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:38.134001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:38.161286 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef6cfe2f-85e8-4d3a-ab81-a0adc81d3c43 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.699509 Oct 31 15:38:38.161715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2302/4722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:37 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:38.252630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:38.253343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:38.264994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.265998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.266679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.267657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.268394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.269161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.705565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:38.711179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:38.726620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.734337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.743067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.744110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.744401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.748427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.750331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:38.787356 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-993625d3-cc6f-489d-82ae-ffe548b22c0b tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.537400 Oct 31 15:38:38.808950 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2421/4723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:38 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:38.866131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-533075a9-edcc-42e9-8509-5d7275df95bf tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179256 Oct 31 15:38:38.868432 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2303/4724] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:38 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:39.190380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:39.192816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:39.223041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.227616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.228846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.231640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.232907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.234295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.651041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:39.666332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e698f193-0815-4359-a69e-d9eaa8fb9347 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.485147 Oct 31 15:38:39.669202 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2422/4725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:39 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:39.815491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:39.816110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:39.833765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.834260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.834704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.835415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.835871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.836301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.879751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:39.882090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:39.906275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.906776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.907210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.907915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.908536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.911744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.988980 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54f3ac1b-b3d9-4bd1-874c-e9e2dfbe5c70 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113019 Oct 31 15:38:39.994505 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2423/4726] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:39 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:40.639328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:40.647789 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f70f757-a515-4b16-9b65-8e42f4200192 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.836066 Oct 31 15:38:40.656140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2304/4727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:39 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:40.691668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:40.692294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:40.710460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.710972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.711414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:40.713370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.714049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.714681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:41.001941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:41.004209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:41.026384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:41.026889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:41.027335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:41.028062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:41.028523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:41.028982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:41.115016 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa135290-737d-4837-a609-7ea353807ab9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117304 Oct 31 15:38:41.115620 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2305/4728] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:40 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:41.334304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:41.351307 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42616dda-70b8-4238-9986-d00262f0494e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.663439 Oct 31 15:38:41.351909 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2424/4729] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:40 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:41.672241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:41.673096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:41.691134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:41.691633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:41.692074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:41.692813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:41.693283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:41.693705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.132111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:42.143955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:42.165263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.168310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.169212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.170696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.173403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.174010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.266097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:42.316754 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-beeb6594-3209-4a88-b607-9f0d8a7020c2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188961 Oct 31 15:38:42.324457 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2425/4730] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:42 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:42.376860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:42.378134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:42.388486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.389402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.390135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.391282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.392385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.393355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.478334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:42.495187 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbacdb69-63b5-4b42-bb55-33a6f53c33b0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.825285 Oct 31 15:38:42.498699 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2306/4731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:41 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:42.865356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:42.879135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61603395-e018-4fb3-acd0-b250207165d3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.507439 Oct 31 15:38:42.879435 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2426/4732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:42 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:43.337034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:43.340607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:43.387072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.399183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.401148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.404195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.408475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.411595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.522120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:43.523605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:43.530288 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8a668d1d-9907-497c-ba6c-9292b423c569 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198347 Oct 31 15:38:43.534524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2307/4733] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:43 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:43.557808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.558795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.559497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.562570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.564685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.565563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.900247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-28be2dda-44d7-451f-a58c-4f752dfb4c8e req-0dbcc6d4-f6c3-4693-9bf9-92487593dee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0", "name": "network-vif-plugged", "status": "completed", "tag": "2042c267-fde3-4ed4-ab06-bf4ebfd32ca4"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:43.927811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-28be2dda-44d7-451f-a58c-4f752dfb4c8e req-0dbcc6d4-f6c3-4693-9bf9-92487593dee5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.928993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-28be2dda-44d7-451f-a58c-4f752dfb4c8e req-0dbcc6d4-f6c3-4693-9bf9-92487593dee5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.929460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-28be2dda-44d7-451f-a58c-4f752dfb4c8e req-0dbcc6d4-f6c3-4693-9bf9-92487593dee5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.975763 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-28be2dda-44d7-451f-a58c-4f752dfb4c8e req-0dbcc6d4-f6c3-4693-9bf9-92487593dee5 service nova] Creating event network-vif-plugged:2042c267-fde3-4ed4-ab06-bf4ebfd32ca4 for instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 on n-h1-858383-17 Oct 31 15:38:43.996743 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-28be2dda-44d7-451f-a58c-4f752dfb4c8e req-0dbcc6d4-f6c3-4693-9bf9-92487593dee5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104391 Oct 31 15:38:44.003347 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2308/4734] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:44.015303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:44.021715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:44.041427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:44.042275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:44.042971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.043863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:44.046353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:44.046995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.196411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:44.213204 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72bd5ddc-7166-4456-a586-a4d1451079ef tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.695524 Oct 31 15:38:44.231315 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2427/4735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:43 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:44.547807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:44.550790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:44.575875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:44.576760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:44.577501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.585795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:44.586585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:44.587950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.668173 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b5d5045-824e-4cc1-9586-61d7cccb1460 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125686 Oct 31 15:38:44.682076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:44.683889 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2428/4736] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:44 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:44.686379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:44.694126 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7092bee5-e0dc-46f1-aaff-323339a27978 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.687485 Oct 31 15:38:44.694730 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2309/4737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:44 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:45.239006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:45.239631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:45.248987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.252634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.253440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.255960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.256614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.261355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.674921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:45.684547 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8f593fa-891e-49ed-ba46-15658e67e558 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.449385 Oct 31 15:38:45.730420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:45.736340 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2429/4738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:45 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:45.749294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:45.764352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:45.769535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:45.783741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.784250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.788772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:45.789095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.789904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.790387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.790947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.791399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.791772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.792134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.792607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.792776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.793076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.934542 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4261175-f2e1-4d0e-9c53-ba7cdbffd1d2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235381 Oct 31 15:38:45.935321 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2310/4739] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:45 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:46.292231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:46.300459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4be3569b-703d-4bcb-a37f-47160b5b00f9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1367 microversion: 2.1 time: 0.562605 Oct 31 15:38:46.301091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2430/4740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:45 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:46.717304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:46.718418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:46.736485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:46.737302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:46.737948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:46.738670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:46.739126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:46.739925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:46.950163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:46.951909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:46.966134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:46.966893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:46.968470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:46.970867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:46.971519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:46.972601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.046162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:47.054315 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa6f64dd-8201-4516-9b64-63a005ef0dec tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.341093 Oct 31 15:38:47.061793 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2311/4741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:46 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:47.090065 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68caaed4-2692-43e9-b032-f4af1b42e719 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146742 Oct 31 15:38:47.098163 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2431/4742] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:46 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:38:47.184491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:47.186812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:47.202661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.203203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.203732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.204496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.205062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.205528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.260276 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Cannot 'reboot' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action HTTP/1.1 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 28 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: {"reboot": {"type": "HARD"}} Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'reboot' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a66b783d-f29a-49cd-901c-f7c5682e1651', 'body': {'reboot': {'type': 'HARD'}}} Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:38:47.274626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.280458 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.283200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 409 to user: Cannot 'reboot' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:47.284352 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c696e695-4048-4907-9a16-9139d1cdaddc tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action" status: 409 len: 145 microversion: 2.1 time: 0.104280 Oct 31 15:38:47.285902 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2312/4743] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:38:47 2022] POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:38:47.308362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:47.314013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:47.317662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:47.322532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.323422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.324079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.325104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.325729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.326012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:47.326627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.326768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:47.344173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.347311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.347931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.349985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.350652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.359782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.413462 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Cannot 'rebuild' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action HTTP/1.1 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 65 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot 'rebuild' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a66b783d-f29a-49cd-901c-f7c5682e1651', 'body': {'rebuild': {'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a'}}} Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:38:47.439541 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:47.444028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 409 to user: Cannot 'rebuild' instance a66b783d-f29a-49cd-901c-f7c5682e1651 while it is in vm_state rescued {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:47.449341 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9082b55-b311-43f9-a3da-563795bb79f4 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action" status: 409 len: 146 microversion: 2.1 time: 0.153979 Oct 31 15:38:47.454348 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2432/4744] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:38:47 2022] POST /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651/action => generated 146 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:38:47.459531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:47.464842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:47.473914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.474736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.475381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.476251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.476944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.477618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.954010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:38:48.082892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:48.097003 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81ff4053-859f-4701-a014-a15803192838 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1558 microversion: 2.1 time: 0.777123 Oct 31 15:38:48.113788 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2313/4745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:47 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1558 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:48.123589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b63d6197-f6fc-4f64-9383-e197142f589e req-d14dc985-23e7-416a-a988-39d183ba2c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340e5d24-3b01-4b22-8daa-41e8c8afa7b7", "name": "network-vif-plugged", "status": "completed", "tag": "74a46185-35cb-4927-8fed-4f0ed54f9cba"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:48.134855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b63d6197-f6fc-4f64-9383-e197142f589e req-d14dc985-23e7-416a-a988-39d183ba2c7a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.135759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b63d6197-f6fc-4f64-9383-e197142f589e req-d14dc985-23e7-416a-a988-39d183ba2c7a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.136430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b63d6197-f6fc-4f64-9383-e197142f589e req-d14dc985-23e7-416a-a988-39d183ba2c7a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.151295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b63d6197-f6fc-4f64-9383-e197142f589e req-d14dc985-23e7-416a-a988-39d183ba2c7a service nova] Creating event network-vif-plugged:74a46185-35cb-4927-8fed-4f0ed54f9cba for instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 on n-h1-858383-17 Oct 31 15:38:48.157348 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b63d6197-f6fc-4f64-9383-e197142f589e req-d14dc985-23e7-416a-a988-39d183ba2c7a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041809 Oct 31 15:38:48.158815 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2314/4746] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:48.165720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:48.169558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:48.170116 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9311f3e2-39f5-4ef2-a79d-781a07411d83 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 204 len: 0 microversion: 2.1 time: 0.713920 Oct 31 15:38:48.172925 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2433/4747] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:38:47 2022] DELETE /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:38:48.183588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.184647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.185347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.187490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.187490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.187490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.189229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:48.191789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:48.213603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.214625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.215525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.218552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.219326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.221689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.897653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1e16089-b707-49bf-9afc-aac0ee496716 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.723089 Oct 31 15:38:48.906883 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2434/4748] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:38:48 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-interface => generated 285 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:48.911848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:48.912475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:48.922922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.923515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.924044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.925001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.926048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.926577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:49.294545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:49.302846 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-11fe9fb1-87a4-4104-a91a-2e48e07a3ff7 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 1.142137 Oct 31 15:38:49.331727 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2315/4749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:48 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:49.848930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:49.857339 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ddadf21-9d0e-4a07-8a89-2a47dd6946ce tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1687 microversion: 2.1 time: 0.949224 Oct 31 15:38:49.862476 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2435/4750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:48 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1687 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:50.328774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:50.329414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:50.351549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:50.352051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:50.363421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:50.364415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:50.364951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:50.369977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:50.894124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:50.894749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:50.905478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:50.906200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:50.906815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:50.907731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:50.908360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:50.908987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:51.149482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:51.188715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f919709d-4335-49da-a4e1-bf70f505db29 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1316 microversion: 2.1 time: 0.864244 Oct 31 15:38:51.194494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2316/4751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:50 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:51.531324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:51.545559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41a85930-422c-44c6-9cb1-947335fbe70e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1687 microversion: 2.1 time: 0.655069 Oct 31 15:38:51.546430 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2436/4752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:50 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1687 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:52.241602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:52.241602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:52.245499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:52.249998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:52.250624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:52.253133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:52.253635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:52.254086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:52.574533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:52.576439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:52.610817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:52.611662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:52.611957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:52.612742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:52.614422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:52.614422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:53.905572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:53.921168 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa9e2361-eb53-4373-a471-c4ec72e5af45 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1687 microversion: 2.1 time: 1.350668 Oct 31 15:38:53.923423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2437/4753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:52 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1687 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:53.988738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3c88a237-def7-4855-8efa-0a15711a3614 req-247b16bc-f58b-4b2f-8898-0f1e05dc6511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0", "tag": "2042c267-fde3-4ed4-ab06-bf4ebfd32ca4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:54.006877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3c88a237-def7-4855-8efa-0a15711a3614 req-247b16bc-f58b-4b2f-8898-0f1e05dc6511 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.008115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3c88a237-def7-4855-8efa-0a15711a3614 req-247b16bc-f58b-4b2f-8898-0f1e05dc6511 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.010658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3c88a237-def7-4855-8efa-0a15711a3614 req-247b16bc-f58b-4b2f-8898-0f1e05dc6511 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.013921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:54.023242 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21368c4d-badf-4ba6-aa40-75f41fd40f22 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1504 microversion: 2.1 time: 1.796770 Oct 31 15:38:54.028296 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2317/4754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:52 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1504 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:54.030405 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3c88a237-def7-4855-8efa-0a15711a3614 req-247b16bc-f58b-4b2f-8898-0f1e05dc6511 service nova] Creating event network-changed:2042c267-fde3-4ed4-ab06-bf4ebfd32ca4 for instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 on n-h1-858383-17 Oct 31 15:38:54.042470 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3c88a237-def7-4855-8efa-0a15711a3614 req-247b16bc-f58b-4b2f-8898-0f1e05dc6511 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097581 Oct 31 15:38:54.043185 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2438/4755] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:54.062767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.063438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:54.071659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.073039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.074038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.076365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.077073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.078146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.323251 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b323e728-e2de-419a-9354-cf020c085595 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "DELETE /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.265745 Oct 31 15:38:54.329262 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2318/4756] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Oct 31 15:38:54 2022] DELETE /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7/os-server-password => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:38:54.338384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.339037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:54.355352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.356171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.356626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.359788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.364057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.365320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.444067 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db52a9c0-7b50-47fc-9d83-f6c65ca65ce8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.102493 Oct 31 15:38:54.449771 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2439/4757] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Oct 31 15:38:54 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7/os-server-password => generated 16 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:38:54.459325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.460312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:54.472411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.475040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.480651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.483263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.485526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.488877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.575076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:38:54.845306 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-402eb01b-bf74-4221-b8c3-eec42a8d4274 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "DELETE /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 204 len: 0 microversion: 2.1 time: 0.386247 Oct 31 15:38:54.848026 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2319/4758] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:38:54 2022] DELETE /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:38:54.858139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.858996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:54.894650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.895423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.896234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.897245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.897890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.898533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.986611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.989494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:55.024612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:55.028317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:55.028912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:55.033615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:55.034518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:55.038890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:55.355452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:55.369958 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f31d4695-c02f-42e4-9d18-f599a541a1b9 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1620 microversion: 2.1 time: 0.393967 Oct 31 15:38:55.372467 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2320/4759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:54 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1620 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:55.694557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:55.709859 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e00aa9e6-e4e1-44a6-87c9-c498902198ed tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1510 microversion: 2.1 time: 0.856758 Oct 31 15:38:55.726686 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2440/4760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:54 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1510 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:56.397134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:56.398238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:56.410733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.417578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.418214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.419151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.421002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.426940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.683674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-273af2d4-9bbc-4a33-ad10-719369d94268 req-d05751cf-e7ab-4ed7-8bb2-a3cdfd6b4daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713c7cb6-b332-4f57-b8a3-6b233e3b311a", "name": "network-vif-deleted", "tag": "453f0fee-9b5b-40b8-85f4-c5304d8b4731"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:56.716492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-273af2d4-9bbc-4a33-ad10-719369d94268 req-d05751cf-e7ab-4ed7-8bb2-a3cdfd6b4daa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.717325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-273af2d4-9bbc-4a33-ad10-719369d94268 req-d05751cf-e7ab-4ed7-8bb2-a3cdfd6b4daa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.720075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-273af2d4-9bbc-4a33-ad10-719369d94268 req-d05751cf-e7ab-4ed7-8bb2-a3cdfd6b4daa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.723859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:56.734086 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-301fb643-5d65-4b94-b8a4-6045ae6f4628 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 200 len: 1620 microversion: 2.1 time: 0.340896 Oct 31 15:38:56.744584 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2321/4761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:56 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 1620 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:56.760787 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-273af2d4-9bbc-4a33-ad10-719369d94268 req-d05751cf-e7ab-4ed7-8bb2-a3cdfd6b4daa service nova] Creating event network-vif-deleted:453f0fee-9b5b-40b8-85f4-c5304d8b4731 for instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a on n-h2-858383-17 Oct 31 15:38:56.761974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:56.762612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:56.767967 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-273af2d4-9bbc-4a33-ad10-719369d94268 req-d05751cf-e7ab-4ed7-8bb2-a3cdfd6b4daa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089533 Oct 31 15:38:56.782004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.782377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.783574 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2441/4762] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:56.792357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.793179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.793672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.794124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:57.381955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:57.411277 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6f9e3d8-92e9-44fd-ab8a-37cd4fdee7f5 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1510 microversion: 2.1 time: 0.665402 Oct 31 15:38:57.417972 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2322/4763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:56 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1510 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:57.776261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:57.777789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: 713c7cb6-b332-4f57-b8a3-6b233e3b311a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:57.788720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:57.789469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:57.790695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:57.791633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:57.792300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:57.792946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:57.819060 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a could not be found. Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a HTTP/1.1 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a could not be found. Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '713c7cb6-b332-4f57-b8a3-6b233e3b311a'} Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a could not be found. Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a could not be found. Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:57.821939 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a could not be found. Oct 31 15:38:57.826683 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:38:57.836317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 404 to user: Instance 713c7cb6-b332-4f57-b8a3-6b233e3b311a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:57.838012 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69eedd70-188a-4676-a604-9cdaa8cb0322 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a" status: 404 len: 111 microversion: 2.1 time: 0.068594 Oct 31 15:38:57.838781 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2442/4764] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:57 2022] GET /compute/v2.1/servers/713c7cb6-b332-4f57-b8a3-6b233e3b311a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:38:57.847888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-729c11b7-d32e-407e-a386-52070fd63f0e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '.version_select at 0x7f5ca11cc430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:57.879987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-729c11b7-d32e-407e-a386-52070fd63f0e tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284758742" status: 202 len: 0 microversion: 2.1 time: 0.034817 Oct 31 15:38:57.882065 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2323/4765] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284758742 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:38:58.447988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:58.448591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:58.462371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:58.462371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:58.462371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:58.462903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:58.463291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:58.463551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:58.502075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:58.921673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:58.932279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49156e97-d8ac-47a4-9bc4-31d4cd59c3f8 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1510 microversion: 2.1 time: 0.488621 Oct 31 15:38:58.934121 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2443/4766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:58 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:59.629207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8f95938b-9074-4c15-ae69-31eba3dfd9a1 req-d7a693d1-fe3e-4c56-b69f-f5bacf87b1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340e5d24-3b01-4b22-8daa-41e8c8afa7b7", "name": "network-vif-deleted", "tag": "74a46185-35cb-4927-8fed-4f0ed54f9cba"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:59.656146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f95938b-9074-4c15-ae69-31eba3dfd9a1 req-d7a693d1-fe3e-4c56-b69f-f5bacf87b1df service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.656648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f95938b-9074-4c15-ae69-31eba3dfd9a1 req-d7a693d1-fe3e-4c56-b69f-f5bacf87b1df service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.657124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f95938b-9074-4c15-ae69-31eba3dfd9a1 req-d7a693d1-fe3e-4c56-b69f-f5bacf87b1df service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:59.683142 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8f95938b-9074-4c15-ae69-31eba3dfd9a1 req-d7a693d1-fe3e-4c56-b69f-f5bacf87b1df service nova] Creating event network-vif-deleted:74a46185-35cb-4927-8fed-4f0ed54f9cba for instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 on n-h1-858383-17 Oct 31 15:38:59.700238 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8f95938b-9074-4c15-ae69-31eba3dfd9a1 req-d7a693d1-fe3e-4c56-b69f-f5bacf87b1df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074263 Oct 31 15:38:59.700976 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2324/4767] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:59.955415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:59.957513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:59.970103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.974068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.974885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:59.975694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.976211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.981880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.019511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:00.020291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:00.020961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.021586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lazy-loading 'fault' on Instance uuid 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:39:00.175470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d32ae2c313940bb9d704bcf64a22be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73712f1170a949a8a98bbe83fc059554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:00.188820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4cfc2731-aa4c-4796-9221-d20e6c75dec0 tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 200 len: 1306 microversion: 2.1 time: 0.236443 Oct 31 15:39:00.191507 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2444/4768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:59 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 1306 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:01.218787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:01.220427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] [instance: 340e5d24-3b01-4b22-8daa-41e8c8afa7b7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:01.237722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.241091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.241842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.243024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.247767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.248772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.290753 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] HTTP exception thrown: Instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 could not be found. Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Request method failure captured: Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 HTTP/1.1 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-voA9DO16hVWr66zpZ9EJxlSGrwsBEMKkPFzjJLFyZQqqIcWf1AJTSHhmIJjCdkwBStRZ8yjqU7F_W9zwJgkJlfNBvQW3RqDAepxUGrQf3-1DWWYJr903EeP6XeP07MK8pjvgJF4OGNBRw5gGpb3T149GZAiDu7KsTNt43C5BdE1Ms Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 73712f1170a949a8a98bbe83fc059554 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerPasswordTestJSON-1338175871 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73712f1170a949a8a98bbe83fc059554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73712f1170a949a8a98bbe83fc059554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73712f1170a949a8a98bbe83fc059554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73712f1170a949a8a98bbe83fc059554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerPasswordTestJSON-1338175871 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 73712f1170a949a8a98bbe83fc059554 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1338175871 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerPasswordTestJSON-1338175871-project Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 9d32ae2c313940bb9d704bcf64a22be4 Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerPasswordTestJSON-1338175871-project Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 could not be found. Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '340e5d24-3b01-4b22-8daa-41e8c8afa7b7'} Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 could not be found. Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 could not be found. Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:01.295712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 could not be found. Oct 31 15:39:01.299962 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:01.306642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] Returning 404 to user: Instance 340e5d24-3b01-4b22-8daa-41e8c8afa7b7 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:01.307733 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84c1a116-e11c-4044-92b9-5874209412fe tempest-ServerPasswordTestJSON-1338175871 tempest-ServerPasswordTestJSON-1338175871-project] 10.222.0.48 "GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7" status: 404 len: 111 microversion: 2.1 time: 0.095955 Oct 31 15:39:01.316982 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2325/4769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:01 2022] GET /compute/v2.1/servers/340e5d24-3b01-4b22-8daa-41e8c8afa7b7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:39:10.950098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:10.950797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:10.972088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:10.974427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:10.982932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:10.985094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:10.987987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:10.991393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:10.994286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:10.996727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.083137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:39:11.313101 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0c5c3acc-ed61-46b3-ad5a-561e53db9af3 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 204 len: 0 microversion: 2.1 time: 0.367592 Oct 31 15:39:11.314125 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2445/4770] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:39:10 2022] DELETE /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:11.325432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:11.326133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:11.341127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:11.344267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:11.347095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.347619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.350457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.352225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.352741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.353195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:12.147185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:12.168525 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32e511ff-f777-4011-ae3d-c3166160da15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1507 microversion: 2.1 time: 0.850014 Oct 31 15:39:12.184217 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2326/4771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:11 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:13.194311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:13.195055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:13.206949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:13.209030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:13.209720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:13.210990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:13.211725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:13.212674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:13.566959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:13.580300 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9083f0c4-b1fc-4713-a16c-f5a4aea48b76 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1507 microversion: 2.1 time: 0.392008 Oct 31 15:39:13.580947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2446/4772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:13 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:14.604273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:14.604927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:14.611881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:14.612585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:14.613228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:14.614097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:14.614733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:14.615348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.116648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:15.133806 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fea7651f-49f6-4191-afc1-70927222b175 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1507 microversion: 2.1 time: 0.534044 Oct 31 15:39:15.135012 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2327/4773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:14 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:15.799395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-698c706a-c383-4017-a1f6-b4352847a561 req-6a1da7ef-b471-41a4-bf8c-1219d27550f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66b783d-f29a-49cd-901c-f7c5682e1651", "name": "network-vif-deleted", "tag": "e006f6a5-48b0-44fe-9f2b-9106e43004d1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:15.844625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-698c706a-c383-4017-a1f6-b4352847a561 req-6a1da7ef-b471-41a4-bf8c-1219d27550f1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.848204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-698c706a-c383-4017-a1f6-b4352847a561 req-6a1da7ef-b471-41a4-bf8c-1219d27550f1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.851517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-698c706a-c383-4017-a1f6-b4352847a561 req-6a1da7ef-b471-41a4-bf8c-1219d27550f1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.893294 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-698c706a-c383-4017-a1f6-b4352847a561 req-6a1da7ef-b471-41a4-bf8c-1219d27550f1 service nova] Creating event network-vif-deleted:e006f6a5-48b0-44fe-9f2b-9106e43004d1 for instance a66b783d-f29a-49cd-901c-f7c5682e1651 on n-h1-858383-17 Oct 31 15:39:15.900624 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-698c706a-c383-4017-a1f6-b4352847a561 req-6a1da7ef-b471-41a4-bf8c-1219d27550f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104807 Oct 31 15:39:15.904183 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2447/4774] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:16.165760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:16.165760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:16.178995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:16.180400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:16.182325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:16.185170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:16.185786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:16.186518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:16.264620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:16.269418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:16.270170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:16.271161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lazy-loading 'fault' on Instance uuid a66b783d-f29a-49cd-901c-f7c5682e1651 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:39:17.130298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:17.150514 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9e93627-366d-47ec-9077-1f9e9abd8a15 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 200 len: 1311 microversion: 2.1 time: 0.991070 Oct 31 15:39:17.151426 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2328/4775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:16 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 1311 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:18.184965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:18.186892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: a66b783d-f29a-49cd-901c-f7c5682e1651] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.206145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.206660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.207329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.207913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.208390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.213362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.246536 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 could not be found. Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 HTTP/1.1 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 could not be found. Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a66b783d-f29a-49cd-901c-f7c5682e1651'} Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 could not be found. Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 could not be found. Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:39:18.248307 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 could not be found. Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 404 to user: Instance a66b783d-f29a-49cd-901c-f7c5682e1651 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-112dd04e-6271-425e-8799-2b930f775651 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651" status: 404 len: 111 microversion: 2.1 time: 0.075819 Oct 31 15:39:18.255451 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2448/4776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:18 2022] GET /compute/v2.1/servers/a66b783d-f29a-49cd-901c-f7c5682e1651 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:39:18.275834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:18.276397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.299286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.300095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.301413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.302188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.302666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.305405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.370603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:39:18.512850 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55b55621-91cd-455f-9550-14bb97f55e59 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 204 len: 0 microversion: 2.1 time: 0.251341 Oct 31 15:39:18.516440 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2329/4777] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:39:18 2022] DELETE /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:18.523451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:18.524300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.531859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.532684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.533329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.534328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.534978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.535585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.989099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:18.997775 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e628788-36db-4293-b4bd-89caabb046e2 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.478704 Oct 31 15:39:19.005747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2449/4778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:18 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:20.032690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:20.035568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:20.062662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:20.063418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:20.064584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:20.065797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:20.066959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:20.068400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:20.454175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:20.469687 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0fc57513-4c61-4d64-aaf0-378cf56b99b6 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.442807 Oct 31 15:39:20.470697 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2330/4779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:20 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:21.500393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:21.501640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:21.516946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:21.517450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:21.517894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:21.519704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:21.520206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:21.524505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:22.204152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1aceb8fb-dc04-4002-8dbc-70963648b0fb req-155505f3-9a8f-44f4-8123-e2b35d181a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb4a0f0-3b54-4012-bfde-2176e14f7711", "name": "network-vif-deleted", "tag": "b147bbb4-e537-45aa-b9d9-374f2973e0fe"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:22.240669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1aceb8fb-dc04-4002-8dbc-70963648b0fb req-155505f3-9a8f-44f4-8123-e2b35d181a0f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:22.241181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1aceb8fb-dc04-4002-8dbc-70963648b0fb req-155505f3-9a8f-44f4-8123-e2b35d181a0f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:22.241894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1aceb8fb-dc04-4002-8dbc-70963648b0fb req-155505f3-9a8f-44f4-8123-e2b35d181a0f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:22.261415 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1aceb8fb-dc04-4002-8dbc-70963648b0fb req-155505f3-9a8f-44f4-8123-e2b35d181a0f service nova] Creating event network-vif-deleted:b147bbb4-e537-45aa-b9d9-374f2973e0fe for instance efb4a0f0-3b54-4012-bfde-2176e14f7711 on n-h2-858383-17 Oct 31 15:39:22.272406 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1aceb8fb-dc04-4002-8dbc-70963648b0fb req-155505f3-9a8f-44f4-8123-e2b35d181a0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073277 Oct 31 15:39:22.276264 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2331/4780] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:22.292765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b26002fe48044e7bc31993c6698a22e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2dcd238bdf4ac994999771f8478dff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:22.333933 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-556920d2-cb74-4917-812f-a6986e931f00 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 200 len: 1522 microversion: 2.1 time: 0.838157 Oct 31 15:39:22.339730 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2450/4781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:21 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:23.363209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:23.364129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] [instance: efb4a0f0-3b54-4012-bfde-2176e14f7711] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:23.384460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:23.384460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:23.384853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:23.385667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:23.386213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:23.386719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:23.414049 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] HTTP exception thrown: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 could not be found. Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Request method failure captured: Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 HTTP/1.1 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-sPZ-sPCXs0-XMsg2UGXDH36BOLSvYAsC0aRYRxGn2rbKkXDXQmHDHIZQUx7PfxsB24tX3Ch15w_mWeqKvU_YnrV0m2CQw-lp9XdbdsTuIU_KeV-o4aFBW604r4y-ZFiEm0q-_POPVhC3lZIAsn1__NJdBf0MEbEfztsl1_WdRcRZA Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca2dcd238bdf4ac994999771f8478dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: ca2dcd238bdf4ac994999771f8478dff Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1998682812 Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3b26002fe48044e7bc31993c6698a22e Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1998682812-project Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 could not be found. Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'efb4a0f0-3b54-4012-bfde-2176e14f7711'} Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 could not be found. Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 could not be found. Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:23.415921 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 could not be found. Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] Returning 404 to user: Instance efb4a0f0-3b54-4012-bfde-2176e14f7711 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d18ea8c-bea3-414a-87bf-0f766fcf3a78 tempest-ServerRescueNegativeTestJSON-1998682812 tempest-ServerRescueNegativeTestJSON-1998682812-project] 10.222.0.48 "GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711" status: 404 len: 111 microversion: 2.1 time: 0.062721 Oct 31 15:39:23.423399 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2332/4782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:23 2022] GET /compute/v2.1/servers/efb4a0f0-3b54-4012-bfde-2176e14f7711 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:39:41.255484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:41.257058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:41.258244 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:39:41.263007 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 15:39:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 31 15:39:41.505452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-5683433", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:41.857740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:39:43.548097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:39:43.548825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:39:43.549333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:39:43.549815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:39:43.551281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:39:43.576339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.580753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.581391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.584171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.584667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.587690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.627258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:43.635352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:43.657057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:39:43.660041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:39:43.758630 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3e95d16-64e8-4bd0-94b8-25aeae60778e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508236 Oct 31 15:39:43.761005 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2451/4783] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:39:43.771212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ca2b08fa-ae68-4695-8fee-00730b371799 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:43.771696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca2b08fa-ae68-4695-8fee-00730b371799 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:43.774979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:43.778037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:44.666393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca2b08fa-ae68-4695-8fee-00730b371799 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:44.675030 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ca2b08fa-ae68-4695-8fee-00730b371799 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1190 microversion: 2.1 time: 0.908035 Oct 31 15:39:44.677212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2333/4784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:43 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1190 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:45.711098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:45.713213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:45.729335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:45.730108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:45.733456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.735908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:45.743379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:45.744851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.968237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:45.979246 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4edd0d8f-0143-497d-90f2-f6e319660ab8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1250 microversion: 2.1 time: 0.272955 Oct 31 15:39:45.982476 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2452/4785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:45 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1250 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:47.009825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:47.010451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:47.026401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.029046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.029890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.032080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.033563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.034789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.161119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:47.173580 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f90ce3a-4f43-4469-bd49-7c984a9df86f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1248 microversion: 2.1 time: 0.167740 Oct 31 15:39:47.180675 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2334/4786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:47 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1248 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:47.379624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ec07461-4093-4924-8cb8-2641669069bc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Action: 'create', calling method: .version_select at 0x7f5ca137cdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1912177738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKdSPEJ6cYliy2g8KjORtMvLzeqa5NBMmJLir66hE8o5oGp0CM1SHRaZUK3niAFJ1zn/TsOSVOOO0NnvEvT2L7abhKHE9oTytshh5kXKd416JU8Wh66K5qCrG9iDyu26Q=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:47.400098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ec07461-4093-4924-8cb8-2641669069bc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Getting quotas for project f880fdbef7204abdb6d1fcb972535754. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:47.414804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ec07461-4093-4924-8cb8-2641669069bc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Getting quotas for user 4cc2e142832e421a912ebebe7df682e6 and project f880fdbef7204abdb6d1fcb972535754. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:47.454045 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ec07461-4093-4924-8cb8-2641669069bc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.366706 Oct 31 15:39:47.462050 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2453/4787] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:39:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:48.204580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:48.206022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:48.226567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:48.228627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:48.232040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:48.233707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:48.234477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:48.235320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:48.510035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:48.533778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cfb2358c-17b8-4d44-848c-cce50c0c68a0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1248 microversion: 2.1 time: 0.325316 Oct 31 15:39:48.535422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2335/4788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:48 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1248 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:49.561722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:49.562348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:49.578273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.580577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.581109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.589303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.593284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.609359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.270385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:50.283811 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fad5448-fc93-4602-baa7-b1be0ab028b8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 0.727364 Oct 31 15:39:50.286700 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2454/4789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:49 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:51.308931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:51.309669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:51.324454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.327910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.328775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.329655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.331103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.336783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.949094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:51.965471 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c69a25e-9fbb-40cd-90e5-37962fe19a1f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 0.652898 Oct 31 15:39:51.966152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2336/4790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:51 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:52.993813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:52.994447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:53.018460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.021266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.022600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.028620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.029512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.030236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.372364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-72751a85-3c79-4079-859e-6a26667a07d8 req-aaeae247-ce56-4bac-888a-6ae2204a96b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1822d74b-2b43-41ce-85c4-f87833af7e74", "tag": "30c9f344-6125-41d9-92b9-ce5578114a0f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:53.389739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-72751a85-3c79-4079-859e-6a26667a07d8 req-aaeae247-ce56-4bac-888a-6ae2204a96b9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.390435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-72751a85-3c79-4079-859e-6a26667a07d8 req-aaeae247-ce56-4bac-888a-6ae2204a96b9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.391256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-72751a85-3c79-4079-859e-6a26667a07d8 req-aaeae247-ce56-4bac-888a-6ae2204a96b9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.407066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-72751a85-3c79-4079-859e-6a26667a07d8 req-aaeae247-ce56-4bac-888a-6ae2204a96b9 service nova] Creating event network-changed:30c9f344-6125-41d9-92b9-ce5578114a0f for instance 1822d74b-2b43-41ce-85c4-f87833af7e74 on n-h2-858383-17 Oct 31 15:39:53.415456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-72751a85-3c79-4079-859e-6a26667a07d8 req-aaeae247-ce56-4bac-888a-6ae2204a96b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051156 Oct 31 15:39:53.416660 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2337/4791] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:53.608869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:53.993549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:54.010283 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d4bf8931-44f2-4409-a586-6d07fde4ad07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.019694 Oct 31 15:39:54.013219 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2455/4792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:52 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:55.034391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:55.040307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:55.041062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:55.060963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:55.064264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:55.065320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:55.066526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:55.067189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:55.070001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:55.585762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:55.597223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bfb20e0d-eb5a-4e51-86d7-cd20497379f4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 0.565452 Oct 31 15:39:55.598529 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2338/4793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:55 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:56.634986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:56.635633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:56.655863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.658030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.662353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.665016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.667867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.670189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:57.153692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:57.179136 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac3e06c3-5fc1-43f0-99cd-121e932e1e43 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 0.554253 Oct 31 15:39:57.182940 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2456/4794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:56 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:58.209589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:58.210480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:58.229396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.230162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.230771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.234679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.235587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.236194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.656759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3d3927b-57f4-4233-9757-66515fb19119"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:58.660028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:58.665699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:58.668949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.669808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.670484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.671440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.672130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.672979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:59.041074 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-480ad83c-efe8-449c-a3a5-631c21ce9651 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "POST /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387959 Oct 31 15:39:59.050192 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2457/4795] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:39:58 2022] POST /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:59.363514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:59.379316 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bdfa4e22-0edf-4620-bae3-aea3a8ab41c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.175567 Oct 31 15:39:59.389335 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2339/4796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:58 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:00.410843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:00.411608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:00.446412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:00.446920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:00.453337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:00.454901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:00.455412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:00.455863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:01.035156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:01.048484 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d358a034-8b07-4edd-90d0-e6bc6d0deba5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 0.642894 Oct 31 15:40:01.049357 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2458/4797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:00 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:02.077132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:02.078386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:02.156534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.189420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.190584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:02.192319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.195354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.197096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:03.695647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:03.709905 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c38a682a-4ebe-4819-bd81-05ef7475a1cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.636680 Oct 31 15:40:03.715032 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2340/4798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:02 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:04.743029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:04.744631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:04.759174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:04.760186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:04.762116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:04.766554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:04.767372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:04.768073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:06.053905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:06.065494 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9be75412-77ae-4641-a589-1072c1a712df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.329796 Oct 31 15:40:06.071294 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2459/4799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:04 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:07.099157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:07.099790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:07.116060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.128791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.129578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.131171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.131844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.132497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:08.249466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:08.263474 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db827317-ec4d-4a37-99e2-509d34665719 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.168272 Oct 31 15:40:08.265092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2341/4800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:07 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:09.291761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:09.292381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:09.305481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:09.311542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:09.312041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:09.315284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:09.316898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:09.319592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.473200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1460061290", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "39ec6d43-2f54-4959-9cfa-e1fee61e9895"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:10.600582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] validate_networks() for [('39ec6d43-2f54-4959-9cfa-e1fee61e9895', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:40:10.830334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:10.850271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b71d598-4699-4702-a636-3591d2e56f01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.562499 Oct 31 15:40:10.850909 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2460/4801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:09 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:10.871067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-488c417f-2e32-482c-9479-207e6759bcb1 req-8ed4185b-2beb-4253-9800-bd20ee054449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1822d74b-2b43-41ce-85c4-f87833af7e74", "name": "network-vif-plugged", "status": "completed", "tag": "30c9f344-6125-41d9-92b9-ce5578114a0f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:10.890020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-488c417f-2e32-482c-9479-207e6759bcb1 req-8ed4185b-2beb-4253-9800-bd20ee054449 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:10.890514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-488c417f-2e32-482c-9479-207e6759bcb1 req-8ed4185b-2beb-4253-9800-bd20ee054449 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:10.890961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-488c417f-2e32-482c-9479-207e6759bcb1 req-8ed4185b-2beb-4253-9800-bd20ee054449 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.937305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-488c417f-2e32-482c-9479-207e6759bcb1 req-8ed4185b-2beb-4253-9800-bd20ee054449 service nova] Creating event network-vif-plugged:30c9f344-6125-41d9-92b9-ce5578114a0f for instance 1822d74b-2b43-41ce-85c4-f87833af7e74 on n-h2-858383-17 Oct 31 15:40:10.953915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-488c417f-2e32-482c-9479-207e6759bcb1 req-8ed4185b-2beb-4253-9800-bd20ee054449 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097893 Oct 31 15:40:10.962014 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2461/4802] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:11.878572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.880940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:11.894240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:11.902732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.904668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.905764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.907254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.909282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.910257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.979343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:12.860986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:40:12.861520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:40:12.862121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:40:12.862771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:40:12.863303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:40:12.878987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:12.880033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:12.884613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:12.885911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:12.893160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:12.894050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:12.957908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Getting quotas for project b99ddffb41834efa8cb474af34c73099. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:12.980526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Getting quotas for user 59f6b665503b448885cd5e67c529f462 and project b99ddffb41834efa8cb474af34c73099. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:13.003995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:40:13.007933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:40:13.110104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78888cc3-1639-45b3-9672-7f772e5ade69 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.931138 Oct 31 15:40:13.120839 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2342/4803] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:40:13.126187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-765dc90c-39a1-485e-9608-3b6471da7a28 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:13.133413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-765dc90c-39a1-485e-9608-3b6471da7a28 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:13.349932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:13.363026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5586814-82ad-4d09-9920-8b73ed4a0912 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1290 microversion: 2.1 time: 1.490405 Oct 31 15:40:13.382069 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2462/4804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:11 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1290 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:13.508270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-765dc90c-39a1-485e-9608-3b6471da7a28 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:13.524620 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-765dc90c-39a1-485e-9608-3b6471da7a28 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1228 microversion: 2.1 time: 0.402286 Oct 31 15:40:13.525659 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2343/4805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:13 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1228 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:14.390379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:14.391008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:14.409265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:14.409693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:14.410132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:14.410846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:14.411427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:14.411859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:14.554827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:14.555458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:14.558232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:14.577093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:14.580792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:14.585398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:14.587176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:14.587681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:14.588199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:14.633951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=47 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:14.848177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:14.858130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e19e66a6-0fa7-4379-9197-8d58f9cdfee9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1280 microversion: 2.1 time: 0.307822 Oct 31 15:40:14.863493 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2344/4806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:14 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:14.873252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1996851298-access_point-2007493189", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "31f76705-3983-4f9f-bdd7-685385767118"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1912177738", "security_groups": [{"name": "tempest-secgroup_access--1064639650"}, {"name": "tempest-secgroup_general--750944418"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:15.085189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:15.097378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eedb5a9a-ad69-45dd-a9b3-52cff9d139b6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1471 microversion: 2.1 time: 0.711200 Oct 31 15:40:15.099729 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2463/4807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:14 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1471 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:15.380388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1554428801", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:15.493826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:40:16.105733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] validate_networks() for [('31f76705-3983-4f9f-bdd7-685385767118', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:40:17.280000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:40:17.284896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:40:17.287394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:40:17.288952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:40:17.290891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:40:17.326481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.327365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.328721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.330022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.331097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.335610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.392617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:17.404345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:17.437343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:40:17.439807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:40:17.512390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f04c9a3-2dc5-43ff-adc8-09b5e3d1de3b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.134170 Oct 31 15:40:17.518696 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2464/4808] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:40:17.542039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:17.544035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:17.556186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.556710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.559209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.561851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.562366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.564552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.338174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:40:18.339376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:40:18.340410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:40:18.341030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:40:18.341626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:40:18.359705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.360413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.365147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.371639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.372460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.373971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:18.374639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.383238 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c58b6d8-7166-414b-ad65-314cff516323 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1286 microversion: 2.1 time: 0.863122 Oct 31 15:40:18.387929 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2465/4809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:17 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1286 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:18.435801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Getting quotas for project f880fdbef7204abdb6d1fcb972535754. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:18.449726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Getting quotas for user 4cc2e142832e421a912ebebe7df682e6 and project f880fdbef7204abdb6d1fcb972535754. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:18.468147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:40:18.470214 n-d-858383-17 devstack@n-api.service[120626]: WARNING nova.utils [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1996851298-access_point-2007493189 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1996851298-ac Oct 31 15:40:18.470972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:40:18.559144 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b87d1bb-1e84-4fc2-baae-e8812e40bbf7 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 3.694074 Oct 31 15:40:18.559827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2345/4810] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:40:14 2022] POST /compute/v2.1/servers => generated 457 bytes in 3695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:40:18.571603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:18.572116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:18.619603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.620087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.624113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.625126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.625548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.625991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.679958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f06ef311-8d97-401e-b611-060aa2d28d63"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:18.683456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:18.689817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:18.696509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.697053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.700272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.701063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.701549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.701995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.902752 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85cfe989-dffc-4262-a2a0-402579c7371b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 204 len: 0 microversion: 2.1 time: 0.340523 Oct 31 15:40:18.907532 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2346/4811] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:18 2022] DELETE /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:18.913567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-28dd7e0d-946c-45f5-916b-b5b142cb3a61 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:18.915434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-28dd7e0d-946c-45f5-916b-b5b142cb3a61 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:18.947100 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] HTTP exception thrown: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Request method failure captured: Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments/d3d3927b-57f4-4233-9757-66515fb19119 HTTP/1.1 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 74 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-vdBRMSr5svTtKQXtvTdBbUgy7a82ygXHamze1DYoI-06DC3BFpfafdLSzO7F3Ng6_kiz9CwCxoGPX_XfjrupT2A-gJK4uY6mywRXgomamwCI3A0QQnSAlXU9IRrYoo9ToQ8vVt-lq1zZC3Fy9pRgqO1MBrL-Fe_MKLR4S2FQrOoTw Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 033dce00252b468bae6180c9a587af18 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesAdminNegativeTest-1529225 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/033dce00252b468bae6180c9a587af18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/033dce00252b468bae6180c9a587af18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_033dce00252b468bae6180c9a587af18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/033dce00252b468bae6180c9a587af18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesAdminNegativeTest-1529225 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 033dce00252b468bae6180c9a587af18 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1529225 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesAdminNegativeTest-1529225-project-admin Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ed8e5ba9a8a74795ae5d0b0d9cb505a8 Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesAdminNegativeTest-1529225-project-admin Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: {"volumeAttachment": {"volumeId": "f06ef311-8d97-401e-b611-060aa2d28d63"}} Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: exception: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': '71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0', 'id': 'd3d3927b-57f4-4233-9757-66515fb19119', 'body': {'volumeAttachment': {'volumeId': 'f06ef311-8d97-401e-b611-060aa2d28d63'}}} Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. (HTTP 404) (Request-ID: req-a6f3dd3f-ecd0-4417-b803-4c4daecc5161) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:40:18.949495 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Returning 400 to user: Volume f06ef311-8d97-401e-b611-060aa2d28d63 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9eb28ff1-550d-410e-bba5-f8a2aa599a51 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments/d3d3927b-57f4-4233-9757-66515fb19119" status: 400 len: 107 microversion: 2.1 time: 0.561870 Oct 31 15:40:18.953965 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2466/4812] 10.222.0.48 () {60 vars in 1433 bytes} [Mon Oct 31 15:40:18 2022] PUT /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments/d3d3927b-57f4-4233-9757-66515fb19119 => generated 107 bytes in 563 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:40:18.966494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:18.967398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:18.987898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.988412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.988897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.001257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.001807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.002249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.132278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-28dd7e0d-946c-45f5-916b-b5b142cb3a61 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:19.143936 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-28dd7e0d-946c-45f5-916b-b5b142cb3a61 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1295 microversion: 2.1 time: 0.236691 Oct 31 15:40:19.144626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2347/4813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:18 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1295 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:19.163920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:19.166074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:19.166605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:19.177027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-683312d4-8ab2-42c5-8229-3095181245a3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 200 len: 1267 microversion: 2.1 time: 0.220555 Oct 31 15:40:19.178015 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2467/4814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:18 2022] GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:19.217897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.218419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.231025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.233120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.238033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.238546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.394066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lazy-loading 'services' on Instance uuid 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:19.411848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:19.412642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:19.427164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.428008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.429892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.434813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.435318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.435766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.571808 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-738fb066-b87b-45ec-ab66-d20780584350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments/d3d3927b-57f4-4233-9757-66515fb19119" status: 202 len: 0 microversion: 2.1 time: 0.423321 Oct 31 15:40:19.597428 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2348/4815] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:40:19 2022] DELETE /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments/d3d3927b-57f4-4233-9757-66515fb19119 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:40:19.622863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:19.634245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:19.655324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.655839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.657799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.661065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:19.661843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:19.662490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:19.811418 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80e5fd08-5e5e-4318-a7e7-c445f23c1b24 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208526 Oct 31 15:40:19.815362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2349/4816] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:19 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:19.982921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:19.994871 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72916609-5375-4222-98dc-87c0d9640c12 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.587383 Oct 31 15:40:19.996392 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2468/4817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:19 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:20.178304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:20.179568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:20.191800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.193572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.195252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.197188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.199452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.200115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.217393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:20.221949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:20.236215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.237556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.240374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.241446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.242158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.244420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.570473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:20.580156 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5224e50-e521-48bb-8d24-9dc4c620ab02 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 200 len: 1211 microversion: 2.1 time: 0.379208 Oct 31 15:40:20.585868 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2469/4818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:20 2022] GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 1211 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:20.600513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:20.611622 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db4f6333-b79a-4c94-9942-93970ad7d2d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1291 microversion: 2.1 time: 0.442369 Oct 31 15:40:20.640172 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2350/4819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:20 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1291 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:20.827641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:20.830670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:20.854637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.855445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.856116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.857082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.857904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.858622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.917615 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8b7f200-47c1-4da2-9542-87d1e1515705 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093914 Oct 31 15:40:20.921835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2470/4820] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:20 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:21.023065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:21.023704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:21.034752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:21.038322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:21.040307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:21.047403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:21.048451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:21.049348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:21.607986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:21.608618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:21.616511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:21.617047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:21.617493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:21.618218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:21.618689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:21.619125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:21.954672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:21.964920 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6b433e3-b22c-45a4-8dfc-15bb537f28f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 200 len: 1211 microversion: 2.1 time: 0.361225 Oct 31 15:40:21.966576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2471/4821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:21 2022] GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 1211 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:21.988165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:21.990220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:22.001115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:22.001991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:22.002671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:22.003666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:22.004493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:22.005250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:22.249241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:22.260506 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-56c74805-57c5-46ec-a5f7-dbe3d060c5e4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 1.242248 Oct 31 15:40:22.268209 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2351/4822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:21 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:22.286449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:22.289224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:22.306510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:22.307672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:22.308408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:22.310227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:22.311060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:22.324505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:22.366168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:22.380487 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6bcabee0-9d75-46fe-b58a-44d82742b549 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1353 microversion: 2.1 time: 0.410955 Oct 31 15:40:22.393461 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2472/4823] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:21 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1353 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:22.417190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dae302bb-c1c2-4b25-b57f-229a65c05350 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147256 Oct 31 15:40:22.418172 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2352/4824] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:22 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:22.991285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:22.991962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:23.027239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.028312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.029283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.030429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.031526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.032278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.092864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.093605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.095258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.096084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lazy-loading 'fault' on Instance uuid d101e71b-3778-40c8-935a-fbc48c779c39 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:23.297721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:23.299688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:23.310841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:23.314707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.315209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.315652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.318157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.318886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.319685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.324271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d86cd5a3-bfa0-4dea-a5e0-ee803ebe153a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 200 len: 1215 microversion: 2.1 time: 0.336546 Oct 31 15:40:23.325720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2473/4825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:22 2022] GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:23.413013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:23.413868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:23.428015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.434278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.435002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.438377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.439087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.439711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.673710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:23.686489 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-951c76cb-b1cf-474d-b5fa-f22093fdeb07 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1353 microversion: 2.1 time: 0.278759 Oct 31 15:40:23.687508 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2474/4826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:23 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1353 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:23.696873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:23.699071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:23.722641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.724025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.724648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.725746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.726411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.727013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.798096 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f92af46-70d6-4bdb-9647-2fda05869d66 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109162 Oct 31 15:40:23.805135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2475/4827] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:23 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:24.251625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:24.270650 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa7f9e08-d67c-4091-acf4-b96d0f2437b4 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.978266 Oct 31 15:40:24.271259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2353/4828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:23 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:24.353308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:24.354735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:24.366051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.372886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.373686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.374847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.375559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.376239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.404071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 HTTP/1.1 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd101e71b-3778-40c8-935a-fbc48c779c39'} Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:24.407445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:40:24.412269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:24.414424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:24.424978 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03604f5e-1d5f-408f-9941-e0ea6a3629ea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 404 len: 111 microversion: 2.1 time: 0.075534 Oct 31 15:40:24.426837 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2476/4829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:24 2022] GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:24.493924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1925499720", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:24.588844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:40:24.715932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:24.716797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:24.727611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.733105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.733806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.734743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.735971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.740001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.985722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:25.000939 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4cf9ec21-2875-42ed-948c-dc7f088d3404 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1353 microversion: 2.1 time: 0.288997 Oct 31 15:40:25.001793 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2477/4830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:24 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1353 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:25.010907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:25.013172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:25.034643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:25.035539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:25.037133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:25.038160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:25.039288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:25.040363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:25.122568 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f34a5c02-a8c3-44fa-84c2-734a3f4e054f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119461 Oct 31 15:40:25.123651 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2478/4831] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:25 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:25.299903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:25.300641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:25.309926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:25.311693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:25.312230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:25.315884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:25.316505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:25.317672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.234603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:26.251423 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4deb5130-135a-4865-8834-1d9802ae794f tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.955393 Oct 31 15:40:26.253842 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2479/4832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:25 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:26.271569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5459b0f9-3636-40d5-ac77-6e40c7bfe734 req-a31ef764-2875-4eea-9fb9-db3e8e281fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00035ce3-08f2-4fe3-a18e-192857d486ad", "tag": "cf13497a-17d7-4ae1-92c3-f472afc010c2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:26.304250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5459b0f9-3636-40d5-ac77-6e40c7bfe734 req-a31ef764-2875-4eea-9fb9-db3e8e281fea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.304803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5459b0f9-3636-40d5-ac77-6e40c7bfe734 req-a31ef764-2875-4eea-9fb9-db3e8e281fea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.305241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5459b0f9-3636-40d5-ac77-6e40c7bfe734 req-a31ef764-2875-4eea-9fb9-db3e8e281fea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.309585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:26.322497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5459b0f9-3636-40d5-ac77-6e40c7bfe734 req-a31ef764-2875-4eea-9fb9-db3e8e281fea service nova] Creating event network-changed:cf13497a-17d7-4ae1-92c3-f472afc010c2 for instance 00035ce3-08f2-4fe3-a18e-192857d486ad on n-h1-858383-17 Oct 31 15:40:26.335256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5459b0f9-3636-40d5-ac77-6e40c7bfe734 req-a31ef764-2875-4eea-9fb9-db3e8e281fea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078879 Oct 31 15:40:26.338231 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2480/4833] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:26.346998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:26.348258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:26.360507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.362458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.363281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.367743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.368880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.369632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.561054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:26.577141 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef34c442-c722-4cf3-bc26-fc6e9ecc5f36 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1353 microversion: 2.1 time: 0.237022 Oct 31 15:40:26.580353 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2481/4834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:26 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1353 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:26.591517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:26.594537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:26.604876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.605666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.606559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.607450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.608077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.608670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.652113 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1de03327-6cae-4ed1-a849-fe3da44ee4a9 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070121 Oct 31 15:40:26.653007 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2482/4835] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:26 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:26.862050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:40:26.863003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:40:26.863793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:40:26.864442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:40:26.865609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:40:26.887118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.889494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.890210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.891575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.892306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.893003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.937597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:26.966716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:26.991073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:40:26.994398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:40:27.108576 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e67d356-dd05-41e6-bfc8-0b3004b325d9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.618420 Oct 31 15:40:27.110650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2354/4836] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:40:27.133804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef9e6797-6e47-4d8d-a08b-3f8d4254e27b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.134428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef9e6797-6e47-4d8d-a08b-3f8d4254e27b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.280323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.281120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.291030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.291727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.292313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.294002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.294719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.296911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.373925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:27.419793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:27.431452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef9e6797-6e47-4d8d-a08b-3f8d4254e27b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:27.444438 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef9e6797-6e47-4d8d-a08b-3f8d4254e27b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1221 microversion: 2.1 time: 0.325305 Oct 31 15:40:27.445060 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2483/4837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:27 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1221 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:27.607064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.608301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.620689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.621226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.621675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.622472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.622849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.623281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.776010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:27.785076 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-91311c8e-c663-48de-a817-1fd189636507 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.512480 Oct 31 15:40:27.792761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2355/4838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:27 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:27.808521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.814381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.834511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.835016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.835670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.836562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.837231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.837859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.897138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2028f413-9d5e-415a-ac26-34805a309f7a tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103005 Oct 31 15:40:27.898605 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2356/4839] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:27 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:28.077820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:28.090203 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6dc1ad5-554b-489a-a3be-2460c2db304b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 0.487180 Oct 31 15:40:28.090812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2484/4840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:27 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:28.470802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:28.471435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:28.481521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:28.482476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:28.483322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:28.484810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:28.486538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:28.487267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:28.809529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:28.811733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:28.820841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:28.826666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:28.827936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:28.829561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:28.833612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:28.834352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:28.987195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:29.004908 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-149cffb4-4bfd-45ef-b18d-2a7f287cf609 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1273 microversion: 2.1 time: 0.537386 Oct 31 15:40:29.030078 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2357/4841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:28 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1273 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:29.040602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:29.044586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:29.053342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:29.054562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:29.055624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.058198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:29.058941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:29.059627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.134692 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a22e6bb9-cd91-4510-8728-3f97c5a28599 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102893 Oct 31 15:40:29.136210 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2358/4842] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:29 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:40:29.195158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:29.200716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:29.237852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:29.240528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:29.245401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.247871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:29.250407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:29.252048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.345826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:29.359016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81f843c8-fc6a-4147-aaf5-3bdf5a1e9ff3 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.553125 Oct 31 15:40:29.360906 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2485/4843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:28 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:29.506033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1930910952", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "092d85d1-c91e-4e1a-9d2e-5561e4167dea"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:29.571042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] validate_networks() for [('092d85d1-c91e-4e1a-9d2e-5561e4167dea', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:40:30.491780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:30.522042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33462e38-ecaf-4b77-a9bd-343105b61445 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 1.384485 Oct 31 15:40:30.540791 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2359/4844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:29 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:30.540791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:30.540791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:30.560673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:30.561681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:30.561681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:30.562515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:30.562981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:30.563591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:30.799315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:30.803098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:30.818896 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-427d4723-2db1-488e-9e81-ec8d8218862e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1279 microversion: 2.1 time: 0.290216 Oct 31 15:40:30.833049 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2360/4845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:30 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1279 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:30.841324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:30.842232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:30.855704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:30.856220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:30.857052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:30.857975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:30.858597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:30.859183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.452501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:31.460558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-122838e9-028d-43bc-9a80-ab736f14f0e9 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.626211 Oct 31 15:40:31.461189 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2361/4846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:30 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:31.556154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:31.557014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:31.577178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:31.577737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:31.578409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.579311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:31.579969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:31.580571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.067468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:40:32.068090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:40:32.068903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:40:32.069803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:40:32.070431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:40:32.110826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.112612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.114997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.117901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.119224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.120126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.125839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:32.134898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1657e5e5-026a-4771-bd72-128580cfe66c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 0.582975 Oct 31 15:40:32.139045 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2362/4847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:31 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:32.144236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:32.146178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:32.157345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.163849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.169114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.170245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.170933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.171566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.195274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Getting quotas for project 8a296588291c4b7f9a069126f2219f5a. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:32.208533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Getting quotas for user 35b871cb47154546b1fabb9a2b807b90 and project 8a296588291c4b7f9a069126f2219f5a. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:32.241621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:40:32.248056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:40:32.366789 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57909c42-355e-4c7a-89b8-482ba61ffd04 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.865188 Oct 31 15:40:32.368281 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2486/4848] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:40:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:40:32.373458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-640b6371-11a7-4c37-b1ef-6fcaf62c62d4 req-9745e013-a7db-4b89-9439-b6f0324b7d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a482551-a14a-43cd-ac40-24c69454f476", "tag": "d3969917-bfa1-441c-89d4-30b2a2f569ef"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:32.387967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-640b6371-11a7-4c37-b1ef-6fcaf62c62d4 req-9745e013-a7db-4b89-9439-b6f0324b7d3a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.388977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-640b6371-11a7-4c37-b1ef-6fcaf62c62d4 req-9745e013-a7db-4b89-9439-b6f0324b7d3a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.389672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-640b6371-11a7-4c37-b1ef-6fcaf62c62d4 req-9745e013-a7db-4b89-9439-b6f0324b7d3a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.426389 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-640b6371-11a7-4c37-b1ef-6fcaf62c62d4 req-9745e013-a7db-4b89-9439-b6f0324b7d3a service nova] Creating event network-changed:d3969917-bfa1-441c-89d4-30b2a2f569ef for instance 1a482551-a14a-43cd-ac40-24c69454f476 on n-h1-858383-17 Oct 31 15:40:32.438265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-640b6371-11a7-4c37-b1ef-6fcaf62c62d4 req-9745e013-a7db-4b89-9439-b6f0324b7d3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068389 Oct 31 15:40:32.438872 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2487/4849] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:32.448916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55286a3d-be0d-4e2a-a69d-a3b067e7fa8f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:32.449632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55286a3d-be0d-4e2a-a69d-a3b067e7fa8f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:32.531758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55286a3d-be0d-4e2a-a69d-a3b067e7fa8f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:32.535703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:32.539265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55286a3d-be0d-4e2a-a69d-a3b067e7fa8f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1218 microversion: 2.1 time: 0.094733 Oct 31 15:40:32.540426 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2488/4850] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:32 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:32.547017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:32.547898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:32.560299 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8de4edb3-cf59-4b34-b9d1-8cecb64f219c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 0.419785 Oct 31 15:40:32.573123 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2363/4851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:32 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:32.581062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.581844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.582501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.585674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.586415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.587099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.892339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:32.910826 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15c958a4-53d2-4294-b16b-29f7801685d1 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.368483 Oct 31 15:40:32.911994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2489/4852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:32 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:33.164823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:33.165448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:33.176567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.177095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.177537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.178245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.178703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.179125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.565742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:33.566387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:33.580328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.580983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.581863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.583014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.583699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.584351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.936025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:33.946923 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0597f834-0d12-4e13-b965-fb96905ad4c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1214 microversion: 2.1 time: 0.384959 Oct 31 15:40:33.947527 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2490/4853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:33 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:33.979651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:33.985117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:34.012687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:34.013663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:34.014591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.016441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:34.019746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:34.020470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.360265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:34.379752 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1c89ba0e-5b8b-41d4-8800-dd91a9e3ea20 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 1.218481 Oct 31 15:40:34.381891 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2364/4854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:33 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:34.406331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:34.406978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:34.427017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:34.427767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:34.430290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.432311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:34.433158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:34.433822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.816146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:34.841524 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac90cfdd-b9b2-4444-8fe0-d87d97febc29 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 0.865561 Oct 31 15:40:34.843266 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2491/4855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:33 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:34.958369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:34.970756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:34.971685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:34.980989 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0a7262e-1f50-48c4-a80e-8aaea64eed9d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.596977 Oct 31 15:40:35.000662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:35.001315 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2365/4856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:34 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:35.002140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:35.002855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:35.004834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:35.005594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:35.006256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:35.170353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:35.210223 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bc1f099b-ed21-4f8e-9657-334c2c7fb4ae tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1270 microversion: 2.1 time: 0.243948 Oct 31 15:40:35.211857 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2492/4857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:34 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:35.406905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:35.413717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:35.435673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:35.437834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:35.438338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:35.439236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:35.439706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:35.440142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:35.881718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:35.883062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:35.895634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:35.897026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:35.897996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:35.899617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:35.901069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:35.901901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:36.156907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:36.179135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-750bb286-ebac-4006-b29f-33baf8444070 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 0.770989 Oct 31 15:40:36.179646 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2366/4858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:35 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:36.195879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:36.201848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:36.217192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:36.218784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:36.220235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:36.221355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:36.222058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:36.224348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:36.904366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:36.984236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=22 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:37.254417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:37.270661 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad426e64-5979-4ae2-93bc-6321a3ae5464 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 1.400393 Oct 31 15:40:37.271594 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2493/4859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:35 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:37.284178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:37.288050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:37.361624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:37.362623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:37.368947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:37.370097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:37.371059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:37.374109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:37.632521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:37.656656 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08e547ae-78f4-4e42-894c-f10211e2f91c tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1276 microversion: 2.1 time: 0.381884 Oct 31 15:40:37.657795 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2494/4860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:37 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1276 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:37.664415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d5e00909-cdf6-4a2b-83db-229ec825298e req-df3fef6e-131e-4f04-8039-a696394256b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00035ce3-08f2-4fe3-a18e-192857d486ad", "name": "network-vif-plugged", "status": "completed", "tag": "cf13497a-17d7-4ae1-92c3-f472afc010c2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:37.674733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:37.678452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d5e00909-cdf6-4a2b-83db-229ec825298e req-df3fef6e-131e-4f04-8039-a696394256b4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:37.680684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d5e00909-cdf6-4a2b-83db-229ec825298e req-df3fef6e-131e-4f04-8039-a696394256b4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:37.681458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d5e00909-cdf6-4a2b-83db-229ec825298e req-df3fef6e-131e-4f04-8039-a696394256b4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:37.701588 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d5e00909-cdf6-4a2b-83db-229ec825298e req-df3fef6e-131e-4f04-8039-a696394256b4 service nova] Creating event network-vif-plugged:cf13497a-17d7-4ae1-92c3-f472afc010c2 for instance 00035ce3-08f2-4fe3-a18e-192857d486ad on n-h1-858383-17 Oct 31 15:40:37.715224 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d5e00909-cdf6-4a2b-83db-229ec825298e req-df3fef6e-131e-4f04-8039-a696394256b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055005 Oct 31 15:40:37.716690 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2495/4861] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:37.724091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6705abc9-6be7-489c-a466-3d0f2af004b5 req-9075f257-d2d3-4408-adb6-597d9bcbcfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d898471-009a-4157-8b52-ff57d55bc645", "tag": "011b8177-c4ac-42cb-b9b5-460db45ca059"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:37.737438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6705abc9-6be7-489c-a466-3d0f2af004b5 req-9075f257-d2d3-4408-adb6-597d9bcbcfc3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:37.739098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6705abc9-6be7-489c-a466-3d0f2af004b5 req-9075f257-d2d3-4408-adb6-597d9bcbcfc3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:37.739894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6705abc9-6be7-489c-a466-3d0f2af004b5 req-9075f257-d2d3-4408-adb6-597d9bcbcfc3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:37.758847 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6705abc9-6be7-489c-a466-3d0f2af004b5 req-9075f257-d2d3-4408-adb6-597d9bcbcfc3 service nova] Creating event network-changed:011b8177-c4ac-42cb-b9b5-460db45ca059 for instance 6d898471-009a-4157-8b52-ff57d55bc645 on n-h2-858383-17 Oct 31 15:40:37.772734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:37.778017 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6705abc9-6be7-489c-a466-3d0f2af004b5 req-9075f257-d2d3-4408-adb6-597d9bcbcfc3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058361 Oct 31 15:40:37.778679 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2496/4862] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:37.785524 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b24c4837-de25-47b6-bc7f-de9ea1f67017 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 1.601648 Oct 31 15:40:37.786440 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2367/4863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:36 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:37.802562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:37.802562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:37.808269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:37.819365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:37.820281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:37.820824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:37.821324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:37.821763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:38.302360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:38.302981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:38.318748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:38.324607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:38.326346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:38.326346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:38.329266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:38.329942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:39.412987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:39.423786 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2efb979b-2199-4f2a-90c6-712c9ecd64a2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 1.641218 Oct 31 15:40:39.429423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2497/4864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:37 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:39.440380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:39.441973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:39.456191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:39.459501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:39.466550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:39.469483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:39.471230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:39.473661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:39.597255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:39.618142 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b681e655-8fe4-46f7-b5aa-b5feedae0ebd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 1.316644 Oct 31 15:40:39.620233 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2368/4865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:38 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:39.631911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:39.633451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:39.651266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:39.654982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:39.655481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:39.658546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:39.659048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:39.659491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:39.810517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:39.837223 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ec8ecc4-c4ff-4566-abfc-4c7b8d5106c0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1276 microversion: 2.1 time: 0.406456 Oct 31 15:40:39.853877 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2498/4866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:39 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1276 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:40.251015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:40.262725 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e00c4119-1e89-47ca-ac6e-1429a16caa88 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1328 microversion: 2.1 time: 0.638750 Oct 31 15:40:40.268223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2369/4867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:39 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1328 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:40.455507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:40.456153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:40.468235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:40.468746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:40.469188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:40.469899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:40.473090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:40.473658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:40.642511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:40.643169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:40.651593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:40.652424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:40.652913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:40.653648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:40.655362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:40.656012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:41.958129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:41.968309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:41.980884 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7bb24cf3-b1f4-4200-aa6d-f002efbd5f30 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 1.527949 Oct 31 15:40:41.993031 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2499/4868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:40 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:41.993157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-48e8aa7c-2cf4-46b4-a74d-729472cf7127 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 1.345270 Oct 31 15:40:41.993157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2370/4869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:40 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:42.005776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:42.006407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:42.016771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:42.019469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:42.025618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:42.026121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:42.026566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:42.027289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:42.027745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:42.032763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:42.037769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:42.038974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:42.041231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:42.042162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:42.044435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:42.046237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:42.146814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:42.338282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:42.356146 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ee4b354-7a9a-41d0-835e-1b6ec02df509 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1276 microversion: 2.1 time: 0.370630 Oct 31 15:40:42.357351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2500/4870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:41 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1276 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:42.979551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4305efd1-bd7d-4d01-bd01-fbfff0b42498 req-84f4f755-58b6-48b3-9cfb-ff558bdd05ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a482551-a14a-43cd-ac40-24c69454f476", "name": "network-vif-plugged", "status": "completed", "tag": "d3969917-bfa1-441c-89d4-30b2a2f569ef"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:42.998739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:43.001915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4305efd1-bd7d-4d01-bd01-fbfff0b42498 req-84f4f755-58b6-48b3-9cfb-ff558bdd05ec service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.002785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4305efd1-bd7d-4d01-bd01-fbfff0b42498 req-84f4f755-58b6-48b3-9cfb-ff558bdd05ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.003514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4305efd1-bd7d-4d01-bd01-fbfff0b42498 req-84f4f755-58b6-48b3-9cfb-ff558bdd05ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.025447 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4305efd1-bd7d-4d01-bd01-fbfff0b42498 req-84f4f755-58b6-48b3-9cfb-ff558bdd05ec service nova] Creating event network-vif-plugged:d3969917-bfa1-441c-89d4-30b2a2f569ef for instance 1a482551-a14a-43cd-ac40-24c69454f476 on n-h1-858383-17 Oct 31 15:40:43.032464 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4305efd1-bd7d-4d01-bd01-fbfff0b42498 req-84f4f755-58b6-48b3-9cfb-ff558bdd05ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061853 Oct 31 15:40:43.033998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2501/4871] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:43.040049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:43.041394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:43.049851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.051967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.052776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.053799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.054475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.055162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.276848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:43.295071 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b9c7222-2ef8-4d06-90c1-9caa9d06da06 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1528 microversion: 2.1 time: 1.296066 Oct 31 15:40:43.313986 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2371/4872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:41 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1528 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:43.328993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:43.333872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:43.348859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.355588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.356342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.357420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.358148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.358837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:44.373433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:44.375609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:44.385066 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83cf48d0-08e9-43a1-a70d-5e64b19beef4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 1.349541 Oct 31 15:40:44.390199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:44.391478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2502/4873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:43 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:44.399256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:44.404083 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c69c9b19-89ce-47a2-aaa2-64a5b38d881f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 1.087787 Oct 31 15:40:44.405592 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2372/4874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:43 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:44.406582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:44.417267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:44.418645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:44.419512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:44.420020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:44.420456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:44.421217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:44.421675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:44.422296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:44.431827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:44.433764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:44.436488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:44.440603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:44.441765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:44.442545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.134287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:45.155459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-603a00a9-9067-47e5-b7eb-4e26b4344933 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1528 microversion: 2.1 time: 0.762676 Oct 31 15:40:45.156338 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2503/4875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:44 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1528 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:45.242720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:45.256667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c97c7db0-9c9b-473b-a7fe-5751dbda5e3b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 0.848617 Oct 31 15:40:45.272733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:45.272733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:45.274253 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2373/4876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:44 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:45.279155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:45.280477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:45.281176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.282424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:45.284981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:45.286264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.307119 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] HTTP exception thrown: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Request method failure captured: Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad HTTP/1.1 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-xZZ1e2QCtXsFkw1NG6aZe-V8P13-E2GXj34zz3uIa-ee-drz-C6H3PMAlK1ZIhoCw47T5wP2PnAnZEOJUNNSfP6sI-7Zug7AO236GB1vj0dbRDvUy74ls71cgO3KyZWCtXgfCkyP5yOzjFe2a-imyr-tfnxc89KletJV88yHg0Yzs Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 27f9356eab4d4fbeb5e79ac432031a00 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1216704129 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1216704129 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 27f9356eab4d4fbeb5e79ac432031a00 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1216704129 Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1216704129-project Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 309236ebcddc49209901d47c0131c4fc Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1216704129-project Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '00035ce3-08f2-4fe3-a18e-192857d486ad'} Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:45.309605 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:45.317288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Returning 404 to user: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:45.325092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-130dfeaf-4d13-413e-8a3a-7f3f5a31fc69 tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 404 len: 111 microversion: 2.1 time: 0.139841 Oct 31 15:40:45.325092 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2504/4877] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:45 2022] DELETE /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:40:45.333476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:45.334421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:45.343133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:45.346010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:45.348323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:45.349200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.351200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:45.352860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:45.357498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.432570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:45.433074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:45.443013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:45.443885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:45.445205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.446241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:45.446957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:45.447741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:45.979637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:46.033213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b885ff21-2a92-4962-a6e1-5f2897534796 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1528 microversion: 2.1 time: 0.705650 Oct 31 15:40:46.037981 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2374/4878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:45 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1528 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:46.045196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:46.054497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:46.055399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:46.055669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62876c35-a60b-4efd-adc0-b05810e35fb1 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1472 microversion: 2.1 time: 0.628998 Oct 31 15:40:46.058213 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2505/4879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:45 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1472 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:46.072849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.072849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.072849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.072849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.072849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.072849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.082693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Action: 'update', calling method: >, body: {"server": {"name": "00035ce3-08f2-4fe3-a18e-192857d486ad_new"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:46.086098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:46.093631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.094437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.095429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.096404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.097156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.097714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.121238 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] HTTP exception thrown: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Request method failure captured: Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad HTTP/1.1 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 64 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-xZZ1e2QCtXsFkw1NG6aZe-V8P13-E2GXj34zz3uIa-ee-drz-C6H3PMAlK1ZIhoCw47T5wP2PnAnZEOJUNNSfP6sI-7Zug7AO236GB1vj0dbRDvUy74ls71cgO3KyZWCtXgfCkyP5yOzjFe2a-imyr-tfnxc89KletJV88yHg0Yzs Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 27f9356eab4d4fbeb5e79ac432031a00 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1216704129 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/27f9356eab4d4fbeb5e79ac432031a00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1216704129 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 27f9356eab4d4fbeb5e79ac432031a00 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1216704129 Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1216704129-project Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 309236ebcddc49209901d47c0131c4fc Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1216704129-project Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "00035ce3-08f2-4fe3-a18e-192857d486ad_new"}} Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '00035ce3-08f2-4fe3-a18e-192857d486ad', 'body': {'server': {'name': '00035ce3-08f2-4fe3-a18e-192857d486ad_new'}}} Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:40:46.123423 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:46.128114 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:46.131915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] Returning 404 to user: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:46.133254 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cf4fe27-851f-47d7-82be-da5b6965969d tempest-ServersNegativeTestMultiTenantJSON-1216704129 tempest-ServersNegativeTestMultiTenantJSON-1216704129-project] 10.222.0.48 "PUT /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 404 len: 111 microversion: 2.1 time: 0.057925 Oct 31 15:40:46.134762 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2506/4880] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:40:46 2022] PUT /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:46.145772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:46.146289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:46.161395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.162506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.163067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.164015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.164605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.165377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.242452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:46.399142 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-874d153d-158f-4ef3-9bdd-fc78fcdb78de tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 204 len: 0 microversion: 2.1 time: 0.257997 Oct 31 15:40:46.399932 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2507/4881] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:46 2022] DELETE /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:46.404970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:46.405671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:46.415400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.416275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.416928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.418719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.419420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.420021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.921706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:46.932869 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2d73f8ba-90cb-4c7c-aaf2-e170432f0506 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 0.890999 Oct 31 15:40:46.934143 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2375/4882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:46 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:46.940320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:46.941915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:46.949316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.950575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.951258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:46.952517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:46.953573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:46.954242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:47.681413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:47.714067 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-151f8177-2558-4c19-83ad-9d16010aa422 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 1.303573 Oct 31 15:40:47.714923 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2508/4883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:46 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:47.728390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:47.730606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:47.747506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:47.748646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:47.748646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:47.749198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:47.753156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:47.754512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:48.596523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:48.607510 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-197d3a6c-f05b-4673-b11d-116d4a5c157b tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1534 microversion: 2.1 time: 1.669451 Oct 31 15:40:48.608336 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2376/4884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:46 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1534 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:48.613289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:48.613919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:48.645072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:48.649456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:48.649923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:48.650693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:48.651172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:48.651606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:48.709477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:48.895433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:48.909498 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-daf625d5-b4ea-4ffc-a9fc-5ec0849b85be tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1643 microversion: 2.1 time: 1.191237 Oct 31 15:40:48.910221 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2509/4885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:47 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1643 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:48.915141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:48.922932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:48.932614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:48.933180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:48.933580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:48.934302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:48.934769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:48.935202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:49.592921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:49.605984 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c62ea2f-eb7b-4941-9f73-9b1e89f47b36 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 0.995188 Oct 31 15:40:49.606687 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2377/4886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:48 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:49.625395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:49.626425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:49.642332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:49.645415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:49.645994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:49.649560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:49.650180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:49.650735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:49.714744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:49.745210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eda21865-6795-4493-8ddc-eb6f98e99adf tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 0.833090 Oct 31 15:40:49.746514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2510/4887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:48 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:49.751989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1c8598ff-fbf1-45a3-9b9d-d1bcc76d5ccb req-7592dd52-13d4-4a45-88cb-2c616233a6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d898471-009a-4157-8b52-ff57d55bc645", "name": "network-vif-plugged", "status": "completed", "tag": "011b8177-c4ac-42cb-b9b5-460db45ca059"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:49.762787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1c8598ff-fbf1-45a3-9b9d-d1bcc76d5ccb req-7592dd52-13d4-4a45-88cb-2c616233a6e8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:49.763608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1c8598ff-fbf1-45a3-9b9d-d1bcc76d5ccb req-7592dd52-13d4-4a45-88cb-2c616233a6e8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:49.764467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1c8598ff-fbf1-45a3-9b9d-d1bcc76d5ccb req-7592dd52-13d4-4a45-88cb-2c616233a6e8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:49.779264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1c8598ff-fbf1-45a3-9b9d-d1bcc76d5ccb req-7592dd52-13d4-4a45-88cb-2c616233a6e8 service nova] Creating event network-vif-plugged:011b8177-c4ac-42cb-b9b5-460db45ca059 for instance 6d898471-009a-4157-8b52-ff57d55bc645 on n-h2-858383-17 Oct 31 15:40:49.788900 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1c8598ff-fbf1-45a3-9b9d-d1bcc76d5ccb req-7592dd52-13d4-4a45-88cb-2c616233a6e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040804 Oct 31 15:40:49.790287 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2511/4888] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:50.012773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-be62fcf1-8ae9-493c-8e54-cc20b6dc31cf req-2303704d-548d-49b2-a924-b51c90c90eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb3314c-688e-420f-8c47-73a9b38fbd0b", "tag": "087f2b41-549c-4470-84d2-deb1ed8e9f1a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:50.029423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-be62fcf1-8ae9-493c-8e54-cc20b6dc31cf req-2303704d-548d-49b2-a924-b51c90c90eac service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.032377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-be62fcf1-8ae9-493c-8e54-cc20b6dc31cf req-2303704d-548d-49b2-a924-b51c90c90eac service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.036607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-be62fcf1-8ae9-493c-8e54-cc20b6dc31cf req-2303704d-548d-49b2-a924-b51c90c90eac service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.099355 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-be62fcf1-8ae9-493c-8e54-cc20b6dc31cf req-2303704d-548d-49b2-a924-b51c90c90eac service nova] Creating event network-changed:087f2b41-549c-4470-84d2-deb1ed8e9f1a for instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b on n-h1-858383-17 Oct 31 15:40:50.107601 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-be62fcf1-8ae9-493c-8e54-cc20b6dc31cf req-2303704d-548d-49b2-a924-b51c90c90eac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315264 Oct 31 15:40:50.109625 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2512/4889] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:50.116566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:50.118356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:50.138170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.138928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.140305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.141604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.142453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.143062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.663749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:50.677851 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33a3cb36-a5f9-4bcd-a5db-6c07a8716718 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1643 microversion: 2.1 time: 1.063230 Oct 31 15:40:50.679230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2378/4890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:49 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1643 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:50.701637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:50.703574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:50.719670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.723540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.725227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.726589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.728534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.730613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.890734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:50.910305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32d30514-5fea-4486-9bba-b5de1436167e tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1534 microversion: 2.1 time: 0.798619 Oct 31 15:40:50.911683 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2513/4891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:50 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1534 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:50.916368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:50.916992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:50.932966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.933784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.934244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.935712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.943522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.944166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:51.892807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:51.905999 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ddb1d270-dd0e-4b81-bfd1-0d64cc8fcf1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1321 microversion: 2.1 time: 1.225363 Oct 31 15:40:51.907268 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2379/4892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:50 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1321 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:51.918365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:51.919525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:51.932344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:51.933737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:51.935669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:51.936941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:51.938936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:51.940200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:52.559680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:52.579929 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8df2b82f-fefb-4c16-8bf1-9d74def71e3f tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 0.670699 Oct 31 15:40:52.601100 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2380/4893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:51 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:52.606629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:52.607253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:52.609058 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-412d8970-01e2-4b51-aa9c-a2fe1c3a8438 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1796 microversion: 2.1 time: 1.695393 Oct 31 15:40:52.611483 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2514/4894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:50 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1796 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:52.614207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:52.614692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:52.621217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-742961c0-0366-4a9d-b015-0193f4068504 req-c52c03e4-731f-4ccd-ad9b-55e8c16d8479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00035ce3-08f2-4fe3-a18e-192857d486ad", "name": "network-vif-deleted", "tag": "cf13497a-17d7-4ae1-92c3-f472afc010c2"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:52.625153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:52.625946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:52.626463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:52.627096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:52.641186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-742961c0-0366-4a9d-b015-0193f4068504 req-c52c03e4-731f-4ccd-ad9b-55e8c16d8479 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:52.641735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-742961c0-0366-4a9d-b015-0193f4068504 req-c52c03e4-731f-4ccd-ad9b-55e8c16d8479 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:52.642391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-742961c0-0366-4a9d-b015-0193f4068504 req-c52c03e4-731f-4ccd-ad9b-55e8c16d8479 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:52.664154 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-742961c0-0366-4a9d-b015-0193f4068504 req-c52c03e4-731f-4ccd-ad9b-55e8c16d8479 service nova] Creating event network-vif-deleted:cf13497a-17d7-4ae1-92c3-f472afc010c2 for instance 00035ce3-08f2-4fe3-a18e-192857d486ad on n-h1-858383-17 Oct 31 15:40:52.674646 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-742961c0-0366-4a9d-b015-0193f4068504 req-c52c03e4-731f-4ccd-ad9b-55e8c16d8479 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056596 Oct 31 15:40:52.681571 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2515/4895] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:52.698647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:52.699153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:52.699708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:52.700227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lazy-loading 'fault' on Instance uuid 00035ce3-08f2-4fe3-a18e-192857d486ad {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:52.870781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:52.904390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32080839-1fac-47c0-9abd-62d3e4e8649d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1318 microversion: 2.1 time: 0.301089 Oct 31 15:40:52.905952 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2381/4896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:52 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:52.944222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:52.945050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:52.964659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:52.965257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:52.965795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:52.966861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:52.967402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:52.968438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:53.603342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:53.603921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:53.619522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:53.620231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:53.620886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:53.621799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:53.622263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:53.622690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:53.818332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:53.828570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bbe6282-84f0-4e76-8635-9a098fe93e32 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1503 microversion: 2.1 time: 0.897180 Oct 31 15:40:53.829702 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2516/4897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:52 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1503 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:53.860669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:53.861827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:53.870203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:53.871137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:53.871988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:53.873215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:53.874163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:53.874911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:54.116650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:54.127653 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12588dc9-f746-4d85-a5e4-181d74b596e3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 0.528170 Oct 31 15:40:54.154313 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2382/4898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:53 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:54.172899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:54.174078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:54.182874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:54.183569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:54.189091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:54.190135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:54.191058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:54.191780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:54.247632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:54.248299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:54.248955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:54.249584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lazy-loading 'fault' on Instance uuid 00035ce3-08f2-4fe3-a18e-192857d486ad {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:54.565113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f6b665503b448885cd5e67c529f462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99ddffb41834efa8cb474af34c73099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:54.571779 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c62d1bb2-2e7f-45de-80ab-aadac5965cf6 tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 200 len: 1318 microversion: 2.1 time: 0.414720 Oct 31 15:40:54.572384 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2383/4899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:54 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:54.999660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:55.007970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-853f53c0-dd55-4d8c-981e-8422bf9db24f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1503 microversion: 2.1 time: 1.153223 Oct 31 15:40:55.009145 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2517/4900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:53 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1503 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:55.031124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:55.031945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:55.039725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.040449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.041098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.041966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.042697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.043290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.072135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:55.155798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:55.156418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:55.163378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.164128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.164775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.165661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.166283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.166872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.213444 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f24c1906-23e4-441f-ba02-f53a697b5354 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 204 len: 0 microversion: 2.1 time: 0.185851 Oct 31 15:40:55.218407 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2384/4901] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:55 2022] DELETE /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:55.231747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:55.232816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:55.242070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.243556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.244221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.245205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.246135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.246731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.313924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:56.339164 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d2aa41a-737e-4745-ae0d-0cd0580a6512 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 1.187020 Oct 31 15:40:56.357362 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2518/4902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:55 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:56.376599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:56.376599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] [instance: 00035ce3-08f2-4fe3-a18e-192857d486ad] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:56.386529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.388463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.390499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.391310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.394730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.396340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.421392 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] HTTP exception thrown: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Request method failure captured: Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad HTTP/1.1 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-xH5nicZa78UrcBdtVtPAGrImqjxAygFUg-yx0Y_AH5vOZzvqkEWRFasRHfcYiXcPfzx7Qorn69AB49WZ7Xu_xEncGSy_G0DkPjqsm5YjJWZW_80wpgyVZQMeGfJcE-e9mir382qckxbcQqeWGgK9V-QLPhBegCRfPlhDsDcTwyXYo Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: b99ddffb41834efa8cb474af34c73099 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1247799781 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b99ddffb41834efa8cb474af34c73099"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b99ddffb41834efa8cb474af34c73099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b99ddffb41834efa8cb474af34c73099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b99ddffb41834efa8cb474af34c73099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1247799781 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: b99ddffb41834efa8cb474af34c73099 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1247799781 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1247799781-project Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59f6b665503b448885cd5e67c529f462 Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1247799781-project Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '00035ce3-08f2-4fe3-a18e-192857d486ad'} Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:56.423542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. Oct 31 15:40:56.429146 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:40:56.431411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] Returning 404 to user: Instance 00035ce3-08f2-4fe3-a18e-192857d486ad could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:56.432459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2ab73fc-51c6-4c43-ae81-836a817dd38d tempest-ServersNegativeTestMultiTenantJSON-1247799781 tempest-ServersNegativeTestMultiTenantJSON-1247799781-project] 10.222.0.48 "GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad" status: 404 len: 111 microversion: 2.1 time: 0.073742 Oct 31 15:40:56.433659 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2519/4903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:56 2022] GET /compute/v2.1/servers/00035ce3-08f2-4fe3-a18e-192857d486ad => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:56.529828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:56.562067 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-efe78ccb-4ad6-4a4d-8bec-e07923dd3284 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1509 microversion: 2.1 time: 1.337725 Oct 31 15:40:56.563133 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2385/4904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:55 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1509 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:57.373685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:57.374999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:57.383786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:57.384647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:57.388547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:57.389686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:57.390458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:57.391136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:57.587091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:57.587724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:57.626894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:57.629324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:57.630223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:57.631275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:57.633262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:57.635283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:58.918088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:58.933542 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1868edd5-b6e5-4589-a03c-057e16f137b0 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 1.568465 Oct 31 15:40:58.936633 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2520/4905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:57 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:59.189505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:59.205488 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e5dc76cc-8796-469a-a6f9-01cd29f37764 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1509 microversion: 2.1 time: 1.622631 Oct 31 15:40:59.210274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2386/4906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:57 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1509 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:59.964233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:59.965532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:59.993761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:59.997191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:59.998696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.011236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.013820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.014485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.240726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:00.241374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:00.257867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.258624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.259106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.266758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.267598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.268774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.492989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:00.505406 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d39e9822-0ed7-467e-bae0-05ae05e2686a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 200 len: 1467 microversion: 2.1 time: 0.271271 Oct 31 15:41:00.506549 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2387/4907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:00 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 1467 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:00.536113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-59f671a6-54f6-4065-94d0-cdd1bb8d1fd8 req-aae1d272-46c2-4c0d-9673-3343995cfa83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d898471-009a-4157-8b52-ff57d55bc645", "name": "network-vif-deleted", "tag": "011b8177-c4ac-42cb-b9b5-460db45ca059"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:00.573629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-59f671a6-54f6-4065-94d0-cdd1bb8d1fd8 req-aae1d272-46c2-4c0d-9673-3343995cfa83 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.582998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-59f671a6-54f6-4065-94d0-cdd1bb8d1fd8 req-aae1d272-46c2-4c0d-9673-3343995cfa83 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.588097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-59f671a6-54f6-4065-94d0-cdd1bb8d1fd8 req-aae1d272-46c2-4c0d-9673-3343995cfa83 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.645076 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-59f671a6-54f6-4065-94d0-cdd1bb8d1fd8 req-aae1d272-46c2-4c0d-9673-3343995cfa83 service nova] Creating event network-vif-deleted:011b8177-c4ac-42cb-b9b5-460db45ca059 for instance 6d898471-009a-4157-8b52-ff57d55bc645 on n-h2-858383-17 Oct 31 15:41:00.655019 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-59f671a6-54f6-4065-94d0-cdd1bb8d1fd8 req-aae1d272-46c2-4c0d-9673-3343995cfa83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146478 Oct 31 15:41:00.658497 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2388/4908] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:00.753243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:00.757130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:00.777970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0830357c-f40a-4a03-8653-982104d4a2fb tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 0.818194 Oct 31 15:41:00.779961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2521/4909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:59 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:01.536018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:01.536789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:01.555478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:01.555992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:01.556650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.557399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:01.557856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:01.558454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.574263 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 HTTP/1.1 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '6d898471-009a-4157-8b52-ff57d55bc645'} Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:01.576328 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:41:01.581537 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:01.583911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:01.585425 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-18371e1b-99b8-4ef5-b5e3-92da38ac79a5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 404 len: 111 microversion: 2.1 time: 0.056298 Oct 31 15:41:01.587068 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2389/4910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:01 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:01.603845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a118ea8f-5abd-45d8-9abe-497ef839af2b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: .version_select at 0x7f5ca139b4c0>, body: {"keypair": {"name": "tempest-key-1966125112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBRLKRaheu1gw/cNLuzJYJqkLFUIapNeqFRGKuoSvTsXiZYSQggYIq46zmQdhHMqPaAzGzrVcxXZtZSXOa9w/OTyy8kS0wfBSlSUL5ZmbGaMo1jH+6GkkKEb39lsik/vA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:01.632760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a118ea8f-5abd-45d8-9abe-497ef839af2b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:01.640669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a118ea8f-5abd-45d8-9abe-497ef839af2b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:01.699327 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a118ea8f-5abd-45d8-9abe-497ef839af2b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.100411 Oct 31 15:41:01.700810 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2522/4911] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:41:01 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:01.712681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8bec43f8-e4ba-4655-a80d-490c0180de07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '.version_select at 0x7f5ca1dbc820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:01.721953 n-d-858383-17 devstack@n-api.service[120626]: WARNING oslo_db.sqlalchemy.utils [None req-8bec43f8-e4ba-4655-a80d-490c0180de07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:41:01.728581 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8bec43f8-e4ba-4655-a80d-490c0180de07 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.019667 Oct 31 15:41:01.729512 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2390/4912] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:41:01 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:01.804810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:01.805476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:01.819624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:01.819624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:01.819624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.820373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:01.820881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:01.825010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.880132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-555629425", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-key-1966125112", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:01.980632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:41:03.057313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:03.066142 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ffa83137-c379-488e-a524-0e95c0c33168 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 1.267839 Oct 31 15:41:03.070566 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2523/4913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:01 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:03.079578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-38e1d59c-18f1-4129-a64c-bc21226e570d req-f4ac7842-b1e6-49b7-b0af-206a3efbd817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb3314c-688e-420f-8c47-73a9b38fbd0b", "name": "network-vif-plugged", "status": "completed", "tag": "087f2b41-549c-4470-84d2-deb1ed8e9f1a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:03.107361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-38e1d59c-18f1-4129-a64c-bc21226e570d req-f4ac7842-b1e6-49b7-b0af-206a3efbd817 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:03.121134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-38e1d59c-18f1-4129-a64c-bc21226e570d req-f4ac7842-b1e6-49b7-b0af-206a3efbd817 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:03.121864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-38e1d59c-18f1-4129-a64c-bc21226e570d req-f4ac7842-b1e6-49b7-b0af-206a3efbd817 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:03.135065 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-38e1d59c-18f1-4129-a64c-bc21226e570d req-f4ac7842-b1e6-49b7-b0af-206a3efbd817 service nova] Creating event network-vif-plugged:087f2b41-549c-4470-84d2-deb1ed8e9f1a for instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b on n-h1-858383-17 Oct 31 15:41:03.140935 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-38e1d59c-18f1-4129-a64c-bc21226e570d req-f4ac7842-b1e6-49b7-b0af-206a3efbd817 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068577 Oct 31 15:41:03.142210 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2524/4914] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:04.114724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:04.122239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:04.131789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.132645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.133289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.135297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.135957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.168311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.226085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:41:04.226824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:41:04.227433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:41:04.227965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:41:04.228640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:41:04.241666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.242433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.243073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.243981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.244614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.245437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.298592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:04.306673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:04.324488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:41:04.327599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:41:04.433336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22aa5ab3-8294-44c0-87a6-038ea7f44fed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.557195 Oct 31 15:41:04.434026 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2391/4915] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:41:04.447080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98e64154-5387-41cc-b97a-72802fb65936 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:04.450012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98e64154-5387-41cc-b97a-72802fb65936 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:04.892648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98e64154-5387-41cc-b97a-72802fb65936 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:04.903051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98e64154-5387-41cc-b97a-72802fb65936 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1228 microversion: 2.1 time: 0.461676 Oct 31 15:41:04.903640 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2392/4916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:04 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1228 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:04.918984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ca7f8d77-22d3-458b-8b3d-b34d980e29a3 req-b28662a6-d6bf-4ae9-b136-b5ffe37bcdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a482551-a14a-43cd-ac40-24c69454f476", "tag": "d3969917-bfa1-441c-89d4-30b2a2f569ef"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:04.949671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ca7f8d77-22d3-458b-8b3d-b34d980e29a3 req-b28662a6-d6bf-4ae9-b136-b5ffe37bcdc2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.950973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ca7f8d77-22d3-458b-8b3d-b34d980e29a3 req-b28662a6-d6bf-4ae9-b136-b5ffe37bcdc2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.953090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ca7f8d77-22d3-458b-8b3d-b34d980e29a3 req-b28662a6-d6bf-4ae9-b136-b5ffe37bcdc2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.983679 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ca7f8d77-22d3-458b-8b3d-b34d980e29a3 req-b28662a6-d6bf-4ae9-b136-b5ffe37bcdc2 service nova] Creating event network-changed:d3969917-bfa1-441c-89d4-30b2a2f569ef for instance 1a482551-a14a-43cd-ac40-24c69454f476 on n-h1-858383-17 Oct 31 15:41:04.995443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ca7f8d77-22d3-458b-8b3d-b34d980e29a3 req-b28662a6-d6bf-4ae9-b136-b5ffe37bcdc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086342 Oct 31 15:41:04.999624 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2393/4917] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:05.926653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:05.928194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:05.941617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:05.942677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:05.948332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:05.949974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:05.950590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:05.951163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:06.086682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:06.096854 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-feeb13d9-9579-490b-a69c-e37914516d9d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1318 microversion: 2.1 time: 2.002317 Oct 31 15:41:06.098297 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2525/4918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:04 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1318 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:06.297730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:06.306391 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64027650-ea9d-4e44-b6b7-44edb52cafb7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1280 microversion: 2.1 time: 0.384400 Oct 31 15:41:06.306980 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2394/4919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:05 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:07.130119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:07.130768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:07.138311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:07.145524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:07.148088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:07.149430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:07.151178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:07.152025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:07.337067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:07.338850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:07.400820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:07.403592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:07.404073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:07.405097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:07.405579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:07.409325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:07.727747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:07.748477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0714186f-b23d-4c22-a79c-2c08e9cfbf4f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1286 microversion: 2.1 time: 0.415318 Oct 31 15:41:07.749617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2395/4920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:07 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1286 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:08.130860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:08.152215 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2721234d-a30e-49c1-969e-6eba1069062d tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1508 microversion: 2.1 time: 1.023734 Oct 31 15:41:08.152900 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2526/4921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:07 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1508 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:08.772360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:08.773122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:08.795851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:08.801489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:08.804310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:08.805300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:08.812574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:08.813343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:08.899613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:09.066927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:09.075637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c14c438-0bf4-4c11-af9d-106535bc83e9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1286 microversion: 2.1 time: 0.307999 Oct 31 15:41:09.086109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2396/4922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:08 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1286 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:10.112151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:10.113588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:10.129905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:10.131661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:10.132340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:10.133167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:10.134236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:10.134966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:10.142118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:10.519701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:10.529288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ddc4207-a52e-47aa-a7b7-0100849e233f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.421582 Oct 31 15:41:10.536223 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2527/4923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:10 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:10.915860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7180779c-d631-4f2d-bb25-12140b5bff45"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:10.919807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:10.929619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:10.930453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:10.931088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:10.932059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:10.932746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:10.933375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:11.011796 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] HTTP exception thrown: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Request method failure captured: Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b/os-volume_attachments/49fb3b3a-4016-4b2a-9735-ad708495808f HTTP/1.1 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 74 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-vdBRMSr5svTtKQXtvTdBbUgy7a82ygXHamze1DYoI-06DC3BFpfafdLSzO7F3Ng6_kiz9CwCxoGPX_XfjrupT2A-gJK4uY6mywRXgomamwCI3A0QQnSAlXU9IRrYoo9ToQ8vVt-lq1zZC3Fy9pRgqO1MBrL-Fe_MKLR4S2FQrOoTw Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 033dce00252b468bae6180c9a587af18 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesAdminNegativeTest-1529225 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/033dce00252b468bae6180c9a587af18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/033dce00252b468bae6180c9a587af18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_033dce00252b468bae6180c9a587af18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/033dce00252b468bae6180c9a587af18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesAdminNegativeTest-1529225 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 033dce00252b468bae6180c9a587af18 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1529225 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesAdminNegativeTest-1529225-project-admin Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ed8e5ba9a8a74795ae5d0b0d9cb505a8 Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesAdminNegativeTest-1529225-project-admin Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: {"volumeAttachment": {"volumeId": "7180779c-d631-4f2d-bb25-12140b5bff45"}} Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: exception: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': '3fb3314c-688e-420f-8c47-73a9b38fbd0b', 'id': '49fb3b3a-4016-4b2a-9735-ad708495808f', 'body': {'volumeAttachment': {'volumeId': '7180779c-d631-4f2d-bb25-12140b5bff45'}}} Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. (HTTP 404) (Request-ID: req-03257596-20cc-463e-86f9-98e7cd99eb9e) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:41:11.014028 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] Returning 404 to user: Volume 49fb3b3a-4016-4b2a-9735-ad708495808f could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0838b8ff-2eff-473e-a799-5863578d1b54 tempest-VolumesAdminNegativeTest-1529225 tempest-VolumesAdminNegativeTest-1529225-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b/os-volume_attachments/49fb3b3a-4016-4b2a-9735-ad708495808f" status: 404 len: 109 microversion: 2.1 time: 0.105377 Oct 31 15:41:11.026275 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2397/4924] 10.222.0.48 () {60 vars in 1433 bytes} [Mon Oct 31 15:41:10 2022] PUT /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b/os-volume_attachments/49fb3b3a-4016-4b2a-9735-ad708495808f => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:11.573682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:11.575475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:11.604040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:11.606156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:11.606858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:11.608340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:11.612605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:11.613872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:11.700208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:12.763737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:12.779765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39924c03-563d-467b-988f-d05624ad567f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 1.219802 Oct 31 15:41:12.781534 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2528/4925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:11 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:13.230848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-69b2377c-69d4-46b6-81ae-84208a6bf549 req-ff51eaeb-2984-4e64-a181-5c556dec039f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb91acf2-7dca-4ede-b67c-b498539bee9b", "tag": "6c6e8f9e-04f8-45f7-b4b6-0e33cf068b6b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:13.264683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-69b2377c-69d4-46b6-81ae-84208a6bf549 req-ff51eaeb-2984-4e64-a181-5c556dec039f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:13.265203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-69b2377c-69d4-46b6-81ae-84208a6bf549 req-ff51eaeb-2984-4e64-a181-5c556dec039f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:13.265640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-69b2377c-69d4-46b6-81ae-84208a6bf549 req-ff51eaeb-2984-4e64-a181-5c556dec039f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:13.289978 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-69b2377c-69d4-46b6-81ae-84208a6bf549 req-ff51eaeb-2984-4e64-a181-5c556dec039f service nova] Creating event network-changed:6c6e8f9e-04f8-45f7-b4b6-0e33cf068b6b for instance cb91acf2-7dca-4ede-b67c-b498539bee9b on n-h2-858383-17 Oct 31 15:41:13.306895 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-69b2377c-69d4-46b6-81ae-84208a6bf549 req-ff51eaeb-2984-4e64-a181-5c556dec039f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083664 Oct 31 15:41:13.307892 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2398/4926] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:13.808650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:13.831406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:13.834659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:13.836728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:13.837249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:13.838018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:13.838503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:13.844471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:15.155041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:15.172200 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca0fb230-83ce-45b9-9071-3507c90471eb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 1.368396 Oct 31 15:41:15.185635 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2529/4927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:13 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:16.200588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:16.201891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:16.204304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:16.206489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:16.214867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:16.249703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:16.253001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:16.257135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.258128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:16.258781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:16.259213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.733876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:16.735018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:16.773459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:16.776850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:16.779827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.781949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:16.784481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:16.788122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.898830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:41:17.128461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:17.145165 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e0a6e141-8567-48c2-aa27-01a50da3684e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.948590 Oct 31 15:41:17.149598 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2399/4928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:16 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:17.168318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ff9580a-cd8c-4779-a4d1-cadd03dc8430 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 204 len: 0 microversion: 2.1 time: 0.439577 Oct 31 15:41:17.169626 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2530/4929] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:16 2022] DELETE /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:41:17.183089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:17.184507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:17.192366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:17.193226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:17.193918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:17.194944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:17.195669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:17.196909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.183200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:18.184001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:18.227712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:18.228237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:18.228707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.229468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:18.229941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:18.243481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.399916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:18.418014 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17abdaf3-cd2d-46d9-889f-0bfc3e8a8df1 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1514 microversion: 2.1 time: 1.242112 Oct 31 15:41:18.440109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2400/4930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:17 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1514 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:18.766520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:18.781779 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d484413-b214-4741-80f3-b3e2053cf0b3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.605156 Oct 31 15:41:18.782734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2531/4931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:18 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:19.489302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:19.492629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:19.510730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.511637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.512323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.513370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.517569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.518418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.810108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:19.811520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:19.823803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.824583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.825296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.826264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.827017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.828290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.584187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:20.593345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f906e336-84fb-4fcf-9fe7-51406335a738 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1514 microversion: 2.1 time: 1.147055 Oct 31 15:41:20.601643 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2401/4932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:19 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1514 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:20.780261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:20.789778 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a5687003-ce3f-4ce2-9adb-aa2d6ba5dc8c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.983476 Oct 31 15:41:20.795294 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2532/4933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:19 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:20.815665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-edd0a54e-7138-4dc3-82db-d44aac5e4c25 req-db58892e-f9fe-4d46-bdea-3fd57f0ff4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb3314c-688e-420f-8c47-73a9b38fbd0b", "name": "network-vif-deleted", "tag": "087f2b41-549c-4470-84d2-deb1ed8e9f1a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:20.831184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-edd0a54e-7138-4dc3-82db-d44aac5e4c25 req-db58892e-f9fe-4d46-bdea-3fd57f0ff4f5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.831953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-edd0a54e-7138-4dc3-82db-d44aac5e4c25 req-db58892e-f9fe-4d46-bdea-3fd57f0ff4f5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.832565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-edd0a54e-7138-4dc3-82db-d44aac5e4c25 req-db58892e-f9fe-4d46-bdea-3fd57f0ff4f5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.869249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-edd0a54e-7138-4dc3-82db-d44aac5e4c25 req-db58892e-f9fe-4d46-bdea-3fd57f0ff4f5 service nova] Creating event network-vif-deleted:087f2b41-549c-4470-84d2-deb1ed8e9f1a for instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b on n-h1-858383-17 Oct 31 15:41:20.893217 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-edd0a54e-7138-4dc3-82db-d44aac5e4c25 req-db58892e-f9fe-4d46-bdea-3fd57f0ff4f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082704 Oct 31 15:41:20.901480 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2402/4934] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:21.636831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:21.638273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:21.664547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.665184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.666982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.673009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.675299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.677752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.765995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.766501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.766972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.767693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lazy-loading 'fault' on Instance uuid 3fb3314c-688e-420f-8c47-73a9b38fbd0b {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:41:21.820220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:21.821419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:21.851730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.852262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.852731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.853467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.853937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.854473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.996258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:22.033473 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a54bef7-2b5d-4328-b746-9d50648c27ce tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 200 len: 1308 microversion: 2.1 time: 0.405764 Oct 31 15:41:22.064208 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2533/4935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:21 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:22.407457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:22.418103 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-144658ed-fe8a-4efb-a9b5-5698d748e26a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.605987 Oct 31 15:41:22.419322 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2403/4936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:21 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:23.062003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:23.067095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 3fb3314c-688e-420f-8c47-73a9b38fbd0b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:23.081512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:23.082023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:23.082459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:23.083190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:23.083662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:23.084103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:23.101404 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] HTTP exception thrown: Instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b could not be found. Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Request method failure captured: Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b HTTP/1.1 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-vILTtS2DqYOtJuD3xXNpUrR44amx4FAuFFrfY7kpiYED8Lmk3qifZdDtDrjxb602uYkVtKYF2h_HupoTLfCJXFsshwAqfj2O-hd0iwMiIVDr6wYKRcBNZbSv40SeutzpdALA4KDjTTvXo01_buXUDmYYFnqANGwQCazwT-8GywST4 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8a296588291c4b7f9a069126f2219f5a Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesAdminNegativeTest-1406915558 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesAdminNegativeTest-1406915558 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8a296588291c4b7f9a069126f2219f5a Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1406915558 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesAdminNegativeTest-1406915558-project Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 35b871cb47154546b1fabb9a2b807b90 Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesAdminNegativeTest-1406915558-project Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b could not be found. Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3fb3314c-688e-420f-8c47-73a9b38fbd0b'} Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b could not be found. Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b could not be found. Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:23.103117 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b could not be found. Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Returning 404 to user: Instance 3fb3314c-688e-420f-8c47-73a9b38fbd0b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7aa98c10-5947-492b-b786-4614e0284a94 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b" status: 404 len: 111 microversion: 2.1 time: 0.046652 Oct 31 15:41:23.109135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2534/4937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:23 2022] GET /compute/v2.1/servers/3fb3314c-688e-420f-8c47-73a9b38fbd0b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:23.447056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:23.448729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:23.467623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:23.468453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:23.470088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:23.475036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:23.476749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:23.479002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:23.684626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:23.697044 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e023134-1790-4d21-98cc-7213b22fb93f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.254124 Oct 31 15:41:23.698217 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2404/4938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:23 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:24.722125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:24.722874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:24.734676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.738847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.739504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.740523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.741100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.741640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.806546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3d8e26b1-c3d5-4f04-b12f-8c49c75da107 req-2dffe079-8dd7-4108-b4ba-95949c1a1a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb91acf2-7dca-4ede-b67c-b498539bee9b", "name": "network-vif-plugged", "status": "completed", "tag": "6c6e8f9e-04f8-45f7-b4b6-0e33cf068b6b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:24.835845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d8e26b1-c3d5-4f04-b12f-8c49c75da107 req-2dffe079-8dd7-4108-b4ba-95949c1a1a80 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.839416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d8e26b1-c3d5-4f04-b12f-8c49c75da107 req-2dffe079-8dd7-4108-b4ba-95949c1a1a80 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.840204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d8e26b1-c3d5-4f04-b12f-8c49c75da107 req-2dffe079-8dd7-4108-b4ba-95949c1a1a80 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.868919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3d8e26b1-c3d5-4f04-b12f-8c49c75da107 req-2dffe079-8dd7-4108-b4ba-95949c1a1a80 service nova] Creating event network-vif-plugged:6c6e8f9e-04f8-45f7-b4b6-0e33cf068b6b for instance cb91acf2-7dca-4ede-b67c-b498539bee9b on n-h2-858383-17 Oct 31 15:41:24.882718 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3d8e26b1-c3d5-4f04-b12f-8c49c75da107 req-2dffe079-8dd7-4108-b4ba-95949c1a1a80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079572 Oct 31 15:41:24.883933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2405/4939] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:25.417012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:25.431127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef1a29ac-4c17-4f53-97ff-49a17d66b72c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1328 microversion: 2.1 time: 0.712738 Oct 31 15:41:25.433417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2535/4940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:24 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1328 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:26.457874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:26.464252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:26.507861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:26.508655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:26.509341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:26.510235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:26.513025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:26.514709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.438104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:27.463806 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0059cc2e-4a4f-41e9-b1a0-6168b141c6a1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1509 microversion: 2.1 time: 1.011980 Oct 31 15:41:27.464449 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2406/4941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:26 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1509 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:27.495926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:27.496556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:27.521867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.521867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.526155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.527169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.527674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.528114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.884866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:28.886054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:28.895482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.899280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.899962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.903047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.903733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.904384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.975993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:41:29.082729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:29.092176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b968b3fd-324e-4c49-82d9-0d63ce2d50ad tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1509 microversion: 2.1 time: 1.600185 Oct 31 15:41:29.097615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2536/4942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:27 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1509 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:29.121331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:29.122185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:29.135228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.136110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.136818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.137601 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef7472b8-d9a1-46fd-a972-3eea43ad836e tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 204 len: 0 microversion: 2.1 time: 0.255382 Oct 31 15:41:29.138315 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2407/4943] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:28 2022] DELETE /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:41:29.139544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.141712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.142959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.158536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:29.162343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:29.180350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.181435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.182128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.185653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.186986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.188290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.255339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:41:29.341091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:29.457554 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33345ea8-5063-495d-9abd-2b2a3a8bcbe0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 204 len: 0 microversion: 2.1 time: 0.341782 Oct 31 15:41:29.458155 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2537/4944] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:29 2022] DELETE /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:41:29.467675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:29.468825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:29.478375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.478954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.479418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.480277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.480773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.481210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:30.073579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:30.088667 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f625a930-54a2-4f51-ace0-7c5ad3d931b8 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1683 microversion: 2.1 time: 0.943934 Oct 31 15:41:30.112543 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2408/4945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:29 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1683 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:30.249017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:30.259667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3165c13-57c5-4384-bfa7-7d245c7abe22 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1515 microversion: 2.1 time: 0.796688 Oct 31 15:41:30.266714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2538/4946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:29 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1515 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:31.140186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:31.140942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:31.155438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.156140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.157073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.159930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.160665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.161303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.295218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:31.295834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:31.315865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.316555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.317293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.318206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.318887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.319507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:32.226467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:32.243379 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60a65e5d-a80d-4ada-8daf-3461783e27aa tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1683 microversion: 2.1 time: 1.109670 Oct 31 15:41:32.245468 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2409/4947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:31 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1683 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:32.532437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:32.545429 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-240197e4-8f9f-4bb2-bcba-294e2124fabd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1515 microversion: 2.1 time: 1.254308 Oct 31 15:41:32.552771 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2539/4948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:31 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1515 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:33.277304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:33.278484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:33.296957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.300753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.301520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.303050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.306072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.306761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.572810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:33.573610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:33.586893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.588059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.588603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.589475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.592673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.593319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.435942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:35.473417 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8bd2272-7973-4053-98a3-5303dd6330c7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 200 len: 1515 microversion: 2.1 time: 1.901204 Oct 31 15:41:35.477723 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2540/4949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:33 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 1515 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:35.492550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c4193096-f09b-44f0-8e6e-f98940d7b3f5 req-dfb35fde-810e-4c77-a380-d3f93ed3dfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb91acf2-7dca-4ede-b67c-b498539bee9b", "name": "network-vif-deleted", "tag": "6c6e8f9e-04f8-45f7-b4b6-0e33cf068b6b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:35.530225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4193096-f09b-44f0-8e6e-f98940d7b3f5 req-dfb35fde-810e-4c77-a380-d3f93ed3dfa6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.532565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4193096-f09b-44f0-8e6e-f98940d7b3f5 req-dfb35fde-810e-4c77-a380-d3f93ed3dfa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.534417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4193096-f09b-44f0-8e6e-f98940d7b3f5 req-dfb35fde-810e-4c77-a380-d3f93ed3dfa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.600164 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c4193096-f09b-44f0-8e6e-f98940d7b3f5 req-dfb35fde-810e-4c77-a380-d3f93ed3dfa6 service nova] Creating event network-vif-deleted:6c6e8f9e-04f8-45f7-b4b6-0e33cf068b6b for instance cb91acf2-7dca-4ede-b67c-b498539bee9b on n-h2-858383-17 Oct 31 15:41:35.634823 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c4193096-f09b-44f0-8e6e-f98940d7b3f5 req-dfb35fde-810e-4c77-a380-d3f93ed3dfa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155650 Oct 31 15:41:35.646570 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2541/4950] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:35.655342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:35.666874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bc7dd2d-4b5a-4af5-93a6-c0d55f71f041 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1683 microversion: 2.1 time: 2.398002 Oct 31 15:41:35.668346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2410/4951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:33 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1683 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:36.505556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:36.506434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:36.524119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.526343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.527085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.529535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.530286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.535482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.575442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b HTTP/1.1 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'cb91acf2-7dca-4ede-b67c-b498539bee9b'} Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:36.581102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:41:36.586653 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:36.588852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:36.591985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2afc73b1-109e-4077-ade8-533b3b11d8cf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 404 len: 111 microversion: 2.1 time: 0.090271 Oct 31 15:41:36.596250 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2542/4952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:36 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:36.602019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b26c5cf8-2a9a-4dc6-877e-e2fa4a660661 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '.version_select at 0x7f5ca25a2ca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:36.653689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b26c5cf8-2a9a-4dc6-877e-e2fa4a660661 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-key-1966125112" status: 202 len: 0 microversion: 2.1 time: 0.055607 Oct 31 15:41:36.665393 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2411/4953] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Oct 31 15:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1966125112 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:41:36.692193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:36.693348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:36.702500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.709902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.710505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.711397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.711987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.712650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.786632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.787787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.789120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.790559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lazy-loading 'fault' on Instance uuid 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:41:36.990661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1489610049", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:37.021949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b871cb47154546b1fabb9a2b807b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a296588291c4b7f9a069126f2219f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:37.034106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-094033eb-5efb-468c-9c04-e2275a1b881b tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 200 len: 1332 microversion: 2.1 time: 0.343950 Oct 31 15:41:37.052726 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2543/4954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:36 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 1332 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:37.093279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:41:37.728350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c1bc643d-8ce7-4c0f-a924-6e2aa20a7d2b req-25f7e996-3dcb-4958-a85b-7aa8a158b3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0", "name": "network-vif-deleted", "tag": "2042c267-fde3-4ed4-ab06-bf4ebfd32ca4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:37.756181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c1bc643d-8ce7-4c0f-a924-6e2aa20a7d2b req-25f7e996-3dcb-4958-a85b-7aa8a158b3e6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:37.763869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c1bc643d-8ce7-4c0f-a924-6e2aa20a7d2b req-25f7e996-3dcb-4958-a85b-7aa8a158b3e6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:37.764643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c1bc643d-8ce7-4c0f-a924-6e2aa20a7d2b req-25f7e996-3dcb-4958-a85b-7aa8a158b3e6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:37.810842 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c1bc643d-8ce7-4c0f-a924-6e2aa20a7d2b req-25f7e996-3dcb-4958-a85b-7aa8a158b3e6 service nova] Creating event network-vif-deleted:2042c267-fde3-4ed4-ab06-bf4ebfd32ca4 for instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 on n-h1-858383-17 Oct 31 15:41:37.833836 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c1bc643d-8ce7-4c0f-a924-6e2aa20a7d2b req-25f7e996-3dcb-4958-a85b-7aa8a158b3e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120697 Oct 31 15:41:37.835062 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2544/4955] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:38.070457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.071199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] [instance: 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.090367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.090886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.091607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.092353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.092858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.093303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.168016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] HTTP exception thrown: Instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 could not be found. Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Request method failure captured: Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 HTTP/1.1 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-vILTtS2DqYOtJuD3xXNpUrR44amx4FAuFFrfY7kpiYED8Lmk3qifZdDtDrjxb602uYkVtKYF2h_HupoTLfCJXFsshwAqfj2O-hd0iwMiIVDr6wYKRcBNZbSv40SeutzpdALA4KDjTTvXo01_buXUDmYYFnqANGwQCazwT-8GywST4 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8a296588291c4b7f9a069126f2219f5a Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesAdminNegativeTest-1406915558 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a296588291c4b7f9a069126f2219f5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesAdminNegativeTest-1406915558 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8a296588291c4b7f9a069126f2219f5a Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1406915558 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesAdminNegativeTest-1406915558-project Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 35b871cb47154546b1fabb9a2b807b90 Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesAdminNegativeTest-1406915558-project Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 could not be found. Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0'} Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 could not be found. Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 could not be found. Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:38.179914 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 could not be found. Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Returning 404 to user: Instance 71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:38.185600 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93f7f158-aa8e-4bbd-8bc9-26694a5fc1ba tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0" status: 404 len: 111 microversion: 2.1 time: 0.116836 Oct 31 15:41:38.195453 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2545/4956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/71dae9d9-9e9b-4b95-8e64-30f1ff2f18e0 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:41:38.210822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15b3870f-f452-4c5c-bcb8-433e3c2493b3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] Calling method '.version_select at 0x7f5ca66b6ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.276912 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15b3870f-f452-4c5c-bcb8-433e3c2493b3 tempest-VolumesAdminNegativeTest-1406915558 tempest-VolumesAdminNegativeTest-1406915558-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789440691" status: 202 len: 0 microversion: 2.1 time: 0.077031 Oct 31 15:41:38.277521 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2546/4957] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789440691 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:41:39.514306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:41:39.514890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:41:39.515211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:41:39.515624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:41:39.516038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:41:39.543482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.544493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.544886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.546159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.546710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.547362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.564731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:39.577643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:39.585164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:39.603277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:41:39.606403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:41:39.706168 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9b428998-6964-4087-9c0a-afc39a9e83b1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.719270 Oct 31 15:41:39.707318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2412/4958] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:41:39.721324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0dc7faf6-7dac-4c38-8ca8-87c56cd877cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:39.722721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0dc7faf6-7dac-4c38-8ca8-87c56cd877cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:39.998847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0dc7faf6-7dac-4c38-8ca8-87c56cd877cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:40.007936 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0dc7faf6-7dac-4c38-8ca8-87c56cd877cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1209 microversion: 2.1 time: 0.293560 Oct 31 15:41:40.024908 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2547/4959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:39 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1209 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:41.044736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:41.046177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:41.059703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.060245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.061546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.063745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.064479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.065046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.196540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:41.215844 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52770e91-998d-430d-80b4-8259f2602709 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1205 microversion: 2.1 time: 0.177020 Oct 31 15:41:41.216787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2413/4960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:41 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1205 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:42.242807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:42.244483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:42.252836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:42.259578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.263420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.263963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:42.264831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.265457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.265963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:42.614362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:42.628852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb559857-91e4-4674-9e15-d9322454fac5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1267 microversion: 2.1 time: 0.389989 Oct 31 15:41:42.645379 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2548/4961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:42 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1267 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:43.656482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:43.659074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:43.670656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.673899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.674688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.676397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.681734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.682499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.794957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:43.812352 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-473a04ee-6da3-470d-a857-6406c34924af tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1267 microversion: 2.1 time: 0.160709 Oct 31 15:41:43.848837 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2414/4962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:43 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:44.859513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:44.860172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:44.871376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.871889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.874565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.875375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.882825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.883389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.203215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:46.220319 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a86b4325-dfac-432b-a32b-6dd1a5007736 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 1.362768 Oct 31 15:41:46.221404 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2549/4963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:44 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:47.259332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:47.260021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:47.272410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:47.280123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:47.284420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:47.284927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:47.287036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:47.290778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:47.291556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:47.804277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:47.817342 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8a8c9117-ee82-481f-b52c-183fff61451d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 0.573629 Oct 31 15:41:47.821118 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2415/4964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:47 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:48.845029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:48.845552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:48.872574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.873118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.873565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:48.879089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.879681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.881371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:50.007770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:50.083805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:50.111040 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be16f2a0-4f78-4342-96fe-4e2221fc728d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 1.270091 Oct 31 15:41:50.133057 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2550/4965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:48 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:50.948473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9a3aa261-18ad-4559-ad26-d38c39a11758 req-e4b2bad2-4bd7-4e04-9bf6-568d56a68410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e9d128-28c0-4a8d-96a6-6677d4936eca", "tag": "5ff61c59-968a-4de6-bc44-fb69d16f0f17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:50.971462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:50.973341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:50.978137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9a3aa261-18ad-4559-ad26-d38c39a11758 req-e4b2bad2-4bd7-4e04-9bf6-568d56a68410 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:50.978921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9a3aa261-18ad-4559-ad26-d38c39a11758 req-e4b2bad2-4bd7-4e04-9bf6-568d56a68410 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:50.981009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9a3aa261-18ad-4559-ad26-d38c39a11758 req-e4b2bad2-4bd7-4e04-9bf6-568d56a68410 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:51.014360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9a3aa261-18ad-4559-ad26-d38c39a11758 req-e4b2bad2-4bd7-4e04-9bf6-568d56a68410 service nova] Creating event network-changed:5ff61c59-968a-4de6-bc44-fb69d16f0f17 for instance 39e9d128-28c0-4a8d-96a6-6677d4936eca on n-h2-858383-17 Oct 31 15:41:51.038545 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9a3aa261-18ad-4559-ad26-d38c39a11758 req-e4b2bad2-4bd7-4e04-9bf6-568d56a68410 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094269 Oct 31 15:41:51.040384 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2416/4966] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:51.139071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:51.139697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:51.157868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:51.170470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:51.173512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:51.175579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:51.185123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:51.186343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:51.844507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:51.867468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a305bc26-fba5-4f79-b291-bd512150c730 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 0.732103 Oct 31 15:41:51.878747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2551/4967] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:51 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:52.905433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:52.906149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:52.920060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:52.923406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:52.925823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:52.928165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:52.928680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:52.931000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:53.849512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:53.870588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-40830b60-5ddb-4edf-8b73-e6e280356bae tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 0.970586 Oct 31 15:41:53.871220 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2417/4968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:52 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:54.897735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:54.898625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:54.911393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:54.911883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:54.912314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:54.934585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:54.940001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:54.942888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:55.909898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:55.920299 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b9401622-d2c9-41a7-9ab9-f2dacc2f8b9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 1.027494 Oct 31 15:41:55.930437 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2552/4969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:54 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:56.947831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:56.948462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:56.963382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:56.963894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:56.964484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:56.965352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:56.965719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:56.966419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:57.600750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:57.617586 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5085a79-f6bd-43ab-81e9-f5b6109264d0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 0.673702 Oct 31 15:41:57.619004 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2418/4970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:56 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:58.646121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:58.646867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:58.678768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:58.686708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:58.688951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:58.692453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:58.692453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:58.692745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:59.373706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:59.385296 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2a28dda-5612-4502-8228-e30bc6ca041c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 0.742809 Oct 31 15:41:59.388330 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2553/4971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:58 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:59.874396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f81813c4-8dc6-4945-aee8-649005fe414f req-a5237c8f-815b-4e55-a81c-26c0a2196e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e9d128-28c0-4a8d-96a6-6677d4936eca", "name": "network-vif-plugged", "status": "completed", "tag": "5ff61c59-968a-4de6-bc44-fb69d16f0f17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:59.891074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f81813c4-8dc6-4945-aee8-649005fe414f req-a5237c8f-815b-4e55-a81c-26c0a2196e93 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:59.891676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f81813c4-8dc6-4945-aee8-649005fe414f req-a5237c8f-815b-4e55-a81c-26c0a2196e93 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:59.899930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f81813c4-8dc6-4945-aee8-649005fe414f req-a5237c8f-815b-4e55-a81c-26c0a2196e93 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:59.926485 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f81813c4-8dc6-4945-aee8-649005fe414f req-a5237c8f-815b-4e55-a81c-26c0a2196e93 service nova] Creating event network-vif-plugged:5ff61c59-968a-4de6-bc44-fb69d16f0f17 for instance 39e9d128-28c0-4a8d-96a6-6677d4936eca on n-h2-858383-17 Oct 31 15:41:59.937091 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f81813c4-8dc6-4945-aee8-649005fe414f req-a5237c8f-815b-4e55-a81c-26c0a2196e93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.597177 Oct 31 15:41:59.938318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2419/4972] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:00.416427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:00.417095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:00.428089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:00.428599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:00.429664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:00.435676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:00.436362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:00.437126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:00.484792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:01.713211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:01.733687 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb232a54-935d-4070-96ce-f78da1463bdb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1309 microversion: 2.1 time: 1.323040 Oct 31 15:42:01.738473 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2554/4973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:00 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1309 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:02.761856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:02.763194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:02.775063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:02.779383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:02.783302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:02.784356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:02.787614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:02.788282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:03.992683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:04.001267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0617c8d-51b8-48c5-8d26-1e91da20cc70 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1491 microversion: 2.1 time: 1.245098 Oct 31 15:42:04.001859 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2420/4974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:02 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1491 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:04.334886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1489610049", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:04.433463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:42:07.363241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:42:07.365865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:42:07.366596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:42:07.367238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:42:07.367859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:42:07.380503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:07.381387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:07.382055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:07.383015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:07.383685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:07.384346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:07.408461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:07.416823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:07.435372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:42:07.439899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:42:07.509367 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f1e61f4-017f-41d3-b95a-4dd8103862f0 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.178345 Oct 31 15:42:07.511559 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2555/4975] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:42:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:42:07.534899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20df7458-9f23-4930-9de8-37f80d8357a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:07.536819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20df7458-9f23-4930-9de8-37f80d8357a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:07.777819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20df7458-9f23-4930-9de8-37f80d8357a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:07.796910 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20df7458-9f23-4930-9de8-37f80d8357a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1209 microversion: 2.1 time: 0.278361 Oct 31 15:42:07.804083 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2421/4976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:07 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1209 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:08.825095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:08.825745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:08.844641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:08.845305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:08.845747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:08.846565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:08.847513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:08.850344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:09.549202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:09.580168 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f7428ec-9802-4c57-8ead-70586cd04c8f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1213 microversion: 2.1 time: 0.760283 Oct 31 15:42:09.585649 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2556/4977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:08 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1213 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:10.607089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:10.607712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:10.624920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:10.625429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:10.628903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:10.633316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:10.634078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:10.638065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:10.723351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=42 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:11.065631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:11.080022 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c554bbc-67ec-496d-8836-5a719596ec62 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1267 microversion: 2.1 time: 0.475878 Oct 31 15:42:11.097711 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2422/4978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:10 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1267 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:12.109457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:12.110202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:12.134322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:12.139078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:12.139733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:12.140739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:12.147565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:12.151503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:12.591714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:12.599693 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f221d12-de78-432d-8b6b-a7bce93a7b23 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1267 microversion: 2.1 time: 0.495017 Oct 31 15:42:12.605609 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2557/4979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:12 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1267 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:13.626331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:13.627628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:13.646263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:13.647983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:13.649029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:13.653441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:13.655214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:13.658649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:14.447022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:14.463958 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c661077-9dc6-43dd-b488-d0873bf2c272 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1267 microversion: 2.1 time: 0.840034 Oct 31 15:42:14.484917 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2423/4980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:13 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1267 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:15.503097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:15.504481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:15.517448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:15.565878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:15.572207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:15.574279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:15.576225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:15.578379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:15.583675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:16.775446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:16.788348 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-994da3f9-5b2a-44c2-a2ff-49bfd3c88183 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 1.290491 Oct 31 15:42:16.789314 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2558/4981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:15 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:17.818587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:17.819799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:17.845109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:17.846754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=20 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:17.849078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:17.849745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:17.850426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:17.851667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:17.852333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:17.853200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:20.649853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:20.669419 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-29d96cd7-8286-4523-ab0e-a8ebb9609c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 2.855299 Oct 31 15:42:20.685157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2424/4982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:17 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:21.698847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:21.699479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:21.707931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:21.712609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:21.718792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:21.730979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:21.731532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:21.732374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:21.732792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:21.733312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.555757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5569c180-aae9-4409-89d8-d2f56714b643 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Calling method '.version_select at 0x7f5ca67499d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:22.579563 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5569c180-aae9-4409-89d8-d2f56714b643 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] HTTP exception thrown: Image not found. Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5569c180-aae9-4409-89d8-d2f56714b643 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Request method failure captured: Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/images/92b01d83-29d9-4c66-b36b-bf9ca7d5b831/metadata/os_distro HTTP/1.1 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-zdN-Jssgm0Apra-Txo5IjtDk4pbCJDnFyiL20I5grLzhGbwhma8HTFyuu6zgMRqAF-X7yCc0LZ1vkq4FU25sungEAbDM_B-QreM7a1_WIiO5L5xWJe9Yv_7ESCL7rsEZpePE4vQN3jytUn9hTEhGquXN5Y7rWpO6eO8pn0-EgvY48 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/642359511f7d4daa842471a448f2d138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_642359511f7d4daa842471a448f2d138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3f8828a7d30a465682edb5a6d3883b01 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'image_id': '92b01d83-29d9-4c66-b36b-bf9ca7d5b831', 'id': 'os_distro'} Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 92b01d83-29d9-4c66-b36b-bf9ca7d5b831 Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:42:22.605730 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 92b01d83-29d9-4c66-b36b-bf9ca7d5b831 could not be found. Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:42:22.609550 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.614011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5569c180-aae9-4409-89d8-d2f56714b643 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:22.615066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5569c180-aae9-4409-89d8-d2f56714b643 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] 10.222.0.48 "DELETE /compute/v2.1/images/92b01d83-29d9-4c66-b36b-bf9ca7d5b831/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.531362 Oct 31 15:42:22.619950 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2425/4983] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Oct 31 15:42:22 2022] DELETE /compute/v2.1/images/92b01d83-29d9-4c66-b36b-bf9ca7d5b831/metadata/os_distro => generated 62 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:42:22.628092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-923d38c6-4618-437c-a41f-452f2a78bf79 req-28278e67-ae0c-4b03-9f7d-1b40fb9bfc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0cf5cfc-939e-4656-9b5f-3fef9ff4217c", "tag": "f563bf76-07b9-425a-8205-4544e1ea3012"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:22.650888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-923d38c6-4618-437c-a41f-452f2a78bf79 req-28278e67-ae0c-4b03-9f7d-1b40fb9bfc49 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.651709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-923d38c6-4618-437c-a41f-452f2a78bf79 req-28278e67-ae0c-4b03-9f7d-1b40fb9bfc49 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.652285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-923d38c6-4618-437c-a41f-452f2a78bf79 req-28278e67-ae0c-4b03-9f7d-1b40fb9bfc49 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.676924 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-923d38c6-4618-437c-a41f-452f2a78bf79 req-28278e67-ae0c-4b03-9f7d-1b40fb9bfc49 service nova] Creating event network-changed:f563bf76-07b9-425a-8205-4544e1ea3012 for instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c on n-h1-858383-17 Oct 31 15:42:22.689991 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-923d38c6-4618-437c-a41f-452f2a78bf79 req-28278e67-ae0c-4b03-9f7d-1b40fb9bfc49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068263 Oct 31 15:42:22.691095 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2426/4984] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:22.700437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ecd322e-94aa-4629-834e-a4b002aade6c tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Calling method '.version_select at 0x7f5ca1cdf3a0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:22.733573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:22.739379 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5ecd322e-94aa-4629-834e-a4b002aade6c tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] HTTP exception thrown: Image not found. Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ecd322e-94aa-4629-834e-a4b002aade6c tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Request method failure captured: Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/images/23d175b5-3f13-46ff-81c4-2e0642fdc11a/metadata/os_version HTTP/1.1 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-zdN-Jssgm0Apra-Txo5IjtDk4pbCJDnFyiL20I5grLzhGbwhma8HTFyuu6zgMRqAF-X7yCc0LZ1vkq4FU25sungEAbDM_B-QreM7a1_WIiO5L5xWJe9Yv_7ESCL7rsEZpePE4vQN3jytUn9hTEhGquXN5Y7rWpO6eO8pn0-EgvY48 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/642359511f7d4daa842471a448f2d138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_642359511f7d4daa842471a448f2d138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3f8828a7d30a465682edb5a6d3883b01 Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'image_id': '23d175b5-3f13-46ff-81c4-2e0642fdc11a', 'id': 'os_version'} Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23d175b5-3f13-46ff-81c4-2e0642fdc11a Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:42:22.749829 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23d175b5-3f13-46ff-81c4-2e0642fdc11a could not be found. Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:42:22.753047 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.761144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ecd322e-94aa-4629-834e-a4b002aade6c tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:22.777556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5ecd322e-94aa-4629-834e-a4b002aade6c tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] 10.222.0.48 "GET /compute/v2.1/images/23d175b5-3f13-46ff-81c4-2e0642fdc11a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.084663 Oct 31 15:42:22.781763 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2427/4985] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Oct 31 15:42:22 2022] GET /compute/v2.1/images/23d175b5-3f13-46ff-81c4-2e0642fdc11a/metadata/os_version => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:42:22.788544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cfacba13-7316-41bb-8f95-65832f77e5ba tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 1.094692 Oct 31 15:42:22.805042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7155f97-00df-45b8-8523-b5302d888ab2 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Calling method '.version_select at 0x7f5ca67e2dc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:22.827305 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2559/4986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:21 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:22.835284 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a7155f97-00df-45b8-8523-b5302d888ab2 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] HTTP exception thrown: Image not found. Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7155f97-00df-45b8-8523-b5302d888ab2 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Request method failure captured: Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/images/db79b72e-f7db-4306-b3a3-737f85fd486a/metadata HTTP/1.1 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-zdN-Jssgm0Apra-Txo5IjtDk4pbCJDnFyiL20I5grLzhGbwhma8HTFyuu6zgMRqAF-X7yCc0LZ1vkq4FU25sungEAbDM_B-QreM7a1_WIiO5L5xWJe9Yv_7ESCL7rsEZpePE4vQN3jytUn9hTEhGquXN5Y7rWpO6eO8pn0-EgvY48 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/642359511f7d4daa842471a448f2d138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_642359511f7d4daa842471a448f2d138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3f8828a7d30a465682edb5a6d3883b01 Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'image_id': 'db79b72e-f7db-4306-b3a3-737f85fd486a'} Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db79b72e-f7db-4306-b3a3-737f85fd486a Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:42:22.837522 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db79b72e-f7db-4306-b3a3-737f85fd486a could not be found. Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7155f97-00df-45b8-8523-b5302d888ab2 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7155f97-00df-45b8-8523-b5302d888ab2 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] 10.222.0.48 "GET /compute/v2.1/images/db79b72e-f7db-4306-b3a3-737f85fd486a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048662 Oct 31 15:42:22.840913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2428/4987] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Oct 31 15:42:22 2022] GET /compute/v2.1/images/db79b72e-f7db-4306-b3a3-737f85fd486a/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:42:22.930947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d967fb05-03a8-4245-b8bc-ab0699812ba8 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Action: 'update_all', calling method: .version_select at 0x7f5ca16d64c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:22.959840 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d967fb05-03a8-4245-b8bc-ab0699812ba8 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] HTTP exception thrown: Image not found. Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d967fb05-03a8-4245-b8bc-ab0699812ba8 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Request method failure captured: Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/images/f5c2a6db-5443-43be-8313-da9ebbf8eda4/metadata HTTP/1.1 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 57 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-zdN-Jssgm0Apra-Txo5IjtDk4pbCJDnFyiL20I5grLzhGbwhma8HTFyuu6zgMRqAF-X7yCc0LZ1vkq4FU25sungEAbDM_B-QreM7a1_WIiO5L5xWJe9Yv_7ESCL7rsEZpePE4vQN3jytUn9hTEhGquXN5Y7rWpO6eO8pn0-EgvY48 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/642359511f7d4daa842471a448f2d138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_642359511f7d4daa842471a448f2d138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3f8828a7d30a465682edb5a6d3883b01 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'image_id': 'f5c2a6db-5443-43be-8313-da9ebbf8eda4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f5c2a6db-5443-43be-8313-da9ebbf8eda4 Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:42:22.963851 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5c2a6db-5443-43be-8313-da9ebbf8eda4 could not be found. Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d967fb05-03a8-4245-b8bc-ab0699812ba8 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d967fb05-03a8-4245-b8bc-ab0699812ba8 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] 10.222.0.48 "PUT /compute/v2.1/images/f5c2a6db-5443-43be-8313-da9ebbf8eda4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039079 Oct 31 15:42:22.970097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2560/4988] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:42:22 2022] PUT /compute/v2.1/images/f5c2a6db-5443-43be-8313-da9ebbf8eda4/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:42:22.981572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c51b68d-dfba-4d39-9c89-d5c784876496 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Action: 'update', calling method: .version_select at 0x7f5ca1cdf820>, body: {"meta": {"os_distro": "alt"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:23.004177 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-6c51b68d-dfba-4d39-9c89-d5c784876496 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] HTTP exception thrown: Image not found. Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c51b68d-dfba-4d39-9c89-d5c784876496 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Request method failure captured: Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: request: PUT /compute/v2.1/images/70cc0d0a-ba27-45aa-a7f2-307b914c11c6/metadata/os_distro HTTP/1.1 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 30 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-zdN-Jssgm0Apra-Txo5IjtDk4pbCJDnFyiL20I5grLzhGbwhma8HTFyuu6zgMRqAF-X7yCc0LZ1vkq4FU25sungEAbDM_B-QreM7a1_WIiO5L5xWJe9Yv_7ESCL7rsEZpePE4vQN3jytUn9hTEhGquXN5Y7rWpO6eO8pn0-EgvY48 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/642359511f7d4daa842471a448f2d138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_642359511f7d4daa842471a448f2d138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 3f8828a7d30a465682edb5a6d3883b01 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: {"meta": {"os_distro": "alt"}} Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: exception: Image not found. Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'image_id': '70cc0d0a-ba27-45aa-a7f2-307b914c11c6', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 70cc0d0a-ba27-45aa-a7f2-307b914c11c6 Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:42:23.007615 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70cc0d0a-ba27-45aa-a7f2-307b914c11c6 could not be found. Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:42:23.012652 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.020928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c51b68d-dfba-4d39-9c89-d5c784876496 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Returning 404 to user: Image not found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:23.022210 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c51b68d-dfba-4d39-9c89-d5c784876496 tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] 10.222.0.48 "PUT /compute/v2.1/images/70cc0d0a-ba27-45aa-a7f2-307b914c11c6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.048429 Oct 31 15:42:23.036530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3777fd5e-fd3e-40d5-8ced-025d2297644b tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Action: 'create', calling method: .version_select at 0x7f5ca235c550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:23.041530 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2429/4989] 10.222.0.48 () {60 vars in 1310 bytes} [Mon Oct 31 15:42:22 2022] PUT /compute/v2.1/images/70cc0d0a-ba27-45aa-a7f2-307b914c11c6/metadata/os_distro => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:42:23.078867 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3777fd5e-fd3e-40d5-8ced-025d2297644b tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] HTTP exception thrown: Image not found. Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3777fd5e-fd3e-40d5-8ced-025d2297644b tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Request method failure captured: Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/images/b529e5cd-227d-4ad2-9cfc-14f6d2bdf3a9/metadata HTTP/1.1 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 57 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-zdN-Jssgm0Apra-Txo5IjtDk4pbCJDnFyiL20I5grLzhGbwhma8HTFyuu6zgMRqAF-X7yCc0LZ1vkq4FU25sungEAbDM_B-QreM7a1_WIiO5L5xWJe9Yv_7ESCL7rsEZpePE4vQN3jytUn9hTEhGquXN5Y7rWpO6eO8pn0-EgvY48 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/642359511f7d4daa842471a448f2d138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_642359511f7d4daa842471a448f2d138"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/642359511f7d4daa842471a448f2d138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 642359511f7d4daa842471a448f2d138 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3f8828a7d30a465682edb5a6d3883b01 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2024904046-project Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: exception: Image not found. Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'image_id': 'b529e5cd-227d-4ad2-9cfc-14f6d2bdf3a9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b529e5cd-227d-4ad2-9cfc-14f6d2bdf3a9 Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:42:23.082508 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b529e5cd-227d-4ad2-9cfc-14f6d2bdf3a9 could not be found. Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:42:23.086728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:23.093373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3777fd5e-fd3e-40d5-8ced-025d2297644b tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] Returning 404 to user: Image not found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:23.094470 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3777fd5e-fd3e-40d5-8ced-025d2297644b tempest-ImagesMetadataNegativeTestJSON-2024904046 tempest-ImagesMetadataNegativeTestJSON-2024904046-project] 10.222.0.48 "POST /compute/v2.1/images/b529e5cd-227d-4ad2-9cfc-14f6d2bdf3a9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062949 Oct 31 15:42:23.100503 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2561/4990] 10.222.0.48 () {60 vars in 1281 bytes} [Mon Oct 31 15:42:23 2022] POST /compute/v2.1/images/b529e5cd-227d-4ad2-9cfc-14f6d2bdf3a9/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:42:23.826474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:23.827899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:23.852903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.853529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.854732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:23.862416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.863084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.863603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:24.861908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:24.874803 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78196466-4813-4f24-a55d-34043947d2cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 1.055790 Oct 31 15:42:24.881449 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2430/4991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:23 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:25.096828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1650940626", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a17a5b49-e754-4201-b739-b1cf5de1766a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1912177738", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1a482551-a14a-43cd-ac40-24c69454f476"]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:25.229342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] validate_networks() for [('a17a5b49-e754-4201-b739-b1cf5de1766a', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:42:25.903525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:25.905441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:25.918342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:25.921449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:25.924302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:25.945124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:25.947863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:25.948371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:26.416443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:26.439279 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6c6b63b-d45f-4e57-886b-71b3aaed2051 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 0.537877 Oct 31 15:42:26.440429 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2431/4992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:25 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:26.974320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:42:26.975568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:42:26.979253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:42:26.979942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:42:26.980930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:42:27.012200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.013821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.015318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.019839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.021355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.022196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.064536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Getting quotas for project f880fdbef7204abdb6d1fcb972535754. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:27.072484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Getting quotas for user 4cc2e142832e421a912ebebe7df682e6 and project f880fdbef7204abdb6d1fcb972535754. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:27.094573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:42:27.097411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:42:27.260877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aeef5dca-3ee2-4a74-b3a6-6f1a270c1cdc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.167287 Oct 31 15:42:27.274856 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2562/4993] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:42:25 2022] POST /compute/v2.1/servers => generated 361 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:42:27.278951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4da6e5b0-ceb4-4281-81dc-f904313f58d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:27.281478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4da6e5b0-ceb4-4281-81dc-f904313f58d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:27.468983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:27.469678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:27.491615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.492159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.493237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.497816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.502622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.503131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.606755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4da6e5b0-ceb4-4281-81dc-f904313f58d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:27.615624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4da6e5b0-ceb4-4281-81dc-f904313f58d0 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1242 microversion: 2.1 time: 0.340458 Oct 31 15:42:27.622619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2432/4994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:27 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:28.060280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:28.069418 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ebeaf9d-48e9-443e-a5d9-44a8baed4169 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 0.607542 Oct 31 15:42:28.070022 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2563/4995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:27 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:28.101348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e3d4d383-29de-44be-b267-ab480a0addb4 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Action: 'create', calling method: .version_select at 0x7f5ca67e2310>, body: {"keypair": {"name": "tempest-keypair-783376306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ2Mc3btUbySIxeFHCDEeAZN26Ayx1o7VcWdGPBQu3qbbnaB9QSow8NBQkwpxrDIC8dmWGvEMDlj24AxMlG5EHlOMK2EGKm/xSw7H9XA+QQjaMdSPM5/ZB/nNNezi4gXA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:28.141289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e3d4d383-29de-44be-b267-ab480a0addb4 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:28.196142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e3d4d383-29de-44be-b267-ab480a0addb4 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for user 76ffc2e3fba64385b401279830e2bca6 and project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:28.240688 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e3d4d383-29de-44be-b267-ab480a0addb4 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.564838 Oct 31 15:42:28.241817 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2433/4996] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:42:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:28.255033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf913ab6-86ea-47cc-9096-e53b1182b597 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca22af8b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.278604 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf913ab6-86ea-47cc-9096-e53b1182b597 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-783376306" status: 200 len: 497 microversion: 2.1 time: 0.029571 Oct 31 15:42:28.281225 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2564/4997] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Oct 31 15:42:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-783376306 => generated 497 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:28.292742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad670bf9-a993-4521-8f22-10687b403f52 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca1237820>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.340440 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad670bf9-a993-4521-8f22-10687b403f52 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783376306" status: 202 len: 0 microversion: 2.1 time: 0.051543 Oct 31 15:42:28.341650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2434/4998] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783376306 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:28.355382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bec9db10-5a6d-49e1-9fad-3262b4633b53 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Action: 'create', calling method: .version_select at 0x7f5ca22f6ca0>, body: {"keypair": {"name": "tempest-keypair-402831986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq5zUdYSC39DOvDL/e/FquiaYMdsKJL/zt/C1Q8ofMknvOsfxN88vO7Zf72UhA/wQGrFzz7DsQSUJT0awoVFqMU8SPfVtPprAk+CDU8iigyd1kkbzg/HZ9eItG75crrBA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:28.389773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-bec9db10-5a6d-49e1-9fad-3262b4633b53 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:28.406746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-bec9db10-5a6d-49e1-9fad-3262b4633b53 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for user 76ffc2e3fba64385b401279830e2bca6 and project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:28.460443 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bec9db10-5a6d-49e1-9fad-3262b4633b53 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107968 Oct 31 15:42:28.462883 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2565/4999] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:42:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:28.475860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f4a3e29-ef1a-4c09-b54c-198a2017f7ff tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca26b84c0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.517010 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f4a3e29-ef1a-4c09-b54c-198a2017f7ff tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-402831986" status: 202 len: 0 microversion: 2.1 time: 0.045623 Oct 31 15:42:28.518195 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2435/5000] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Oct 31 15:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-402831986 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:28.530052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e7f9599-85c0-4a29-990a-d3ef141f174e tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Action: 'create', calling method: .version_select at 0x7f5ca14ffaf0>, body: {"keypair": {"name": "tempest-keypair-1632587914", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:28.569938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7e7f9599-85c0-4a29-990a-d3ef141f174e tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:28.588715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7e7f9599-85c0-4a29-990a-d3ef141f174e tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for user 76ffc2e3fba64385b401279830e2bca6 and project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:28.651227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.652085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:28.658442 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e7f9599-85c0-4a29-990a-d3ef141f174e tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.134820 Oct 31 15:42:28.662433 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2566/5001] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:42:28 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:28.665395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.666123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.666716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.677886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65001477-8137-4e6d-ab93-3b6bd694f937 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca139b430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.678910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.680387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.681717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.753131 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65001477-8137-4e6d-ab93-3b6bd694f937 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632587914" status: 202 len: 0 microversion: 2.1 time: 0.083106 Oct 31 15:42:28.763127 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2567/5002] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632587914 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:42:28.775098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a84ee9d-2a69-49f0-9ddf-0dabda7a81b5 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Action: 'create', calling method: .version_select at 0x7f5ca1671820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1842242983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJr7Oy4JExacMXSxDwdOGFT54Rk8UygYaNvQTWKZGHIYa1RgjqiRlCLYngqgAmHHIC5YTLWAoy+56lHVnI/pA4lWlXJR7FMD8qRwl+QaZP6tQGqjLGgaZjgTAwKHRJxQMQ=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:28.952748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4a84ee9d-2a69-49f0-9ddf-0dabda7a81b5 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:28.972622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4a84ee9d-2a69-49f0-9ddf-0dabda7a81b5 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for user 76ffc2e3fba64385b401279830e2bca6 and project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:29.024559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:29.037490 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5990f7b5-5adb-4375-a428-14e936d024a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1238 microversion: 2.1 time: 0.390785 Oct 31 15:42:29.040162 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2436/5003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:28 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1238 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:29.066831 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a84ee9d-2a69-49f0-9ddf-0dabda7a81b5 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.301169 Oct 31 15:42:29.067459 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2568/5004] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:42:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:29.085424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b53d1023-2f0d-40e2-ad2f-ad583b4fbbc1 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Action: 'create', calling method: .version_select at 0x7f5ca22c9b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-48948453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjeCuQhnSB/u0Zos95LUx9fCA+MFwhaqT3d7JVsSkS1gl2MUi3uS1h7F9BwL3qSaGdvA/5LpkDknC2v3WQcr26D5aknbR0ULmYYVBkgqSYqxBdSjeDRE8YYO/4+t9gm9w=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:29.099838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.101079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:29.114725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.117028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.117599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.119988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.122495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.123070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.166866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b53d1023-2f0d-40e2-ad2f-ad583b4fbbc1 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:29.192135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b53d1023-2f0d-40e2-ad2f-ad583b4fbbc1 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for user 76ffc2e3fba64385b401279830e2bca6 and project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:29.278189 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b53d1023-2f0d-40e2-ad2f-ad583b4fbbc1 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.199295 Oct 31 15:42:29.288878 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2437/5005] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:42:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:29.298659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-70e62f70-dd13-4c0f-b850-ade74d34c314 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Action: 'create', calling method: .version_select at 0x7f5ca1d4a5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-981793558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKev7Z9oB/BOjI7sMgNa1MWkYmgi8GbUdS32bw8bdwLWu9pYXnUBWGJtJ/V3liQ8cYcu5l0Xd0JWCJQFtW2vJjd9mAvTldahHW3e20rTUFysRHTNw39ZPXarVu23zu1+Fw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:29.369333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-70e62f70-dd13-4c0f-b850-ade74d34c314 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:29.381630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-70e62f70-dd13-4c0f-b850-ade74d34c314 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Getting quotas for user 76ffc2e3fba64385b401279830e2bca6 and project ff066ead172f49f0bb0e4e607568b38f. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:29.496635 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-70e62f70-dd13-4c0f-b850-ade74d34c314 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.206015 Oct 31 15:42:29.502855 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2438/5006] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:42:29 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:29.516369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff537fd7-6146-4ab5-9030-567e0474a791 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca1d06040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.523998 n-d-858383-17 devstack@n-api.service[120626]: WARNING oslo_db.sqlalchemy.utils [None req-ff537fd7-6146-4ab5-9030-567e0474a791 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:42:29.537848 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff537fd7-6146-4ab5-9030-567e0474a791 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.034033 Oct 31 15:42:29.538457 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2439/5007] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:42:29 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:29.554618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f258aaf9-e8a2-49f0-8b90-fcc3402b3667 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca1d4a1f0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.594324 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f258aaf9-e8a2-49f0-8b90-fcc3402b3667 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-981793558" status: 202 len: 0 microversion: 2.1 time: 0.048434 Oct 31 15:42:29.596803 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2440/5008] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-981793558 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:42:29.603885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e5d7502-e8c4-43d6-95d8-3ba420efa236 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca26f8af0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.664252 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e5d7502-e8c4-43d6-95d8-3ba420efa236 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-48948453" status: 202 len: 0 microversion: 2.1 time: 0.063344 Oct 31 15:42:29.665721 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2441/5009] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-48948453 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:29.686442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b95b621-83ff-426c-bece-8f5b21fda960 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] Calling method '.version_select at 0x7f5ca669d790>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.742172 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b95b621-83ff-426c-bece-8f5b21fda960 tempest-KeyPairsV2TestJSON-685207301 tempest-KeyPairsV2TestJSON-685207301-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1842242983" status: 202 len: 0 microversion: 2.1 time: 0.070830 Oct 31 15:42:29.743513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2442/5010] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Oct 31 15:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1842242983 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:29.767509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:29.778407 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ec00e5a-27fc-42ed-afb7-eee6e45e3d9c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 0.681625 Oct 31 15:42:29.784165 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2569/5011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:29 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:30.070894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:30.071757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:30.087643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.088302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.089660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.092867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.093505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.094938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.312307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:30.332815 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e161642d-b016-4646-ab75-4d3ad2f338b8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.267842 Oct 31 15:42:30.350108 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2443/5012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:30 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:30.810416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:30.811933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:30.825579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.826108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.826671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.827605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.828083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.833821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.847425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=46 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:31.359793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:31.360419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:31.372998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.374307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.374771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.375505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.375974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.376408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.387946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:31.406445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2727c523-8010-4144-87b7-75c3cd42f1e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 0.599665 Oct 31 15:42:31.408193 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2570/5013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:30 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:31.544880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:31.564510 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c507c1a-c10f-448e-9589-0e819efc3f88 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.208776 Oct 31 15:42:31.585161 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2444/5014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:31 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:32.433488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:32.434118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:32.452550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.468900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.470526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.475341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.476063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.482317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.596216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:32.605216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:32.630760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.632288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.640834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.642112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.642845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.643508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.031218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:33.062151 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64406122-642a-4306-8422-9e7e5040a219 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.478180 Oct 31 15:42:33.063687 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2445/5015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:32 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:33.446276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:33.463133 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6367b4f5-dd6b-4101-ae83-861b1680bcd8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 1.033338 Oct 31 15:42:33.488721 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2571/5016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:32 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:33.809883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9f962ed9-bcd7-4fe5-8afd-b7a49ec1e031 req-76d141b8-4b76-4b61-9052-6253543ecbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0cf5cfc-939e-4656-9b5f-3fef9ff4217c", "name": "network-vif-plugged", "status": "completed", "tag": "f563bf76-07b9-425a-8205-4544e1ea3012"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:33.851950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9f962ed9-bcd7-4fe5-8afd-b7a49ec1e031 req-76d141b8-4b76-4b61-9052-6253543ecbf6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.852625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9f962ed9-bcd7-4fe5-8afd-b7a49ec1e031 req-76d141b8-4b76-4b61-9052-6253543ecbf6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.853566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9f962ed9-bcd7-4fe5-8afd-b7a49ec1e031 req-76d141b8-4b76-4b61-9052-6253543ecbf6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.907824 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9f962ed9-bcd7-4fe5-8afd-b7a49ec1e031 req-76d141b8-4b76-4b61-9052-6253543ecbf6 service nova] Creating event network-vif-plugged:f563bf76-07b9-425a-8205-4544e1ea3012 for instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c on n-h1-858383-17 Oct 31 15:42:33.915177 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9f962ed9-bcd7-4fe5-8afd-b7a49ec1e031 req-76d141b8-4b76-4b61-9052-6253543ecbf6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110466 Oct 31 15:42:33.915850 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2446/5017] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:34.088520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:34.089545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:34.110201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.110722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.111187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.111887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.112353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.112830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.500248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:34.501892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:34.517860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.518808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.519459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.520546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.521343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.522042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.681453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:34.700607 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81110f0e-a91e-4108-8fff-c2b17d0ec1fb tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.616935 Oct 31 15:42:34.706493 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2572/5018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:34 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:35.139569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:35.161493 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bbc8e6da-fb1e-4b8c-827f-dd6ed97921df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1309 microversion: 2.1 time: 0.663206 Oct 31 15:42:35.162950 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2447/5019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:34 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1309 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:35.736969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:35.737600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:35.748924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.749725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.750124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.750845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.751310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.751782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.993580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:36.010918 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56aa8752-0c3a-49d6-a264-c32011c11e2c tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.276384 Oct 31 15:42:36.029564 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2573/5020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:35 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:36.190008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:36.190008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:36.207498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.207992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.228473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.231888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.232598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.238412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.400021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-56fe8769-0841-483a-b6ee-8d1fbfb3806a req-3bac0056-1393-4dec-a465-5e3eaff3f8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb54ab22-f903-4598-a818-90b80fb3ac2e", "tag": "138599bf-31fd-4f2a-8d8a-ab795ed8690b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:36.427406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56fe8769-0841-483a-b6ee-8d1fbfb3806a req-3bac0056-1393-4dec-a465-5e3eaff3f8fa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.428371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56fe8769-0841-483a-b6ee-8d1fbfb3806a req-3bac0056-1393-4dec-a465-5e3eaff3f8fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.428994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56fe8769-0841-483a-b6ee-8d1fbfb3806a req-3bac0056-1393-4dec-a465-5e3eaff3f8fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.500174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-56fe8769-0841-483a-b6ee-8d1fbfb3806a req-3bac0056-1393-4dec-a465-5e3eaff3f8fa service nova] Creating event network-changed:138599bf-31fd-4f2a-8d8a-ab795ed8690b for instance bb54ab22-f903-4598-a818-90b80fb3ac2e on n-h2-858383-17 Oct 31 15:42:36.523351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-56fe8769-0841-483a-b6ee-8d1fbfb3806a req-3bac0056-1393-4dec-a465-5e3eaff3f8fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127761 Oct 31 15:42:36.535976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2574/5021] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:37.039021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:37.040491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:37.052189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:37.052189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.059643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.060150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.061199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.066159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.066671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.187794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:37.205036 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-48f808a3-c006-42e6-8e40-c7c053e508e8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1491 microversion: 2.1 time: 1.017190 Oct 31 15:42:37.208111 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2448/5022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:36 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1491 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:37.235287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:37.237674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:37.252426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.255032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.258340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.259274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.274085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.274920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.577232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:37.588117 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67248128-c679-4eff-8c17-6fc65b5f4128 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.554579 Oct 31 15:42:37.592365 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2575/5023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:37 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:37.734414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:37.750271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-203f11cc-5579-4855-8ab7-f0a1b5f972f8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1491 microversion: 2.1 time: 0.521644 Oct 31 15:42:37.791030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:37.793509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:37.801349 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2449/5024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:37 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1491 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:37.807829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.808385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.808868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.812537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.813058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.813501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.623439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:38.625338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:38.640407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.641198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.641804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.642690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.643297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.645374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.989737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:39.052094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:39.062752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-701cc2ef-be4c-4fbf-ba03-bdcbc816c689 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1491 microversion: 2.1 time: 1.288913 Oct 31 15:42:39.063941 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2576/5025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:37 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1491 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:39.074220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:39.092813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:39.095454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:39.102391 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bd8be1a-aab9-4a9a-90af-02f6305acf27 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.483838 Oct 31 15:42:39.109978 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2450/5026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:38 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:39.114443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.117342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.118162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.119432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.120107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.123781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.190265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:42:39.374178 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-611356f9-8daf-40d0-9d95-e7ed4fc90281 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 204 len: 0 microversion: 2.1 time: 0.287310 Oct 31 15:42:39.376165 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2577/5027] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:42:39 2022] DELETE /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:42:39.387253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:39.388432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:39.399008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.399633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.400072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.400925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.401779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.402576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.448331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=14 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:39.768075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:39.782985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fbf4e268-920a-4348-bcda-d104dbed229d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1497 microversion: 2.1 time: 0.395729 Oct 31 15:42:39.785502 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2451/5028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:39 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1497 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:40.137865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:40.138603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:40.147493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.147996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.148440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.149870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.150352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.150772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.484965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:40.498110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a329182f-0ff8-489d-8f51-9a79b78f9bbc tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.363411 Oct 31 15:42:40.502437 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2578/5029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:40 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:40.809108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:40.809649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:40.817279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.818059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.818691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.819709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.820396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.821374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.826999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=88 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:41.517104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:41.532409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:41.532974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:41.538274 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a015261-98a9-4586-816e-4edb97756c1c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1497 microversion: 2.1 time: 0.733181 Oct 31 15:42:41.542035 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2452/5030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:40 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1497 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:41.555938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.556438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.557485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.558237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.558749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.559185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.071723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:42.081130 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59be1345-9d99-4a2a-9cbf-52011d5526c9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.553408 Oct 31 15:42:42.101968 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2579/5031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:41 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:42.566302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:42.567265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:42.579679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.580261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.580755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.581462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.582100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.582839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.117949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:43.119992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:43.140201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:43.140801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:43.141244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.143592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:43.144395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:43.145009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.262878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:43.275616 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0f7e1e7-fd38-4d96-80fb-83d75d704977 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1497 microversion: 2.1 time: 0.712075 Oct 31 15:42:43.277386 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2453/5032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:42 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1497 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:43.350794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:43.367420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b82ae82-e047-443d-8287-0a136c2c1cb2 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.253653 Oct 31 15:42:43.376504 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2580/5033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:43 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:43.643323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-582a34d0-313d-430d-9621-41ed6d9db35c req-20ad9229-a4d2-49c1-8e23-df404e3dd68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0cf5cfc-939e-4656-9b5f-3fef9ff4217c", "name": "network-vif-deleted", "tag": "f563bf76-07b9-425a-8205-4544e1ea3012"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:43.688123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-582a34d0-313d-430d-9621-41ed6d9db35c req-20ad9229-a4d2-49c1-8e23-df404e3dd68f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:43.688765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-582a34d0-313d-430d-9621-41ed6d9db35c req-20ad9229-a4d2-49c1-8e23-df404e3dd68f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:43.689216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-582a34d0-313d-430d-9621-41ed6d9db35c req-20ad9229-a4d2-49c1-8e23-df404e3dd68f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.743552 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-582a34d0-313d-430d-9621-41ed6d9db35c req-20ad9229-a4d2-49c1-8e23-df404e3dd68f service nova] Creating event network-vif-deleted:f563bf76-07b9-425a-8205-4544e1ea3012 for instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c on n-h1-858383-17 Oct 31 15:42:43.760626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-582a34d0-313d-430d-9621-41ed6d9db35c req-20ad9229-a4d2-49c1-8e23-df404e3dd68f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121936 Oct 31 15:42:43.778313 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2454/5034] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:44.303986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:44.305295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:44.317881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.321092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.322413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.332758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.334794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.335423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.396190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:44.396929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:44.412331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.412876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.413321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.418283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.418835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.422692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.459107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.461060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.461851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.462336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lazy-loading 'fault' on Instance uuid d0cf5cfc-939e-4656-9b5f-3fef9ff4217c {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:42:44.671891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:44.680522 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15253d70-a995-49a5-b973-38cbe4102027 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 200 len: 1299 microversion: 2.1 time: 0.381098 Oct 31 15:42:44.683194 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2581/5035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:44 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 1299 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:44.793653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:44.815562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a550ac15-f445-40af-bfac-01e25e7e57a9 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.423699 Oct 31 15:42:44.825114 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2455/5036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:44 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:45.513571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6f08dfaa-7b74-486c-97e4-88b9a88c11c9 req-39d6c6bb-83dc-493b-8fcb-ef54b0d9ff73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb54ab22-f903-4598-a818-90b80fb3ac2e", "name": "network-vif-plugged", "status": "completed", "tag": "138599bf-31fd-4f2a-8d8a-ab795ed8690b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:45.530209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:45.539026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f08dfaa-7b74-486c-97e4-88b9a88c11c9 req-39d6c6bb-83dc-493b-8fcb-ef54b0d9ff73 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.539701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f08dfaa-7b74-486c-97e4-88b9a88c11c9 req-39d6c6bb-83dc-493b-8fcb-ef54b0d9ff73 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.540205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f08dfaa-7b74-486c-97e4-88b9a88c11c9 req-39d6c6bb-83dc-493b-8fcb-ef54b0d9ff73 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.568570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6f08dfaa-7b74-486c-97e4-88b9a88c11c9 req-39d6c6bb-83dc-493b-8fcb-ef54b0d9ff73 service nova] Creating event network-vif-plugged:138599bf-31fd-4f2a-8d8a-ab795ed8690b for instance bb54ab22-f903-4598-a818-90b80fb3ac2e on n-h2-858383-17 Oct 31 15:42:45.582190 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6f08dfaa-7b74-486c-97e4-88b9a88c11c9 req-39d6c6bb-83dc-493b-8fcb-ef54b0d9ff73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072459 Oct 31 15:42:45.583800 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2582/5037] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:45.735171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:45.736148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:45.768849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.770298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.773519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.774524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.775266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.775942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.800280 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c HTTP/1.1 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd0cf5cfc-939e-4656-9b5f-3fef9ff4217c'} Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:45.802963 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:42:45.806712 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:45.810890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:45.812352 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bbad6ff6-fa8a-4389-a213-91248c18b3b9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 404 len: 111 microversion: 2.1 time: 0.093809 Oct 31 15:42:45.813324 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2456/5038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:45 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:42:45.825050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:45.826235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:45.837247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.838312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.846801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:45.847440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:45.848769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.851703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.854461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.856512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.882880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:45.892147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.893403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.894245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.898158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.899463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.902078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.984057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:42:46.158761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:46.171370 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-882a0652-0772-44d9-9fb4-1ef4c330cfb4 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.331537 Oct 31 15:42:46.187583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2457/5039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:45 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:46.195558 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f82d3d62-a18f-4992-8d0b-bcb54621a88a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 204 len: 0 microversion: 2.1 time: 0.377076 Oct 31 15:42:46.199445 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2583/5040] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:42:45 2022] DELETE /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:42:46.209141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:46.210016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:46.219024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:46.219849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:46.220690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:46.221734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:46.222398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:46.223090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:46.585067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:46.595813 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2664d1b7-d5f4-465b-9975-154efd63b61a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1497 microversion: 2.1 time: 0.392539 Oct 31 15:42:46.596640 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2458/5041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:46 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1497 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:47.202386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:47.204120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:47.237076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.237750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.240563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.241304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.241866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.251113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.315064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:47.514683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:47.527089 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df360e63-9c55-4f93-b292-8954a3443cac tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1300 microversion: 2.1 time: 0.331080 Oct 31 15:42:47.532418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2584/5042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:47 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1300 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:47.619574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:47.620188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:47.632909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.635688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.636145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.636921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.637391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.637822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.561986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:48.563204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:48.577555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.578316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.582147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.583200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.584364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.587443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:49.300438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:49.326279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d43a9360-2655-45d6-bab7-27e6dfd1d585 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1473 microversion: 2.1 time: 0.770501 Oct 31 15:42:49.332243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:49.342818 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1727aad8-eb1c-4c5c-a2be-df945ce049a6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1497 microversion: 2.1 time: 1.727081 Oct 31 15:42:49.346387 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2459/5043] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:47 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1497 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:49.350206 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2585/5044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:48 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1473 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:49.367409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:49.368035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:49.381229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.389626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.390899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:49.391856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.392752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.393820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.003959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:50.017432 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81d0080d-71e9-4064-a7df-eb21a659a802 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1473 microversion: 2.1 time: 0.658460 Oct 31 15:42:50.018474 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2460/5045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:49 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1473 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:50.057157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:50.058437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:50.079745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.080986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.081755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.082624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.083269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.083832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.373285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:50.374008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:50.401926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.405172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.407892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.411177 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea33cbad-29ca-46af-b8b8-bdf503d2ace1 tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1626 microversion: 2.1 time: 0.370697 Oct 31 15:42:50.412734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2586/5046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:50 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1626 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:50.413503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.414091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.414549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.438681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:50.440435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:50.461742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.462457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.463059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.463953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.464567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.465626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:51.224275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:51.241842 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2b6624d-4e05-4b2d-97ca-7452442254a7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1497 microversion: 2.1 time: 0.873329 Oct 31 15:42:51.246743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2461/5047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:50 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1497 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:51.444987 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76244204-1a4d-49a8-93c6-6606f85f0e9f tempest-TestSecurityGroupsBasicOps-2030792888 tempest-TestSecurityGroupsBasicOps-2030792888-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1914 microversion: 2.1 time: 1.007679 Oct 31 15:42:51.459566 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2587/5048] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:50 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1914 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:51.567032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:51.567598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:51.575951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:51.576455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:51.577011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:51.577726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:51.582656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:51.588551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:51.656166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:42:51.862917 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39acf860-14b8-400b-a9e7-5b515b2edf4e tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 204 len: 0 microversion: 2.1 time: 0.298686 Oct 31 15:42:51.867203 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2462/5049] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:42:51 2022] DELETE /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:42:51.881030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:51.883101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:51.921179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:51.923224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:51.925118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:51.932926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:51.937243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:51.938194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:51.987358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2415f001-81fe-4f02-b379-4f190bbf6972 req-bc389df2-1a57-4203-a5fe-8355ce378fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e9d128-28c0-4a8d-96a6-6677d4936eca", "name": "network-vif-deleted", "tag": "5ff61c59-968a-4de6-bc44-fb69d16f0f17"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:52.013417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2415f001-81fe-4f02-b379-4f190bbf6972 req-bc389df2-1a57-4203-a5fe-8355ce378fef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:52.015968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2415f001-81fe-4f02-b379-4f190bbf6972 req-bc389df2-1a57-4203-a5fe-8355ce378fef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:52.017875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2415f001-81fe-4f02-b379-4f190bbf6972 req-bc389df2-1a57-4203-a5fe-8355ce378fef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:52.071534 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2415f001-81fe-4f02-b379-4f190bbf6972 req-bc389df2-1a57-4203-a5fe-8355ce378fef service nova] Creating event network-vif-deleted:5ff61c59-968a-4de6-bc44-fb69d16f0f17 for instance 39e9d128-28c0-4a8d-96a6-6677d4936eca on n-h2-858383-17 Oct 31 15:42:52.090142 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2415f001-81fe-4f02-b379-4f190bbf6972 req-bc389df2-1a57-4203-a5fe-8355ce378fef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101308 Oct 31 15:42:52.096969 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2463/5050] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:52.175614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:52.190702 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ea5ec82-8de0-437f-a035-886f2669c52b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1479 microversion: 2.1 time: 0.322648 Oct 31 15:42:52.222103 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2588/5051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:51 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1479 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:52.272690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:52.273669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:52.288632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:52.289157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:52.289588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:52.290294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:52.290748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:52.291168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:52.458005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:52.472826 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3bf08ed3-4407-4d08-8036-2efffb0a16cd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1455 microversion: 2.1 time: 0.202742 Oct 31 15:42:52.474458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2464/5052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:52 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1455 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:53.229689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:53.230345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:53.253868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.256562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.257237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:53.259300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.259924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.260584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:53.478475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:53.503052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:53.505747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:53.507220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd6854eb-b7a8-4a08-b3f4-efb78cd06006 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1479 microversion: 2.1 time: 0.282596 Oct 31 15:42:53.515881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2589/5053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:53 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1479 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:53.530225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.531671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.535999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:53.538245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.539510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.539887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:53.655842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.656523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.658194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:53.658967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lazy-loading 'fault' on Instance uuid 39e9d128-28c0-4a8d-96a6-6677d4936eca {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:42:53.921359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11541ee1-b980-4b1f-9be9-bcc89292b355 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca156b280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-841008496", "description": "tempest-description-138434472"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:54.324255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:54.339673 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0c02d2cd-0458-44af-952a-ae7816fd2550 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 200 len: 1299 microversion: 2.1 time: 0.844583 Oct 31 15:42:54.340583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2465/5054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:53 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 1299 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:54.540534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:54.541233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:54.582150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:54.583296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:54.583863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:54.585395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:54.586016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:54.586849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:54.866650 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11541ee1-b980-4b1f-9be9-bcc89292b355 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.274790 Oct 31 15:42:54.867814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2590/5055] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:42:53 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:42:54.882579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4d0d095-2b6e-45ab-89fa-845c2205bbda tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca67ecb80>, body: {"security_group_rule": {"parent_group_id": "077a6e8b-0ad6-47ca-a0bf-249a27e3dce7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:54.931631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:54.941496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-539a23a3-1b3d-4243-b823-fc0450f45166 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1479 microversion: 2.1 time: 0.406337 Oct 31 15:42:54.949072 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2466/5056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:54 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1479 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:55.379360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:55.381623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:55.407768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.412678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.413295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.414910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4d0d095-2b6e-45ab-89fa-845c2205bbda tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.537013 Oct 31 15:42:55.415746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2591/5057] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:42:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:55.420047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.421111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.423310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.428334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acb38889-504c-416a-afd8-db3cb92c4408 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca22a09d0>, body: {"security_group_rule": {"parent_group_id": "077a6e8b-0ad6-47ca-a0bf-249a27e3dce7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:55.504995 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca HTTP/1.1 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '39e9d128-28c0-4a8d-96a6-6677d4936eca'} Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:55.510811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:42:55.514435 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.516830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:55.521349 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d1dc3865-2905-4e4b-b5ca-4d0dcb197237 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 404 len: 111 microversion: 2.1 time: 0.159225 Oct 31 15:42:55.530994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2467/5058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:55 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:42:55.557915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-acb38889-504c-416a-afd8-db3cb92c4408 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: This rule already exists in group 077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acb38889-504c-416a-afd8-db3cb92c4408 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 138 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: {"security_group_rule": {"parent_group_id": "077a6e8b-0ad6-47ca-a0bf-249a27e3dce7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: exception: This rule already exists in group 077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'security_group_rule': {'parent_group_id': '077a6e8b-0ad6-47ca-a0bf-249a27e3dce7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:55.561207 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:55.565208 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:55.565208 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:55.565208 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 Oct 31 15:42:55.565208 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:55.568439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acb38889-504c-416a-afd8-db3cb92c4408 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 400 to user: This rule already exists in group 077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:55.571796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-acb38889-504c-416a-afd8-db3cb92c4408 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.147115 Oct 31 15:42:55.572137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2cbb3881-6d32-40e4-a202-69687fd98a5e req-c4133c77-b1c5-4629-aaa0-3b204eb66fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb54ab22-f903-4598-a818-90b80fb3ac2e", "name": "network-vif-deleted", "tag": "138599bf-31fd-4f2a-8d8a-ab795ed8690b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:55.573171 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2592/5059] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:42:55 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:42:55.583880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca20794e-6527-4d37-b613-c41f0d1d255b tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca67ecdc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:55.628657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2cbb3881-6d32-40e4-a202-69687fd98a5e req-c4133c77-b1c5-4629-aaa0-3b204eb66fcd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.635733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2cbb3881-6d32-40e4-a202-69687fd98a5e req-c4133c77-b1c5-4629-aaa0-3b204eb66fcd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.636516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2cbb3881-6d32-40e4-a202-69687fd98a5e req-c4133c77-b1c5-4629-aaa0-3b204eb66fcd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.681375 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2cbb3881-6d32-40e4-a202-69687fd98a5e req-c4133c77-b1c5-4629-aaa0-3b204eb66fcd service nova] Creating event network-vif-deleted:138599bf-31fd-4f2a-8d8a-ab795ed8690b for instance bb54ab22-f903-4598-a818-90b80fb3ac2e on n-h2-858383-17 Oct 31 15:42:55.690513 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2cbb3881-6d32-40e4-a202-69687fd98a5e req-c4133c77-b1c5-4629-aaa0-3b204eb66fcd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142738 Oct 31 15:42:55.692215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2468/5060] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:55.945178 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca20794e-6527-4d37-b613-c41f0d1d255b tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/0a77a57b-77df-4fa7-9e55-3d01c090a4fe" status: 202 len: 0 microversion: 2.1 time: 0.366948 Oct 31 15:42:55.946173 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2593/5061] 10.222.0.48 () {58 vars in 1287 bytes} [Mon Oct 31 15:42:55 2022] DELETE /compute/v2.1/os-security-group-rules/0a77a57b-77df-4fa7-9e55-3d01c090a4fe => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:42:55.956991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef974729-1e1c-45cf-bc92-f80aaf15459d tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca230c0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1887869057", "description": "tempest-description-290590450"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:55.977954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:55.978579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:55.999516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.000013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.002357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.004555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.006427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.009513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.095948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.096809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.097398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.099499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lazy-loading 'fault' on Instance uuid bb54ab22-f903-4598-a818-90b80fb3ac2e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:42:56.182542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:56.195548 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a228247-e75f-49e8-bd07-19b77dcb90a8 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 200 len: 1332 microversion: 2.1 time: 0.221643 Oct 31 15:42:56.201686 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2594/5062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:55 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 1332 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:56.224053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-260591127", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:56.335699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:42:56.338668 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef974729-1e1c-45cf-bc92-f80aaf15459d tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.387243 Oct 31 15:42:56.350008 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2469/5063] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:42:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:56.361402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5050b868-4a83-4c30-8f27-202865d2e96e tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca298fe50>, body: {"security_group_rule": {"parent_group_id": "1f610e68-8f68-4141-be74-abac9a10fd32", "ip_protocol": "tcp", "from_port": 961787645, "to_port": 22}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:56.950113 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5050b868-4a83-4c30-8f27-202865d2e96e tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Invalid port range 961787645:22. Former value cannot be greater than the later Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5050b868-4a83-4c30-8f27-202865d2e96e tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 145 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: {"security_group_rule": {"parent_group_id": "1f610e68-8f68-4141-be74-abac9a10fd32", "ip_protocol": "tcp", "from_port": 961787645, "to_port": 22}} Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid port range 961787645:22. Former value cannot be greater than the later Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1f610e68-8f68-4141-be74-abac9a10fd32', 'ip_protocol': 'tcp', 'from_port': 961787645, 'to_port': 22}}} Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 961787645:22. Former value cannot be greater than the later Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 961787645:22. Former value cannot be greater than the later Oct 31 15:42:56.952358 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 961787645:22. Former value cannot be greater than the later Oct 31 15:42:56.955769 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.959745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5050b868-4a83-4c30-8f27-202865d2e96e tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 400 to user: Invalid port range 961787645:22. Former value cannot be greater than the later {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:56.960900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5050b868-4a83-4c30-8f27-202865d2e96e tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.609278 Oct 31 15:42:56.966378 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2470/5064] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:42:56 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 614 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:42:56.973389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b28328b-c084-4111-b0a1-f3c0b46cec4c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca26f81f0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2085354823", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:56.977133 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2b28328b-c084-4111-b0a1-f3c0b46cec4c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Security group id should be uuid Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b28328b-c084-4111-b0a1-f3c0b46cec4c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 131 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2085354823", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: exception: Security group id should be uuid Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2085354823', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:56.978988 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:56.983141 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 31 15:42:56.983141 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:42:56.984804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b28328b-c084-4111-b0a1-f3c0b46cec4c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 400 to user: Security group id should be uuid {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:56.986225 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b28328b-c084-4111-b0a1-f3c0b46cec4c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017979 Oct 31 15:42:56.988476 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2471/5065] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:42:56 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:42:57.007175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-34a9b6dc-adbe-4f13-8d2b-3529e98cb4f8 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca298f790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-762221358", "description": "tempest-description-964059912"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:58.039739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:42:58.040242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:42:58.041403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:42:58.041876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:42:58.042305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:42:58.067488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:58.067988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:58.071667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:58.076634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:58.077465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:58.078154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:58.128537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:58.146333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:58.189766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:42:58.194030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:42:58.320528 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ea364a7-0553-4083-92fe-877b0228ebbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.101455 Oct 31 15:42:58.320730 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-34a9b6dc-adbe-4f13-8d2b-3529e98cb4f8 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.326631 Oct 31 15:42:58.322710 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2595/5066] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:42:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:42:58.329688 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2472/5067] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:42:56 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:58.333936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:58.334819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: bb54ab22-f903-4598-a818-90b80fb3ac2e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:58.342285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-71ad0ee7-169f-4f0b-bad0-34d5312aac01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:58.343260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-71ad0ee7-169f-4f0b-bad0-34d5312aac01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:58.344535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:58.358333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:58.359119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:58.360068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:58.361499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:58.362459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:58.383369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] HTTP exception thrown: Instance bb54ab22-f903-4598-a818-90b80fb3ac2e could not be found. Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Request method failure captured: Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e HTTP/1.1 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-xAKLxbxMG4Y9xp2X0dkXo-C4WTh1ZI6bnfz8tESNKxajwYOOJtmaqV4ZY3bdFRzBsr-0TXmSg986sI15IenX8lqs9CSWd5nnIWC0QjwxfP53Fd79DSOYriI4CK9ZbZq9rFQjSdRnQgnq4zC-I6DjQiDmlWKr0ryi1FaQUSIAeh_vE Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f880fdbef7204abdb6d1fcb972535754 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1996851298 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1996851298 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f880fdbef7204abdb6d1fcb972535754 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1996851298 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestSecurityGroupsBasicOps-1996851298-project Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 4cc2e142832e421a912ebebe7df682e6 Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1996851298-project Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance bb54ab22-f903-4598-a818-90b80fb3ac2e could not be found. Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'bb54ab22-f903-4598-a818-90b80fb3ac2e'} Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb54ab22-f903-4598-a818-90b80fb3ac2e could not be found. Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb54ab22-f903-4598-a818-90b80fb3ac2e could not be found. Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.385181 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb54ab22-f903-4598-a818-90b80fb3ac2e could not be found. Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Returning 404 to user: Instance bb54ab22-f903-4598-a818-90b80fb3ac2e could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de912543-6ec1-4816-b0c4-7c0010796b56 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e" status: 404 len: 111 microversion: 2.1 time: 0.061906 Oct 31 15:42:58.390445 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2596/5068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:58 2022] GET /compute/v2.1/servers/bb54ab22-f903-4598-a818-90b80fb3ac2e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:42:58.401470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a36c8f7-d820-4078-b939-a2c853a465ed tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca67ff280>, body: {"security_group_rule": {"parent_group_id": "32de0bfa-3e69-4df0-af39-719b19a0241f", "ip_protocol": "tempest-999-1250280909", "from_port": 22, "to_port": 22}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:58.603729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-71ad0ee7-169f-4f0b-bad0-34d5312aac01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:58.626346 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-71ad0ee7-169f-4f0b-bad0-34d5312aac01 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1208 microversion: 2.1 time: 0.295456 Oct 31 15:42:58.633470 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2473/5069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:58 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1208 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:58.972407 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2a36c8f7-d820-4078-b939-a2c853a465ed tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Invalid IP protocol tempest-999-1250280909. Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a36c8f7-d820-4078-b939-a2c853a465ed tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 157 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: {"security_group_rule": {"parent_group_id": "32de0bfa-3e69-4df0-af39-719b19a0241f", "ip_protocol": "tempest-999-1250280909", "from_port": 22, "to_port": 22}} Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid IP protocol tempest-999-1250280909. Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'security_group_rule': {'parent_group_id': '32de0bfa-3e69-4df0-af39-719b19a0241f', 'ip_protocol': 'tempest-999-1250280909', 'from_port': 22, 'to_port': 22}}} Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1250280909. Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1250280909. Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.975584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1250280909. Oct 31 15:42:58.979738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:42:58.981546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a36c8f7-d820-4078-b939-a2c853a465ed tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 400 to user: Invalid IP protocol tempest-999-1250280909. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:58.983114 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a36c8f7-d820-4078-b939-a2c853a465ed tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.585854 Oct 31 15:42:58.984192 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2597/5070] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:42:58 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 594 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:42:58.999046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79190f09-384f-401b-8d54-036c09e9d05f tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca1d4aaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-307075473", "description": "tempest-description-61114883"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:59.665084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:59.665729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:59.684078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.685321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.685862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:59.689514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.690032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.690473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:00.063560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79190f09-384f-401b-8d54-036c09e9d05f tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.073540 Oct 31 15:43:00.065164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2474/5071] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:42:58 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:00.067041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:00.081139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8975d7c7-9850-4d1e-826c-29ab11dd33e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca2705af0>, body: {"security_group_rule": {"parent_group_id": "2abdb636-8d8c-4d9c-b567-cc3ae60577c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:00.095341 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce62940e-0daf-4de0-badc-624b7386558a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1204 microversion: 2.1 time: 0.439380 Oct 31 15:43:00.099108 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2598/5072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:59 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1204 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:00.380412 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-8975d7c7-9850-4d1e-826c-29ab11dd33e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8975d7c7-9850-4d1e-826c-29ab11dd33e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 138 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: {"security_group_rule": {"parent_group_id": "2abdb636-8d8c-4d9c-b567-cc3ae60577c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2abdb636-8d8c-4d9c-b567-cc3ae60577c5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:43:00.383142 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:43:00.388159 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:00.390936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8975d7c7-9850-4d1e-826c-29ab11dd33e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:00.392329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8975d7c7-9850-4d1e-826c-29ab11dd33e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.317880 Oct 31 15:43:00.393524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2475/5073] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:43:00 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:43:00.402574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6f06d30-d559-4b8e-885b-e46f6071be2c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca239df70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-62836343", "description": "tempest-description-1102391975"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:01.129137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:01.129752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:01.146676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:01.149591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:01.150122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:01.150900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:01.152623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:01.154561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:01.622456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:01.631590 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39528157-1ca3-4fb2-b749-5b1e6c550836 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1266 microversion: 2.1 time: 0.507146 Oct 31 15:43:01.638547 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2476/5074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:01 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:02.021504 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6f06d30-d559-4b8e-885b-e46f6071be2c tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.622939 Oct 31 15:43:02.032704 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2599/5075] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Oct 31 15:43:00 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:02.042607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcf57af4-ba95-4026-aefe-8f2f61a56ad2 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca2425310>, body: {"security_group_rule": {"parent_group_id": "f526666f-5e62-4128-b4e4-f7ade713b9ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 826531940}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:02.421453 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-dcf57af4-ba95-4026-aefe-8f2f61a56ad2 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Invalid port range 22:826531940. Valid TCP ports should be between 1-65535 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcf57af4-ba95-4026-aefe-8f2f61a56ad2 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 145 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: {"security_group_rule": {"parent_group_id": "f526666f-5e62-4128-b4e4-f7ade713b9ad", "ip_protocol": "tcp", "from_port": 22, "to_port": 826531940}} Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: method: Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid port range 22:826531940. Valid TCP ports should be between 1-65535 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f526666f-5e62-4128-b4e4-f7ade713b9ad', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 826531940}}} Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:826531940. Valid TCP ports should be between 1-65535 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:826531940. Valid TCP ports should be between 1-65535 Oct 31 15:43:02.425567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:826531940. Valid TCP ports should be between 1-65535 Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcf57af4-ba95-4026-aefe-8f2f61a56ad2 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 400 to user: Invalid port range 22:826531940. Valid TCP ports should be between 1-65535 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:02.430125 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dcf57af4-ba95-4026-aefe-8f2f61a56ad2 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.392066 Oct 31 15:43:02.433567 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2477/5076] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:43:02 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:43:02.441918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Action: 'create', calling method: .version_select at 0x7f5ca66b6a60>, body: {"security_group_rule": {"parent_group_id": "79a3c043-4896-4196-90d7-f42e66640668", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:02.666789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:02.667420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:02.686679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:02.687202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:02.687656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:02.688664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:02.691329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:02.693340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:02.698330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:02.824605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:43:02.825711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Neutron security group 79a3c043-4896-4196-90d7-f42e66640668 not found {{(pid=120625) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:43:02.826472 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.826472 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 138 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: {"security_group_rule": {"parent_group_id": "79a3c043-4896-4196-90d7-f42e66640668", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'security_group_rule': {'parent_group_id': '79a3c043-4896-4196-90d7-f42e66640668', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:43:02.829027 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] Oct 31 15:43:02.832266 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:02.836985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 404 to user: Security group 79a3c043-4896-4196-90d7-f42e66640668 does not exist Oct 31 15:43:02.836985 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-2b812c48-aca7-4a16-9451-98b5753e2625'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:02.838123 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e82905fb-feec-45b5-a2e1-a092be2561be tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.403978 Oct 31 15:43:02.839799 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2600/5077] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Oct 31 15:43:02 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:43:02.850878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca22af820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:02.983772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:03.001217 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4692891-dc1b-42b2-a356-cb3e99ac6afa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1266 microversion: 2.1 time: 0.336195 Oct 31 15:43:03.006364 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2478/5078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:02 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:03.210377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG neutronclient.v2_0.client [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist", "detail": ""}} {{(pid=120625) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:43:03.211055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.security_group_api [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Neutron security group rule 71a23544-4122-4520-89ce-5957bce9d75c not found {{(pid=120625) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 31 15:43:03.212280 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] HTTP exception thrown: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.212280 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Request method failure captured: Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-security-group-rules/71a23544-4122-4520-89ce-5957bce9d75c HTTP/1.1 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-z9248ILyMcpz3DDbfkeiA9BCnFu8rEbNkzL9JPDWoLssOl7lATsCqed0wny6VV1XOvM8pFI8uLvwkPQGsKZLG3ldNr6yYA-Q8JWj66v1Ms-qI5Gf2QoW68p7XsBnuGulPDVDTHK7fbcYSb2RVEy3F9J_cokHbmdZzZVqf3JkqHQYM Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc379c3665ee47a09e6d1c6ce91606ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: bc379c3665ee47a09e6d1c6ce91606ca Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: cbced0d38035465bb950c62a096a7ce7 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-401343203-project Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: method: Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: exception: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '71a23544-4122-4520-89ce-5957bce9d75c'} Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:43:03.217008 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] Oct 31 15:43:03.220944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:43:03.225459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Returning 404 to user: Security group rule 71a23544-4122-4520-89ce-5957bce9d75c does not exist Oct 31 15:43:03.225459 n-d-858383-17 devstack@n-api.service[120625]: Neutron server returns request_ids: ['req-877f744b-b212-40b3-b347-1b9152a5c850'] {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:03.225459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-094b096f-d032-4cc9-b08c-5c481b9b9b49 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/71a23544-4122-4520-89ce-5957bce9d75c" status: 404 len: 199 microversion: 2.1 time: 0.377460 Oct 31 15:43:03.225982 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2601/5079] 10.222.0.48 () {58 vars in 1287 bytes} [Mon Oct 31 15:43:02 2022] DELETE /compute/v2.1/os-security-group-rules/71a23544-4122-4520-89ce-5957bce9d75c => generated 199 bytes in 380 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:43:03.236633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9554dbfd-68b2-40dc-b062-415a58922c0a tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca24250d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:04.036566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:04.037470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:04.047229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:04.048835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:04.049693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:04.051373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:04.052035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:04.052539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:04.341062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:04.354506 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57ff4ede-8c1f-42c4-b92b-feae18799c41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1266 microversion: 2.1 time: 0.327261 Oct 31 15:43:04.354748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2602/5080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:04 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:04.693804 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9554dbfd-68b2-40dc-b062-415a58922c0a tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f526666f-5e62-4128-b4e4-f7ade713b9ad" status: 202 len: 0 microversion: 2.1 time: 1.462551 Oct 31 15:43:04.694395 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2479/5081] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:43:03 2022] DELETE /compute/v2.1/os-security-groups/f526666f-5e62-4128-b4e4-f7ade713b9ad => generated 0 bytes in 1464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:04.703225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90e7a64d-3e00-48dd-a803-5f5b7588a34a tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca15dd430>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:05.383931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:05.388831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:05.406998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.410875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.411542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:05.412400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.414920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.415479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:06.160523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:06.178028 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a48ace74-f164-4de2-bed0-64b477fac6fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 0.796983 Oct 31 15:43:06.199290 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2480/5082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:05 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:06.813605 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-90e7a64d-3e00-48dd-a803-5f5b7588a34a tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/2abdb636-8d8c-4d9c-b567-cc3ae60577c5" status: 202 len: 0 microversion: 2.1 time: 2.114681 Oct 31 15:43:06.814402 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2603/5083] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:43:04 2022] DELETE /compute/v2.1/os-security-groups/2abdb636-8d8c-4d9c-b567-cc3ae60577c5 => generated 0 bytes in 2116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:06.825115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32f078d9-b926-4e29-843b-d5815cb47bb1 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca6749280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:07.225195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:07.226730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:07.252441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.257726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.261362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.266336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.271228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.272549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:08.103374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:08.170146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:08.619691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:09.101075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:09.123726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a699086-7f7b-41a8-8d23-7021fec47823 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 1.903461 Oct 31 15:43:09.150118 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2604/5084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:07 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:09.420376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32f078d9-b926-4e29-843b-d5815cb47bb1 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/32de0bfa-3e69-4df0-af39-719b19a0241f" status: 202 len: 0 microversion: 2.1 time: 2.600588 Oct 31 15:43:09.421620 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2481/5085] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:43:06 2022] DELETE /compute/v2.1/os-security-groups/32de0bfa-3e69-4df0-af39-719b19a0241f => generated 0 bytes in 2603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:09.430348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf1caf02-96a1-48b3-a630-2d3140fd5bfc tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca2b4aca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.003600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d37d5516-65e9-42b9-8f46-090b961dcdb1 req-09228821-7704-4e86-ac65-78c5f4639a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85692a51-2e30-4793-8a0e-3c67e278bd30", "tag": "d036a3b0-433b-4e5a-886e-104672b3d2e3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:10.031544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d37d5516-65e9-42b9-8f46-090b961dcdb1 req-09228821-7704-4e86-ac65-78c5f4639a37 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.034113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d37d5516-65e9-42b9-8f46-090b961dcdb1 req-09228821-7704-4e86-ac65-78c5f4639a37 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.036013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d37d5516-65e9-42b9-8f46-090b961dcdb1 req-09228821-7704-4e86-ac65-78c5f4639a37 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.052465 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d37d5516-65e9-42b9-8f46-090b961dcdb1 req-09228821-7704-4e86-ac65-78c5f4639a37 service nova] Creating event network-changed:d036a3b0-433b-4e5a-886e-104672b3d2e3 for instance 85692a51-2e30-4793-8a0e-3c67e278bd30 on n-h1-858383-17 Oct 31 15:43:10.058904 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d37d5516-65e9-42b9-8f46-090b961dcdb1 req-09228821-7704-4e86-ac65-78c5f4639a37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062078 Oct 31 15:43:10.060475 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2482/5086] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:10.153794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.155286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:10.172032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.173237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.175136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.177765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.178479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.180092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.383753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf1caf02-96a1-48b3-a630-2d3140fd5bfc tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/1f610e68-8f68-4141-be74-abac9a10fd32" status: 202 len: 0 microversion: 2.1 time: 0.957913 Oct 31 15:43:10.385934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2605/5087] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:43:09 2022] DELETE /compute/v2.1/os-security-groups/1f610e68-8f68-4141-be74-abac9a10fd32 => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:10.398748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-274ccb12-c948-4796-ba62-aeb3564668e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] Calling method '.version_select at 0x7f5ca24575e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.713003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:10.726121 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f18e8fe5-c5ab-49a3-8407-0302c95821f9 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 0.578480 Oct 31 15:43:10.726738 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2483/5088] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:11.468459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-274ccb12-c948-4796-ba62-aeb3564668e7 tempest-SecurityGroupRulesNegativeTestJSON-401343203 tempest-SecurityGroupRulesNegativeTestJSON-401343203-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/077a6e8b-0ad6-47ca-a0bf-249a27e3dce7" status: 202 len: 0 microversion: 2.1 time: 1.078245 Oct 31 15:43:11.469749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2606/5089] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 15:43:10 2022] DELETE /compute/v2.1/os-security-groups/077a6e8b-0ad6-47ca-a0bf-249a27e3dce7 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:11.754031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:11.754654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:11.771238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.775414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.778139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.785544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.788007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.790605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:12.536390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:12.551823 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64e8b9cb-5e37-42d5-9e5b-8ab4f453d326 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 0.795049 Oct 31 15:43:12.552994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2484/5090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:11 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:13.595863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:13.597260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:13.615684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.617650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.618838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.621829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.624303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.628003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:14.562422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:14.586009 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-357767b5-bad5-43a3-98f7-afe12e828fb4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 1.003806 Oct 31 15:43:14.590700 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2607/5091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:13 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:15.615155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:15.616651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:15.650583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:15.651096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:15.651756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:15.653767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:15.661889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:15.663345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:16.067159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:16.084182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0dc7fae5-7ea0-4b37-abdc-8b6bb73d961d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 0.473488 Oct 31 15:43:16.087424 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2485/5092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:15 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:17.111777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:17.113034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:17.122375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:17.137001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:17.138317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:17.139063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:17.141415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:17.142772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:17.144217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:17.796655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:17.806934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=74 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:17.814807 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-902837b4-6d6b-4b57-be16-11dc770b8bc1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 0.710065 Oct 31 15:43:17.817210 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2608/5093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:17 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:17.868063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:17.868589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:17.873486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:17.877557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:17.884144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:17.884845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:17.885765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:17.886395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:17.896914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:17.977727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:43:18.187166 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9e96d91-45c1-4cdf-a09a-f03dc2e838c3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 204 len: 0 microversion: 2.1 time: 0.322672 Oct 31 15:43:18.190646 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2486/5094] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:43:17 2022] DELETE /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:43:18.204666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:18.209832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:18.238012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.238935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.247409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:18.248426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.249107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.249702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:18.635949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8c883b3c-a547-45fc-9de3-9e86b09c45f7 req-1caaa61a-2bb8-4c62-9ae2-9a32c460fc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a482551-a14a-43cd-ac40-24c69454f476", "tag": "d3969917-bfa1-441c-89d4-30b2a2f569ef"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:18.658937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8c883b3c-a547-45fc-9de3-9e86b09c45f7 req-1caaa61a-2bb8-4c62-9ae2-9a32c460fc1d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.659755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8c883b3c-a547-45fc-9de3-9e86b09c45f7 req-1caaa61a-2bb8-4c62-9ae2-9a32c460fc1d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.659858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8c883b3c-a547-45fc-9de3-9e86b09c45f7 req-1caaa61a-2bb8-4c62-9ae2-9a32c460fc1d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:18.733230 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8c883b3c-a547-45fc-9de3-9e86b09c45f7 req-1caaa61a-2bb8-4c62-9ae2-9a32c460fc1d service nova] Creating event network-changed:d3969917-bfa1-441c-89d4-30b2a2f569ef for instance 1a482551-a14a-43cd-ac40-24c69454f476 on n-h1-858383-17 Oct 31 15:43:18.744276 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8c883b3c-a547-45fc-9de3-9e86b09c45f7 req-1caaa61a-2bb8-4c62-9ae2-9a32c460fc1d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.853156 Oct 31 15:43:18.745441 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2609/5095] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:18.843106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:18.847013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:18.883420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.884881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.885589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:18.887758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.888248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.888978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:19.898121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:19.908257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78cfea35-6722-4628-bc42-e9a3536d079b tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1767 microversion: 2.1 time: 1.713752 Oct 31 15:43:19.925586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2487/5096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:18 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1767 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:20.271367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0a8d129c-f48e-445e-b200-c47fa9a65e6a req-cfee4523-464a-4b3f-9d4b-909b8ffdc2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85692a51-2e30-4793-8a0e-3c67e278bd30", "name": "network-vif-plugged", "status": "completed", "tag": "d036a3b0-433b-4e5a-886e-104672b3d2e3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:20.287775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a8d129c-f48e-445e-b200-c47fa9a65e6a req-cfee4523-464a-4b3f-9d4b-909b8ffdc2a3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:20.288278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a8d129c-f48e-445e-b200-c47fa9a65e6a req-cfee4523-464a-4b3f-9d4b-909b8ffdc2a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:20.294142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a8d129c-f48e-445e-b200-c47fa9a65e6a req-cfee4523-464a-4b3f-9d4b-909b8ffdc2a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:20.335182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0a8d129c-f48e-445e-b200-c47fa9a65e6a req-cfee4523-464a-4b3f-9d4b-909b8ffdc2a3 service nova] Creating event network-vif-plugged:d036a3b0-433b-4e5a-886e-104672b3d2e3 for instance 85692a51-2e30-4793-8a0e-3c67e278bd30 on n-h1-858383-17 Oct 31 15:43:20.348292 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0a8d129c-f48e-445e-b200-c47fa9a65e6a req-cfee4523-464a-4b3f-9d4b-909b8ffdc2a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081506 Oct 31 15:43:20.349730 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2488/5097] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:20.965475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:20.969234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:20.989544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:20.997006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:21.003037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:21.005866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:21.008228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:21.009983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:21.037653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:21.076656 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24ac4c13-14f4-46f7-9991-82ae6e23ba78 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 2.238873 Oct 31 15:43:21.083312 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2610/5098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:18 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:22.116624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:22.119985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:22.160652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.161274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.162734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.166805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.168879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.175433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.327258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:22.343720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-86e4f96a-f9f6-4a79-92ff-6a5096136fb3 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1767 microversion: 2.1 time: 1.395024 Oct 31 15:43:22.345418 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2489/5099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:20 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1767 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:23.366550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:23.371982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:23.372616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:23.378091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3862f873-4a4d-4f4e-b98f-e588e9ba0a53 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1308 microversion: 2.1 time: 1.275182 Oct 31 15:43:23.378748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2611/5100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:22 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1308 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:23.402926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:23.403481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:23.403943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:23.406482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:23.406962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:23.407407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:24.411663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:24.422356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:24.459648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:24.460270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:24.462150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:24.462481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:24.463291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:24.463770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:24.464812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:24.475224 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da199048-ccde-4ca7-b10f-14f69db8b368 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1767 microversion: 2.1 time: 1.107647 Oct 31 15:43:24.475832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2490/5101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:23 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1767 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:25.054576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-41ba3a65-6313-471f-b8a4-7d992f473c5d req-3085de20-6f9f-455a-80e5-114ea483af2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a482551-a14a-43cd-ac40-24c69454f476", "name": "network-vif-deleted", "tag": "d3969917-bfa1-441c-89d4-30b2a2f569ef"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:25.099298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-41ba3a65-6313-471f-b8a4-7d992f473c5d req-3085de20-6f9f-455a-80e5-114ea483af2f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.099808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-41ba3a65-6313-471f-b8a4-7d992f473c5d req-3085de20-6f9f-455a-80e5-114ea483af2f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.100247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-41ba3a65-6313-471f-b8a4-7d992f473c5d req-3085de20-6f9f-455a-80e5-114ea483af2f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.171324 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-41ba3a65-6313-471f-b8a4-7d992f473c5d req-3085de20-6f9f-455a-80e5-114ea483af2f service nova] Creating event network-vif-deleted:d3969917-bfa1-441c-89d4-30b2a2f569ef for instance 1a482551-a14a-43cd-ac40-24c69454f476 on n-h1-858383-17 Oct 31 15:43:25.196437 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-41ba3a65-6313-471f-b8a4-7d992f473c5d req-3085de20-6f9f-455a-80e5-114ea483af2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145821 Oct 31 15:43:25.202437 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2491/5102] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:25.323168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:25.382245 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59cb82af-2f0d-4327-9c6d-6e5fc05dd460 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1490 microversion: 2.1 time: 0.979146 Oct 31 15:43:25.384003 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2612/5103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:24 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1490 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:25.411832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:25.415264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:25.439484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.440001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.440452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.443267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.443755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.444189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.501693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:25.502937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:25.542264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.543412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.553151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.557194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.557768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.563471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.662136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.663439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.665402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.668732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lazy-loading 'fault' on Instance uuid 1a482551-a14a-43cd-ac40-24c69454f476 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:43:25.750504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2019a605-a90f-46f3-a9d0-da0e8c0f9557 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "PUT /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1085 microversion: 2.1 time: 0.343462 Oct 31 15:43:25.764838 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2492/5104] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:43:25 2022] PUT /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1085 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:25.774898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:25.775505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:25.801725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.802359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.802659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.803372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.803832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.804254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.865761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc2e142832e421a912ebebe7df682e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f880fdbef7204abdb6d1fcb972535754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:25.914634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8024963-a57e-4775-9221-efcf9a053730 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 200 len: 1385 microversion: 2.1 time: 0.404219 Oct 31 15:43:25.915328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2613/5105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:25 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 1385 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:26.441825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:26.456751 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ef1d35b-e236-4978-9623-611e180a7fe6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1511 microversion: 2.1 time: 0.683565 Oct 31 15:43:26.458913 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2493/5106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:25 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:26.481262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:26.482139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:26.494318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:26.495088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:26.496586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:26.501741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:26.503016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:26.503656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:26.941234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:26.941859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] [instance: 1a482551-a14a-43cd-ac40-24c69454f476] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:26.955664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:26.956226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:26.966304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:26.967130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:26.967634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:26.968083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:27.011879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] HTTP exception thrown: Instance 1a482551-a14a-43cd-ac40-24c69454f476 could not be found. Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Request method failure captured: Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 HTTP/1.1 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-xAKLxbxMG4Y9xp2X0dkXo-C4WTh1ZI6bnfz8tESNKxajwYOOJtmaqV4ZY3bdFRzBsr-0TXmSg986sI15IenX8lqs9CSWd5nnIWC0QjwxfP53Fd79DSOYriI4CK9ZbZq9rFQjSdRnQgnq4zC-I6DjQiDmlWKr0ryi1FaQUSIAeh_vE Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: f880fdbef7204abdb6d1fcb972535754 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1996851298 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f880fdbef7204abdb6d1fcb972535754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1996851298 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: f880fdbef7204abdb6d1fcb972535754 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1996851298 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestSecurityGroupsBasicOps-1996851298-project Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 4cc2e142832e421a912ebebe7df682e6 Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1996851298-project Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1a482551-a14a-43cd-ac40-24c69454f476 could not be found. Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1a482551-a14a-43cd-ac40-24c69454f476'} Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a482551-a14a-43cd-ac40-24c69454f476 could not be found. Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a482551-a14a-43cd-ac40-24c69454f476 could not be found. Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:27.013796 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a482551-a14a-43cd-ac40-24c69454f476 could not be found. Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Returning 404 to user: Instance 1a482551-a14a-43cd-ac40-24c69454f476 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-230e7e71-08ff-4f97-8feb-b6e4bb637419 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476" status: 404 len: 111 microversion: 2.1 time: 0.078905 Oct 31 15:43:27.018153 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2494/5107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:26 2022] GET /compute/v2.1/servers/1a482551-a14a-43cd-ac40-24c69454f476 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:43:27.406381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:27.417868 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea497927-8ca1-418c-9d2c-ad0e24723ad7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1511 microversion: 2.1 time: 0.940965 Oct 31 15:43:27.422467 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2614/5108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:26 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1511 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:27.450735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:27.451261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:27.496778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:27.499367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:27.499982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:27.507590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:27.507590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:27.507590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:27.603523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:43:27.775353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:27.894350 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9663544-4e2c-465c-acb4-6b0d5e163004 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 204 len: 0 microversion: 2.1 time: 0.450139 Oct 31 15:43:27.907573 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2495/5109] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:43:27 2022] DELETE /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:43:27.921841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:27.922632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:27.938847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:27.939346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:27.939792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:27.946865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:27.957628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:27.958350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:28.610291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:28.635630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:28.636371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:28.646812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:28.647735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:28.655947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:28.656412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:28.752046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:28.815264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ab9dac7-2cab-49d7-acc3-22bebfad18fc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1517 microversion: 2.1 time: 0.903217 Oct 31 15:43:28.817163 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2615/5110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:27 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1517 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:28.894096 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-88350c3a-b958-451d-a918-e4b8e51215f1 tempest-AZV2TestJSON-1602626827 tempest-AZV2TestJSON-1602626827-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.640728 Oct 31 15:43:28.907717 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2496/5111] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Oct 31 15:43:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:43:29.847469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:29.848372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:29.884863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:29.893718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:29.901166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:29.903529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:29.906353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:29.914181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:30.578352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:30.591298 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19a3734f-dcb5-45eb-945a-19e8cc34bccf tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1517 microversion: 2.1 time: 0.750061 Oct 31 15:43:30.593788 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2616/5112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:29 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1517 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:31.486410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-16b3fdb2-4056-4deb-9f98-24901a06f7a3 req-6dae6598-b1d3-4a20-98e8-0a82e935b748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85692a51-2e30-4793-8a0e-3c67e278bd30", "name": "network-vif-deleted", "tag": "d036a3b0-433b-4e5a-886e-104672b3d2e3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:31.551439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-16b3fdb2-4056-4deb-9f98-24901a06f7a3 req-6dae6598-b1d3-4a20-98e8-0a82e935b748 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.553308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-16b3fdb2-4056-4deb-9f98-24901a06f7a3 req-6dae6598-b1d3-4a20-98e8-0a82e935b748 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.556976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-16b3fdb2-4056-4deb-9f98-24901a06f7a3 req-6dae6598-b1d3-4a20-98e8-0a82e935b748 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.621394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:31.622226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:31.626223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-16b3fdb2-4056-4deb-9f98-24901a06f7a3 req-6dae6598-b1d3-4a20-98e8-0a82e935b748 service nova] Creating event network-vif-deleted:d036a3b0-433b-4e5a-886e-104672b3d2e3 for instance 85692a51-2e30-4793-8a0e-3c67e278bd30 on n-h1-858383-17 Oct 31 15:43:31.647960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.660356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.663390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.664478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.665742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.666799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.673118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-16b3fdb2-4056-4deb-9f98-24901a06f7a3 req-6dae6598-b1d3-4a20-98e8-0a82e935b748 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195227 Oct 31 15:43:31.675871 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2497/5113] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:31.844595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.846367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.849414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.850565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lazy-loading 'fault' on Instance uuid 85692a51-2e30-4793-8a0e-3c67e278bd30 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:43:31.985009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:32.011778 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b61d7ca8-fc52-478d-91b4-0ad75db4bd18 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 200 len: 1319 microversion: 2.1 time: 0.394704 Oct 31 15:43:32.012392 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2617/5114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:31 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:33.042814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:33.043516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:33.053003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:33.053587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:33.053912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:33.054620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:33.055077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:33.055499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:33.107321 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 HTTP/1.1 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '85692a51-2e30-4793-8a0e-3c67e278bd30'} Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:33.113746 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a403ee99-046c-4b87-a0ea-3e75062413d8 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 404 len: 111 microversion: 2.1 time: 0.077035 Oct 31 15:43:33.118310 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2498/5115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:33 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:43:33.436870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-105917263", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "90346750-9802-4c70-9bb8-9af34a1c5986"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:33.578136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] validate_networks() for [('90346750-9802-4c70-9bb8-9af34a1c5986', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:43:36.163020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:43:36.163566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:43:36.163954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:43:36.164417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:43:36.165058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:43:36.188352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:36.192725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:36.193388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:36.195881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:36.199821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:36.201378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:36.254764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:43:36.268262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Getting quotas for user 60a8ec9af56f4bd4a79c291163e34215 and project aa8a40766a2c4ccd82422d621124597e. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:43:36.301333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:43:36.306308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:43:36.465223 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6699719f-2912-4221-9ee9-7eb15e7ff0e1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.031863 Oct 31 15:43:36.468351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2618/5116] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:43:36.479173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-74bf54ef-0b34-47c1-a362-a467b95ec7b5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:36.479643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-74bf54ef-0b34-47c1-a362-a467b95ec7b5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:37.339146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-74bf54ef-0b34-47c1-a362-a467b95ec7b5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:37.377411 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-74bf54ef-0b34-47c1-a362-a467b95ec7b5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1208 microversion: 2.1 time: 0.900452 Oct 31 15:43:37.378309 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2499/5117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:36 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1208 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:38.405215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:38.405841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:38.424987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.425734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.426367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.429893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.430570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.431215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.799949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:38.819593 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dea48bd9-fe02-4c47-b630-03b18464db74 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1268 microversion: 2.1 time: 0.420252 Oct 31 15:43:38.820677 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2619/5118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:38 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1268 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:39.850356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:39.851534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:39.871539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:39.876114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:39.876627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:39.882137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:39.882901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:39.883554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:39.884149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.270788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b7c64cb5-e0dc-4ccb-8f36-3b0be640be35 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] Calling method '.version_select at 0x7f5ca2448160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:40.317216 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b7c64cb5-e0dc-4ccb-8f36-3b0be640be35 tempest-TestSecurityGroupsBasicOps-1996851298 tempest-TestSecurityGroupsBasicOps-1996851298-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1912177738" status: 202 len: 0 microversion: 2.1 time: 0.050848 Oct 31 15:43:40.317824 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2620/5119] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Oct 31 15:43:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1912177738 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:43:41.634022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:41.644471 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e5651e6-236e-4a48-9aaf-f19a1167a62c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.799439 Oct 31 15:43:41.649314 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2500/5120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:39 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:42.687327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:42.688590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:42.706035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:42.706534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:42.709898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:42.713187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:42.714144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:42.717914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:44.445319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:44.486392 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f18aa35-bbce-490d-a789-7f3fa85264b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.805354 Oct 31 15:43:44.487469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2621/5121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:42 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:45.514704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:45.515325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:45.566270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:45.567236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:45.567842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:45.570070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:45.571048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:45.571651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:47.344223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:47.356057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:47.371914 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b4c14ee-de2b-476a-8f0d-f03203685ba4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.862729 Oct 31 15:43:47.372999 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2501/5122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:45 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:48.141166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-67ae3a7c-75b0-4cfe-aa99-9d3c75c9d8f5 req-8c957020-be20-4553-9dae-63de41b9d899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923d66b7-09dd-42c2-bf63-f70789977867", "tag": "58d9a137-36ca-4401-941b-0be272aeb688"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:48.155295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:48.156391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:48.157327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:48.169430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-67ae3a7c-75b0-4cfe-aa99-9d3c75c9d8f5 req-8c957020-be20-4553-9dae-63de41b9d899 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:48.171537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-67ae3a7c-75b0-4cfe-aa99-9d3c75c9d8f5 req-8c957020-be20-4553-9dae-63de41b9d899 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:48.172260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-67ae3a7c-75b0-4cfe-aa99-9d3c75c9d8f5 req-8c957020-be20-4553-9dae-63de41b9d899 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:48.188617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=70 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:48.226911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-67ae3a7c-75b0-4cfe-aa99-9d3c75c9d8f5 req-8c957020-be20-4553-9dae-63de41b9d899 service nova] Creating event network-changed:58d9a137-36ca-4401-941b-0be272aeb688 for instance 923d66b7-09dd-42c2-bf63-f70789977867 on n-h1-858383-17 Oct 31 15:43:48.234027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-67ae3a7c-75b0-4cfe-aa99-9d3c75c9d8f5 req-8c957020-be20-4553-9dae-63de41b9d899 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097844 Oct 31 15:43:48.235261 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2622/5123] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:48.405550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:48.406836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:48.409789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:48.425626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:48.426487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:48.427198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:48.428140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:48.428841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:48.429472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.055025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:49.071931 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f6026f02-7789-4129-a4ef-4a58597f4e7d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 0.663607 Oct 31 15:43:49.076585 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2502/5124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:48 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:50.134552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:50.149521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:50.163664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:50.167076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:50.168476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:50.169612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:50.170392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:50.171059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:50.989928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:50.999084 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64291f00-83b1-418c-b9aa-b0a690feef66 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 0.895210 Oct 31 15:43:51.007112 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2623/5125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:50 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:52.034871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:52.035500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:52.050262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:52.050774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:52.051225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:52.051962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:52.052429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:52.052929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:53.600925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:53.613936 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-873bb20a-2f7c-460d-95d6-a6df1e5916fb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.583296 Oct 31 15:43:53.630012 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2503/5126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:52 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:54.641994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:54.642609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:54.664396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:54.666339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:54.666788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:54.670852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:54.671345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:54.671785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:55.751738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1561221446", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a2a6cac4-59e3-423f-9f84-b122580ca177"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:55.864980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] validate_networks() for [('a2a6cac4-59e3-423f-9f84-b122580ca177', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:43:55.906008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:55.937197 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e7f2094-0979-4487-8a90-cb8d543fce59 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.297452 Oct 31 15:43:55.937815 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2624/5127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:54 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:56.967532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:56.969307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:56.986249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:56.987252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:56.990487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:56.992602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:56.995409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:56.998186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:57.904211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:43:57.907532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:43:57.908341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:43:57.909154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:43:57.909884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:43:57.927824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:57.930505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:57.931320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:57.932943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:57.948685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:57.949565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:57.974502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:58.023879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Getting quotas for project f431fc3405d6487f8d72618d22fa8d61. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:43:58.038079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Getting quotas for user 787d8cd6efe24a1b809b5932c6e46b69 and project f431fc3405d6487f8d72618d22fa8d61. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:43:58.092529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Going to run 2 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:43:58.102539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: 023ef4b6-8995-42ce-af2b-e57131081e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:43:58.173498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=023ef4b6-8995-42ce-af2b-e57131081e22,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:43:58.255124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:58.270730 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ae4c826-2df9-4833-ae71-5ccb08e957da tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.307192 Oct 31 15:43:58.276858 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2625/5128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:56 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:58.321605 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a9b7939-67b5-46c3-9da1-efac6362ee64 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.406368 Oct 31 15:43:58.324651 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2504/5129] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:43:58.335690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:58.346213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:58.347285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Searching by: {'deleted': False, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:43:58.375016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:58.375778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:58.376980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:58.377905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:58.378524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:58.380161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:58.426988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3dd46697-709b-477b-ac52-d9fa84274cdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.092518 Oct 31 15:43:58.427874 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2626/5130] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:43:58 2022] GET /compute/v2.1/servers => generated 677 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:58.441103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90940ce6-7d31-4ad9-8fcd-5281813524ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:58.441885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90940ce6-7d31-4ad9-8fcd-5281813524ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:59.254537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90940ce6-7d31-4ad9-8fcd-5281813524ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:59.263266 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90940ce6-7d31-4ad9-8fcd-5281813524ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1220 microversion: 2.1 time: 0.826821 Oct 31 15:43:59.267774 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2505/5131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:58 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1220 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:59.300682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:59.301300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:59.313819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:59.314179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:59.318009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:59.318884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:59.320659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:59.321265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:59.968551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:59.983358 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33503146-c27a-4089-8b60-a736b995f7d1 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 0.688138 Oct 31 15:43:59.986315 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2627/5132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:59 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:00.293220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:00.294007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:00.311198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:00.312314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:00.313506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:00.316182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:00.317691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:00.319862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:00.706993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:00.739182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-36ba7c78-2efa-4117-94c0-dc99e13af390 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1224 microversion: 2.1 time: 0.449804 Oct 31 15:44:00.761409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2506/5133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:00 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1224 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:01.021027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:01.024216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:01.052269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:01.058713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:01.061550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:01.065157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:01.070044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:01.075660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:01.765762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ddf8b2ea-26da-45ae-9772-2c13f59af86d req-f643b88e-856c-4b4d-8957-a170d69665a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d66b7-09dd-42c2-bf63-f70789977867", "name": "network-vif-plugged", "status": "completed", "tag": "58d9a137-36ca-4401-941b-0be272aeb688"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:01.828853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ddf8b2ea-26da-45ae-9772-2c13f59af86d req-f643b88e-856c-4b4d-8957-a170d69665a7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:01.829254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ddf8b2ea-26da-45ae-9772-2c13f59af86d req-f643b88e-856c-4b4d-8957-a170d69665a7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:01.833432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ddf8b2ea-26da-45ae-9772-2c13f59af86d req-f643b88e-856c-4b4d-8957-a170d69665a7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:01.893154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ddf8b2ea-26da-45ae-9772-2c13f59af86d req-f643b88e-856c-4b4d-8957-a170d69665a7 service nova] Creating event network-vif-plugged:58d9a137-36ca-4401-941b-0be272aeb688 for instance 923d66b7-09dd-42c2-bf63-f70789977867 on n-h1-858383-17 Oct 31 15:44:01.904855 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ddf8b2ea-26da-45ae-9772-2c13f59af86d req-f643b88e-856c-4b4d-8957-a170d69665a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143248 Oct 31 15:44:01.910494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2507/5134] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:01.926583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:01.931938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:01.959039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:01.960458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:01.963872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:01.969931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:01.970757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:01.972523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:02.504281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:02.518915 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7c17ad3-d87d-4b73-8ee8-87f91b851aee tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1280 microversion: 2.1 time: 0.605056 Oct 31 15:44:02.535682 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2508/5135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:01 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1280 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:02.626552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:02.641341 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d7f1c04-6a14-415a-9b31-603edb1e118f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 1.631890 Oct 31 15:44:02.643622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2628/5136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:01 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:03.548402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:03.549266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:03.583614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:03.584114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:03.584566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:03.586597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:03.588983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:03.590287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:03.669678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:03.670384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:03.693773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:03.696158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:03.696980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:03.711930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:03.714298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:03.721560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:03.954373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:03.970812 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-70289690-1f5d-4795-9319-39e4d2e920a6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1278 microversion: 2.1 time: 0.424957 Oct 31 15:44:03.973654 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2509/5137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:03 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:04.651895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:04.660250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-281271d0-d7fd-4e5d-a3b5-02ee0a4a8ad6 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1308 microversion: 2.1 time: 0.995383 Oct 31 15:44:04.701064 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2629/5138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:03 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1308 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:05.000871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:05.002474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:05.022651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:05.023163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:05.023611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:05.025683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:05.026160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:05.026601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:05.715467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:05.716082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:05.726474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:05.731564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:05.732441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:05.733866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:05.734799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:05.735395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:05.840063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:05.852588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8a25589a-661f-4226-914b-f32c690fb714 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1278 microversion: 2.1 time: 0.855816 Oct 31 15:44:05.855336 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2510/5139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:04 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1278 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:06.710132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:06.724368 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38695578-9d80-40e0-b28b-411421360777 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1490 microversion: 2.1 time: 1.013638 Oct 31 15:44:06.741946 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2630/5140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:05 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1490 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:06.761963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-197114129"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:06.767488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:06.783819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:06.786538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:06.787257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:06.788090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:06.791299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:06.791943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:06.883509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:06.884190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:06.898493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:06.898996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:06.899440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:06.900207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:06.909493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:06.910210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:06.943065 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-007bffed-ae70-499f-a60b-47d4e0b047df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "PUT /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1075 microversion: 2.1 time: 0.191092 Oct 31 15:44:06.956741 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2511/5141] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:44:06 2022] PUT /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1075 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:06.970449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:06.971897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:06.982668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:06.983303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:06.983763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:06.984524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:06.985024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:06.985517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:07.041605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:07.050337 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6cdd528d-b450-49df-8175-3cd484569bd6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1278 microversion: 2.1 time: 0.170683 Oct 31 15:44:07.069747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2631/5142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:06 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:07.873381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:07.897449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f38b6d34-c905-4897-9e94-34e56ee096db tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1501 microversion: 2.1 time: 0.934810 Oct 31 15:44:07.902799 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2512/5143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:06 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1501 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:07.926432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:07.927049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:07.941001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:07.941765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:07.945848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:07.947078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:07.948465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:07.949400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:08.091287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:08.093185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:08.100563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:08.104726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:08.105474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:08.106229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:08.107328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:08.107943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:08.109983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:08.388969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:08.407824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:08.420951 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ab7fdfe-1097-48f7-8144-cb44996ee320 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1278 microversion: 2.1 time: 0.335601 Oct 31 15:44:08.434328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2513/5144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:08 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1278 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:08.699069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:08.712145 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5375e70-6514-4d49-b977-af8ad7445432 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1501 microversion: 2.1 time: 0.789774 Oct 31 15:44:08.714056 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2632/5145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:07 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1501 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:08.735967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4172d201-fa3b-4f87-b003-830723f7245f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:08.742905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4172d201-fa3b-4f87-b003-830723f7245f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:08.744537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4172d201-fa3b-4f87-b003-830723f7245f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:08.745261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4172d201-fa3b-4f87-b003-830723f7245f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:08.777913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4172d201-fa3b-4f87-b003-830723f7245f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Going to try to stop instance {{(pid=120626) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:44:08.836794 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4172d201-fa3b-4f87-b003-830723f7245f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "POST /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867/action" status: 202 len: 0 microversion: 2.1 time: 0.104457 Oct 31 15:44:08.847538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:08.848560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:08.853290 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2514/5146] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:44:08 2022] POST /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:44:08.856997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:08.857900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:08.859246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:08.860295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:08.861163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:08.861822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:09.451163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:09.455483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:09.456301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:09.473986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:09.474484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:09.474926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:09.475645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:09.476133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:09.477194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:09.826444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:09.842179 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f4be669d-32b2-43b7-8f6c-b2dee3414060 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.998909 Oct 31 15:44:09.842786 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2633/5147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:08 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:10.468778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:10.482858 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6518ec6-77d2-4c86-a12d-e0b4e51bde07 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 1.032573 Oct 31 15:44:10.485367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2515/5148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:09 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:10.870685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:10.871435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:10.886243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:10.886803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:10.887682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:10.888415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:10.889248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:10.889686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:11.277561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:11.289150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ebad3b7-760b-4238-b0b9-967de646ba40 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.421532 Oct 31 15:44:11.307865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2634/5149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:10 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:11.375729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-593bf60b-e5b0-46d2-9718-2303b77e0305 req-23315be3-d54e-415b-8d9a-a9a04c6db07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023ef4b6-8995-42ce-af2b-e57131081e22", "tag": "698ec526-b53d-4bd1-a3db-3a473be72d29"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:11.398240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-593bf60b-e5b0-46d2-9718-2303b77e0305 req-23315be3-d54e-415b-8d9a-a9a04c6db07e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:11.401433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-593bf60b-e5b0-46d2-9718-2303b77e0305 req-23315be3-d54e-415b-8d9a-a9a04c6db07e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:11.402162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-593bf60b-e5b0-46d2-9718-2303b77e0305 req-23315be3-d54e-415b-8d9a-a9a04c6db07e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:11.451822 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-593bf60b-e5b0-46d2-9718-2303b77e0305 req-23315be3-d54e-415b-8d9a-a9a04c6db07e service nova] Creating event network-changed:698ec526-b53d-4bd1-a3db-3a473be72d29 for instance 023ef4b6-8995-42ce-af2b-e57131081e22 on n-h2-858383-17 Oct 31 15:44:11.467989 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-593bf60b-e5b0-46d2-9718-2303b77e0305 req-23315be3-d54e-415b-8d9a-a9a04c6db07e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097966 Oct 31 15:44:11.472100 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2516/5150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:11.507862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.508884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:11.519100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:11.520661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:11.522870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:11.523791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:11.529414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:11.530098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:12.212033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:12.223913 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4579f53b-15d4-47df-9b58-2bd729e4a986 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.717951 Oct 31 15:44:12.229662 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2635/5151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:12.313906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.314626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:12.332646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:12.333454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:12.334075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:12.335019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:12.335657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:12.336244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:13.251777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:13.256080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:13.256727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:13.279681 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78b45868-1002-4553-831d-48994edf6ba7 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.969747 Oct 31 15:44:13.280320 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2517/5152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:13.299122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:13.299807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:13.300730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:13.304226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:13.305138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:13.306321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:13.504027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-66f778ae-e358-4cc0-ab34-3082f0ac9632 req-8ea12029-fa7a-4eea-afe3-01fb06868c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4fe529-8581-4ce7-b823-999f85d39db1", "tag": "34414c2c-fb25-4fe0-91c6-7f69b5cebbb0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:13.531344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66f778ae-e358-4cc0-ab34-3082f0ac9632 req-8ea12029-fa7a-4eea-afe3-01fb06868c34 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:13.531934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66f778ae-e358-4cc0-ab34-3082f0ac9632 req-8ea12029-fa7a-4eea-afe3-01fb06868c34 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:13.540192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66f778ae-e358-4cc0-ab34-3082f0ac9632 req-8ea12029-fa7a-4eea-afe3-01fb06868c34 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:13.561584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-66f778ae-e358-4cc0-ab34-3082f0ac9632 req-8ea12029-fa7a-4eea-afe3-01fb06868c34 service nova] Creating event network-changed:34414c2c-fb25-4fe0-91c6-7f69b5cebbb0 for instance bb4fe529-8581-4ce7-b823-999f85d39db1 on n-h1-858383-17 Oct 31 15:44:13.568368 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-66f778ae-e358-4cc0-ab34-3082f0ac9632 req-8ea12029-fa7a-4eea-afe3-01fb06868c34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068135 Oct 31 15:44:13.581092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2518/5153] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:13.692428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:13.710374 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b56c712-ec8a-4d94-bc72-184093fa1aac tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.465683 Oct 31 15:44:13.715398 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2636/5154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:13 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:14.304196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:14.306973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:14.317188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:14.319008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:14.319801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:14.333180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:14.336333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:14.339066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:14.747097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:14.748277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:14.758871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:14.763324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:14.766444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:14.767190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:14.768747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:14.770425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:14.771194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:14.799543 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9565203-0e52-4572-82d4-93aa7937f8bb tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.485690 Oct 31 15:44:14.801747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2519/5155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:14 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:15.778997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:15.789106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb1895b0-82de-4455-ac86-868c19eac30f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 1.049348 Oct 31 15:44:15.806665 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2637/5156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:14 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:15.830749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:15.831284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:15.854172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:15.854690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:15.859758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:15.860872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:15.861359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:15.863927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:16.524106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:16.535585 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8fa09c6d-12b6-4037-ab7b-2723bcf43247 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.709377 Oct 31 15:44:16.538508 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2520/5157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:15 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:16.818873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:16.820539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:16.834652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:16.839101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:16.840169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:16.844197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:16.845805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:16.846520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:17.240324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:17.256889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4de2c965-3a71-4bfd-bf0b-aa55b872f253 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.443003 Oct 31 15:44:17.257521 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2638/5158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:16 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:17.574400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:17.576920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:17.591389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:17.591863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:17.592138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:17.592887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:17.597331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:17.599720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:18.152279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:18.162740 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-976ecb98-620d-4c95-bdd8-b394bfea07ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.601161 Oct 31 15:44:18.173052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2521/5159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:17 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:18.284659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:18.285315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:18.289129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=34 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:18.293342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:18.293838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:18.294280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:18.294996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:18.295952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:18.296542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:18.300362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:18.561995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:18.580103 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd54d36b-aa1a-4882-8116-fcc18eae1fdb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.299896 Oct 31 15:44:18.603629 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2639/5160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:18 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:19.194187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:19.194790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:19.202228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:19.225384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:19.225872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:19.226312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:19.227013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:19.236426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:19.236927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:19.611520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:19.612327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:19.625962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:19.626629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:19.642842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:19.643920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:19.644427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:19.644902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:19.987456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:19.990157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:20.003874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81592f62-4c02-4262-b801-7535bbf756f2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.813501 Oct 31 15:44:20.005914 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2522/5161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:19 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:20.037223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-05d1e66e-29b2-4a43-b737-ebefec54de1a req-37cb2265-c7c8-41e8-9bfc-4cc7c1c7ac48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023ef4b6-8995-42ce-af2b-e57131081e22", "name": "network-vif-plugged", "status": "completed", "tag": "698ec526-b53d-4bd1-a3db-3a473be72d29"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:20.085501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-05d1e66e-29b2-4a43-b737-ebefec54de1a req-37cb2265-c7c8-41e8-9bfc-4cc7c1c7ac48 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:20.086288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-05d1e66e-29b2-4a43-b737-ebefec54de1a req-37cb2265-c7c8-41e8-9bfc-4cc7c1c7ac48 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:20.087930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-05d1e66e-29b2-4a43-b737-ebefec54de1a req-37cb2265-c7c8-41e8-9bfc-4cc7c1c7ac48 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:20.109783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:20.116061 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-05d1e66e-29b2-4a43-b737-ebefec54de1a req-37cb2265-c7c8-41e8-9bfc-4cc7c1c7ac48 service nova] Creating event network-vif-plugged:698ec526-b53d-4bd1-a3db-3a473be72d29 for instance 023ef4b6-8995-42ce-af2b-e57131081e22 on n-h2-858383-17 Oct 31 15:44:20.123580 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11b09926-df9e-4726-9e4f-1d675003b69b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.515858 Oct 31 15:44:20.129515 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2640/5162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:19 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:20.131234 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-05d1e66e-29b2-4a43-b737-ebefec54de1a req-37cb2265-c7c8-41e8-9bfc-4cc7c1c7ac48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118987 Oct 31 15:44:20.132369 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2523/5163] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:21.045929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:21.048137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:21.068327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.069104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.071416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.073528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.078557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.079274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.152942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:21.154355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:21.167789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.171776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.172494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.174566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.176717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.177459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.959890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:21.969406 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a0e9986-dd1a-40b9-a7c3-67f0e1e22fd2 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.822244 Oct 31 15:44:21.975791 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2524/5164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:21 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:22.037688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:22.056864 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11b054e2-ed82-4f47-8e5c-37d127624c12 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 1.030088 Oct 31 15:44:22.057831 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2641/5165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:21 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:22.149463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0f01be89-49c2-439c-ace8-ca7e33e26569 req-ea43e81d-cf2e-4aee-9aa6-95c79b5dd8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4fe529-8581-4ce7-b823-999f85d39db1", "name": "network-vif-plugged", "status": "completed", "tag": "34414c2c-fb25-4fe0-91c6-7f69b5cebbb0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:22.161019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0f01be89-49c2-439c-ace8-ca7e33e26569 req-ea43e81d-cf2e-4aee-9aa6-95c79b5dd8d9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:22.162317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0f01be89-49c2-439c-ace8-ca7e33e26569 req-ea43e81d-cf2e-4aee-9aa6-95c79b5dd8d9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:22.163126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0f01be89-49c2-439c-ace8-ca7e33e26569 req-ea43e81d-cf2e-4aee-9aa6-95c79b5dd8d9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:22.188483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0f01be89-49c2-439c-ace8-ca7e33e26569 req-ea43e81d-cf2e-4aee-9aa6-95c79b5dd8d9 service nova] Creating event network-vif-plugged:34414c2c-fb25-4fe0-91c6-7f69b5cebbb0 for instance bb4fe529-8581-4ce7-b823-999f85d39db1 on n-h1-858383-17 Oct 31 15:44:22.203555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0f01be89-49c2-439c-ace8-ca7e33e26569 req-ea43e81d-cf2e-4aee-9aa6-95c79b5dd8d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053727 Oct 31 15:44:22.208453 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2525/5166] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:23.006204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:23.007162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:23.046504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.047447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.049801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.050857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.052664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.053521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.084441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:23.085461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:23.105542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.108169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.110943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.113798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.115009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.116173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.460505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:23.473669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07e58da1-0ed7-475f-b93b-ff964fa1956f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1320 microversion: 2.1 time: 0.472537 Oct 31 15:44:23.476525 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2642/5167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:22 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1320 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:23.520140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:23.534399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-300b3853-66f4-4ca6-b0fa-8a9e9d9691ed tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.456820 Oct 31 15:44:23.535263 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2526/5168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:23 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:24.505242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:24.505880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:24.526111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:24.526666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:24.527052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:24.532456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:24.533102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:24.533558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:24.563516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:24.564189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:24.585610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:24.590315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:24.590917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:24.591679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:24.596245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:24.605387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.014897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:25.026278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec58fc6f-32c6-445d-8cb7-2da21266bc9a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 200 len: 1507 microversion: 2.1 time: 0.525574 Oct 31 15:44:25.028501 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2643/5169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:24 2022] GET /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:25.037641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:25.051026 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-91a161f1-c531-461e-84bd-005c568e62e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.491344 Oct 31 15:44:25.052200 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2527/5170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:24 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:25.062245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:25.063995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: 023ef4b6-8995-42ce-af2b-e57131081e22] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:25.081307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.083495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.084629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.086479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.088773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.091630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.591748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:25.606794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e2dcd8f-ce6b-4288-b076-1347d772589a tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/023ef4b6-8995-42ce-af2b-e57131081e22" status: 200 len: 1508 microversion: 2.1 time: 0.556901 Oct 31 15:44:25.607945 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2644/5171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:25 2022] GET /compute/v2.1/servers/023ef4b6-8995-42ce-af2b-e57131081e22 => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:25.631372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:25.633760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: 023ef4b6-8995-42ce-af2b-e57131081e22] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:25.647001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.648370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.649294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.652302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.653180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.655753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.740110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: 023ef4b6-8995-42ce-af2b-e57131081e22] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:25.909062 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-015c02ea-7d09-4f2e-87e0-a5704bf68da1 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "DELETE /compute/v2.1/servers/023ef4b6-8995-42ce-af2b-e57131081e22" status: 204 len: 0 microversion: 2.1 time: 0.282467 Oct 31 15:44:25.910140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2528/5172] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:25 2022] DELETE /compute/v2.1/servers/023ef4b6-8995-42ce-af2b-e57131081e22 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:25.920088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:25.920644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:25.931995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.932332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.932807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.935473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.935953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.936385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:26.009819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: bb4fe529-8581-4ce7-b823-999f85d39db1] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:26.083446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:26.084475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:26.094149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:26.094889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:26.096193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:26.097253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:26.102872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:26.114271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:26.214596 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdf2a575-404f-49e0-9634-286d3140b530 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1" status: 204 len: 0 microversion: 2.1 time: 0.299560 Oct 31 15:44:26.215717 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2645/5173] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:25 2022] DELETE /compute/v2.1/servers/bb4fe529-8581-4ce7-b823-999f85d39db1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:26.437365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-876448096", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a2a6cac4-59e3-423f-9f84-b122580ca177"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:26.462294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:26.474428 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79906c49-d19e-4135-820b-7801e384bc13 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.397536 Oct 31 15:44:26.485757 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2529/5174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:26 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:26.576302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] validate_networks() for [('a2a6cac4-59e3-423f-9f84-b122580ca177', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:44:27.506827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:27.508255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:27.520211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:27.521961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:27.523114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:27.524360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:27.524979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:27.525622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.047965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:44:28.050200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:44:28.050905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:44:28.051625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:44:28.052604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:44:28.076063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:28.076643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:28.077247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.078047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:28.078578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:28.079005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.120049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Getting quotas for project f431fc3405d6487f8d72618d22fa8d61. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:28.126771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Getting quotas for user 787d8cd6efe24a1b809b5932c6e46b69 and project f431fc3405d6487f8d72618d22fa8d61. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:28.142105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Going to run 2 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:44:28.145231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:44:28.204497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=dfab6a25-cf18-4f83-8643-ec8bc2fdf319,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:44:28.265928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:28.283155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe0c60ea-240c-4b85-a4cd-92cd7d1a4170 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.780077 Oct 31 15:44:28.285561 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2530/5175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:27 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:28.301165 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a63b525e-3627-4d15-8929-f1bd2e268dbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.866099 Oct 31 15:44:28.303472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2646/5176] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:44:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1871 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:44:28.332259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:28.344542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:28.346066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Searching by: {'deleted': False, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:44:28.383950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:28.390193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:28.390769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.392573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:28.395109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:28.395680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.460174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:44:28.552647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef71d352-e29b-48e4-8b45-74cc35745d32 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.245293 Oct 31 15:44:28.561647 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2531/5177] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 15:44:28 2022] GET /compute/v2.1/servers => generated 1335 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:28.570932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48828e86-4845-40dc-a293-58deeaadbe16 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:28.572558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48828e86-4845-40dc-a293-58deeaadbe16 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:28.700284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48828e86-4845-40dc-a293-58deeaadbe16 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:28.707848 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48828e86-4845-40dc-a293-58deeaadbe16 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1217 microversion: 2.1 time: 0.143768 Oct 31 15:44:28.713113 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2647/5178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:28 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:29.310342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:29.311043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:29.323428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:29.323941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:29.324386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:29.329805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:29.330313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:29.330763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:29.520267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d493bb62-c9a4-4210-8724-afa6a57fb6ee req-bf11916d-c546-4a0a-9813-693169a0a942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023ef4b6-8995-42ce-af2b-e57131081e22", "name": "network-vif-deleted", "tag": "698ec526-b53d-4bd1-a3db-3a473be72d29"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:29.599381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d493bb62-c9a4-4210-8724-afa6a57fb6ee req-bf11916d-c546-4a0a-9813-693169a0a942 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:29.606227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d493bb62-c9a4-4210-8724-afa6a57fb6ee req-bf11916d-c546-4a0a-9813-693169a0a942 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:29.606806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d493bb62-c9a4-4210-8724-afa6a57fb6ee req-bf11916d-c546-4a0a-9813-693169a0a942 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:29.676515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d493bb62-c9a4-4210-8724-afa6a57fb6ee req-bf11916d-c546-4a0a-9813-693169a0a942 service nova] Creating event network-vif-deleted:698ec526-b53d-4bd1-a3db-3a473be72d29 for instance 023ef4b6-8995-42ce-af2b-e57131081e22 on n-h2-858383-17 Oct 31 15:44:29.711625 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d493bb62-c9a4-4210-8724-afa6a57fb6ee req-bf11916d-c546-4a0a-9813-693169a0a942 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193346 Oct 31 15:44:29.713432 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2648/5179] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:29.744672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c583b193-80aa-4daa-8b61-82347f9137f3 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:29.753459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c583b193-80aa-4daa-8b61-82347f9137f3 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:30.074482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c583b193-80aa-4daa-8b61-82347f9137f3 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:30.090436 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c583b193-80aa-4daa-8b61-82347f9137f3 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1217 microversion: 2.1 time: 0.354655 Oct 31 15:44:30.112518 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2649/5180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:29 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1217 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:30.185098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:30.236244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b81fc8a0-a98f-49cd-9ec2-70eca2004555 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.931634 Oct 31 15:44:30.238542 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2532/5181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:29 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:31.118536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:31.119236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:31.186432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.186948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.190593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.191594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.192230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.192842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.263942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:31.264566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:31.292073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.292564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.299953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.307726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.309037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.312973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.540129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:31.553163 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e09d949-af93-47f2-b3f1-c08592377ddb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1213 microversion: 2.1 time: 0.440829 Oct 31 15:44:31.557853 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2650/5182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:31 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1213 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:31.766156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-441f715e-9c45-4f7a-8cc6-f8826cbc607d req-8b1514c4-47fd-4212-91ed-709bcc5ae5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4fe529-8581-4ce7-b823-999f85d39db1", "name": "network-vif-deleted", "tag": "34414c2c-fb25-4fe0-91c6-7f69b5cebbb0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:31.788128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-441f715e-9c45-4f7a-8cc6-f8826cbc607d req-8b1514c4-47fd-4212-91ed-709bcc5ae5a3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.791001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-441f715e-9c45-4f7a-8cc6-f8826cbc607d req-8b1514c4-47fd-4212-91ed-709bcc5ae5a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.791480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-441f715e-9c45-4f7a-8cc6-f8826cbc607d req-8b1514c4-47fd-4212-91ed-709bcc5ae5a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.817358 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-441f715e-9c45-4f7a-8cc6-f8826cbc607d req-8b1514c4-47fd-4212-91ed-709bcc5ae5a3 service nova] Creating event network-vif-deleted:34414c2c-fb25-4fe0-91c6-7f69b5cebbb0 for instance bb4fe529-8581-4ce7-b823-999f85d39db1 on n-h1-858383-17 Oct 31 15:44:31.828303 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-441f715e-9c45-4f7a-8cc6-f8826cbc607d req-8b1514c4-47fd-4212-91ed-709bcc5ae5a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067390 Oct 31 15:44:31.829624 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2651/5183] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:32.003791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:32.027706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b23fea0-5853-46cf-9f76-bbf4beadd95b tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.767770 Oct 31 15:44:32.029826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2533/5184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:31 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:32.587412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:32.588845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:32.597908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:32.598732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:32.599381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:32.600773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:32.602851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:32.604306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:33.048641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:33.055597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:33.056217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:33.064069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fbdac75-d2cb-40a9-ada7-183b49340b33 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1275 microversion: 2.1 time: 0.485382 Oct 31 15:44:33.077046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:33.077046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:33.077046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:33.078432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:33.080185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:33.083806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:33.097156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2652/5185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:32 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1275 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:33.440121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:33.476625 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01d978ec-8e37-4739-8e49-a63715d2ae3c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1511 microversion: 2.1 time: 0.424636 Oct 31 15:44:33.477867 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2534/5186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:33 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:34.092131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:34.092902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:34.128678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.129672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.130158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.135225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.135717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.136160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.384230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:34.401701 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a565f53d-dfc5-47a5-8287-a67a24d4174c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1275 microversion: 2.1 time: 0.313843 Oct 31 15:44:34.404973 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2653/5187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:34 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:34.506351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:34.506975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:34.523125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.523663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.525358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.527150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.528310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.532733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.173939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:35.189838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dca9307c-2aa4-447b-83d6-e92b2b5f0f1d tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1488 microversion: 2.1 time: 0.692339 Oct 31 15:44:35.190984 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2535/5188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:34 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1488 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:35.225406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1889179188"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:35.230560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:35.245245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.246432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.247028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.247887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.248655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.249185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.426003 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9633bded-e5b5-41e1-abc1-1dc504710382 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "PUT /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1062 microversion: 2.1 time: 0.208054 Oct 31 15:44:35.427182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2654/5189] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:44:35 2022] PUT /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1062 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:35.450704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:35.451086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:35.451688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:35.452326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:35.477831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.485564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.486009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.486460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.487305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.487646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.488072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.494130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.498789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.504110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.505534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.507232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:36.025569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:36.038449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20075a94-601f-4832-bde6-1dcf1b788c14 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1275 microversion: 2.1 time: 0.611618 Oct 31 15:44:36.041333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2536/5190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:35 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1275 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:36.262107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:36.285305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60f6631d-a797-4aa2-a80c-e143d5b2bcbc tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1489 microversion: 2.1 time: 0.837830 Oct 31 15:44:36.286452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2655/5191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:35 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1489 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:36.312356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:36.313506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:36.322900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:36.325955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:36.326603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:36.327503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:36.329782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:36.332296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:37.066378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:37.069030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:37.090768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:37.091281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:37.091731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:37.092486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:37.102794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:37.103345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:37.799496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:37.817672 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-caf70be8-a40a-4e9a-ad24-a728368f3efd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1489 microversion: 2.1 time: 1.509195 Oct 31 15:44:37.840333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2537/5192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:36 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1489 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:37.854236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:37.856670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:37.870420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:37.873566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:37.874556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:37.877167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:37.877885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:37.879106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:37.953903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:37.968919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:38.087637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:38.155073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:38.157097 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22ca303b-fe49-488c-801a-34a67bcdb54c tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 204 len: 0 microversion: 2.1 time: 0.314260 Oct 31 15:44:38.157995 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2538/5193] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:37 2022] DELETE /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:38.170258 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56ea7cab-5549-4223-ac7e-c104af39e2e5 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 1.108340 Oct 31 15:44:38.170613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:38.180789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:38.182003 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2656/5194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:37 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:38.187868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:38.188365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:38.190612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:38.192535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:38.193980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:38.194709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:38.406572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:39.207326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:39.208635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:39.221491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.222247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.222852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:39.223730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.224363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.225013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:39.281232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:39.361087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:39.375870 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-53fbe965-b313-4596-9ff2-5f741519c786 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1495 microversion: 2.1 time: 1.213002 Oct 31 15:44:39.388726 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2539/5195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:38 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1495 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:39.874888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0a69dcc3-6d71-4c6e-8b88-98a14825f293 req-7a180270-2049-462b-8e12-c10c23fc167c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfab6a25-cf18-4f83-8643-ec8bc2fdf319", "tag": "8fd22153-57a4-40b1-84c7-bcfcbf2871b3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:39.896389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a69dcc3-6d71-4c6e-8b88-98a14825f293 req-7a180270-2049-462b-8e12-c10c23fc167c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.896804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a69dcc3-6d71-4c6e-8b88-98a14825f293 req-7a180270-2049-462b-8e12-c10c23fc167c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.897255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0a69dcc3-6d71-4c6e-8b88-98a14825f293 req-7a180270-2049-462b-8e12-c10c23fc167c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:39.949846 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0a69dcc3-6d71-4c6e-8b88-98a14825f293 req-7a180270-2049-462b-8e12-c10c23fc167c service nova] Creating event network-changed:8fd22153-57a4-40b1-84c7-bcfcbf2871b3 for instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 on n-h2-858383-17 Oct 31 15:44:39.971716 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0a69dcc3-6d71-4c6e-8b88-98a14825f293 req-7a180270-2049-462b-8e12-c10c23fc167c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099849 Oct 31 15:44:39.975608 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2540/5196] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:40.085268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:40.408808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:40.411331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:40.421821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:40.423599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:40.424288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:40.425572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:40.426377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:40.427567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:40.436920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:40.450200 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7adf749c-6f99-45a1-90c1-1d6f03a5864b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 1.256764 Oct 31 15:44:40.457640 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2657/5197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:39 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:41.482916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:41.483617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:41.493121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:41.493613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:41.494055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:41.494781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:41.495237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:41.495665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:41.962734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:41.977227 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ec08a24-e21c-4de6-8b97-5407cf35f37e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1495 microversion: 2.1 time: 1.574494 Oct 31 15:44:41.978153 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2541/5198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:40 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1495 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:42.262470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bba67ba9-c0d7-4cdd-87b4-67535f500a39 req-3fd44d9a-7da8-4e6c-be06-c0a79fe3c7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d66b7-09dd-42c2-bf63-f70789977867", "name": "network-vif-deleted", "tag": "58d9a137-36ca-4401-941b-0be272aeb688"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:42.289282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bba67ba9-c0d7-4cdd-87b4-67535f500a39 req-3fd44d9a-7da8-4e6c-be06-c0a79fe3c7d3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:42.289872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bba67ba9-c0d7-4cdd-87b4-67535f500a39 req-3fd44d9a-7da8-4e6c-be06-c0a79fe3c7d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:42.297189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bba67ba9-c0d7-4cdd-87b4-67535f500a39 req-3fd44d9a-7da8-4e6c-be06-c0a79fe3c7d3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:42.339979 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bba67ba9-c0d7-4cdd-87b4-67535f500a39 req-3fd44d9a-7da8-4e6c-be06-c0a79fe3c7d3 service nova] Creating event network-vif-deleted:58d9a137-36ca-4401-941b-0be272aeb688 for instance 923d66b7-09dd-42c2-bf63-f70789977867 on n-h1-858383-17 Oct 31 15:44:42.353898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bba67ba9-c0d7-4cdd-87b4-67535f500a39 req-3fd44d9a-7da8-4e6c-be06-c0a79fe3c7d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095314 Oct 31 15:44:42.354495 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2542/5199] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:43.009334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:43.010036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:43.015276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:43.023411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:43.024202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:43.024921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:43.025851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:43.035486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:43.036265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:43.046634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19e040b7-2f04-422e-a0c5-c649171eb429 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 1.567305 Oct 31 15:44:43.049877 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2658/5200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:41 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:43.112523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:43.113732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:43.114350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:43.115472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lazy-loading 'fault' on Instance uuid 923d66b7-09dd-42c2-bf63-f70789977867 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:44:43.487438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:43.506271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa4757d5-dd3c-4f1f-8b47-a9607ea8d5df tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 200 len: 1310 microversion: 2.1 time: 0.498094 Oct 31 15:44:43.507769 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2543/5201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:43 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 1310 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:44.081134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.082424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.093228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.093907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.094505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.095477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.096102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.096683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.465982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b1e66118-3f3a-4f26-9b3b-181edd0af226 req-d3ea0863-e483-4343-85aa-e204c831a07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110", "tag": "f6a4c041-ebe5-49d7-8547-84e41ce2dc34"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:44.481698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b1e66118-3f3a-4f26-9b3b-181edd0af226 req-d3ea0863-e483-4343-85aa-e204c831a07a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.493277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b1e66118-3f3a-4f26-9b3b-181edd0af226 req-d3ea0863-e483-4343-85aa-e204c831a07a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.493970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b1e66118-3f3a-4f26-9b3b-181edd0af226 req-d3ea0863-e483-4343-85aa-e204c831a07a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.521506 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b1e66118-3f3a-4f26-9b3b-181edd0af226 req-d3ea0863-e483-4343-85aa-e204c831a07a service nova] Creating event network-changed:f6a4c041-ebe5-49d7-8547-84e41ce2dc34 for instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 on n-h1-858383-17 Oct 31 15:44:44.534734 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b1e66118-3f3a-4f26-9b3b-181edd0af226 req-d3ea0863-e483-4343-85aa-e204c831a07a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076390 Oct 31 15:44:44.535792 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2544/5202] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:44.566719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.569174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.594776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.596837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.604104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.607937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.608638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.610967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.666233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 HTTP/1.1 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '923d66b7-09dd-42c2-bf63-f70789977867'} Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.671567 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.675971 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.683558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:44.685524 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b4d2f71-a07d-4699-8695-45bafaae39e5 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 404 len: 111 microversion: 2.1 time: 0.147693 Oct 31 15:44:44.690929 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2545/5203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:44 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:44.708375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.709522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.730987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.734156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.736090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.736986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.739374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.739992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.777770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 HTTP/1.1 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '923d66b7-09dd-42c2-bf63-f70789977867'} Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:44.783312 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:44.787072 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76f9c805-9529-4dd0-b6f7-76551b9c705f tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 404 len: 111 microversion: 2.1 time: 0.080467 Oct 31 15:44:44.789140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2546/5204] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:44 2022] DELETE /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:44.794593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.795865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 923d66b7-09dd-42c2-bf63-f70789977867] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.802823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.803519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.804918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.806371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.807295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.807956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.871877 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 HTTP/1.1 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '923d66b7-09dd-42c2-bf63-f70789977867'} Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.875404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 923d66b7-09dd-42c2-bf63-f70789977867 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:44.881772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d6dd7fb-9aef-47e4-b07f-11aaf96ebd8a tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867" status: 404 len: 111 microversion: 2.1 time: 0.086839 Oct 31 15:44:44.886898 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2547/5205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:44 2022] GET /compute/v2.1/servers/923d66b7-09dd-42c2-bf63-f70789977867 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:44:44.903753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.904334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.925757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.927888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.937537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.937692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:44.938699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.939381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.940034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.958234 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7deba1f7-f156-40c4-b1c2-4f5f7b6a97ae tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 0.884133 Oct 31 15:44:44.962833 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2659/5206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:44 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:44.976486 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 HTTP/1.1 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '85692a51-2e30-4793-8a0e-3c67e278bd30'} Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:44.978597 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:44.982810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:44.984788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:44.986383 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a8755ec-3e7f-46e9-a68b-6dbd975bd8e3 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 404 len: 111 microversion: 2.1 time: 0.096806 Oct 31 15:44:44.987419 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2548/5207] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:44 2022] DELETE /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:44.995999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.996732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 85692a51-2e30-4793-8a0e-3c67e278bd30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.002903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.003524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.004089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.004937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.005506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.006034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.020357 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 HTTP/1.1 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '85692a51-2e30-4793-8a0e-3c67e278bd30'} Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.022401 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. Oct 31 15:44:45.027627 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.034091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 85692a51-2e30-4793-8a0e-3c67e278bd30 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.034091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2072fb09-5895-4f11-8ff7-de10fdddaf58 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30" status: 404 len: 111 microversion: 2.1 time: 0.039237 Oct 31 15:44:45.034091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2660/5208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:44 2022] GET /compute/v2.1/servers/85692a51-2e30-4793-8a0e-3c67e278bd30 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.040259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.041154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.049390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.050146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.051396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.052419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.053146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.053806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.073053 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c HTTP/1.1 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd0cf5cfc-939e-4656-9b5f-3fef9ff4217c'} Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.075301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.079008 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.081333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.082537 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b785b1f-c437-484b-9790-1841fa8863aa tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 404 len: 111 microversion: 2.1 time: 0.046247 Oct 31 15:44:45.092562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.093419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d0cf5cfc-939e-4656-9b5f-3fef9ff4217c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.099163 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2549/5209] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:45 2022] DELETE /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.103563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.104309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.105032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.106018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.106691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.107408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.125634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c HTTP/1.1 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd0cf5cfc-939e-4656-9b5f-3fef9ff4217c'} Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.127578 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. Oct 31 15:44:45.133430 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.135175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance d0cf5cfc-939e-4656-9b5f-3fef9ff4217c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.136055 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fb27fdf-749b-4c44-83a9-2119330ca653 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c" status: 404 len: 111 microversion: 2.1 time: 0.047874 Oct 31 15:44:45.144940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.145706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.150604 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2661/5210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/d0cf5cfc-939e-4656-9b5f-3fef9ff4217c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.152627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.153301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.154105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.154853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.156666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.156666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.177128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca HTTP/1.1 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '39e9d128-28c0-4a8d-96a6-6677d4936eca'} Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.179548 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.184879 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.188067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.189175 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92d5c2c4-3cee-49ae-a2b8-7020ea243417 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 404 len: 111 microversion: 2.1 time: 0.048400 Oct 31 15:44:45.193194 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2550/5211] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:45 2022] DELETE /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.203605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.204167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 39e9d128-28c0-4a8d-96a6-6677d4936eca] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.215434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.220950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.221467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.222234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.230155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.231065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.251223 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca HTTP/1.1 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '39e9d128-28c0-4a8d-96a6-6677d4936eca'} Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.253224 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 39e9d128-28c0-4a8d-96a6-6677d4936eca could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.258812 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-372f7871-ef5d-41c0-bf4d-a3504cfd2812 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca" status: 404 len: 111 microversion: 2.1 time: 0.059693 Oct 31 15:44:45.269044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.269681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.274336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2662/5212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/39e9d128-28c0-4a8d-96a6-6677d4936eca => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.280482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.281416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.282311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.283670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.284297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.286265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.308430 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b HTTP/1.1 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'cb91acf2-7dca-4ede-b67c-b498539bee9b'} Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.310204 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.315558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67597d43-c83c-4ea7-875e-24978035c944 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 404 len: 111 microversion: 2.1 time: 0.049414 Oct 31 15:44:45.321890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.322665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: cb91acf2-7dca-4ede-b67c-b498539bee9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.326461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2551/5213] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:45 2022] DELETE /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.330202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.330709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.331148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.331962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.332472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.332965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.350950 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b HTTP/1.1 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'cb91acf2-7dca-4ede-b67c-b498539bee9b'} Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.352723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance cb91acf2-7dca-4ede-b67c-b498539bee9b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.357058 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f062f1a-db31-4de5-8652-c8bbf4790bdd tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b" status: 404 len: 111 microversion: 2.1 time: 0.038858 Oct 31 15:44:45.361743 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2663/5214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/cb91acf2-7dca-4ede-b67c-b498539bee9b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.368206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.368437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.378007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.378505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.378948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.379662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.380125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.380555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.397601 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:44:45.398393 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 15:44:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 (ip 10.222.0.48) !!! Oct 31 15:44:45.421073 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 HTTP/1.1 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '6d898471-009a-4157-8b52-ff57d55bc645'} Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.422653 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.427211 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.430834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.434000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98d3d7c8-21aa-4b37-a2de-201f58a621e2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 404 len: 111 microversion: 2.1 time: 0.070956 Oct 31 15:44:45.442873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.443529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 6d898471-009a-4157-8b52-ff57d55bc645] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.448809 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2552/5215] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:45 2022] DELETE /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:44:45.451440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.451940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.452379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.453153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.453674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.454034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.502227 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 HTTP/1.1 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '6d898471-009a-4157-8b52-ff57d55bc645'} Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.504294 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. Oct 31 15:44:45.508785 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.510965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 6d898471-009a-4157-8b52-ff57d55bc645 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.512152 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71a43948-5437-4cc0-ae0e-6cd81cb69dea tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645" status: 404 len: 111 microversion: 2.1 time: 0.073366 Oct 31 15:44:45.513263 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2664/5216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/6d898471-009a-4157-8b52-ff57d55bc645 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:44:45.521980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.522523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.530627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.533640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.534309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.535229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.535778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.538151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.564405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 HTTP/1.1 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd101e71b-3778-40c8-935a-fbc48c779c39'} Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.579116 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.586866 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5463197b-83e0-4afd-81b1-21b2159b2052 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 404 len: 111 microversion: 2.1 time: 0.064145 Oct 31 15:44:45.593552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.593867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: d101e71b-3778-40c8-935a-fbc48c779c39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.598753 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2553/5217] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:45 2022] DELETE /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.600669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.602071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.608996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.610007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.610654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.611242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.645356 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 HTTP/1.1 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'd101e71b-3778-40c8-935a-fbc48c779c39'} Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:45.646989 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance d101e71b-3778-40c8-935a-fbc48c779c39 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:45.654633 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53a76a5a-3cc1-4ac5-8d43-ce355dfe29b4 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39" status: 404 len: 111 microversion: 2.1 time: 0.061101 Oct 31 15:44:45.658634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.659153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.664755 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2665/5218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/d101e71b-3778-40c8-935a-fbc48c779c39 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:45.666334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.666834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.667271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.667990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.668439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.668904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.697497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:45.824238 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1721c907-b923-4f83-91ec-5fb84196f923 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 204 len: 0 microversion: 2.1 time: 0.168762 Oct 31 15:44:45.825876 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2554/5219] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:45 2022] DELETE /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:45.833755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.834505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.846399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.848098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.851821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.852793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.856529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.857292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.995876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.996959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:46.011959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:46.013434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:46.015215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:46.023789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:46.025697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:46.027934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:46.213720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:46.225058 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77ff94c3-cfbe-4344-87ba-5a9208604669 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1477 microversion: 2.1 time: 0.395496 Oct 31 15:44:46.227059 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2666/5220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:47.255634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:47.256287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:47.267895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:47.268495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:47.269196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:47.271336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:47.271924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:47.272369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:47.332347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:47.341694 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67087cb1-ef24-4606-b073-65fd4472c968 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 1.356257 Oct 31 15:44:47.350231 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2555/5221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:47.640712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:47.657254 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10c69499-9c41-41cb-b2a8-e35b2d26562e tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1477 microversion: 2.1 time: 0.409799 Oct 31 15:44:47.660855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2667/5222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:47 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1477 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:48.375644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:48.376871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:48.392766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.393564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.396901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.403155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.403834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.406856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.686019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:48.687442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:48.690967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:48.706519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.707639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.709449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.711046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.712188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.712991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.225099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:49.252062 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-359becd0-c790-4d39-8ee0-9938d01470c6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 0.881917 Oct 31 15:44:49.255288 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2556/5223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:48 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:49.316100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:49.343313 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33b7fc3e-9410-486e-9575-85c3f959e0c2 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1477 microversion: 2.1 time: 0.644239 Oct 31 15:44:49.345567 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2668/5224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:48 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:49.394009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Calling method '.version_select at 0x7f5ca11ccd30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:49.399695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.400397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.402312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.436202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:49.448152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.448764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.449418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.462502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.463279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.464161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.470784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47531eb0-5790-4faf-82a3-f7ba004bb57c tempest-PortsAdminExtendedAttrsTestJSON-174591472 tempest-PortsAdminExtendedAttrsTestJSON-174591472-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.213310 Oct 31 15:44:49.471903 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2557/5225] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 15:44:49 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:49.495726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c9a42df9-3dd6-47fb-831d-01d2ebdd43b0 req-816d3d43-1826-489e-b3f9-b37b58ecb57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfab6a25-cf18-4f83-8643-ec8bc2fdf319", "name": "network-vif-plugged", "status": "completed", "tag": "8fd22153-57a4-40b1-84c7-bcfcbf2871b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:49.515205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c9a42df9-3dd6-47fb-831d-01d2ebdd43b0 req-816d3d43-1826-489e-b3f9-b37b58ecb57b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.515770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c9a42df9-3dd6-47fb-831d-01d2ebdd43b0 req-816d3d43-1826-489e-b3f9-b37b58ecb57b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.516208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c9a42df9-3dd6-47fb-831d-01d2ebdd43b0 req-816d3d43-1826-489e-b3f9-b37b58ecb57b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.539003 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c9a42df9-3dd6-47fb-831d-01d2ebdd43b0 req-816d3d43-1826-489e-b3f9-b37b58ecb57b service nova] Creating event network-vif-plugged:8fd22153-57a4-40b1-84c7-bcfcbf2871b3 for instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 on n-h2-858383-17 Oct 31 15:44:49.559158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c9a42df9-3dd6-47fb-831d-01d2ebdd43b0 req-816d3d43-1826-489e-b3f9-b37b58ecb57b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067737 Oct 31 15:44:49.559711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2669/5226] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:49.682939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3d94f428-c0cb-46ff-97fa-a0451e098260 req-0c2bd4af-b052-4a90-9b9f-59653a6e1ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1822d74b-2b43-41ce-85c4-f87833af7e74", "name": "network-vif-deleted", "tag": "30c9f344-6125-41d9-92b9-ce5578114a0f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:49.706527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d94f428-c0cb-46ff-97fa-a0451e098260 req-0c2bd4af-b052-4a90-9b9f-59653a6e1ad8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.707266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d94f428-c0cb-46ff-97fa-a0451e098260 req-0c2bd4af-b052-4a90-9b9f-59653a6e1ad8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.709328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d94f428-c0cb-46ff-97fa-a0451e098260 req-0c2bd4af-b052-4a90-9b9f-59653a6e1ad8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.756150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3d94f428-c0cb-46ff-97fa-a0451e098260 req-0c2bd4af-b052-4a90-9b9f-59653a6e1ad8 service nova] Creating event network-vif-deleted:30c9f344-6125-41d9-92b9-ce5578114a0f for instance 1822d74b-2b43-41ce-85c4-f87833af7e74 on n-h2-858383-17 Oct 31 15:44:49.771223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3d94f428-c0cb-46ff-97fa-a0451e098260 req-0c2bd4af-b052-4a90-9b9f-59653a6e1ad8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089292 Oct 31 15:44:49.773524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2558/5227] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:50.281642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:50.284070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:50.318472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.319853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.320669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.321828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.322541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.324025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.376797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:50.379227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:50.392626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.394458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.396670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.399986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.403784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.404326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.455023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.455732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.456527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.457188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lazy-loading 'fault' on Instance uuid 1822d74b-2b43-41ce-85c4-f87833af7e74 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:44:50.540665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60a8ec9af56f4bd4a79c291163e34215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa8a40766a2c4ccd82422d621124597e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:50.552813 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-97e72739-f03e-439e-baab-6128083e1d77 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 200 len: 1280 microversion: 2.1 time: 0.181350 Oct 31 15:44:50.553621 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2559/5228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:50 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:50.769401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:50.787237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-543f15d3-44f3-4e46-a281-faec8769afbb tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 0.511850 Oct 31 15:44:50.791624 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2670/5229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:50 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:51.579335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:51.580057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] [instance: 1822d74b-2b43-41ce-85c4-f87833af7e74] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:51.592110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.592953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.598936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.599719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.600280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.601411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.630480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:51.637728 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] HTTP exception thrown: Instance 1822d74b-2b43-41ce-85c4-f87833af7e74 could not be found. Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Request method failure captured: Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 HTTP/1.1 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-w9SwGU_ZWyXHfOuZ1IoUa248iXwH5N9GTK0gCw6Qx6WwtXR6umtVb2gJBWL0mHqVnBSMazaOCDV7_xKfkH-fqJrmmRtGsPMEjfx1eS_xAWIr09iGISRYI0xhNVe6_u0oPXsSKMZ13nJTbuPWqVzJS_zml5SiQ7r4h5N2zXjKT4SO8 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa8a40766a2c4ccd82422d621124597e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersTestJSON-1364176609 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: aa8a40766a2c4ccd82422d621124597e Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersTestJSON-1364176609 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 60a8ec9af56f4bd4a79c291163e34215 Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersTestJSON-1364176609-project Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1822d74b-2b43-41ce-85c4-f87833af7e74 could not be found. Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1822d74b-2b43-41ce-85c4-f87833af7e74'} Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1822d74b-2b43-41ce-85c4-f87833af7e74 could not be found. Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1822d74b-2b43-41ce-85c4-f87833af7e74 could not be found. Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:51.640577 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1822d74b-2b43-41ce-85c4-f87833af7e74 could not be found. Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:44:51.645177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] Returning 404 to user: Instance 1822d74b-2b43-41ce-85c4-f87833af7e74 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:51.646784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae833783-82ff-469a-bea5-97826feddf41 tempest-ServersTestJSON-1364176609 tempest-ServersTestJSON-1364176609-project] 10.222.0.48 "GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74" status: 404 len: 111 microversion: 2.1 time: 0.071624 Oct 31 15:44:51.650226 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2560/5230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:51 2022] GET /compute/v2.1/servers/1822d74b-2b43-41ce-85c4-f87833af7e74 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:51.823970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:51.823970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:51.843283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.843550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.843991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.844644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.845296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.845555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:52.460392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:52.477504 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c546c697-a8ec-4702-8ae1-8d2084a6a102 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 0.660803 Oct 31 15:44:52.478526 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2671/5231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:51 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:52.978666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a41aa73c-1ce3-43d3-ab3f-fc1e4c9533e2 req-301de52c-1e75-413e-9f80-ed16b4322d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110", "name": "network-vif-plugged", "status": "completed", "tag": "f6a4c041-ebe5-49d7-8547-84e41ce2dc34"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:53.014167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a41aa73c-1ce3-43d3-ab3f-fc1e4c9533e2 req-301de52c-1e75-413e-9f80-ed16b4322d51 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:53.015320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a41aa73c-1ce3-43d3-ab3f-fc1e4c9533e2 req-301de52c-1e75-413e-9f80-ed16b4322d51 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:53.016131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a41aa73c-1ce3-43d3-ab3f-fc1e4c9533e2 req-301de52c-1e75-413e-9f80-ed16b4322d51 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:53.049625 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a41aa73c-1ce3-43d3-ab3f-fc1e4c9533e2 req-301de52c-1e75-413e-9f80-ed16b4322d51 service nova] Creating event network-vif-plugged:f6a4c041-ebe5-49d7-8547-84e41ce2dc34 for instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 on n-h1-858383-17 Oct 31 15:44:53.060391 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a41aa73c-1ce3-43d3-ab3f-fc1e4c9533e2 req-301de52c-1e75-413e-9f80-ed16b4322d51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086298 Oct 31 15:44:53.064848 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2561/5232] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:53.507866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:53.510159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:53.524125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:53.525028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:53.530520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:53.534681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:53.535259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:53.535722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:54.589550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:54.597766 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12b9f5c9-5983-4de1-bbda-d126dc02edf6 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1317 microversion: 2.1 time: 1.095742 Oct 31 15:44:54.604526 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2672/5233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:53 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1317 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:55.086019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:55.088663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:55.089814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:55.090464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:55.091206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:55.095887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:55.096351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:55.137787 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c106ae7-ec44-4725-9236-6f89f559c41f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.198347 Oct 31 15:44:55.139192 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2562/5234] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Oct 31 15:44:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:55.383416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1335158010", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-17", "networks": [{"uuid": "afccf616-5f65-4c20-af53-b4728aee1def"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:55.514669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] validate_networks() for [('afccf616-5f65-4c20-af53-b4728aee1def', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:44:55.622871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:55.623795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:55.636482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:55.637168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:55.637771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:55.640825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:55.644521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:55.656035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.219495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:56.232659 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fcdb7199-ed11-4c2a-87d6-d1f64d90715e tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 200 len: 1505 microversion: 2.1 time: 0.614861 Oct 31 15:44:56.237902 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2563/5235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:55 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:56.273565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:56.274485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:56.288437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.295127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.296046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.296978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.298330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.301736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.885055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:56.895037 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69af6f05-7c49-4f3c-9703-5678ec4e100d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319" status: 200 len: 1504 microversion: 2.1 time: 0.637503 Oct 31 15:44:56.896132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2564/5236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:56 2022] GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:56.922160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:56.922834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:56.929997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.930903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.931828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.932880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.933450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.933975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.992851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:57.031600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:44:57.032620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:44:57.033376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:44:57.033950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:44:57.034528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:44:57.062026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:57.062525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:57.062969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:57.063704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:57.064166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:57.064634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:57.143685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Getting quotas for project 3dcc31ce1e5141e597b13d56dcc4e8fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:57.152311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Getting quotas for user a0743203333c4417b026c839de8a6510 and project 3dcc31ce1e5141e597b13d56dcc4e8fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:57.187022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:44:57.195088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:44:57.273550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2e6e0cd-ab47-449e-83d7-395026b4e18f tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319" status: 204 len: 0 microversion: 2.1 time: 0.356385 Oct 31 15:44:57.277253 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2565/5237] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:56 2022] DELETE /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:44:57.298375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:57.299295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:57.307573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:57.311827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:57.312466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:57.317427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:57.318106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:57.318815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:57.330286 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3179de4-9c49-479c-a63d-d00980798438 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.950919 Oct 31 15:44:57.337085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2673/5238] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:44:57.343631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31fa9652-76e0-4f33-87ce-6c7fabea0a4e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:57.344396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31fa9652-76e0-4f33-87ce-6c7fabea0a4e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:57.410282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:57.438016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31fa9652-76e0-4f33-87ce-6c7fabea0a4e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1329 microversion: 2.1 time: 0.098149 Oct 31 15:44:57.452739 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2674/5239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:57 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:57.594602 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-58947da3-2951-4817-bb73-9f9fd2ffb67d tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 204 len: 0 microversion: 2.1 time: 0.315611 Oct 31 15:44:57.598588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2566/5240] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:57 2022] DELETE /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:57.604253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:57.605142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:57.614193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:57.614844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:57.615377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:57.616713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:57.617583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:57.618346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:58.078610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:58.087869 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6ee5e8b-3714-437a-997e-019de2366f1b tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319" status: 200 len: 1510 microversion: 2.1 time: 0.488174 Oct 31 15:44:58.108193 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2675/5241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:57 2022] GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:58.469686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:58.472613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:58.499504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:58.500142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:58.500894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:58.503367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:58.504010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:58.507708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:58.821153 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d030a102-761a-40e7-83be-efb3b77703f2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1346 microversion: 2.1 time: 0.360142 Oct 31 15:44:58.823204 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2567/5242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:58 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1346 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:59.118567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:59.119337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:59.134573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:59.136475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:59.137070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:59.138829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:59.140963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:59.141697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:59.696162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:59.708297 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec077c24-9e2e-447e-b4a2-edf42a6a0d8c tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319" status: 200 len: 1510 microversion: 2.1 time: 0.596532 Oct 31 15:44:59.725867 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2676/5243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:59 2022] GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 => generated 1510 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:59.850026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:59.851738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:59.859172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:59.861385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:59.862276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:59.863293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:59.864033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:59.867543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:00.273025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21bc1d42-8ae7-4433-9ff9-89662c47ec6e tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1436 microversion: 2.1 time: 0.429246 Oct 31 15:45:00.274767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2568/5244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:59 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1436 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:00.735743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:00.736998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:00.748091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:00.748600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:00.755852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:00.757360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:00.757855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:00.758302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:01.306783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:01.308850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:01.332269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:01.337184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:01.340103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:01.342684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:01.347732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:01.348341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:02.014388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787d8cd6efe24a1b809b5932c6e46b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f431fc3405d6487f8d72618d22fa8d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:02.039463 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd250ac1-71fc-4668-9467-f78463a31461 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319" status: 200 len: 1510 microversion: 2.1 time: 1.305336 Oct 31 15:45:02.042880 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2677/5245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:00 2022] GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 => generated 1510 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:02.057088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-cf66d819-9302-47dd-a3ad-7d7c67bf1940 req-a5b41d90-5f4a-4777-907f-07c9658c2d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfab6a25-cf18-4f83-8643-ec8bc2fdf319", "name": "network-vif-deleted", "tag": "8fd22153-57a4-40b1-84c7-bcfcbf2871b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:02.073092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cf66d819-9302-47dd-a3ad-7d7c67bf1940 req-a5b41d90-5f4a-4777-907f-07c9658c2d66 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:02.073852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cf66d819-9302-47dd-a3ad-7d7c67bf1940 req-a5b41d90-5f4a-4777-907f-07c9658c2d66 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:02.074567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cf66d819-9302-47dd-a3ad-7d7c67bf1940 req-a5b41d90-5f4a-4777-907f-07c9658c2d66 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:02.092033 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-cf66d819-9302-47dd-a3ad-7d7c67bf1940 req-a5b41d90-5f4a-4777-907f-07c9658c2d66 service nova] Creating event network-vif-deleted:8fd22153-57a4-40b1-84c7-bcfcbf2871b3 for instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 on n-h2-858383-17 Oct 31 15:45:02.109538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-cf66d819-9302-47dd-a3ad-7d7c67bf1940 req-a5b41d90-5f4a-4777-907f-07c9658c2d66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065145 Oct 31 15:45:02.111715 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2678/5246] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:02.289934 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce9888e4-7afd-472b-aa62-4df03aa854e2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1466 microversion: 2.1 time: 0.987086 Oct 31 15:45:02.304725 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2569/5247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:01 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1466 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:02.544821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-87fd38c0-eb29-4705-82c6-43b1a4f433e1 req-d781c7ff-6b82-4454-baf6-21704b3f6a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b2873a-07d9-42c6-a786-0a3c0cb14368", "tag": "d7abf4d6-791e-44dd-b979-53e8fff8aa4e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:02.562994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-87fd38c0-eb29-4705-82c6-43b1a4f433e1 req-d781c7ff-6b82-4454-baf6-21704b3f6a2d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:02.564894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-87fd38c0-eb29-4705-82c6-43b1a4f433e1 req-d781c7ff-6b82-4454-baf6-21704b3f6a2d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:02.565846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-87fd38c0-eb29-4705-82c6-43b1a4f433e1 req-d781c7ff-6b82-4454-baf6-21704b3f6a2d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:02.626625 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-87fd38c0-eb29-4705-82c6-43b1a4f433e1 req-d781c7ff-6b82-4454-baf6-21704b3f6a2d service nova] Creating event network-changed:d7abf4d6-791e-44dd-b979-53e8fff8aa4e for instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 on n-h2-858383-17 Oct 31 15:45:02.640900 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-87fd38c0-eb29-4705-82c6-43b1a4f433e1 req-d781c7ff-6b82-4454-baf6-21704b3f6a2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101219 Oct 31 15:45:02.642952 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2679/5248] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:03.067854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:03.068536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: dfab6a25-cf18-4f83-8643-ec8bc2fdf319] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:03.091306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.091916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.092397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.093175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.093825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.096827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.130769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] HTTP exception thrown: Instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 could not be found. Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Request method failure captured: Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 HTTP/1.1 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-06qfoZM3cNshUy0SLTybewC6g2QWbvpMNHEakc-6C92eEzK4-zLHmlavQRyMk2a8RGEnjqJx_YOyvSjhLr440jnKZ8kK_NObeUEEbaZa0Ac-23ZZa9uj0S4XiVN4Km9P7MYrqw0ZRzM5SxHBT8qkdpdps3HksZskEH79xf4riHoW0 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: f431fc3405d6487f8d72618d22fa8d61 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-MultipleCreateTestJSON-1863651982 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-MultipleCreateTestJSON-1863651982 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: f431fc3405d6487f8d72618d22fa8d61 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1863651982 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-MultipleCreateTestJSON-1863651982-project Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 787d8cd6efe24a1b809b5932c6e46b69 Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-MultipleCreateTestJSON-1863651982-project Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 could not be found. Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'dfab6a25-cf18-4f83-8643-ec8bc2fdf319'} Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 could not be found. Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 could not be found. Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:03.133350 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 could not be found. Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Returning 404 to user: Instance dfab6a25-cf18-4f83-8643-ec8bc2fdf319 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:45:03.139117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7172f62d-bb3f-40e7-a95c-08cab60b6f09 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319" status: 404 len: 111 microversion: 2.1 time: 0.071347 Oct 31 15:45:03.149942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:03.150507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] [instance: f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:03.153076 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2570/5249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:03 2022] GET /compute/v2.1/servers/dfab6a25-cf18-4f83-8643-ec8bc2fdf319 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:45:03.159314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.159447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.159978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.160836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.161504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.162149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.184441 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] HTTP exception thrown: Instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 could not be found. Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Request method failure captured: Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 HTTP/1.1 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-06qfoZM3cNshUy0SLTybewC6g2QWbvpMNHEakc-6C92eEzK4-zLHmlavQRyMk2a8RGEnjqJx_YOyvSjhLr440jnKZ8kK_NObeUEEbaZa0Ac-23ZZa9uj0S4XiVN4Km9P7MYrqw0ZRzM5SxHBT8qkdpdps3HksZskEH79xf4riHoW0 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f431fc3405d6487f8d72618d22fa8d61 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-MultipleCreateTestJSON-1863651982 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f431fc3405d6487f8d72618d22fa8d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-MultipleCreateTestJSON-1863651982 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f431fc3405d6487f8d72618d22fa8d61 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1863651982 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-MultipleCreateTestJSON-1863651982-project Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 787d8cd6efe24a1b809b5932c6e46b69 Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-MultipleCreateTestJSON-1863651982-project Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 could not be found. Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110'} Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 could not be found. Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 could not be found. Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:03.187445 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 could not be found. Oct 31 15:45:03.192459 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:03.196879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] Returning 404 to user: Instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:45:03.197973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57e1589c-4787-4cde-aac6-db2fb75411a8 tempest-MultipleCreateTestJSON-1863651982 tempest-MultipleCreateTestJSON-1863651982-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110" status: 404 len: 111 microversion: 2.1 time: 0.056509 Oct 31 15:45:03.199070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2680/5250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:03 2022] GET /compute/v2.1/servers/f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:45:03.323248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:03.324174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:03.338566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.339642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.340250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.341278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.341911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.342578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.735985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbc1bcf5-d97d-464d-9c4c-5e4ce8343e19 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1466 microversion: 2.1 time: 0.422201 Oct 31 15:45:03.738391 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2571/5251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:03 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1466 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:04.193349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4ed1a4b4-75ce-42b5-94f6-35fa4a9c7e2f req-393c0786-d482-4285-9a23-990aa8dff194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110", "name": "network-vif-deleted", "tag": "f6a4c041-ebe5-49d7-8547-84e41ce2dc34"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:04.213484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4ed1a4b4-75ce-42b5-94f6-35fa4a9c7e2f req-393c0786-d482-4285-9a23-990aa8dff194 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:04.216276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4ed1a4b4-75ce-42b5-94f6-35fa4a9c7e2f req-393c0786-d482-4285-9a23-990aa8dff194 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:04.217354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4ed1a4b4-75ce-42b5-94f6-35fa4a9c7e2f req-393c0786-d482-4285-9a23-990aa8dff194 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:04.260799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4ed1a4b4-75ce-42b5-94f6-35fa4a9c7e2f req-393c0786-d482-4285-9a23-990aa8dff194 service nova] Creating event network-vif-deleted:f6a4c041-ebe5-49d7-8547-84e41ce2dc34 for instance f0fb80d6-7a06-469a-8dc6-b2fdd8d1b110 on n-h1-858383-17 Oct 31 15:45:04.274670 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4ed1a4b4-75ce-42b5-94f6-35fa4a9c7e2f req-393c0786-d482-4285-9a23-990aa8dff194 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093584 Oct 31 15:45:04.277160 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2681/5252] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:04.769249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:04.769903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:04.785143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:04.785947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:04.788065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:04.789303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:04.790703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:04.791146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:05.120667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:05.259643 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d35f4bb-0668-4bf3-82f4-339bd6d0743d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1466 microversion: 2.1 time: 0.495085 Oct 31 15:45:05.262660 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2572/5253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:04 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1466 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:06.299010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:06.299678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:06.320253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:06.321213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:06.321670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:06.322633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:06.331882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:06.332628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:07.101771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:07.404155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd00e7d6-6f09-43aa-bc63-98c978137cc0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1466 microversion: 2.1 time: 1.115135 Oct 31 15:45:07.405735 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2682/5254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:06 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1466 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:08.432767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:08.434110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:08.448520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.449486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.449971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:08.450873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.451423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.451876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:09.262491 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e75ba6b2-c8e7-41b6-8a30-852a59d6213d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1466 microversion: 2.1 time: 0.831966 Oct 31 15:45:09.264513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2573/5255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:08 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1466 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:10.022647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-92751845-0e65-4127-8bd8-7a12b1fe6262 req-f59ba44a-04a1-406a-8d79-c3b1c9514717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b2873a-07d9-42c6-a786-0a3c0cb14368", "name": "network-vif-plugged", "status": "completed", "tag": "d7abf4d6-791e-44dd-b979-53e8fff8aa4e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:10.034711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:10.066296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92751845-0e65-4127-8bd8-7a12b1fe6262 req-f59ba44a-04a1-406a-8d79-c3b1c9514717 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:10.067636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92751845-0e65-4127-8bd8-7a12b1fe6262 req-f59ba44a-04a1-406a-8d79-c3b1c9514717 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:10.070219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92751845-0e65-4127-8bd8-7a12b1fe6262 req-f59ba44a-04a1-406a-8d79-c3b1c9514717 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:10.081498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:10.109228 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-92751845-0e65-4127-8bd8-7a12b1fe6262 req-f59ba44a-04a1-406a-8d79-c3b1c9514717 service nova] Creating event network-vif-plugged:d7abf4d6-791e-44dd-b979-53e8fff8aa4e for instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 on n-h2-858383-17 Oct 31 15:45:10.120183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-92751845-0e65-4127-8bd8-7a12b1fe6262 req-f59ba44a-04a1-406a-8d79-c3b1c9514717 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120399 Oct 31 15:45:10.122731 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2683/5256] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:45:10.306346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:10.308558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:10.317425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:10.318397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:10.319063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:10.320152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:10.321485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:10.323136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:10.798779 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0eb92382-f5b2-4f59-9cab-5679fbe1377f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1466 microversion: 2.1 time: 0.507163 Oct 31 15:45:10.804814 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2574/5257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:10 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1466 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:11.824929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:11.825528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:11.855131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:11.855131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:11.855131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:11.856550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:11.858446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:11.859051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:12.574221 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-767b1b20-500d-48ab-aa1f-9b3d980b8bda tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1650 microversion: 2.1 time: 0.754274 Oct 31 15:45:12.578586 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2684/5258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:11 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1650 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:12.605042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:12.605661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:12.620227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:12.622092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:12.623834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:12.629751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:12.630510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:12.631379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:13.012985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0588fbf6-25f8-4ebe-8d13-87c95faf4252 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1650 microversion: 2.1 time: 0.416113 Oct 31 15:45:13.017223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2575/5259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:12 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1650 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:13.042619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:13.044001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:13.064320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:13.065757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:13.067179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:13.069651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:13.071568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:13.073464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:13.377121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dadb2b78-9346-43f6-9d87-8d0d9e469e40 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1650 microversion: 2.1 time: 0.340152 Oct 31 15:45:13.379010 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2685/5260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:13 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1650 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:13.680201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-864983060", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-17", "networks": [{"uuid": "afccf616-5f65-4c20-af53-b4728aee1def"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:13.848603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] validate_networks() for [('afccf616-5f65-4c20-af53-b4728aee1def', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:45:14.913772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:14.914368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:14.915007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:14.915649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:14.916519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:14.934673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:14.935522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:14.936632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:14.939063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:14.941311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:14.941935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:14.996134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:15.018149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Getting quotas for project 3dcc31ce1e5141e597b13d56dcc4e8fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:15.030155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Getting quotas for user a0743203333c4417b026c839de8a6510 and project 3dcc31ce1e5141e597b13d56dcc4e8fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:15.054668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:15.067963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:15.209066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df34e7c5-e629-43c4-a3d1-4d822a389801 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526817 Oct 31 15:45:15.216843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2576/5261] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:45:15.236480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc5a2960-8180-46dd-b4a3-fa8039098b76 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:15.237126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc5a2960-8180-46dd-b4a3-fa8039098b76 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:15.498297 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc5a2960-8180-46dd-b4a3-fa8039098b76 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1328 microversion: 2.1 time: 0.264017 Oct 31 15:45:15.501854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2686/5262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:15 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:16.531736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:16.532372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:16.561212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:16.561713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:16.566188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:16.576287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:16.579802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:16.583716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:16.882852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-924133ea-47d1-4162-adf9-7656a624c62d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1337 microversion: 2.1 time: 0.356013 Oct 31 15:45:16.894437 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2687/5263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:16 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1337 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:17.056820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-918520333", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:17.160932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1243027118", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:17.183792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] validate_networks() for [('7d595c49-078e-4b9a-8f8f-2f689a0106c6', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:45:17.276430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:17.276896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:17.277374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:17.277792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:17.278210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:17.316790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.317300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.317750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:17.318677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.319324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.319761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:17.371426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Getting quotas for project d58ae618d5a54f01abf7ea12518f17d7. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:17.389299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Getting quotas for user 264ce1cfbaea49f28a9dbefddd40c476 and project d58ae618d5a54f01abf7ea12518f17d7. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:17.438806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:17.441285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:17.572360 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34bd1721-e4da-47f4-96d4-1ddda263733e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.627300 Oct 31 15:45:17.580364 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2688/5264] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:45:17.589786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5aa2a63-d2ec-4834-a2fe-242e7fc9f6ba tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:17.592660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e5aa2a63-d2ec-4834-a2fe-242e7fc9f6ba tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:17.792233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5aa2a63-d2ec-4834-a2fe-242e7fc9f6ba tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:17.805566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5aa2a63-d2ec-4834-a2fe-242e7fc9f6ba tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:17.807329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5aa2a63-d2ec-4834-a2fe-242e7fc9f6ba tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:17.848399 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5aa2a63-d2ec-4834-a2fe-242e7fc9f6ba tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1281 microversion: 2.47 time: 0.252834 Oct 31 15:45:17.849738 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2689/5265] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:17 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:17.909094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:17.909754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:17.923523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.924433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.925247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:17.926170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.927173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.928395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:18.297640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77d90cd6-09f4-4c51-bc32-8542e4bcc97c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1435 microversion: 2.1 time: 0.392424 Oct 31 15:45:18.303154 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2690/5266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:17 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1435 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:18.461781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:18.464274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:18.464925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:18.465870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:18.466372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:18.477695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:18.478787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:18.479476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:18.480443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:18.481208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:18.482460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:18.510888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Getting quotas for project 79012b90300346aea230c944a64eb70f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:18.517363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Getting quotas for user 48adabd656cc43d8bfd0e1d1534062f1 and project 79012b90300346aea230c944a64eb70f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:18.535844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:18.538830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:18.628742 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb491403-e3fe-4fc1-879b-40fc86dd2321 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325987 Oct 31 15:45:18.630129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2577/5267] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:45:18.645587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-96425082-153c-48f3-b12f-384d5af6c711 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:18.649673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-96425082-153c-48f3-b12f-384d5af6c711 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:18.760299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-96425082-153c-48f3-b12f-384d5af6c711 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:18.770924 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-96425082-153c-48f3-b12f-384d5af6c711 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1216 microversion: 2.1 time: 0.133591 Oct 31 15:45:18.788612 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2691/5268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:18 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:18.877532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:18.878488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:18.910056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:18.913459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:18.914139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:18.917552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:18.918291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:18.919696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.148169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:19.166486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:19.176240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:19.179412 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-740c95ed-aead-4431-bd59-c9c626301513 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1333 microversion: 2.47 time: 0.307371 Oct 31 15:45:19.179997 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2578/5269] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:18 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1333 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:19.326163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:19.327081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:19.329192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:19.361272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:19.362212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:19.363601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.366826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:19.370155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:19.371760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.794733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:19.795348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:19.798578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:19.815806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:19.816437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:19.816918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.817647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:19.818237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:19.822787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.961924 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7cc6e99a-db78-442b-86be-ce76b5be43e0 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.640231 Oct 31 15:45:19.964129 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2692/5270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:19 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:20.065564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:20.076399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50e9d785-215a-444d-bdb0-4ca8905f5c58 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1220 microversion: 2.1 time: 0.285866 Oct 31 15:45:20.077509 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2579/5271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:19 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1220 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:20.217413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:20.218359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:20.225876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:20.226422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:20.226867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:20.227574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:20.228217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:20.228729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:20.343205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:20.365175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:20.367595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:20.369086 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-acdf188a-bcf3-4a24-b95d-c67d5d50fe9d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1339 microversion: 2.47 time: 0.165555 Oct 31 15:45:20.376668 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2693/5272] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:20 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:20.987031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:20.987655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:21.002668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.003168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.003602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.004313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.004794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.008400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.109892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:21.111856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:21.144861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.155660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.159731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.160598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.183578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.184043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.386297 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-819e2a83-35f9-41ba-bf0b-19a8a073cba9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.399926 Oct 31 15:45:21.387513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2580/5273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:20 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:21.389549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:21.402558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:21.404963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:21.409203 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9893d3d-8ea3-4aa4-8334-0a85ce4c37a6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1268 microversion: 2.1 time: 0.303489 Oct 31 15:45:21.410287 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2694/5274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:21 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1268 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:21.425574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.430568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.430568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.430568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.430568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.432976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.563037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:21.592762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:21.596652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:21.598450 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ab070ce5-0d8c-4377-a4e9-499ebfb6b445 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1339 microversion: 2.47 time: 0.200250 Oct 31 15:45:21.617329 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2581/5275] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:21 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1339 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:21.779615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-657b21d8-1090-4ddc-99e2-3180f0a99a89 req-749d1fe5-7396-4f34-8d52-46625a9c8ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b17114e-1779-4a2a-8aa4-73a06d95f2e7", "tag": "f2983532-6cbc-4b0c-b10f-8e7d35230659"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:21.796565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-657b21d8-1090-4ddc-99e2-3180f0a99a89 req-749d1fe5-7396-4f34-8d52-46625a9c8ee2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.797097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-657b21d8-1090-4ddc-99e2-3180f0a99a89 req-749d1fe5-7396-4f34-8d52-46625a9c8ee2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.797532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-657b21d8-1090-4ddc-99e2-3180f0a99a89 req-749d1fe5-7396-4f34-8d52-46625a9c8ee2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.820048 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-657b21d8-1090-4ddc-99e2-3180f0a99a89 req-749d1fe5-7396-4f34-8d52-46625a9c8ee2 service nova] Creating event network-changed:f2983532-6cbc-4b0c-b10f-8e7d35230659 for instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 on n-h1-858383-17 Oct 31 15:45:21.853179 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-657b21d8-1090-4ddc-99e2-3180f0a99a89 req-749d1fe5-7396-4f34-8d52-46625a9c8ee2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084689 Oct 31 15:45:21.879830 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2695/5276] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:22.415427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:22.416316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:22.425419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:22.426418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:22.427817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:22.430264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:22.435209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:22.435956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:22.436108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:22.436837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:22.453555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:22.454222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:22.454813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:22.455676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:22.456307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:22.456914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:22.538150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:22.547186 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40b92b01-353e-4206-9cc5-eaa84f5bcf9f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1268 microversion: 2.1 time: 0.115449 Oct 31 15:45:22.548359 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2696/5277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:22 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1268 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:22.628660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:22.629334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:22.653243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:22.653742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:22.654179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:22.654892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:22.655352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:22.655776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:22.859400 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00b696a3-4ab1-4816-aabb-ce6639931a67 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.448991 Oct 31 15:45:22.867311 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2582/5278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:22 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:22.983009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:23.001816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:23.004306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:23.007804 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60973d59-299f-472e-93d2-566f67645243 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1339 microversion: 2.47 time: 0.383530 Oct 31 15:45:23.010081 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2697/5279] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:22 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1339 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:23.573948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:23.575276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:23.583671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.584220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.584665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:23.585427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.586077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.586513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:23.831817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:23.842022 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa10d451-007a-4b6d-a419-f3dc6aadb551 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1274 microversion: 2.1 time: 0.275422 Oct 31 15:45:23.842758 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2583/5280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:23 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1274 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:23.890679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:23.891809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:23.900314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.900849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.901290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:23.902000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.902617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.903056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:24.039606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:24.040231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:24.048779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:24.049608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:24.050278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:24.051523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:24.052821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:24.054235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:24.168578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:24.184035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:24.188424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:24.190123 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-336f1edf-986a-40b2-82c2-fb0e0a89739d tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1339 microversion: 2.47 time: 0.154589 Oct 31 15:45:24.191819 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2584/5281] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:24 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:24.271770 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b407bfd4-3a66-4d4e-96dc-986702f00a47 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.384360 Oct 31 15:45:24.276317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2698/5282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:23 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:24.881847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:24.884915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:24.902497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:24.903613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:24.907066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:24.908512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:24.909246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:24.910624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.229082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:25.229793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:25.246882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.248143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.248830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.249784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.250386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.251024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.461685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:25.473323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:25.476638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:25.477894 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7942274b-2179-43e9-84b1-5422ba06f032 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1360 microversion: 2.47 time: 0.262836 Oct 31 15:45:25.482966 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2699/5283] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:25 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1360 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:25.486333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:25.491345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:25.492248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:25.496282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6009b998-0527-47e1-949f-1d7948fac495 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.632952 Oct 31 15:45:25.496965 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2585/5284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:24 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:25.508260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.513722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1394211800"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:25.521695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.523715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:25.524323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.526871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.527477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.529165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.539905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.540755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.543172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.544910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.547403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.548038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.744955 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01e371df-b1e8-49d9-b32e-b6fa4c9b0e6d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.260794 Oct 31 15:45:25.745776 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2700/5285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:25 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:25.960768 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1de1ce70-ac6b-431c-bb40-4ad4e39abeea tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "POST /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d/action" status: 202 len: 52 microversion: 2.47 time: 0.450550 Oct 31 15:45:25.961932 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2586/5286] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:45:25 2022] POST /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d/action => generated 52 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:45:25.975370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:25.976524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:25.986570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.987384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.988142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:25.991442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:25.992337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:25.994524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.040484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:45:26.214756 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e4bc8ec-24b5-492b-8e01-277b750c582a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "DELETE /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 204 len: 0 microversion: 2.47 time: 0.244442 Oct 31 15:45:26.216493 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2701/5287] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:45:25 2022] DELETE /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:45:26.224267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:26.225006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:26.245629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:26.246376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:26.261962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.263181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:26.265904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:26.266607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.462796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:26.477362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:26.479239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:26.486035 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a13a54d7-e3ea-4ab5-8068-2ddec8c5390e tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.265983 Oct 31 15:45:26.486897 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2587/5288] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:26 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:26.525710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:26.527787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:26.542434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:26.545592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:26.548090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.549895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:26.553284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:26.553942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.770077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:26.771841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:26.798538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:26.799255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:26.799720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.804879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:26.806326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:26.808783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:26.834251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:26.844019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa4bc9cd-f04d-4a83-ba81-53cfaf23278b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.323526 Oct 31 15:45:26.858548 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2702/5289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:26 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:27.038349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-bc3159d0-0a12-499c-b58f-460d04a607e4 req-8ad3c421-39cc-4c02-aab0-b8b8381229db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:27.073450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc3159d0-0a12-499c-b58f-460d04a607e4 req-8ad3c421-39cc-4c02-aab0-b8b8381229db service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:27.073995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc3159d0-0a12-499c-b58f-460d04a607e4 req-8ad3c421-39cc-4c02-aab0-b8b8381229db service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:27.074432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-bc3159d0-0a12-499c-b58f-460d04a607e4 req-8ad3c421-39cc-4c02-aab0-b8b8381229db service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:27.087897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:27.109176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-bc3159d0-0a12-499c-b58f-460d04a607e4 req-8ad3c421-39cc-4c02-aab0-b8b8381229db service nova] Creating event network-changed:e291afc7-e012-4d7f-a4b4-577c9e9d1b00 for instance 0f9fee03-445e-4efc-96b9-379c4fc55497 on n-h1-858383-17 Oct 31 15:45:27.121078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-bc3159d0-0a12-499c-b58f-460d04a607e4 req-8ad3c421-39cc-4c02-aab0-b8b8381229db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090816 Oct 31 15:45:27.122487 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2703/5290] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:27.169969 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f35f5616-ad77-4bb0-8fee-99296a2e3831 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.404042 Oct 31 15:45:27.187960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2588/5291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:26 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:27.515262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:27.530733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:27.534438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:27.562366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:27.563204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:27.564226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:27.565158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:27.565790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:27.566384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:27.718428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:27.730236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:27.732133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:27.733761 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f66dfdb6-3d58-4c29-b45c-e4096734182a tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.222306 Oct 31 15:45:27.748725 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2704/5292] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:27 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:27.869115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:27.871206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:27.893988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:27.897432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:27.898109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:27.900098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:27.902866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:27.903499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.191474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:28.195793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:28.197474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:28.203372 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a4cb3ce-0ed0-48dd-bb83-95154782e2a8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.339609 Oct 31 15:45:28.217012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:28.217509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:28.220863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.221788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:28.222424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:28.222662 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2589/5293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:27 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:28.223054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.378465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6b267c6-64de-49dc-9383-667851c32ca9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.186592 Oct 31 15:45:28.379145 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2705/5294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:28 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:28.761303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:28.761917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:28.768367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:28.769958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:28.772175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:28.772931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:28.773917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.774803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:28.775415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:28.776182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.855571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:28.870494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:28.873593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:28.876041 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-999e0426-c460-45f9-8e1a-f0aaed019f5b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.118490 Oct 31 15:45:28.876641 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2590/5295] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:28 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:29.227655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:29.228906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:29.231825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:29.236872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.237569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.238798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.240386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.241055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.241648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.402907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:29.406136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:29.414586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.415402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.416035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.417326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.417983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.418625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:30.080890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:30.095518 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-609c7ce4-b8ce-4978-a4d0-0886766579a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.871588 Oct 31 15:45:30.096445 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2706/5296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:29 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:30.102566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:30.109660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:30.125695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:30.126197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:30.126636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:30.127491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:30.127960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:30.128389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:30.274158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:30.285160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:30.288389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:30.289802 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2609dbc-f606-4424-9c70-db8a81c098ab tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.192312 Oct 31 15:45:30.291118 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2707/5297] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:30 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:30.323365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4861e7e9-1519-4e20-95f4-40888133a43c tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.925278 Oct 31 15:45:30.325662 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2591/5298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:29 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:31.106305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c4b06912-b653-48d6-ac4b-ab81b5a2660a req-e8463a6c-225b-46ab-a0fc-fc9bffca8dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b17114e-1779-4a2a-8aa4-73a06d95f2e7", "name": "network-vif-plugged", "status": "completed", "tag": "f2983532-6cbc-4b0c-b10f-8e7d35230659"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:31.124891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:31.125533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:31.130618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4b06912-b653-48d6-ac4b-ab81b5a2660a req-e8463a6c-225b-46ab-a0fc-fc9bffca8dee service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.131387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4b06912-b653-48d6-ac4b-ab81b5a2660a req-e8463a6c-225b-46ab-a0fc-fc9bffca8dee service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.132076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4b06912-b653-48d6-ac4b-ab81b5a2660a req-e8463a6c-225b-46ab-a0fc-fc9bffca8dee service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.143258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.144004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.144625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.145590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.146547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.147153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.151270 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c4b06912-b653-48d6-ac4b-ab81b5a2660a req-e8463a6c-225b-46ab-a0fc-fc9bffca8dee service nova] Creating event network-vif-plugged:f2983532-6cbc-4b0c-b10f-8e7d35230659 for instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 on n-h1-858383-17 Oct 31 15:45:31.158083 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c4b06912-b653-48d6-ac4b-ab81b5a2660a req-e8463a6c-225b-46ab-a0fc-fc9bffca8dee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063869 Oct 31 15:45:31.159516 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2708/5299] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:31.317221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:31.319077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:31.349578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.350097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.350548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.351280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.351749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.352181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.563655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:31.584137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:31.596272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:31.597721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2bdd468f-82f8-432f-a5df-09ad5ba945f7 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.286077 Oct 31 15:45:31.600804 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2709/5300] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:31 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:31.619005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:31.628999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:31.642335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.643122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.644116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.650691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.659949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.660775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.768412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:31.775607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:31.782887 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef3e0347-7bda-4c61-8cae-efa7cd233dec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.659059 Oct 31 15:45:31.789610 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2592/5301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:31 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:31.986383 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0073348-99d6-4b67-aa3a-1188f83e2b2d tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.384085 Oct 31 15:45:31.987774 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2710/5302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:31 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:32.629893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:32.631170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:32.639954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.640973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.641643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:32.642568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.643406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.644047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:32.730370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:32.740352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:32.743772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:32.745150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bdf40a81-28d7-470d-88d0-ddef5f40ea43 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.119141 Oct 31 15:45:32.745773 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2593/5303] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:32 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:32.808562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:32.809127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:32.822384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.823326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.823995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:32.824989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.826022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.826719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:33.012311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:33.012726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:33.020207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:33.021405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:33.022186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:33.029439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.039497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:33.042467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:33.043128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:33.047748 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2c79fc3-05c7-42dd-b6da-2ac65609ac9b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.243068 Oct 31 15:45:33.050112 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2711/5304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:32 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:33.244590 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98867ddd-3001-4d75-9f68-6da737c0b598 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.236283 Oct 31 15:45:33.252580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2594/5305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:33 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:33.777870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:33.778853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:33.786283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:33.787268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:33.787956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:33.788991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:33.789696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:33.790334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:33.872546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.882215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.883656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.885017 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1dd4e88d-36e5-4d4c-9e35-3498b97d4c39 tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1366 microversion: 2.47 time: 0.111238 Oct 31 15:45:33.885711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2712/5306] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:33 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:34.079181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:34.080414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:34.090013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.090756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.091367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.092311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.093034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.093633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.269401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:34.271185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:34.283129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.284360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.286942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.288324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.289357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.290661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.319835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:34.332410 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20398c59-a4b7-44d6-aa73-3098f85791b8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.257506 Oct 31 15:45:34.342039 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2595/5307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:34 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:34.468682 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4aa2a65e-1e59-411b-b7a4-1d3a44b6d6a6 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1465 microversion: 2.1 time: 0.203194 Oct 31 15:45:34.469911 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2713/5308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:34 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1465 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:34.915344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:34.915976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:34.924297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.925105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.925724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.928305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.929828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.930594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.036885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.037385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.037970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.038619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lazy-loading 'fault' on Instance uuid 873f6212-6245-4b00-b840-d9268c7b946d {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:45:35.084937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:35.103203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:35.106748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '264ce1cfbaea49f28a9dbefddd40c476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58ae618d5a54f01abf7ea12518f17d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:35.108977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ffb72112-ba0e-43a3-a3e5-dd9b7344abec tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 200 len: 1371 microversion: 2.47 time: 0.198256 Oct 31 15:45:35.121956 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2596/5309] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:34 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:35.361817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:35.364198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:35.381943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.383494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.385165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.389395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.390162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.391395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.491786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:35.492414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:35.503117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.503985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.505558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.506683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.508191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.511927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.710174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:35.719275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7fb178d4-bf5d-4863-a42b-6ae3635c832e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.361863 Oct 31 15:45:35.737779 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2714/5310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:35 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:35.846492 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f7ca83ae-682a-4850-8ec6-f1d944791a79 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1650 microversion: 2.1 time: 0.347749 Oct 31 15:45:35.869144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2597/5311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:35 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1650 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:35.878193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:35.878820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:35.892126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.892647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.893117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.894022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.894658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.895856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.120065 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2204db99-c291-4555-a494-0fe441f92ad2 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1650 microversion: 2.1 time: 0.245474 Oct 31 15:45:36.121474 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2715/5312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:35 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1650 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:36.144881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:36.145562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] [instance: 873f6212-6245-4b00-b840-d9268c7b946d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:36.152510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:36.153395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:36.160593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.165968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.166939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.167254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.169229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.170332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.172380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.172675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.173635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.174277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.176434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.177035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.196799 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] HTTP exception thrown: Instance 873f6212-6245-4b00-b840-d9268c7b946d could not be found. Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Request method failure captured: Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d HTTP/1.1 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2MoVEa92eTd96ExY9Cv_ll_7CMb0KZLVjpaIqB74X7uY8f0Wh34h-zMufPM7O7WbpjXb4O-NxbJkkdu2ooTbVmptcpDFy6h_0yZqrCPttuU3yhXdMilJlmkoTE8GjL3IQTyWke_h-vnLdyBmvCK1ATPJPFUwYS7CLYQwVgJlQ-pfo Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d58ae618d5a54f01abf7ea12518f17d7 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAaction247Test-1851923063 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d58ae618d5a54f01abf7ea12518f17d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d58ae618d5a54f01abf7ea12518f17d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d58ae618d5a54f01abf7ea12518f17d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d58ae618d5a54f01abf7ea12518f17d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAaction247Test-1851923063 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d58ae618d5a54f01abf7ea12518f17d7 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAaction247Test-1851923063 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAaction247Test-1851923063-project Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 264ce1cfbaea49f28a9dbefddd40c476 Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAaction247Test-1851923063-project Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 873f6212-6245-4b00-b840-d9268c7b946d could not be found. Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '873f6212-6245-4b00-b840-d9268c7b946d'} Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873f6212-6245-4b00-b840-d9268c7b946d could not be found. Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873f6212-6245-4b00-b840-d9268c7b946d could not be found. Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:36.199105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873f6212-6245-4b00-b840-d9268c7b946d could not be found. Oct 31 15:45:36.203227 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:36.206588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] Returning 404 to user: Instance 873f6212-6245-4b00-b840-d9268c7b946d could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:45:36.208235 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0030a67e-1604-4449-9955-f7008080043b tempest-ServersAaction247Test-1851923063 tempest-ServersAaction247Test-1851923063-project] 10.222.0.48 "GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d" status: 404 len: 111 microversion: 2.47 time: 0.070038 Oct 31 15:45:36.209611 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2598/5313] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:36 2022] GET /compute/v2.1/servers/873f6212-6245-4b00-b840-d9268c7b946d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:45:36.511654 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a371f089-645a-431d-866a-d411849da341 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1650 microversion: 2.1 time: 0.366423 Oct 31 15:45:36.515522 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2716/5314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:36 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1650 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:36.537617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:36.538128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:36.563954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.565448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.569361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.570374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.571054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.571684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.669528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:45:36.753344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:36.754082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:36.770124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.772459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.775697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.777700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.779778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.780312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.835712 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92e084f5-7fa3-44df-ab51-f6bd26cbe6e3 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 204 len: 0 microversion: 2.1 time: 0.301469 Oct 31 15:45:36.837098 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2599/5315] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:45:36 2022] DELETE /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:45:36.849266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:36.855544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:36.865802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.868075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.868783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.871976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:36.872807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:36.874728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:37.257727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-82b6c2a3-c2b9-4881-8703-2766764265d9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1656 microversion: 2.1 time: 0.416012 Oct 31 15:45:37.267782 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2600/5316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:36 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1656 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:37.268460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:37.283601 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb3b0af1-27ed-4fc8-8d74-eca7328bb9f1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.535732 Oct 31 15:45:37.284869 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2717/5317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:36 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:38.289495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:38.290127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:38.308579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:38.310174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:38.324339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:38.325233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:38.329263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:38.334625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:38.337694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:38.339196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:38.341981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:38.343833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:38.344428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:38.347027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:38.347931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:38.350410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:38.832160 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e29fafc5-4eff-4e65-9b07-162ba4e4e5bc tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1656 microversion: 2.1 time: 0.549955 Oct 31 15:45:38.835215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2601/5318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:38 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1656 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:38.949655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:38.960400 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cffeb265-775f-4682-9ad5-9b1910d66474 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.656845 Oct 31 15:45:38.963501 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2718/5319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:38 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:39.680740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4e557b7e-6be8-483b-9adf-60dc3d307fa7 req-4e745ae4-d214-4677-822c-86c205e58ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b17114e-1779-4a2a-8aa4-73a06d95f2e7", "name": "network-vif-deleted", "tag": "f2983532-6cbc-4b0c-b10f-8e7d35230659"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:39.700557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4e557b7e-6be8-483b-9adf-60dc3d307fa7 req-4e745ae4-d214-4677-822c-86c205e58ec6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:39.703105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4e557b7e-6be8-483b-9adf-60dc3d307fa7 req-4e745ae4-d214-4677-822c-86c205e58ec6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:39.703835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4e557b7e-6be8-483b-9adf-60dc3d307fa7 req-4e745ae4-d214-4677-822c-86c205e58ec6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.730345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4e557b7e-6be8-483b-9adf-60dc3d307fa7 req-4e745ae4-d214-4677-822c-86c205e58ec6 service nova] Creating event network-vif-deleted:f2983532-6cbc-4b0c-b10f-8e7d35230659 for instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 on n-h1-858383-17 Oct 31 15:45:39.736266 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4e557b7e-6be8-483b-9adf-60dc3d307fa7 req-4e745ae4-d214-4677-822c-86c205e58ec6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066311 Oct 31 15:45:39.737798 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2719/5320] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:39.782566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-502974997", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:39.863228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:39.865181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:39.908259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:39.909715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:39.910225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.911996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:39.912955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:39.913354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:39.913800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.914592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:39.915088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:39.915497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:39.916484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:39.942145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:39.943676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:39.945409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.948161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:39.950179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:39.950843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.979191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:39.979986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:39.981029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.981861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lazy-loading 'fault' on Instance uuid 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:45:40.010124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Getting quotas for project b548ee8a1c4748ef9e41a410dc8ff870. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:40.016912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Getting quotas for user 594e5f90ebd44a43b52f306368d7d6cf and project b548ee8a1c4748ef9e41a410dc8ff870. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:40.036767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:40.039379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:40.097023 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e113e1b6-6b7a-43be-a501-1f8940dee71d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.634023 Oct 31 15:45:40.099660 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2602/5321] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:45:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:45:40.105982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:40.107295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:40.116930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.117735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.118389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.119234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.120181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.120850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.131564 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9bf6987a-3e6a-40c3-839a-4409ef2444f1 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 200 len: 1455 microversion: 2.1 time: 0.273760 Oct 31 15:45:40.134450 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2720/5322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:39 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 1455 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:40.169566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c629080-2465-45a3-b68d-fd6a9eee0dfa tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:40.170471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c629080-2465-45a3-b68d-fd6a9eee0dfa tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:40.383833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c629080-2465-45a3-b68d-fd6a9eee0dfa tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.404760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c629080-2465-45a3-b68d-fd6a9eee0dfa tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.408763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c629080-2465-45a3-b68d-fd6a9eee0dfa tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.414988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c629080-2465-45a3-b68d-fd6a9eee0dfa tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80" status: 200 len: 1277 microversion: 2.47 time: 0.266459 Oct 31 15:45:40.416165 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2721/5323] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:40 2022] GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80 => generated 1277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:40.429228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f8567331-83ef-4819-b66f-ef0e2a917a64 req-7d3fb4dd-ab6a-4792-83d5-35c4c82ad2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "name": "network-vif-plugged", "status": "completed", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:40.459740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8567331-83ef-4819-b66f-ef0e2a917a64 req-7d3fb4dd-ab6a-4792-83d5-35c4c82ad2de service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.460238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8567331-83ef-4819-b66f-ef0e2a917a64 req-7d3fb4dd-ab6a-4792-83d5-35c4c82ad2de service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.460671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8567331-83ef-4819-b66f-ef0e2a917a64 req-7d3fb4dd-ab6a-4792-83d5-35c4c82ad2de service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.493803 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f8567331-83ef-4819-b66f-ef0e2a917a64 req-7d3fb4dd-ab6a-4792-83d5-35c4c82ad2de service nova] Creating event network-vif-plugged:e291afc7-e012-4d7f-a4b4-577c9e9d1b00 for instance 0f9fee03-445e-4efc-96b9-379c4fc55497 on n-h1-858383-17 Oct 31 15:45:40.505408 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f8567331-83ef-4819-b66f-ef0e2a917a64 req-7d3fb4dd-ab6a-4792-83d5-35c4c82ad2de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083150 Oct 31 15:45:40.507066 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2722/5324] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:40.534923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1457373164", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": "none"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:40.642116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.651835 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5631aad-5910-4c5b-bde0-09c6d20b6a2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.550914 Oct 31 15:45:40.658135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2603/5325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:40 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:40.676326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:40.676759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:40.677374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:40.677796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:40.678223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:40.692664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.693630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.694098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.694886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.695724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.696165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.729783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:40.752048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Getting quotas for project b548ee8a1c4748ef9e41a410dc8ff870. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:40.768513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Getting quotas for user 594e5f90ebd44a43b52f306368d7d6cf and project b548ee8a1c4748ef9e41a410dc8ff870. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:40.785145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:40.791447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:40.935148 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40118391-acad-4822-a916-55cfaf2025ec tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.401914 Oct 31 15:45:40.937810 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2723/5326] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Oct 31 15:45:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:45:40.952440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1ee0179-21d3-40a1-a2b1-18923092d903 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:40.955289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1ee0179-21d3-40a1-a2b1-18923092d903 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.067825 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1ee0179-21d3-40a1-a2b1-18923092d903 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "PUT /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 992 microversion: 2.47 time: 0.121479 Oct 31 15:45:41.068634 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2604/5327] 10.222.0.48 () {62 vars in 1297 bytes} [Mon Oct 31 15:45:40 2022] PUT /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 992 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:45:41.091508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e135a52-6343-49ea-9754-44d1c0585efc tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.092472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e135a52-6343-49ea-9754-44d1c0585efc tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.168253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.168253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 0b17114e-1779-4a2a-8aa4-73a06d95f2e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.181078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.182997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.184642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.191565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.191565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.193900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.210614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e135a52-6343-49ea-9754-44d1c0585efc tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:41.227380 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] HTTP exception thrown: Instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 could not be found. Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Request method failure captured: Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 HTTP/1.1 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-12-BvLtyW857qxeqVBrpzgrKHWYOoHQNHVq5uGEUhXwMs5hZQ78g6EhpCtKTr-_3GCMxuMffP4YrwwnQstsZDkUy7nHyFkyUxtziDrb-EKwcaD9Gu_hxaGzYKVAY_z-L_YJqZY8OoIQvBm5lgSmyb7x1xj5kziKWJwHrw6nw7MGOM Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 3dcc31ce1e5141e597b13d56dcc4e8fb Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestServerMultinode-1783883659 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestServerMultinode-1783883659 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 3dcc31ce1e5141e597b13d56dcc4e8fb Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestServerMultinode-1783883659 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestServerMultinode-1783883659-project-admin Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a0743203333c4417b026c839de8a6510 Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestServerMultinode-1783883659-project-admin Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 could not be found. Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0b17114e-1779-4a2a-8aa4-73a06d95f2e7'} Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 could not be found. Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 could not be found. Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:41.229112 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 could not be found. Oct 31 15:45:41.233822 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:45:41.235810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Returning 404 to user: Instance 0b17114e-1779-4a2a-8aa4-73a06d95f2e7 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:45:41.236914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e135a52-6343-49ea-9754-44d1c0585efc tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:41.237294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dea0ce05-0ee7-4392-92cc-2aa1ed0881f5 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7" status: 404 len: 111 microversion: 2.1 time: 0.083059 Oct 31 15:45:41.241963 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2605/5328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:41 2022] GET /compute/v2.1/servers/0b17114e-1779-4a2a-8aa4-73a06d95f2e7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:45:41.242604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e135a52-6343-49ea-9754-44d1c0585efc tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:41.246926 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e135a52-6343-49ea-9754-44d1c0585efc tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1278 microversion: 2.47 time: 0.160006 Oct 31 15:45:41.255420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.256109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.265816 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2724/5329] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:41 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:41.287158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.293585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.295196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.296029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.299124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.301852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.357968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:45:41.509779 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f68f2f0-31b7-4821-a00c-948e155858c9 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 204 len: 0 microversion: 2.1 time: 0.263475 Oct 31 15:45:41.511318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2606/5330] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:45:41 2022] DELETE /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:45:41.520527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.521321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.531386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.535170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.538020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.556123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.556986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.557559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.688674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.690209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.700307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.701167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.701844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.702827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.703553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.704710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.881783 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ec199c2-62a4-4565-8bc6-0dbb8c902746 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1656 microversion: 2.1 time: 0.366538 Oct 31 15:45:41.892858 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2725/5331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:41 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1656 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:41.928974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:41.937826 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b23d1a27-47a8-4233-9e3d-5a771ba8d414 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1316 microversion: 2.1 time: 0.256186 Oct 31 15:45:41.938470 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2607/5332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:41 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:42.296874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:42.297794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:42.304665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:42.305748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:42.306451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.308066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:42.309047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:42.310405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.439555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:42.451309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:42.458109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:42.460020 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-480123c3-7305-4f20-b144-468e2d6dcd4c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1282 microversion: 2.47 time: 0.167138 Oct 31 15:45:42.465008 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2726/5333] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:42 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:42.909868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:42.920155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:42.939776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:42.940488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:42.957162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.960772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:42.961286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:42.961732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.963880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:42.967112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:43.215753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:43.215753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:43.215753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:43.215753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:43.215753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:43.215753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:43.611684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:43.615705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.621028 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76140f8d-b1b5-4975-a620-08378d5af882 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1656 microversion: 2.1 time: 0.715015 Oct 31 15:45:43.630665 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52d36972-3a0e-4114-84b4-da39212947f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.673410 Oct 31 15:45:43.645763 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2727/5335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:42 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:43.653534 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2608/5335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:42 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1656 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:43.666081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:43.666891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:43.673493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:43.674210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:43.674851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:43.675761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:43.676632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:43.677444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:43.865928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.904379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.906438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.913260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-736600537", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:43.916041 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-529b0c10-aa21-4b94-9469-e4005ee01449 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1330 microversion: 2.47 time: 0.268860 Oct 31 15:45:43.917810 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2728/5336] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:43 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1330 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:44.049927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] validate_networks() for [('7d595c49-078e-4b9a-8f8f-2f689a0106c6', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:45:44.297391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d546fd5e-1ace-4fe8-902e-50b182895639 req-9d03da96-9552-4d73-b9c3-8a0969bafac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b2873a-07d9-42c6-a786-0a3c0cb14368", "name": "network-vif-deleted", "tag": "d7abf4d6-791e-44dd-b979-53e8fff8aa4e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:44.314665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:44.318647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d546fd5e-1ace-4fe8-902e-50b182895639 req-9d03da96-9552-4d73-b9c3-8a0969bafac0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:44.320314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d546fd5e-1ace-4fe8-902e-50b182895639 req-9d03da96-9552-4d73-b9c3-8a0969bafac0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:44.321065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d546fd5e-1ace-4fe8-902e-50b182895639 req-9d03da96-9552-4d73-b9c3-8a0969bafac0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:44.371967 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d546fd5e-1ace-4fe8-902e-50b182895639 req-9d03da96-9552-4d73-b9c3-8a0969bafac0 service nova] Creating event network-vif-deleted:d7abf4d6-791e-44dd-b979-53e8fff8aa4e for instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 on n-h2-858383-17 Oct 31 15:45:44.379939 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d546fd5e-1ace-4fe8-902e-50b182895639 req-9d03da96-9552-4d73-b9c3-8a0969bafac0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093945 Oct 31 15:45:44.381317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2729/5337] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:45:44.699830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:44.715484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:44.724545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:44.725688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:44.726471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:44.727994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:44.728756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:44.729576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:45.141807 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51301659-12e1-4339-80a8-2c2226e7c3f4 tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1451 microversion: 2.1 time: 0.462600 Oct 31 15:45:45.152843 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2730/5338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:44 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1451 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:45.193440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:45.194351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:45.202726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:45.203974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:45.204661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:45.205569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:45.206190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:45.207000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:45.351204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:45.351703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:45.352100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:45.352533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:45.353378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:45.356513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:45.366505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:45.366992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:45.367430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:45.368158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:45.368617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:45.373370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:45.373834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:45.375292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:45.376713 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a2ac8ab-e554-43cd-ac40-87eb5b0cff8d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1348 microversion: 2.47 time: 0.222272 Oct 31 15:45:45.377283 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2731/5339] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:45 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1348 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:45.395626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Getting quotas for project 79012b90300346aea230c944a64eb70f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:45.401408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:45.402789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Getting quotas for user 48adabd656cc43d8bfd0e1d1534062f1 and project 79012b90300346aea230c944a64eb70f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:45.420457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:45.423243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:45.480610 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-380bd599-5ffa-4d91-8d87-8452a25ae0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.573490 Oct 31 15:45:45.481846 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2609/5340] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:45:45.495411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df122375-62e9-4124-936f-87eff9574e79 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:45.496306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df122375-62e9-4124-936f-87eff9574e79 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:45.586454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-df122375-62e9-4124-936f-87eff9574e79 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:45.602844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df122375-62e9-4124-936f-87eff9574e79 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1216 microversion: 2.1 time: 0.113026 Oct 31 15:45:45.604621 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2732/5341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:45 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:46.174183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:46.175142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:46.194081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.194776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.197492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.198403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.199140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.199729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.274517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.275055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.275667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.276271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lazy-loading 'fault' on Instance uuid 39b2873a-07d9-42c6-a786-0a3c0cb14368 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:45:46.418817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:46.419569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:46.433615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.446658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.447383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.449888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.450802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.452581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.476233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2c9a52e-7feb-45ce-a029-656ea438a22a tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 200 len: 1456 microversion: 2.1 time: 0.305710 Oct 31 15:45:46.480710 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2610/5342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:46 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 1456 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:46.594651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.606873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.609326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.611718 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f421bef-2cfd-4dbf-863f-b7c4b0fe7466 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1336 microversion: 2.47 time: 0.204047 Oct 31 15:45:46.612891 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2733/5343] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:46 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1336 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:46.632098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:46.633101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:46.640009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.644399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.645538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.646280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.648792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.649269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.829393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.840976 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-237a567a-710d-4ec3-9fa7-35c3371c32fc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1268 microversion: 2.1 time: 0.213077 Oct 31 15:45:46.841580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2611/5344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:46 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:47.515775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:47.517471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] [instance: 39b2873a-07d9-42c6-a786-0a3c0cb14368] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:47.526590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.527547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.567228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.569849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.570687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.573517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.624253 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] HTTP exception thrown: Instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 could not be found. Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Request method failure captured: Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 HTTP/1.1 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-12-BvLtyW857qxeqVBrpzgrKHWYOoHQNHVq5uGEUhXwMs5hZQ78g6EhpCtKTr-_3GCMxuMffP4YrwwnQstsZDkUy7nHyFkyUxtziDrb-EKwcaD9Gu_hxaGzYKVAY_z-L_YJqZY8OoIQvBm5lgSmyb7x1xj5kziKWJwHrw6nw7MGOM Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3dcc31ce1e5141e597b13d56dcc4e8fb Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestServerMultinode-1783883659 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3dcc31ce1e5141e597b13d56dcc4e8fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestServerMultinode-1783883659 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3dcc31ce1e5141e597b13d56dcc4e8fb Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestServerMultinode-1783883659 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestServerMultinode-1783883659-project-admin Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: a0743203333c4417b026c839de8a6510 Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestServerMultinode-1783883659-project-admin Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 could not be found. Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '39b2873a-07d9-42c6-a786-0a3c0cb14368'} Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 could not be found. Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 could not be found. Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:45:47.628245 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 could not be found. Oct 31 15:45:47.633843 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:45:47.635699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] Returning 404 to user: Instance 39b2873a-07d9-42c6-a786-0a3c0cb14368 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:45:47.636755 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2673940-840f-4e0a-aa4d-6020cca23f0f tempest-TestServerMultinode-1783883659 tempest-TestServerMultinode-1783883659-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368" status: 404 len: 111 microversion: 2.1 time: 0.125647 Oct 31 15:45:47.644029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:47.645960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:47.650122 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2734/5345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:47 2022] GET /compute/v2.1/servers/39b2873a-07d9-42c6-a786-0a3c0cb14368 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:45:47.655359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.656036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.656739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.657715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.658632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.659244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.802785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.829532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.831365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.835504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-be290a9f-2cd9-41ea-a2cc-3d894244836a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1336 microversion: 2.47 time: 0.196050 Oct 31 15:45:47.845327 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2612/5346] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:47 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1336 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:47.875494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:47.877757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:47.895357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.900179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.901376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.902320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.908290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.909781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:48.134070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:48.147761 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e48fa11-510d-4386-9d6e-2f32aeea5b75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1274 microversion: 2.1 time: 0.277819 Oct 31 15:45:48.149917 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2735/5347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:47 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:48.890549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:48.891187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:48.901468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.902403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.903014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:48.904414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.905770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.906544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.144761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.176456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:49.177781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:49.179200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.187047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.190730 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5634e0a8-0417-4d2f-9e61-d021dc651963 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1357 microversion: 2.47 time: 0.304973 Oct 31 15:45:49.193870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2613/5348] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:48 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:49.211006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.211508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.211946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.215123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.216800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.217265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.244535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:49.253590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:49.305331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.307061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.307512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.310286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.310797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.312385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.496048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:49.496329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:49.496832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:49.497310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:49.497721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:49.714129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:49.731258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.731777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.732336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.733121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.733715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.734021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.769449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.777609 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27c0b981-c916-4213-9822-7dc4c6bc3939 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.608753 Oct 31 15:45:49.791021 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2736/5349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:49 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:49.808078 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-032b8e86-53d8-4be6-b0e4-fa4061882523 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "POST /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692/action" status: 202 len: 1079 microversion: 2.47 time: 0.574736 Oct 31 15:45:49.809353 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2614/5350] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Oct 31 15:45:49 2022] POST /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692/action => generated 1079 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:45:49.837919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:49.839218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:49.864551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.865345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.865952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.866952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:49.870682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:49.871490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.205165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:50.227992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:50.229938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:50.232044 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b3a0cda-d92c-49ef-a1a7-77031a0f3a1e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.403521 Oct 31 15:45:50.236074 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2737/5351] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:49 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:50.803931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:50.805275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:50.847395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.850117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.850655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.851481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.854256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.855106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:51.263219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.264870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:51.265487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:51.273900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:51.274941 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00384384-523f-4424-8bca-42bd87e22be8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.475412 Oct 31 15:45:51.287779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:51.288030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2615/5352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:50 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:51.288135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:51.288135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:51.288135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:51.288135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:51.288135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:51.651649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.666669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.668585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.677101 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2dd9661d-5eb9-485e-9a88-050f5e3d794a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.414715 Oct 31 15:45:51.678458 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2738/5353] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:51 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:52.308462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:52.309202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:52.322503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.325615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.326244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.329994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.330658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.331274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.843971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e3162b65-5ce8-44ab-a9c6-f4a63932ac4f req-4d8aabc8-99ec-4b92-b116-5f0da0494f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ab85ff-eb88-40e5-817e-795c4c07713d", "tag": "2140ecd1-5b25-4caa-80fa-f7a22b669241"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:52.862908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e3162b65-5ce8-44ab-a9c6-f4a63932ac4f req-4d8aabc8-99ec-4b92-b116-5f0da0494f99 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.864085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e3162b65-5ce8-44ab-a9c6-f4a63932ac4f req-4d8aabc8-99ec-4b92-b116-5f0da0494f99 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.867066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e3162b65-5ce8-44ab-a9c6-f4a63932ac4f req-4d8aabc8-99ec-4b92-b116-5f0da0494f99 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.895915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e3162b65-5ce8-44ab-a9c6-f4a63932ac4f req-4d8aabc8-99ec-4b92-b116-5f0da0494f99 service nova] Creating event network-changed:2140ecd1-5b25-4caa-80fa-f7a22b669241 for instance 63ab85ff-eb88-40e5-817e-795c4c07713d on n-h1-858383-17 Oct 31 15:45:52.906268 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e3162b65-5ce8-44ab-a9c6-f4a63932ac4f req-4d8aabc8-99ec-4b92-b116-5f0da0494f99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.395332 Oct 31 15:45:52.908151 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2739/5354] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:52.916246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:52.917479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:52.925271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.926148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.926780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.928443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.929276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.930934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.934132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:52.971056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe453960-5d0c-4a6d-8e07-487071941ae7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.669348 Oct 31 15:45:52.971949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2616/5355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:52 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:53.134020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.193023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.229308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.234852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bef4e01e-521c-4ff0-b065-d7610bb18c49 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.324567 Oct 31 15:45:53.235468 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2740/5356] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:52 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:53.997078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:53.998343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:54.023724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:54.024226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:54.024678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:54.027575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:54.028054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:54.028497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:54.268806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:54.269864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:54.290271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:54.291635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:54.293695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:54.295833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:54.313414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:54.315319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:54.422733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.450287 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c76604c-35d3-4984-bce7-991ec6e30a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.458149 Oct 31 15:45:54.465093 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2617/5357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:53 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:54.584190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.611623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.618174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.619446 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a5b5594-09d2-4e20-9b3f-1d0189008655 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.357241 Oct 31 15:45:54.626699 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2741/5358] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:54 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:55.479269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:55.480873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:55.489516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:55.492400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:55.507810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.513379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.513843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.515026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.515676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.516278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.661325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:55.662264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:55.671375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:55.674279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.677056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.677754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.678729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.679551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.680681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.842197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:55.860011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:55.862345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:55.864616 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-224defdb-678a-48cc-867c-4b158cecd74f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.212310 Oct 31 15:45:55.865284 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2742/5359] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:55 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:56.221619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:56.236139 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8cfe981c-a46b-47f8-8fa2-05b6f7da64df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.761052 Oct 31 15:45:56.240459 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2618/5360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:55 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:56.893736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:56.895539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:56.907791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:56.910298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:56.913827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:56.920230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:56.935653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:56.937830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.163088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.174339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.181713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.185701 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31646647-7e88-4f9c-bd1e-4a757037fd54 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.297733 Oct 31 15:45:57.186283 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2743/5361] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:56 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:57.264314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:57.266428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:57.282117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.288919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.291213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.294090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.297147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.298000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.784546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.795049 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d6b023e6-c393-456a-b460-e5dafeea8130 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.536333 Oct 31 15:45:57.809152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2619/5362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:57 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:58.217853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.220164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:58.233266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.240690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.243293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.245746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.247538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.250571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.296889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:58.528978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.552350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.554483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.555786 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d24e6340-687b-424e-b02a-025fb0d53191 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.343979 Oct 31 15:45:58.556391 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2744/5363] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:58 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:58.821332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.821947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:58.842260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.845469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.846516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.850221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.851588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.864905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.202560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.218111 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce8ab7cb-83b5-4b92-b147-e66aa0b66d73 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.400602 Oct 31 15:45:59.219650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2620/5364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:58 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:59.589285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:59.590506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:59.605298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:59.612837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:59.613810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.614832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:59.618833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:59.619290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.804105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.827383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.829400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.831086 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f54e912a-49db-4a6e-a939-521629fbbcbd tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.246284 Oct 31 15:45:59.832593 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2745/5365] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:59 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:00.241937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:00.242567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:00.256956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.257457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.257903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.258628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.259103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.259536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.428541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:00.440860 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de553016-6d2f-45dc-abbb-c6abd9b8a1e5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 0.202868 Oct 31 15:46:00.441676 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2621/5366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:00 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:00.860389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:00.861058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:00.886393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-42afe998-2626-4435-a8de-ce2bf0e25aa3 req-743a3eaa-f7d5-4b53-9708-a7981da9bba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ab85ff-eb88-40e5-817e-795c4c07713d", "name": "network-vif-plugged", "status": "completed", "tag": "2140ecd1-5b25-4caa-80fa-f7a22b669241"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:00.890990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.892101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.896228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.897979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.898471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.898913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.915843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-42afe998-2626-4435-a8de-ce2bf0e25aa3 req-743a3eaa-f7d5-4b53-9708-a7981da9bba7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.916336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-42afe998-2626-4435-a8de-ce2bf0e25aa3 req-743a3eaa-f7d5-4b53-9708-a7981da9bba7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.916890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-42afe998-2626-4435-a8de-ce2bf0e25aa3 req-743a3eaa-f7d5-4b53-9708-a7981da9bba7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.936316 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-42afe998-2626-4435-a8de-ce2bf0e25aa3 req-743a3eaa-f7d5-4b53-9708-a7981da9bba7 service nova] Creating event network-vif-plugged:2140ecd1-5b25-4caa-80fa-f7a22b669241 for instance 63ab85ff-eb88-40e5-817e-795c4c07713d on n-h1-858383-17 Oct 31 15:46:00.943830 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-42afe998-2626-4435-a8de-ce2bf0e25aa3 req-743a3eaa-f7d5-4b53-9708-a7981da9bba7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064348 Oct 31 15:46:00.944807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2622/5367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:01.057868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:01.074143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:01.075610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:01.076862 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54e083de-9bb9-474c-8632-70386e4da722 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.221237 Oct 31 15:46:01.077728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2746/5368] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:00 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:01.470492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:01.471350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:01.481672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:01.482646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:01.483325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:01.484341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:01.485050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:01.486059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.114465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:02.115221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:02.144225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.144941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.145622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.146366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.146850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.147454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.418238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.431428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.432929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.434153 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0975978d-1423-407a-8b98-c0494f5d6e89 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.324707 Oct 31 15:46:02.434736 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2747/5369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:02 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:02.479249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.489334 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ec5ce535-26ea-40d2-910e-0b0aa98ebff5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1316 microversion: 2.1 time: 1.023298 Oct 31 15:46:02.489933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2623/5370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:01 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1316 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:03.467305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:03.471581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:03.493904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.497113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.497620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.499495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.500646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.504385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.522340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:03.523079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:03.545506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.546290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.549530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.551284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.553069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.556163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.663269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:03.861426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.874852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.883902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.886794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d9d3282-a6bc-499b-aae2-57430eb90b30 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.425501 Oct 31 15:46:03.890315 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2748/5371] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:03 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:03.976951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.989592 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-46de21f7-c0fd-4b18-8841-9d1a3811f45f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1505 microversion: 2.1 time: 0.469413 Oct 31 15:46:03.991961 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2624/5372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:03 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:04.025878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:04.026917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:04.046895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.051963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.052985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.056217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.057140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.059233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.184130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:46:04.352499 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89cbabcc-7f8a-4180-815b-c859ca6dba0a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "DELETE /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 204 len: 0 microversion: 2.1 time: 0.333253 Oct 31 15:46:04.354927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2749/5373] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:46:04 2022] DELETE /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:46:04.367749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:04.368796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:04.381296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.382176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.383787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.386241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.396473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.397913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.695735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:04.707396 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afe3a909-1442-43ce-a8e2-5d22fd7c9cae tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1511 microversion: 2.1 time: 0.348331 Oct 31 15:46:04.712237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2625/5374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:04 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:04.920178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:04.921044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:04.936426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.937105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.937641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.938449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.939009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.939540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.051489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.061574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.063392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.069197 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e45992c-506f-4b62-a6d0-b51d7a0131c6 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.148842 Oct 31 15:46:05.070917 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2750/5375] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:04 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:05.734089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:05.734664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:05.746747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.747300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.747740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.748470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.748961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.749389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.102114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:06.102735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:06.114224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:06.125188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:06.126026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.126976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:06.131145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:06.142802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.371331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:06.380257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93df0a7a-9f50-4daf-a791-10f3a6068d53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1511 microversion: 2.1 time: 0.650480 Oct 31 15:46:06.380737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2626/5376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:05 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:06.540583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:06.554248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:06.558486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:06.560026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d068a10f-f5b0-4bc8-8d6f-37b660d1b85a tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.463443 Oct 31 15:46:06.563835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2751/5377] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:06 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:07.373563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8f51685c-4289-4483-8611-2fdcfad63dc2 req-cf55373a-eaa7-4cff-be69-86090f9fdc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ab85ff-eb88-40e5-817e-795c4c07713d", "name": "network-vif-deleted", "tag": "2140ecd1-5b25-4caa-80fa-f7a22b669241"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:07.395789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f51685c-4289-4483-8611-2fdcfad63dc2 req-cf55373a-eaa7-4cff-be69-86090f9fdc6f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.396613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f51685c-4289-4483-8611-2fdcfad63dc2 req-cf55373a-eaa7-4cff-be69-86090f9fdc6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.397525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f51685c-4289-4483-8611-2fdcfad63dc2 req-cf55373a-eaa7-4cff-be69-86090f9fdc6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.414625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:07.417175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:07.443646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.444352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.447429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.449008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.449816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.450624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.457345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8f51685c-4289-4483-8611-2fdcfad63dc2 req-cf55373a-eaa7-4cff-be69-86090f9fdc6f service nova] Creating event network-vif-deleted:2140ecd1-5b25-4caa-80fa-f7a22b669241 for instance 63ab85ff-eb88-40e5-817e-795c4c07713d on n-h1-858383-17 Oct 31 15:46:07.469647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8f51685c-4289-4483-8611-2fdcfad63dc2 req-cf55373a-eaa7-4cff-be69-86090f9fdc6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103511 Oct 31 15:46:07.475397 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2627/5378] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:07.598300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:07.598300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:07.635330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.641879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.642423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.643198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.646530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.650942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.763901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.777426 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3b0e0aa-6ddb-4994-996c-d64a7505b87e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 200 len: 1301 microversion: 2.1 time: 0.375116 Oct 31 15:46:07.781020 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2752/5379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:07 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 1301 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:07.808521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.820504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.822000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.823209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b798c05-49cd-40d1-8ae4-062bfedc7f62 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.233085 Oct 31 15:46:07.823773 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2628/5380] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:07 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:08.810912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:08.816178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:08.833221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.833728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.834172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.835050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.841619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.845038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.853325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:08.854723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:08.863875 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d HTTP/1.1 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '63ab85ff-eb88-40e5-817e-795c4c07713d'} Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:08.865974 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:08.872244 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:08.873655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.873655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.873655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.876599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.876838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.879696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.889415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:08.891403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb6ec992-c3ae-4cb4-a7a5-034996c091f3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 404 len: 111 microversion: 2.1 time: 0.088306 Oct 31 15:46:08.892912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2753/5381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:08 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:08.913795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:08.917919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:08.932899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.933407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.935284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.936920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.938592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.941188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.112996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.127578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.133895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.137265 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69739e7b-ece5-4741-a9d0-e5b369c4791c tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.287850 Oct 31 15:46:09.138639 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2629/5382] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:08 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:09.242140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.250653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f0d48bc-1363-493a-862c-01e7eebbf0ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.352690 Oct 31 15:46:09.252008 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2754/5383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:08 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:09.493755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8cab8215-ec7e-4b19-acec-99d4fd1fba82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8cab8215-ec7e-4b19-acec-99d4fd1fba82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 163 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": 12345, "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 12345 Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:09.503494 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8cab8215-ec7e-4b19-acec-99d4fd1fba82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:09.509669 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8cab8215-ec7e-4b19-acec-99d4fd1fba82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019227 Oct 31 15:46:09.512811 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2630/5384] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:09 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:09.519696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:09.524352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:09.547196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.554269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.555375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.556363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.559480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.560798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.053600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.067377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dcd4ad60-21dd-4dcb-8530-9a116e89d58f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.548784 Oct 31 15:46:10.068115 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2755/5385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:09 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:10.098102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:10.099499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:10.118937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:10.119856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:10.120938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.124295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:10.125117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:10.125922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.165044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:10.174249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:10.201982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:10.209867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:10.210692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.217763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:10.221348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:10.222641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.356939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.375724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.381442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.383981 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ac1967d-886c-4ee6-90aa-ef66bd9655d2 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.223940 Oct 31 15:46:10.384576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2756/5386] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:10 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:10.494882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.505836 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e1879f5-c556-41c8-a277-4ea6cfac3827 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.413912 Oct 31 15:46:10.506494 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2631/5387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:10 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:11.421427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:11.425533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:11.436091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.436587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.437258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.437739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.443119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.444474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.688407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:11.715837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:11.717821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:11.720529 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb8bc1b7-1523-4e46-af65-4f5cc42cd6be tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.304744 Oct 31 15:46:11.740727 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2757/5388] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:11 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:12.762007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:12.762797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:12.807486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:12.811664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:12.813954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:12.833963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:12.841454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:12.844886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.306103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:13.321142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:13.323109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:13.324947 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f11605fa-d94f-4639-86d4-ac7ff2b5f322 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.570565 Oct 31 15:46:13.349578 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2632/5389] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:12 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:13.624772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c14123c4-1305-446b-8cb6-876453e0f722 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1484552591", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5cf8fe9f-71af-4e85-9fda-069a4588e65d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:13.731331 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c14123c4-1305-446b-8cb6-876453e0f722 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Block Device 5cf8fe9f-71af-4e85-9fda-069a4588e65d is not bootable. Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c14123c4-1305-446b-8cb6-876453e0f722 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 358 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1484552591", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5cf8fe9f-71af-4e85-9fda-069a4588e65d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: exception: Block Device 5cf8fe9f-71af-4e85-9fda-069a4588e65d is not bootable. Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1484552591', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5cf8fe9f-71af-4e85-9fda-069a4588e65d'}], 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5cf8fe9f-71af-4e85-9fda-069a4588e65d is not bootable. Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:13.753853 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5cf8fe9f-71af-4e85-9fda-069a4588e65d is not bootable. Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5cf8fe9f-71af-4e85-9fda-069a4588e65d is not bootable. Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:13.759141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c14123c4-1305-446b-8cb6-876453e0f722 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Block Device 5cf8fe9f-71af-4e85-9fda-069a4588e65d is not bootable. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:13.764969 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c14123c4-1305-446b-8cb6-876453e0f722 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.141032 Oct 31 15:46:13.764969 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2758/5390] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:13.775614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:13.777367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:13.792972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.793766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.794469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.795336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.795927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.796457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.291886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:14.301520 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-100bc55e-d72c-4bff-b765-533bdc6b5322 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.534881 Oct 31 15:46:14.302201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2633/5391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:13 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:14.334520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:14.335156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:14.359700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:14.360515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:14.367885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.368383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.368856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.369566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.369995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.370135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.370439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.372169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.377045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.378455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.380165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.380828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.793428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:14.810961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:14.811846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:14.813382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b2527c5-e78a-4874-8227-b4cbd0a8f943 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.457602 Oct 31 15:46:14.835992 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2634/5392] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:14 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:14.888820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:14.917334 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f08d644-b342-422b-b9c1-91625d7ae8d7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.585287 Oct 31 15:46:14.943836 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2759/5393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:14 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:15.850410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:15.851033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:15.854589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:15.877910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:15.878437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:15.878883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:15.879587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:15.880059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:15.880491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:16.071308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:16.077804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:16.082746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:16.089764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bbe541e8-a0b5-41bf-b154-5ac72871648d tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1366 microversion: 2.47 time: 0.244244 Oct 31 15:46:16.102013 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2635/5394] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:15 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:17.118696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:17.119323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:17.141508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:17.147403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:17.149281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:17.152360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:17.183670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:17.188417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:17.190424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:17.428899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:17.453295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:17.460642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:17.464094 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94f292dd-0aef-49a1-88d1-fa866b0b0e4b tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1372 microversion: 2.47 time: 0.349672 Oct 31 15:46:17.478179 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2760/5395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:17 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:18.113292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8166791b-67a8-42d2-b95c-0e2bee8a7aaf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-61259895", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "destination_type": "local"}, {"source_type": "volume", "uuid": "76962d11-35c8-4c59-a1db-f39a04b9ece2", "destination_type": "invalid"}], "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8166791b-67a8-42d2-b95c-0e2bee8a7aaf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 493 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-61259895", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "destination_type": "local"}, {"source_type": "volume", "uuid": "76962d11-35c8-4c59-a1db-f39a04b9ece2", "destination_type": "invalid"}], "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-61259895', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '76962d11-35c8-4c59-a1db-f39a04b9ece2', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:18.119115 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 15:46:18.123961 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.125568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8166791b-67a8-42d2-b95c-0e2bee8a7aaf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:18.126451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8166791b-67a8-42d2-b95c-0e2bee8a7aaf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018483 Oct 31 15:46:18.127757 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2636/5396] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:18 2022] POST /compute/v2.1/servers => generated 155 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:18.135943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:18.136567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:18.147695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.148207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.148653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.153384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.153892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.154338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.167554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:18.502812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:18.507699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:18.529199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:18.538721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0e93c02-5085-4313-bdfd-759e8f36266c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.406724 Oct 31 15:46:18.548246 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2761/5397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:18 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:18.549237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.550363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.551052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.553367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.554068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.554690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.575550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:18.576184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:18.590960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.592185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.596915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.597993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.602238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.602700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.762676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:18.776531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:18.778219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:18.779731 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c52e3059-7c6c-475a-80e1-16c132a55500 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1372 microversion: 2.47 time: 0.289268 Oct 31 15:46:18.780409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2637/5398] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:18 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:18.828261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:18.838124 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fd0458a-57f9-483c-9bb4-41a0ad77df30 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.266737 Oct 31 15:46:18.839021 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2762/5399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:18 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:18.900826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f0fa0e8-58ac-4e2e-8bf5-134e6b699205 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2088745909", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f0fa0e8-58ac-4e2e-8bf5-134e6b699205 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 492 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2088745909", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2088745909', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.905996 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:46:18.910046 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:18.921055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f0fa0e8-58ac-4e2e-8bf5-134e6b699205 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:18.921940 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f0fa0e8-58ac-4e2e-8bf5-134e6b699205 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.025407 Oct 31 15:46:18.925805 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2638/5400] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:18 2022] POST /compute/v2.1/servers => generated 624 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:18.930989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:18.931601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:18.938263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.938747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.939182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.940433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.941064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.941582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.134761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:19.143444 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7122ed5-fce1-4d50-8471-3ba1bd9a5d1b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.216380 Oct 31 15:46:19.144867 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2763/5401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:18 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:19.172977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:19.173595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:19.181757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.182253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.182970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.183389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.183856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.184302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.389729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:19.399059 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f154df64-7445-4bfd-85ca-d6a7be04ef6e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.230251 Oct 31 15:46:19.400230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2639/5402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:19 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:19.488538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ab64e75-dd41-4fef-a8c6-1eda6de76263 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ab64e75-dd41-4fef-a8c6-1eda6de76263 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 416 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.496102 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ab64e75-dd41-4fef-a8c6-1eda6de76263 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:19.499689 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ab64e75-dd41-4fef-a8c6-1eda6de76263 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.017697 Oct 31 15:46:19.502864 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2764/5403] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:19 2022] POST /compute/v2.1/servers => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:19.510566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:19.511260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:19.518467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.519799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.520746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.521749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.522431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.522933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.759385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:19.769242 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ed27c03-9b75-4e2a-ab30-eda474f3e892 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.264698 Oct 31 15:46:19.770065 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2640/5404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:19 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:19.797306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:19.797936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:19.810581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:19.811479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:19.813672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.814176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.815152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.815989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.816777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.819467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.820150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.820773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.820900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.821773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:19.822551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:19.823138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.242093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.253407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.256014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.257514 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff2174c4-ddbd-41ae-94ac-1d3ca4668104 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1357 microversion: 2.47 time: 0.451027 Oct 31 15:46:20.258296 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2641/5405] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:19 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1357 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:20.284570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:20.292153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.293192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Searching by: {'deleted': False, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870'} {{(pid=120626) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:46:20.300594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.301168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.301904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.303021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.303709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.304396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.356504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.370087 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6277c287-b491-4c2c-bcf3-cd4131a6e448 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.576941 Oct 31 15:46:20.372156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2765/5406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:19 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:20.463881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-497a5fcb-3974-4613-b599-e513e21d528c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-681632650", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": -1, "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:20.479854 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-497a5fcb-3974-4613-b599-e513e21d528c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Flavor -1 could not be found. Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-497a5fcb-3974-4613-b599-e513e21d528c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 205 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-681632650", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": -1, "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor -1 could not be found. Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-681632650', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': -1, 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:20.482404 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 31 15:46:20.486316 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:20.490314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-497a5fcb-3974-4613-b599-e513e21d528c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:20.491601 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-497a5fcb-3974-4613-b599-e513e21d528c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032985 Oct 31 15:46:20.492751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2766/5407] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:20 2022] POST /compute/v2.1/servers => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 31 15:46:20.505351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:20.506062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:20.513898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.514499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.515039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.516246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.517009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.518148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.566823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.multi_cell_list [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120626) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:46:20.686711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.694321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.694960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.696031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.715446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.717947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.772765 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a217301f-97c6-4968-83cb-6bbd91faeede tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.492029 Oct 31 15:46:20.773761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2642/5408] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Oct 31 15:46:20 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:20.805038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:20.805541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:20.816258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.817196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.818162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.824997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.825361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:20.825948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.826561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.836218 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f34465c-61fb-4ce1-bcc8-9131555dd6d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.339291 Oct 31 15:46:20.837328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2767/5409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:20 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:20.867203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:20.868210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:20.880313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.881193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.882586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:46:20.883149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.885083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.885833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.890943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.902169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:20.988862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1032ceab-2685-4f5e-991e-d1a515d28ae9 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "DELETE /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 204 len: 0 microversion: 2.47 time: 0.187672 Oct 31 15:46:20.990372 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2643/5410] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:46:20 2022] DELETE /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:46:21.003047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:21.004490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:21.011704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:21.012808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:21.013483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:21.016421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:21.017346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:21.018562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:21.139917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.149286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.151116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.152326 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b57d2f2f-624c-48c0-b429-e97323f5d522 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1363 microversion: 2.47 time: 0.155781 Oct 31 15:46:21.153258 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2644/5411] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:20 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:21.225328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.235033 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba821bb9-5b1e-4f61-a418-8d960a1baf46 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.372130 Oct 31 15:46:21.245335 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2768/5412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:20 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:21.333131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-105e6c16-cdb6-4d97-bffa-bfc1981ae976 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109684144", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-105e6c16-cdb6-4d97-bffa-bfc1981ae976 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 172 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109684144", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-109684144', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi -1 Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:21.342077 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 15:46:21.348512 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:21.353179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-105e6c16-cdb6-4d97-bffa-bfc1981ae976 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:21.354412 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-105e6c16-cdb6-4d97-bffa-bfc1981ae976 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.026680 Oct 31 15:46:21.361139 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2645/5413] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:21 2022] POST /compute/v2.1/servers => generated 145 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:21.368753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:21.369422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:21.382407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:21.388901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:21.389580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:21.390600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:21.391276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:21.391939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:21.571144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.591347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-097547b0-6baf-4557-abab-e742d79a4af4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.228463 Oct 31 15:46:21.640840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:21.643367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:21.649051 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2769/5414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:21 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:21.653063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:21.653704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:21.654396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:21.655367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:21.656062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:21.656728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:21.925165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.935923 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e948dc4-5f0b-441d-92f6-dc6ac26ef819 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.298218 Oct 31 15:46:21.937158 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2646/5415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:21 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:22.038614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-573ef7a0-05fb-4ea0-8371-8a7976c06484 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-455613233", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:22.045366 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-573ef7a0-05fb-4ea0-8371-8a7976c06484 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-573ef7a0-05fb-4ea0-8371-8a7976c06484 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 215 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-455613233", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-455613233', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:22.047831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-573ef7a0-05fb-4ea0-8371-8a7976c06484 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-573ef7a0-05fb-4ea0-8371-8a7976c06484 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019887 Oct 31 15:46:22.056523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2770/5416] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:22 2022] POST /compute/v2.1/servers => generated 123 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:46:22.059607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:22.060241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:22.069433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.069943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.070387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.071151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.071621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.072056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.180718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:22.181506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:22.184804 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:46:22.184961 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 15:46:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 (ip 10.222.0.48) !!! Oct 31 15:46:22.204196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.204901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.206047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.206885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.209305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.211531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.371877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:22.381405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ec6104f-9cb4-40fa-a524-cd41a63b9834 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.326347 Oct 31 15:46:22.395960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2647/5417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:22 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:22.414886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:22.421217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:22.422901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:22.431416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.432233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.432867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.433691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:22.433976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.434589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.435369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.439784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:22.441313 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-541e7223-1870-4682-959e-cc62e203d11f tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 200 len: 1363 microversion: 2.47 time: 0.264990 Oct 31 15:46:22.445589 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2771/5418] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:22 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:22.852609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:22.873717 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6abe869-42fe-44dd-8f97-6c42b744d773 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.459165 Oct 31 15:46:22.875948 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2648/5419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:22 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:22.981931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36359ab2-732f-49e5-90fc-3a71eb272499 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1092642616", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-key-1499281008", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:23.076084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-36359ab2-732f-49e5-90fc-3a71eb272499 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] validate_networks() for [('7d595c49-078e-4b9a-8f8f-2f689a0106c6', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:46:23.472372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:23.472954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 70577ae6-541c-4c94-bc5f-b20d1d16f692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:23.480119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.480481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.481146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.482022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.482640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.483454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.514421 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] HTTP exception thrown: Instance 70577ae6-541c-4c94-bc5f-b20d1d16f692 could not be found. Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Request method failure captured: Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 HTTP/1.1 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2jdNcBwESRMspnCGAuvRPA576bm6YXqo_BL5_9fLWfVJxbhI5MiXYwjJbWfvbh668tXb_gYqqzmVQI3m2gc6iplz0OBX_bJN3LBA-kRQdMt9nO49JCqLqkd9YftIZ0d73SJ2N6JExtvFOGh25LtjugWOiU5vl3ngjwC63tUkPIdY8 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b548ee8a1c4748ef9e41a410dc8ff870 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerShowV247Test-257997314 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerShowV247Test-257997314 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b548ee8a1c4748ef9e41a410dc8ff870 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerShowV247Test-257997314 Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerShowV247Test-257997314-project Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 594e5f90ebd44a43b52f306368d7d6cf Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerShowV247Test-257997314-project Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 70577ae6-541c-4c94-bc5f-b20d1d16f692 could not be found. Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '70577ae6-541c-4c94-bc5f-b20d1d16f692'} Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70577ae6-541c-4c94-bc5f-b20d1d16f692 could not be found. Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70577ae6-541c-4c94-bc5f-b20d1d16f692 could not be found. Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:23.517148 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70577ae6-541c-4c94-bc5f-b20d1d16f692 could not be found. Oct 31 15:46:23.522030 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.524399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Returning 404 to user: Instance 70577ae6-541c-4c94-bc5f-b20d1d16f692 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:23.525702 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b59478b-650c-4a9f-b988-4e978a9d005e tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692" status: 404 len: 111 microversion: 2.47 time: 0.058232 Oct 31 15:46:23.526789 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2649/5420] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:23 2022] GET /compute/v2.1/servers/70577ae6-541c-4c94-bc5f-b20d1d16f692 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:46:23.527716 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-36359ab2-732f-49e5-90fc-3a71eb272499 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Invalid key_name provided. Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36359ab2-732f-49e5-90fc-3a71eb272499 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 247 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1092642616", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-key-1499281008", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid key_name provided. Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1092642616', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'key_name': 'tempest-key-1499281008', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1499281008 not found for user 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:23.531749 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:23.536107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36359ab2-732f-49e5-90fc-3a71eb272499 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid key_name provided. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:23.537710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:23.537710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:23.544006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.544260 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36359ab2-732f-49e5-90fc-3a71eb272499 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.556280 Oct 31 15:46:23.544641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.545191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.545637 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2772/5421] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:22 2022] POST /compute/v2.1/servers => generated 70 bytes in 569 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:46:23.546288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.546950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.547593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.553827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:23.554689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:23.563897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.569438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.570120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.571065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.571691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.572315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.582964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:46:23.699260 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98db955c-5212-403c-a33c-2ce235b076e4 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80" status: 204 len: 0 microversion: 2.47 time: 0.167977 Oct 31 15:46:23.702537 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2650/5422] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Oct 31 15:46:23 2022] DELETE /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 31 15:46:23.715588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:23.716994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:23.726999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.728033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.731435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.732304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.732977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.733404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.910097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.916119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.941984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6efe3c33-f702-4f02-a916-1858f1e348f7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.391891 Oct 31 15:46:23.942604 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2773/5423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:23 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:23.947132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.948875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.950912 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-edc7abcc-843a-4417-9c26-05574253e589 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80" status: 200 len: 1362 microversion: 2.47 time: 0.242788 Oct 31 15:46:23.951764 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2651/5424] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:23 2022] GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:23.967431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:23.968365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:23.978635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.979902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.980971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.981729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:23.982205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:23.983461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.302878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:24.317126 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b53435df-8fa0-442d-86fe-3983e0ba551b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.353016 Oct 31 15:46:24.319859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2774/5425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:23 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:24.406537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85ec95dd-655e-424a-a06d-188118ac9c5b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-874439374", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:24.603473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.security_group_api [None req-85ec95dd-655e-424a-a06d-188118ac9c5b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Neutron security group does_not_exist not found {{(pid=120626) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 31 15:46:24.604099 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-85ec95dd-655e-424a-a06d-188118ac9c5b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85ec95dd-655e-424a-a06d-188118ac9c5b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 257 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-874439374", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-874439374', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 31 15:46:24.630098 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:46:24.634810 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:24.640738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85ec95dd-655e-424a-a06d-188118ac9c5b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:24.641608 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85ec95dd-655e-424a-a06d-188118ac9c5b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.239917 Oct 31 15:46:24.642367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2652/5426] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:24 2022] POST /compute/v2.1/servers => generated 106 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:24.652978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:24.654186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:24.665044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:24.668947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:24.672148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.673614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:24.674432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:24.675207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.895152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:24.904570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcf60889-1981-4c34-be44-c317a7d0abbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.257247 Oct 31 15:46:24.920333 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2775/5427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:24 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:24.930840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:24.931755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:24.939126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:24.939900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:24.940593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.941481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:24.942691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:24.943276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.992904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:24.993696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:25.006383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.006803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.007240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.007961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.008411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.009047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.177927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.187179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.192791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.194246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '594e5f90ebd44a43b52f306368d7d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b548ee8a1c4748ef9e41a410dc8ff870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.209911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d53befb7-c73b-4537-a738-285342902035 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80" status: 200 len: 1362 microversion: 2.47 time: 0.225845 Oct 31 15:46:25.210292 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea2d6d5a-b135-4ae5-87a3-27665099253a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.271115 Oct 31 15:46:25.224730 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2776/5428] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:24 2022] GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:25.225184 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2653/5429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:24 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:25.237620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44285fce-aecb-4166-a4ef-0eb33dbc4837 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:25.238238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44285fce-aecb-4166-a4ef-0eb33dbc4837 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 111d3fc3-0014-42c0-9d9e-0a4080274301] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:25.245137 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-44285fce-aecb-4166-a4ef-0eb33dbc4837 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 111d3fc3-0014-42c0-9d9e-0a4080274301 could not be found. Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44285fce-aecb-4166-a4ef-0eb33dbc4837 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/111d3fc3-0014-42c0-9d9e-0a4080274301 HTTP/1.1 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 111d3fc3-0014-42c0-9d9e-0a4080274301 could not be found. Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '111d3fc3-0014-42c0-9d9e-0a4080274301'} Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111d3fc3-0014-42c0-9d9e-0a4080274301 could not be found. Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111d3fc3-0014-42c0-9d9e-0a4080274301 could not be found. Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.247728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111d3fc3-0014-42c0-9d9e-0a4080274301 could not be found. Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44285fce-aecb-4166-a4ef-0eb33dbc4837 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 111d3fc3-0014-42c0-9d9e-0a4080274301 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44285fce-aecb-4166-a4ef-0eb33dbc4837 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "DELETE /compute/v2.1/servers/111d3fc3-0014-42c0-9d9e-0a4080274301" status: 404 len: 111 microversion: 2.1 time: 0.016666 Oct 31 15:46:25.254728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2777/5430] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:46:25 2022] DELETE /compute/v2.1/servers/111d3fc3-0014-42c0-9d9e-0a4080274301 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:25.261219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:25.261779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:25.268877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.269377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.269821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.270826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.271297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.271725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.477625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.485706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-31f2c0c4-3f97-4ced-8c33-d4088bb5a574 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.228744 Oct 31 15:46:25.504722 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2654/5431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:25 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:25.522706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:25.523361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:25.535675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.536147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.536589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.537352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.537818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.538250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.850425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.858888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e84c836-f081-4448-9914-24dec5755785 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.340230 Oct 31 15:46:25.859479 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2778/5432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:25 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:25.882160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-579f24da-984a-4fa8-8e19-d09dcf91a6a4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:25.883330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-579f24da-984a-4fa8-8e19-d09dcf91a6a4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:46:25.884000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-579f24da-984a-4fa8-8e19-d09dcf91a6a4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-579f24da-984a-4fa8-8e19-d09dcf91a6a4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 9223372036854775808 could not be found. Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '9223372036854775808'} Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:25.889346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:25.893899 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:25.893899 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:25.893899 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:25.893899 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 31 15:46:25.893899 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:25.895386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-579f24da-984a-4fa8-8e19-d09dcf91a6a4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:25.896432 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-579f24da-984a-4fa8-8e19-d09dcf91a6a4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018872 Oct 31 15:46:25.897230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2655/5433] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Oct 31 15:46:25 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:46:25.905554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:25.906194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:25.921935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.922752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.923346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:25.925155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:25.925888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:25.926573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.243260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.244477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] [instance: 2963c6a1-2e42-48a4-a45a-41f46bd05d80] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:26.261719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:26.269842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.270655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.271316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.272272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.273010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.273661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.274372 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c26edfa-e4e0-4385-9a92-3797370a8317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.372726 Oct 31 15:46:26.288947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2779/5434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:25 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:26.309579 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] HTTP exception thrown: Instance 2963c6a1-2e42-48a4-a45a-41f46bd05d80 could not be found. Oct 31 15:46:26.310689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Request method failure captured: Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80 HTTP/1.1 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2jdNcBwESRMspnCGAuvRPA576bm6YXqo_BL5_9fLWfVJxbhI5MiXYwjJbWfvbh668tXb_gYqqzmVQI3m2gc6iplz0OBX_bJN3LBA-kRQdMt9nO49JCqLqkd9YftIZ0d73SJ2N6JExtvFOGh25LtjugWOiU5vl3ngjwC63tUkPIdY8 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: b548ee8a1c4748ef9e41a410dc8ff870 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerShowV247Test-257997314 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b548ee8a1c4748ef9e41a410dc8ff870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerShowV247Test-257997314 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: b548ee8a1c4748ef9e41a410dc8ff870 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerShowV247Test-257997314 Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerShowV247Test-257997314-project Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 594e5f90ebd44a43b52f306368d7d6cf Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerShowV247Test-257997314-project Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2963c6a1-2e42-48a4-a45a-41f46bd05d80 could not be found. Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2963c6a1-2e42-48a4-a45a-41f46bd05d80'} Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2963c6a1-2e42-48a4-a45a-41f46bd05d80 could not be found. Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2963c6a1-2e42-48a4-a45a-41f46bd05d80 could not be found. Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:26.312140 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2963c6a1-2e42-48a4-a45a-41f46bd05d80 could not be found. Oct 31 15:46:26.317015 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.317463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:26.319187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] Returning 404 to user: Instance 2963c6a1-2e42-48a4-a45a-41f46bd05d80 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:26.320338 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd0f06f5-f308-4c8c-9080-ffc591ad5ce5 tempest-ServerShowV247Test-257997314 tempest-ServerShowV247Test-257997314-project] 10.222.0.48 "GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80" status: 404 len: 111 microversion: 2.47 time: 0.082428 Oct 31 15:46:26.324688 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2656/5435] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:26 2022] GET /compute/v2.1/servers/2963c6a1-2e42-48a4-a45a-41f46bd05d80 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:46:26.336062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.336569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.337039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.338211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.339064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.339182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.602073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:26.614378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c0f66e3-8b96-4759-ba75-f2b743f9a95f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.315369 Oct 31 15:46:26.614978 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2780/5436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:26 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:26.638481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3557893b-9dc9-4901-980c-231ea0417b54 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.639550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3557893b-9dc9-4901-980c-231ea0417b54 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Failed to fetch instance by id -1 {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:46:26.640295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3557893b-9dc9-4901-980c-231ea0417b54 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance -1 could not be found. Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3557893b-9dc9-4901-980c-231ea0417b54 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance -1 could not be found. Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '-1'} Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:26.642146 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:26.647592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:26.647592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:26.647592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 31 15:46:26.647592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:26.650066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3557893b-9dc9-4901-980c-231ea0417b54 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:26.651138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3557893b-9dc9-4901-980c-231ea0417b54 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017371 Oct 31 15:46:26.653657 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2657/5437] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Oct 31 15:46:26 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:46:26.664321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.665407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:26.680044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.680856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.681837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.682908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.683737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.688266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.945680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:26.964266 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcfef14f-0edc-4112-93e2-118a5dac1718 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.306131 Oct 31 15:46:26.975774 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2781/5438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:26 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:26.998531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.999431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:27.013487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.014612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.015436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.016902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.019382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.020109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.303364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:27.316725 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4563868a-8c6b-4506-b88a-2638c655a4df tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.322335 Oct 31 15:46:27.317377 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2658/5439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:26 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:27.348576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51a110ee-f9bf-4e9a-ba63-2eed21641ff3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:27.349955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51a110ee-f9bf-4e9a-ba63-2eed21641ff3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 75e9f984-2837-43e3-b5fa-2dbc27c6467a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:27.359009 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-51a110ee-f9bf-4e9a-ba63-2eed21641ff3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 75e9f984-2837-43e3-b5fa-2dbc27c6467a could not be found. Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51a110ee-f9bf-4e9a-ba63-2eed21641ff3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/75e9f984-2837-43e3-b5fa-2dbc27c6467a/action HTTP/1.1 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 19 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: {"forceDelete": {}} Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 75e9f984-2837-43e3-b5fa-2dbc27c6467a could not be found. Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '75e9f984-2837-43e3-b5fa-2dbc27c6467a', 'body': {'forceDelete': {}}} Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e9f984-2837-43e3-b5fa-2dbc27c6467a could not be found. Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e9f984-2837-43e3-b5fa-2dbc27c6467a could not be found. Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:27.373454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:27.378414 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:27.378414 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:27.378414 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e9f984-2837-43e3-b5fa-2dbc27c6467a could not be found. Oct 31 15:46:27.378414 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:27.378414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51a110ee-f9bf-4e9a-ba63-2eed21641ff3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 75e9f984-2837-43e3-b5fa-2dbc27c6467a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:27.379857 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51a110ee-f9bf-4e9a-ba63-2eed21641ff3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/75e9f984-2837-43e3-b5fa-2dbc27c6467a/action" status: 404 len: 111 microversion: 2.1 time: 0.035634 Oct 31 15:46:27.380896 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2782/5440] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:27 2022] POST /compute/v2.1/servers/75e9f984-2837-43e3-b5fa-2dbc27c6467a/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:27.389188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:27.390734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:27.397845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.398583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.399222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.400610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.401336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.401974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.700893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:27.712389 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ada3aa2b-b991-4436-afcb-ec3c48acbeb5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.327322 Oct 31 15:46:27.714182 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2659/5441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:27 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:27.737616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:27.738238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:27.745890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.746497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.750248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.750788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.751402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.752478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.980155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:27.982452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:27.991689 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34a399c4-abee-4021-9dc9-f9ade1e77a51 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.258350 Oct 31 15:46:28.005218 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2783/5442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:27 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:28.015853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-189ad334-b804-42d8-9eb1-669412d09b39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:28.018918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-189ad334-b804-42d8-9eb1-669412d09b39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 6c932148-9024-40a7-bbe5-5c6692fe471f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:28.024812 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-189ad334-b804-42d8-9eb1-669412d09b39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 6c932148-9024-40a7-bbe5-5c6692fe471f could not be found. Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-189ad334-b804-42d8-9eb1-669412d09b39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/6c932148-9024-40a7-bbe5-5c6692fe471f/action HTTP/1.1 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 39 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: {"os-getConsoleOutput": {"length": 10}} Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 6c932148-9024-40a7-bbe5-5c6692fe471f could not be found. Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '6c932148-9024-40a7-bbe5-5c6692fe471f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c932148-9024-40a7-bbe5-5c6692fe471f could not be found. Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c932148-9024-40a7-bbe5-5c6692fe471f could not be found. Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.029344 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:28.034412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:28.034412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:28.034412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:28.034412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:28.034412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c932148-9024-40a7-bbe5-5c6692fe471f could not be found. Oct 31 15:46:28.034412 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.036564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-189ad334-b804-42d8-9eb1-669412d09b39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 6c932148-9024-40a7-bbe5-5c6692fe471f could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:28.037804 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-189ad334-b804-42d8-9eb1-669412d09b39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/6c932148-9024-40a7-bbe5-5c6692fe471f/action" status: 404 len: 111 microversion: 2.1 time: 0.026874 Oct 31 15:46:28.041825 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2660/5443] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:28 2022] POST /compute/v2.1/servers/6c932148-9024-40a7-bbe5-5c6692fe471f/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:28.047407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:28.048322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:28.066427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:28.067052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:28.067370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:28.068094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:28.068562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:28.069026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:28.402940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:28.426265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0eba87c-0699-4660-9e1d-743cbed94469 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.381506 Oct 31 15:46:28.429356 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2784/5444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:28 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:28.458556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:28.459756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:28.505059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:28.508514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:28.512644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:28.513668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:28.514882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:28.515540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:28.878391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:28.889789 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93b1548a-d8c4-44fb-b771-37277405023f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.438175 Oct 31 15:46:28.891512 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2661/5445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:28 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:28.914792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b75ed2fb-3be1-4c97-a640-55d26d10e317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:28.915687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b75ed2fb-3be1-4c97-a640-55d26d10e317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: f0fd80b9-488e-4f53-b8ad-48779f945b1e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:28.923098 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b75ed2fb-3be1-4c97-a640-55d26d10e317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance f0fd80b9-488e-4f53-b8ad-48779f945b1e could not be found. Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b75ed2fb-3be1-4c97-a640-55d26d10e317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f0fd80b9-488e-4f53-b8ad-48779f945b1e HTTP/1.1 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f0fd80b9-488e-4f53-b8ad-48779f945b1e could not be found. Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f0fd80b9-488e-4f53-b8ad-48779f945b1e'} Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fd80b9-488e-4f53-b8ad-48779f945b1e could not be found. Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fd80b9-488e-4f53-b8ad-48779f945b1e could not be found. Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:28.937831 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:28.943526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:28.943526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:28.943526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:28.943526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fd80b9-488e-4f53-b8ad-48779f945b1e could not be found. Oct 31 15:46:28.943526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:28.945498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b75ed2fb-3be1-4c97-a640-55d26d10e317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance f0fd80b9-488e-4f53-b8ad-48779f945b1e could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:28.948359 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b75ed2fb-3be1-4c97-a640-55d26d10e317 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/f0fd80b9-488e-4f53-b8ad-48779f945b1e" status: 404 len: 111 microversion: 2.1 time: 0.038211 Oct 31 15:46:28.956158 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2785/5446] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:28 2022] GET /compute/v2.1/servers/f0fd80b9-488e-4f53-b8ad-48779f945b1e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:28.958621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:28.959296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:28.972413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:28.972939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:28.983445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:28.984400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:28.984927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:28.985363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:29.322641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:29.349181 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9113958e-e853-41b0-a0f6-4c39c36f92d6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.394888 Oct 31 15:46:29.349782 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2662/5447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:28 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:29.377207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:29.378483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:29.398387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:29.399196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:29.400004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:29.401104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:29.401658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:29.402095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:29.778148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:29.791440 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce5151ff-92a4-4eff-8a10-550c639c37c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.418073 Oct 31 15:46:29.792041 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2786/5448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:29 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:29.972935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a9b7f30-5339-4864-a691-9e47d531d4f0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-252822440", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a9b7f30-5339-4864-a691-9e47d531d4f0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 237 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-252822440", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-252822440', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.014525 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:30.020613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a9b7f30-5339-4864-a691-9e47d531d4f0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:30.024582 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a9b7f30-5339-4864-a691-9e47d531d4f0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.056756 Oct 31 15:46:30.029485 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2787/5449] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:46:30.037467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:30.038907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:30.049849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:30.050356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:30.050799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:30.051516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:30.052042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:30.052485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:30.136590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78c03bad-7366-411c-b222-fa434ed128be tempest-ComputeTenantNetworksTest-916399178 tempest-ComputeTenantNetworksTest-916399178-project] Calling method '.version_select at 0x7f5ca1175040>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:30.386997 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78c03bad-7366-411c-b222-fa434ed128be tempest-ComputeTenantNetworksTest-916399178 tempest-ComputeTenantNetworksTest-916399178-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.632998 Oct 31 15:46:30.387868 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2663/5450] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 15:46:29 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:30.400608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c51f990d-f2e3-44a7-8bb5-1962c6927127 tempest-ComputeTenantNetworksTest-916399178 tempest-ComputeTenantNetworksTest-916399178-project] Calling method '.version_select at 0x7f5ca1031940>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:30.415174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:30.480579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:30.497219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b65fcc9d-9b29-4437-8127-64afb5668413 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.466017 Oct 31 15:46:30.498642 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2788/5451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:30 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:30.527516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:30.533923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:30.544887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:30.546189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:30.547033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:30.552516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:30.553288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:30.553981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:30.589868 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c51f990d-f2e3-44a7-8bb5-1962c6927127 tempest-ComputeTenantNetworksTest-916399178 tempest-ComputeTenantNetworksTest-916399178-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks/48f5277c-cdc5-4370-a099-3f97c4da9b1f" status: 200 len: 138 microversion: 2.1 time: 0.194814 Oct 31 15:46:30.597554 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2664/5452] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Oct 31 15:46:30 2022] GET /compute/v2.1/os-tenant-networks/48f5277c-cdc5-4370-a099-3f97c4da9b1f => generated 138 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:30.807584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:30.821599 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c323ed36-32df-4140-ae24-e9c8cdc2f4b6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.302333 Oct 31 15:46:30.831486 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2789/5453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:30 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:31.099255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:31.105031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50e5b237-0ead-4121-8575-a4811c2325d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1707855947", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50e5b237-0ead-4121-8575-a4811c2325d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 235 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1707855947", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1707855947', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.118731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 15:46:31.123831 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:31.129794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50e5b237-0ead-4121-8575-a4811c2325d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:31.131748 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50e5b237-0ead-4121-8575-a4811c2325d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.033215 Oct 31 15:46:31.133734 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2665/5454] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:31 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:46:31.149268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:31.152984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:31.180546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:31.181487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:31.182151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:31.183383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:31.184251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:31.184953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:31.895437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:31.914783 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-baf1721a-eb39-4871-9ab8-05a2cab5add8 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.776397 Oct 31 15:46:31.915880 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2790/5455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:31 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:31.942964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:31.944141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:31.951634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:31.952343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:31.952996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:31.953937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:31.954556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:31.955829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.275870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:32.283838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:32.298117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04143657-904a-446d-b319-27600e1837f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.356306 Oct 31 15:46:32.299679 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2666/5456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:31 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:32.330804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c666683f-8e31-49d2-b2b2-4c12410ff3de tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:32.334548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c666683f-8e31-49d2-b2b2-4c12410ff3de tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: aedba633-4f5f-4755-a506-2df635df8967] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:32.351044 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c666683f-8e31-49d2-b2b2-4c12410ff3de tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance aedba633-4f5f-4755-a506-2df635df8967 could not be found. Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c666683f-8e31-49d2-b2b2-4c12410ff3de tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/aedba633-4f5f-4755-a506-2df635df8967/action HTTP/1.1 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 13 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: {"pause": {}} Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance aedba633-4f5f-4755-a506-2df635df8967 could not be found. Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'aedba633-4f5f-4755-a506-2df635df8967', 'body': {'pause': {}}} Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedba633-4f5f-4755-a506-2df635df8967 could not be found. Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedba633-4f5f-4755-a506-2df635df8967 could not be found. Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:32.356747 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:32.362948 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:32.362948 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:32.362948 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedba633-4f5f-4755-a506-2df635df8967 could not be found. Oct 31 15:46:32.362948 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:32.364522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c666683f-8e31-49d2-b2b2-4c12410ff3de tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance aedba633-4f5f-4755-a506-2df635df8967 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:32.365609 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c666683f-8e31-49d2-b2b2-4c12410ff3de tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/aedba633-4f5f-4755-a506-2df635df8967/action" status: 404 len: 111 microversion: 2.1 time: 0.047071 Oct 31 15:46:32.366742 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2791/5457] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:32 2022] POST /compute/v2.1/servers/aedba633-4f5f-4755-a506-2df635df8967/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:32.375247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:32.375862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:32.382999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.383934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.384564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.385520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.386253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.386884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.667893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:32.679833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-102aa31a-6191-41aa-b828-89d23bc8ff2d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.308900 Oct 31 15:46:32.680572 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2667/5458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:32 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:32.703737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:32.705595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:32.716854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.717402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.717847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.718563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.719246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.719440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.900472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:32.911974 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-408abd25-333f-4c4f-9281-f63a6707f0c4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.212616 Oct 31 15:46:32.913268 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2792/5459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:32 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:32.935254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:32.935901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:32.943093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.944397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.945308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.946248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.946910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.947540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:33.032244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 202 len: 0 microversion: 2.1 time: 0.100979 Oct 31 15:46:33.036313 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2668/5460] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:32 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:46:33.055147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:33.056848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:33.069915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:33.071159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:33.071777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:33.072879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:33.073661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:33.074228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:33.377735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:33.378713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001610 Oct 31 15:46:33.379056 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2669/5461] 10.222.0.48 () {56 vars in 886 bytes} [Mon Oct 31 15:46:33 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 31 15:46:33.389545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:33.395029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:33.396480 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002392 Oct 31 15:46:33.396903 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2670/5462] 10.222.0.48 () {54 vars in 1035 bytes} [Mon Oct 31 15:46:33 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 31 15:46:33.404757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:33.407638 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003270 Oct 31 15:46:33.419514 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5a1d001-3bcd-4f35-b872-17900f4a4bd9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1509 microversion: 2.1 time: 0.381482 Oct 31 15:46:33.420350 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2671/5463] 10.222.0.48 () {54 vars in 1041 bytes} [Mon Oct 31 15:46:33 2022] GET /compute/v2.1/ => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:33.422081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:33.422609 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2793/5464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:33 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:33.424632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6aa4ffc9-a469-48e8-a046-92fe5f87967b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002104 Oct 31 15:46:33.433186 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2672/5465] 10.222.0.48 () {56 vars in 886 bytes} [Mon Oct 31 15:46:33 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:46:34.451357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:34.453641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:34.463948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.464982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.465656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.466585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.467296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.467912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.639436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:34.648750 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7865e4c2-4f43-4687-bfb3-ce7bb775919c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1489 microversion: 2.1 time: 0.202376 Oct 31 15:46:34.665641 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2794/5466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:34 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1489 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:34.675104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:34.676413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:34.685025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.686357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.687300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.688394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.689101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.689694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.718116 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'pause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state paused Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 13 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: {"pause": {}} Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'pause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state paused Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'pause': {}}} Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state paused. Cannot pause while the instance is in this state. Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state paused Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:34.721258 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state paused Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'pause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state paused {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f43b512f-5528-4025-9402-eabe6c7adc27 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 143 microversion: 2.1 time: 0.053744 Oct 31 15:46:34.726073 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2673/5467] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:34 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 143 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:46:34.731891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:34.732439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:34.739823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.740562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.741191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.742082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.742717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.743309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.841895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c925a42-e5e5-42b0-a084-0d356bea2295 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 202 len: 0 microversion: 2.1 time: 0.113632 Oct 31 15:46:34.842861 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2795/5468] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:34 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:46:34.851383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:34.852262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:34.860264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.861648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.862257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:34.863221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:34.863906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:34.864687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:35.050491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:35.059994 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe40f403-8ee0-40d9-8205-aa1c18c369c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1496 microversion: 2.1 time: 0.212226 Oct 31 15:46:35.061040 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2674/5469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:34 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:36.088089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:36.088904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:36.097832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.098693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.099306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.100331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.100982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.101690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.362199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:36.375895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d37119f-87e1-4a5b-a80e-88d90031dfec tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.293121 Oct 31 15:46:36.377782 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2796/5470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:36 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:36.410088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:36.411458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:36.418628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.418908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.419321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.420019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.420477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.439945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.807262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:36.834764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e25d894-1956-42cf-abb3-e56687354351 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.428675 Oct 31 15:46:36.835541 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2675/5471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:36 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:36.857729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:36.860280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:36.867543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.868258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.868904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.869806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.870453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.871044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.886179 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d/action HTTP/1.1 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 28 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: {"reboot": {"type": "SOFT"}} Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '63ab85ff-eb88-40e5-817e-795c4c07713d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:36.888133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:36.893601 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:36.895217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:36.896256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92b72c47-8dc4-48c8-820f-6bcf631719dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d/action" status: 404 len: 111 microversion: 2.1 time: 0.042541 Oct 31 15:46:36.897046 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2797/5472] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:36 2022] POST /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:36.905681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:36.906667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:36.913668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.914636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.915238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.916430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.917100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.917685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:37.098946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:37.108405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b4117657-252b-46ba-9853-807ba464a0ac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.207033 Oct 31 15:46:37.125387 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2676/5473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:36 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:37.145299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:37.145299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:37.154735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:37.155363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:37.157430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:37.158306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:37.165295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:37.167931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:37.458179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:37.469859 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45a15eee-e50d-4823-b91f-a1455edac5e6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.332499 Oct 31 15:46:37.473765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2798/5474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:37 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:37.502955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b23b0d06-dc40-483b-b589-e7ce4796450e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:37.508171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b23b0d06-dc40-483b-b589-e7ce4796450e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 66c69443-d330-4487-af40-a3e741bda3a9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:37.517735 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b23b0d06-dc40-483b-b589-e7ce4796450e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 66c69443-d330-4487-af40-a3e741bda3a9 could not be found. Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b23b0d06-dc40-483b-b589-e7ce4796450e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/66c69443-d330-4487-af40-a3e741bda3a9/action HTTP/1.1 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 28 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: {"reboot": {"type": "SOFT"}} Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 66c69443-d330-4487-af40-a3e741bda3a9 could not be found. Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '66c69443-d330-4487-af40-a3e741bda3a9', 'body': {'reboot': {'type': 'SOFT'}}} Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c69443-d330-4487-af40-a3e741bda3a9 could not be found. Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c69443-d330-4487-af40-a3e741bda3a9 could not be found. Oct 31 15:46:37.522530 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c69443-d330-4487-af40-a3e741bda3a9 could not be found. Oct 31 15:46:37.527409 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:37.530234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b23b0d06-dc40-483b-b589-e7ce4796450e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 66c69443-d330-4487-af40-a3e741bda3a9 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:37.530234 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b23b0d06-dc40-483b-b589-e7ce4796450e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/66c69443-d330-4487-af40-a3e741bda3a9/action" status: 404 len: 111 microversion: 2.1 time: 0.036278 Oct 31 15:46:37.530234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2677/5475] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:37 2022] POST /compute/v2.1/servers/66c69443-d330-4487-af40-a3e741bda3a9/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:37.540359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:37.541069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:37.551036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:37.551866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:37.553200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:37.558510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:37.559192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:37.559825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:37.845982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:37.865813 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db29808d-ffc7-4bbc-9bcd-50a2cf436c82 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.330921 Oct 31 15:46:37.866406 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2799/5476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:37 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:37.893911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:37.894948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:37.902252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:37.902987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:37.903616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:37.904540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:37.905223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:37.905838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.066031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:38.075068 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4425cafa-49d1-4ab6-a841-6a3f412ed55f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.186948 Oct 31 15:46:38.076337 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2678/5477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:37 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:38.100773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:38.105858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:38.119257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.120568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.121253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.122205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.122878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.123549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.142063 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d/action HTTP/1.1 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 65 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '63ab85ff-eb88-40e5-817e-795c4c07713d', 'body': {'rebuild': {'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a'}}} Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 15:46:38.144463 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:46:38.148920 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.152227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:38.153359 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3def41e7-0141-4fbe-9f8c-995203135e12 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d/action" status: 404 len: 111 microversion: 2.1 time: 0.057261 Oct 31 15:46:38.157588 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2800/5478] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:38 2022] POST /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:38.163366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:38.163990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:38.174220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.174725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.175226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.176553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.177087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.177590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.439059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:38.449564 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc358600-e68b-4290-91db-86bafeaaa8d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.289703 Oct 31 15:46:38.450473 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2679/5479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:38 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:38.480034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:38.481259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:38.489273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.490288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.491003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.493415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.494462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.495572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.799227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:38.810650 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94886c74-61ee-45ed-bb24-325426ba1955 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.334896 Oct 31 15:46:38.825497 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2801/5480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:38 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:38.857407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94ed4cba-0bef-4d5a-beba-1d2512346b5d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:38.860277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94ed4cba-0bef-4d5a-beba-1d2512346b5d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: dc1f6dcf-e1ca-4d51-94ee-70b494390027] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:38.877488 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-94ed4cba-0bef-4d5a-beba-1d2512346b5d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance dc1f6dcf-e1ca-4d51-94ee-70b494390027 could not be found. Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94ed4cba-0bef-4d5a-beba-1d2512346b5d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/dc1f6dcf-e1ca-4d51-94ee-70b494390027/action HTTP/1.1 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 65 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance dc1f6dcf-e1ca-4d51-94ee-70b494390027 could not be found. Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'dc1f6dcf-e1ca-4d51-94ee-70b494390027', 'body': {'rebuild': {'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a'}}} Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1f6dcf-e1ca-4d51-94ee-70b494390027 could not be found. Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:46:38.879525 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1f6dcf-e1ca-4d51-94ee-70b494390027 could not be found. Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1f6dcf-e1ca-4d51-94ee-70b494390027 could not be found. Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94ed4cba-0bef-4d5a-beba-1d2512346b5d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance dc1f6dcf-e1ca-4d51-94ee-70b494390027 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94ed4cba-0bef-4d5a-beba-1d2512346b5d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/dc1f6dcf-e1ca-4d51-94ee-70b494390027/action" status: 404 len: 111 microversion: 2.1 time: 0.027654 Oct 31 15:46:38.887536 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2680/5481] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:38 2022] POST /compute/v2.1/servers/dc1f6dcf-e1ca-4d51-94ee-70b494390027/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:38.890258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:38.890878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:38.897758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.898257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.898697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.899411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:38.899875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:38.900929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.129096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:39.138875 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09aef47b-a9e1-41ef-a83c-3a3979a2527e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.252060 Oct 31 15:46:39.139953 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2802/5482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:38 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:39.162990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:39.163605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:39.180209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.183357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.183898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.184837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.185642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.186311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.489573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:39.498114 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-34c6b2be-a7f7-4dd5-bee5-abae826299ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.338997 Oct 31 15:46:39.499882 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2681/5483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:39 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:39.526999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-368b98dc-b3ea-431e-8a22-de2e7ae0ff7a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:39.527673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-368b98dc-b3ea-431e-8a22-de2e7ae0ff7a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 7cf9e443-a45e-47e3-8c35-47cb86049c4d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:39.537318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-368b98dc-b3ea-431e-8a22-de2e7ae0ff7a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 7cf9e443-a45e-47e3-8c35-47cb86049c4d could not be found. Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-368b98dc-b3ea-431e-8a22-de2e7ae0ff7a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/7cf9e443-a45e-47e3-8c35-47cb86049c4d/action HTTP/1.1 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 15 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: {"restore": {}} Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 7cf9e443-a45e-47e3-8c35-47cb86049c4d could not be found. Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '7cf9e443-a45e-47e3-8c35-47cb86049c4d', 'body': {'restore': {}}} Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf9e443-a45e-47e3-8c35-47cb86049c4d could not be found. Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf9e443-a45e-47e3-8c35-47cb86049c4d could not be found. Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:39.542716 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:39.547857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:39.547857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:39.547857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf9e443-a45e-47e3-8c35-47cb86049c4d could not be found. Oct 31 15:46:39.547857 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:39.547857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-368b98dc-b3ea-431e-8a22-de2e7ae0ff7a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 7cf9e443-a45e-47e3-8c35-47cb86049c4d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:39.553185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-368b98dc-b3ea-431e-8a22-de2e7ae0ff7a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/7cf9e443-a45e-47e3-8c35-47cb86049c4d/action" status: 404 len: 111 microversion: 2.1 time: 0.027685 Oct 31 15:46:39.553909 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2803/5484] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:39 2022] POST /compute/v2.1/servers/7cf9e443-a45e-47e3-8c35-47cb86049c4d/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:39.564623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:39.565503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:39.572639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.573212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.573717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.574524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.575026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.575491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.810742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:39.823400 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-186169a6-23bb-4a9d-a9bc-a7daedb8b1d9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.264811 Oct 31 15:46:39.824796 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2682/5485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:39 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:39.853878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:39.854915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:39.871341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.873841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.877601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.878694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.882179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.882962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:40.332639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:40.335627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:40.355017 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53b90717-3ce2-4253-8831-8909ecc75f7e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.504996 Oct 31 15:46:40.355592 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2804/5486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:39 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:40.383901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:40.384415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:40.399837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:40.400340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:40.400828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:40.401599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:40.403614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:40.405724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:40.466957 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'restore' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 15 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: {"restore": {}} Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'restore' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'restore': {}}} Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state active. Cannot restore while the instance is in this state. Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:40.468454 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'restore' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1829faa5-98c0-4bd7-aecf-42b33e24e41d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 145 microversion: 2.1 time: 0.097400 Oct 31 15:46:40.482909 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2683/5487] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:40 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:46:40.494581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:40.495230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:40.518017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:40.520009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:40.524106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:40.530231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:40.534174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:40.534939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:40.998857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:41.012014 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9f4b986-843c-49bc-900c-137890c440cb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.520563 Oct 31 15:46:41.014751 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2805/5488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:40 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:41.047158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:41.047915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:41.070205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:41.070731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:41.071332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:41.071928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:41.072393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:41.072906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:41.456921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:41.466407 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60d7bde6-ed3b-4b09-826a-1992e534cfea tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.425570 Oct 31 15:46:41.471941 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2684/5489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:41 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:41.504475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb1d616a-ea4f-493e-af73-10d2459bd176 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:41.505093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb1d616a-ea4f-493e-af73-10d2459bd176 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 45be9c64-0a5f-417f-b638-ecb300d41f58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:41.516526 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-eb1d616a-ea4f-493e-af73-10d2459bd176 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 45be9c64-0a5f-417f-b638-ecb300d41f58 could not be found. Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb1d616a-ea4f-493e-af73-10d2459bd176 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/45be9c64-0a5f-417f-b638-ecb300d41f58/action HTTP/1.1 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 14 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: {"resume": {}} Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 45be9c64-0a5f-417f-b638-ecb300d41f58 could not be found. Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '45be9c64-0a5f-417f-b638-ecb300d41f58', 'body': {'resume': {}}} Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45be9c64-0a5f-417f-b638-ecb300d41f58 could not be found. Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45be9c64-0a5f-417f-b638-ecb300d41f58 could not be found. Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:41.525772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:41.534614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:41.534614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:41.534614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45be9c64-0a5f-417f-b638-ecb300d41f58 could not be found. Oct 31 15:46:41.534614 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:41.534614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb1d616a-ea4f-493e-af73-10d2459bd176 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 45be9c64-0a5f-417f-b638-ecb300d41f58 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:41.534614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb1d616a-ea4f-493e-af73-10d2459bd176 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/45be9c64-0a5f-417f-b638-ecb300d41f58/action" status: 404 len: 111 microversion: 2.1 time: 0.036792 Oct 31 15:46:41.537728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:41.538352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:41.541390 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2806/5490] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:41 2022] POST /compute/v2.1/servers/45be9c64-0a5f-417f-b638-ecb300d41f58/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:41.552899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:41.553508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:41.553996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:41.557929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:41.558431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:41.560620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.054653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:42.066050 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-28d37fbb-7c3b-485c-a7f7-227260949d90 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.533669 Oct 31 15:46:42.072077 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2685/5491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:41 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:42.098452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:42.099078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:42.113145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:42.113655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:42.114099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.114813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:42.125491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:42.126269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.428246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:42.436608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-066a3f1a-16a2-4a28-929a-05b14d1a7889 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.343004 Oct 31 15:46:42.449514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2807/5492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:42 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:42.483528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:42.484133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:42.501457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:42.507344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:42.507830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.509822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:42.510293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:42.512972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.591689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'resume' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 14 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: {"resume": {}} Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'resume' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'resume': {}}} Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state active. Cannot resume while the instance is in this state. Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:42.593490 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:42.599246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'resume' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:42.606574 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b72c489d-ba3f-4851-ad12-f877f3a5a4ef tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 144 microversion: 2.1 time: 0.127670 Oct 31 15:46:42.607122 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2686/5493] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:42 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 144 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:46:42.617411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:42.618044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:42.630385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:42.631101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:42.631729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.633056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:42.634934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:42.636833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:43.122478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:43.142255 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-883496cd-73d8-46ca-b940-3fa773ad45e1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.530301 Oct 31 15:46:43.142914 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2808/5494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:42 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:43.180335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:43.181760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:43.193577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:43.194075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:43.194524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:43.195233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:43.195696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:43.196126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:43.544473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:43.568648 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-42537de1-15f5-4c0e-822c-63a136e56df1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.397625 Oct 31 15:46:43.574269 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2687/5495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:43 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:43.797132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-346018d4-5015-4fbf-b947-8b6bbb1d21fd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-346018d4-5015-4fbf-b947-8b6bbb1d21fd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 160 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "7d595c49-078e-4b9a-8f8f-2f689a0106c6"}]}} Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'body': {'server': {'name': '', 'imageRef': '967f19e9-45bc-4d95-8300-59f1ed239b9a', 'flavorRef': '452', 'networks': [{'uuid': '7d595c49-078e-4b9a-8f8f-2f689a0106c6'}]}}} Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '' Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:46:43.802696 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:46:43.807643 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:46:43.816449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-346018d4-5015-4fbf-b947-8b6bbb1d21fd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:43.817594 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-346018d4-5015-4fbf-b947-8b6bbb1d21fd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.025165 Oct 31 15:46:43.818365 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2809/5496] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:43 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:43.828027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:43.828651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:43.841177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:43.843494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:43.844209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:43.846310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:43.847108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:43.847707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:44.454818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:44.476830 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b49be1c7-036b-408d-a52c-37ddad33a504 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.652009 Oct 31 15:46:44.480339 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2688/5497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:43 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:44.508935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:44.510987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:44.519866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:44.521855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:44.522464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:44.523366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:44.523995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:44.524606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:44.822631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:44.835740 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e215ca2-4b6b-46ff-88d4-0ceef2a83167 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.332535 Oct 31 15:46:44.836344 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2810/5498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:44 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:44.869545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a208622-46b7-4bf4-84a2-2c2fc2379ecf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:44.871405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a208622-46b7-4bf4-84a2-2c2fc2379ecf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 7f8535d4-6220-48a7-be1c-6ed6d4f72de3] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:44.882182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3a208622-46b7-4bf4-84a2-2c2fc2379ecf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 7f8535d4-6220-48a7-be1c-6ed6d4f72de3 could not be found. Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a208622-46b7-4bf4-84a2-2c2fc2379ecf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/7f8535d4-6220-48a7-be1c-6ed6d4f72de3/action HTTP/1.1 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 14 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: {"shelve": {}} Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 7f8535d4-6220-48a7-be1c-6ed6d4f72de3 could not be found. Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '7f8535d4-6220-48a7-be1c-6ed6d4f72de3', 'body': {'shelve': {}}} Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8535d4-6220-48a7-be1c-6ed6d4f72de3 could not be found. Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8535d4-6220-48a7-be1c-6ed6d4f72de3 could not be found. Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:44.885609 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:44.892301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:44.892301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:44.892301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8535d4-6220-48a7-be1c-6ed6d4f72de3 could not be found. Oct 31 15:46:44.892301 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:46:44.892301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a208622-46b7-4bf4-84a2-2c2fc2379ecf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 7f8535d4-6220-48a7-be1c-6ed6d4f72de3 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:44.896115 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a208622-46b7-4bf4-84a2-2c2fc2379ecf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/7f8535d4-6220-48a7-be1c-6ed6d4f72de3/action" status: 404 len: 111 microversion: 2.1 time: 0.034576 Oct 31 15:46:44.897419 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2689/5499] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:44 2022] POST /compute/v2.1/servers/7f8535d4-6220-48a7-be1c-6ed6d4f72de3/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:44.911903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:44.913366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:44.918589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:44.925997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:44.926584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:44.927103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:44.928609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:44.929368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:44.931221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:44.957126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:45.117815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aafcf2e7-d515-4502-a139-fd402c925989 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: .version_select at 0x7f5ca13834c0>, body: {"keypair": {"name": "tempest-keypair-1535724856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvIm5mSeP4tNtxw1snkURuOnVnIOUyjrvfoABJNq4y4+WGz76nMnL2g7/5wR5+z0E4ijUP4bXrNllRAJ7xEga91w2Y4Tj6RI8LZdlwO6tOoCg2PJbW4rkfsbPIYKXZusQ=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:45.136012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-aafcf2e7-d515-4502-a139-fd402c925989 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:46:45.141204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:45.142777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-aafcf2e7-d515-4502-a139-fd402c925989 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:46:45.187407 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aafcf2e7-d515-4502-a139-fd402c925989 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291226 Oct 31 15:46:45.188536 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2811/5500] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:46:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:46:45.225876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:45.238847 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5ed06eb7-a9e2-4df2-8200-37487c7fcfbd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.331465 Oct 31 15:46:45.239465 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2690/5501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:44 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:45.271182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:45.272145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:45.291592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:45.292647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:45.293409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:45.294447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:45.295394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:45.296142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:45.785450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:45.796876 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cbb6e792-5693-4605-80ef-ef7825f2e742 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.529795 Oct 31 15:46:45.799143 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2812/5502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:45 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:45.838268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:45.841184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:45.859225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:45.862958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:45.864841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:45.869708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:45.870256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:45.870666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:45.914363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lazy-loading 'flavor' on Instance uuid 0f9fee03-445e-4efc-96b9-379c4fc55497 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:46:46.196207 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cccd450f-d5aa-476e-8da7-ba8668049c50 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 202 len: 0 microversion: 2.1 time: 0.374703 Oct 31 15:46:46.197220 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2691/5503] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:45 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:46:46.206394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:46.207775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:46.216925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:46.218089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:46.221442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:46.223477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:46.224299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:46.225255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:46.845209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:46.861417 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42a584a5-9a78-4adb-b424-327562329d75 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.659957 Oct 31 15:46:46.862786 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2813/5504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:46 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:47.887746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:47.888468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:47.905307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:47.905809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:47.906254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:47.907600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:47.913174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:47.914936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:47.980635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1538005809", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e"}], "security_groups": [{"name": "tempest-securitygroup--2116111934"}], "key_name": "tempest-keypair-1535724856", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:48.179577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] validate_networks() for [('a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:46:48.332187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:48.343173 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dfbbb48a-579a-422a-bab0-f2692b30b52e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.460488 Oct 31 15:46:48.349800 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2692/5505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:47 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:49.028308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:46:49.028895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:46:49.029248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:46:49.029665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:46:49.030074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:46:49.049798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.050293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.050728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:49.056641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.057220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.057672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:49.103981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:46:49.122931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:46:49.149048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:46:49.152879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:46:49.245222 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ca3b857-419c-4676-9b22-1fdab511fbc3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.270146 Oct 31 15:46:49.246270 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2814/5506] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:46:49.258055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-249bcc17-f593-4339-b1b7-9e618d0e7b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:49.258666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-249bcc17-f593-4339-b1b7-9e618d0e7b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:49.385360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:49.386216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:49.405991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.406657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.408239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:49.409166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.411708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.412679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:50.196368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-249bcc17-f593-4339-b1b7-9e618d0e7b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.206676 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-249bcc17-f593-4339-b1b7-9e618d0e7b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1242 microversion: 2.1 time: 0.952379 Oct 31 15:46:50.209892 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2693/5507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:49 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1242 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:50.437201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.448844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28e4729e-aaeb-4423-99c8-b4e607b9128b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 1.070306 Oct 31 15:46:50.468866 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2815/5508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:49 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:51.234646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:51.235920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:51.256746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:51.257402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:51.258523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:51.259340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:51.260082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:51.261196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:51.425136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:51.435773 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f7866f2c-c6ae-405b-86c0-7741dd0369f9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1294 microversion: 2.1 time: 0.205048 Oct 31 15:46:51.437343 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2694/5509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:51 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1294 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:51.482857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:51.483478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:51.493659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:51.494502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:51.495193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:51.496145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:51.496926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:51.497821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:51.803888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:51.812639 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ffa1886d-b222-4cb5-8dee-ba0898485693 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.333601 Oct 31 15:46:51.829317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2816/5510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:51 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:52.464542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:52.465085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.472541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.473083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.473528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.474236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.474694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.475120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.616392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:52.628866 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7711b104-5a14-4e34-96f8-4dbc3f794b6d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1300 microversion: 2.1 time: 0.167577 Oct 31 15:46:52.641266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2695/5511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:52 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:52.842250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:52.843271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.854343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.854934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.855420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.856183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.856640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.857127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.227297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:53.238869 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e70fce12-86fb-41c0-b34f-ccd61315fb74 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.403188 Oct 31 15:46:53.240982 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2817/5512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:52 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:53.653767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:53.654459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:53.667192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.667696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.668135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.668877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.669337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.670898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.228238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:54.248233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3222b4f1-12f7-4fbb-9d7f-ce5990733366 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.591907 Oct 31 15:46:54.249266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2696/5513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:53 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:54.272021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:54.272854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:54.284911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.285706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.286317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.287025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.288107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.288107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.539022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:54.553555 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22c4a5d3-b19d-4244-bf23-8679349591ce tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.289134 Oct 31 15:46:54.555723 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2818/5514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:54 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:55.068679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8ad925c8-61b1-44f6-ba50-a0b7bcdefb21 req-005d341b-f967-4d02-963a-93395d6c7929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8", "tag": "bc488cb8-0dd7-475f-8245-350f28aa91cb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:55.099665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ad925c8-61b1-44f6-ba50-a0b7bcdefb21 req-005d341b-f967-4d02-963a-93395d6c7929 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.100852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ad925c8-61b1-44f6-ba50-a0b7bcdefb21 req-005d341b-f967-4d02-963a-93395d6c7929 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.101474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ad925c8-61b1-44f6-ba50-a0b7bcdefb21 req-005d341b-f967-4d02-963a-93395d6c7929 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.125242 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8ad925c8-61b1-44f6-ba50-a0b7bcdefb21 req-005d341b-f967-4d02-963a-93395d6c7929 service nova] Creating event network-changed:bc488cb8-0dd7-475f-8245-350f28aa91cb for instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 on n-h2-858383-17 Oct 31 15:46:55.143684 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8ad925c8-61b1-44f6-ba50-a0b7bcdefb21 req-005d341b-f967-4d02-963a-93395d6c7929 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080861 Oct 31 15:46:55.144613 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2697/5515] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:55.278084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:55.279479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:55.289458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.290187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.291007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.292401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.293133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.293968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.578263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:55.579079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:55.586206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.599036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.599790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.600808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.601467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.601985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.699866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:55.716391 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab6c3797-89f7-428b-9503-647524298841 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.444368 Oct 31 15:46:55.718311 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2819/5516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:55 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:56.357928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:56.368093 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e56f6933-54e4-4f58-b6b4-64e302e346a7 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.794393 Oct 31 15:46:56.389380 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2698/5517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:55 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:56.745063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:56.745676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:56.763372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:56.766804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:56.767283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:56.768135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:56.768596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:56.769629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.086790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.101509 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e943b54-c91b-4fcd-9e4a-053283f3f769 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.359113 Oct 31 15:46:57.102159 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2820/5518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:56 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:57.398663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:57.399853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:57.416277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.416857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.417163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.417874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.418518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.418747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.749350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.769589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ecb1bdd9-a315-451e-ab40-e1fb9acd4a22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.378417 Oct 31 15:46:57.770233 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2699/5519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:57 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:58.129275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:58.131688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:58.148725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.152104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.153029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.154016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.155871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.158848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.461548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:58.473344 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f30be0fe-c67d-4fca-9a0e-37ca7a4c267d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.351185 Oct 31 15:46:58.474095 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2821/5520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:58 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:58.798645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:58.799278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:58.810374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.810896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.811326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.812382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.815165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.815855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.035312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:59.043519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bab78375-dac9-4f12-99a2-dfbc3951bd22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.250906 Oct 31 15:46:59.059291 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2700/5521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:58 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:59.501412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:59.502155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:59.504916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:59.508759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:59.525742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.526353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.526865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.528836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.532355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.532880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.736822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:59.766504 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4a9144f-9424-4be6-8171-2b3dcf269752 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.268578 Oct 31 15:46:59.777418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2822/5522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:59 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:00.067681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:00.068259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:00.089355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.090131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.090574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.091282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.091736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.092165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.205379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:00.368818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:00.380532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bd0fe57-0116-4c4a-a57c-2045a72da0a2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.316005 Oct 31 15:47:00.384403 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2701/5523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:00 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:00.796117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:00.799235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:00.809740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.810780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.811602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.813346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.814019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.815302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.924655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1449592827", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:00.985317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] validate_networks() for None {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:47:01.025201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:01.035044 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-075646d0-b8c2-4b87-b17c-c7344beaf25f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.243383 Oct 31 15:47:01.039069 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2823/5524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:00 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:01.389290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:01.390233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:01.390913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:01.391492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:01.392925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:01.405165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:01.406045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:01.410577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:01.412302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:01.413142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:01.414120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:01.414765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:01.415413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:01.415549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:01.415930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:01.416429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:01.418286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:01.418842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:01.419287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:01.435232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Getting quotas for project 62e1d177a8864abb90145f5a4f040b84. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:01.441477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Getting quotas for user 23bf433c36b64aad816c4e9c575905af and project 62e1d177a8864abb90145f5a4f040b84. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:01.469875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:47:01.472379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:47:01.540363 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c966388a-b111-4aed-86c9-7cf596c7df96 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621452 Oct 31 15:47:01.542221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2702/5525] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:47:01.553870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c2dc6e95-cb48-4d35-9208-6d87b64bddb9 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:01.554806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c2dc6e95-cb48-4d35-9208-6d87b64bddb9 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:01.650859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c2dc6e95-cb48-4d35-9208-6d87b64bddb9 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:01.661088 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c2dc6e95-cb48-4d35-9208-6d87b64bddb9 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1214 microversion: 2.1 time: 0.111022 Oct 31 15:47:01.662231 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2703/5526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:01 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:01.716278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:01.725532 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac657404-9383-4e94-8ee3-ecb1587a55d0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.324833 Oct 31 15:47:01.726660 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2824/5527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:01 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:02.061889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:02.062938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:02.070314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.070811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.071249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.071956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.072415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.072870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.433081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:02.441081 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d01244ba-1e44-4cce-8e9f-3c98305c56dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.383061 Oct 31 15:47:02.442933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2704/5528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:02 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:02.463244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-7f52a6b3-cc43-4f3f-bbf8-bbc71c3a98c5 req-4bf77784-b05d-42d5-9886-48fca722c499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8", "name": "network-vif-plugged", "status": "completed", "tag": "bc488cb8-0dd7-475f-8245-350f28aa91cb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:02.478770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7f52a6b3-cc43-4f3f-bbf8-bbc71c3a98c5 req-4bf77784-b05d-42d5-9886-48fca722c499 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.479262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7f52a6b3-cc43-4f3f-bbf8-bbc71c3a98c5 req-4bf77784-b05d-42d5-9886-48fca722c499 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.479910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7f52a6b3-cc43-4f3f-bbf8-bbc71c3a98c5 req-4bf77784-b05d-42d5-9886-48fca722c499 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.482816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:02.507607 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-7f52a6b3-cc43-4f3f-bbf8-bbc71c3a98c5 req-4bf77784-b05d-42d5-9886-48fca722c499 service nova] Creating event network-vif-plugged:bc488cb8-0dd7-475f-8245-350f28aa91cb for instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 on n-h2-858383-17 Oct 31 15:47:02.526375 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-7f52a6b3-cc43-4f3f-bbf8-bbc71c3a98c5 req-4bf77784-b05d-42d5-9886-48fca722c499 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336114 Oct 31 15:47:02.527158 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2825/5529] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:02.685924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:02.686793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:02.696281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.697027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.697798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.698720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.699388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.700021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.751866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:02.754276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:02.764129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.764633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.765115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.766781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.767810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.767810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.798160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:02.806355 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa9c8e7d-6e91-457b-8ce0-50d8ec6d8952 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1266 microversion: 2.1 time: 0.125060 Oct 31 15:47:02.807513 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2705/5530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:02 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:02.924612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:02.934210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-706698c4-d4f7-4c8a-aeae-3e3f7b85312c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1531 microversion: 2.1 time: 0.187673 Oct 31 15:47:02.935880 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2826/5531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:02 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1531 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:03.468268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:03.469522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:03.477384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.477953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.478403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.479112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.479778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.482059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.831808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:03.833110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:03.841249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.842081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.842693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.843773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.844762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.845392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.857062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:03.867060 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f892f01-a159-424d-98dc-b1b513042b3e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1368 microversion: 2.1 time: 0.403068 Oct 31 15:47:03.868973 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2706/5532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:03 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1368 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:03.959794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:03.960521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:03.968478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.970332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.971128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.972597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.973599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.974387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:04.019556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:04.029824 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31429a47-6e85-447a-ada5-8107152b79b3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1272 microversion: 2.1 time: 0.202695 Oct 31 15:47:04.032292 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2827/5533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:03 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:04.262752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:04.273520 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02831907-26a9-40c3-900c-c652f4c727c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1531 microversion: 2.1 time: 0.317441 Oct 31 15:47:04.274447 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2707/5534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:03 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1531 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:04.892688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:04.893677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:04.907563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:04.910194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:04.910786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:04.911650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:04.913986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:04.914476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.065595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:05.068548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:05.090543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.104161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.107467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.108610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.109869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.114161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.173494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:05.662181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.670944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c812bbf4-ec31-41e3-ae47-2c50f394bf49 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1559 microversion: 2.1 time: 0.783442 Oct 31 15:47:05.672398 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2828/5535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:04 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1559 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:05.686693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.694921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:05.695870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:05.705195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.714559 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-270bb77f-1e02-497f-a361-5eb82cd07685 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.654826 Oct 31 15:47:05.715561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.742670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2708/5536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:05 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:05.745056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.746567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.751315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:05.752302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.753215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.758790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:05.790958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.796254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.801886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.802733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.803229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.803669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:06.079978 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b9950c0-0972-4f5e-8796-92f6804c0631 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.335065 Oct 31 15:47:06.081289 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2709/5537] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:47:05 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-interface => generated 285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:06.086776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b7a3d10e-bca8-4bb7-bd1e-309dc6916193 req-cf642589-1261-46a8-bab9-4182ef06ffca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "name": "network-vif-plugged", "status": "completed", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:06.124953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7a3d10e-bca8-4bb7-bd1e-309dc6916193 req-cf642589-1261-46a8-bab9-4182ef06ffca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.125895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7a3d10e-bca8-4bb7-bd1e-309dc6916193 req-cf642589-1261-46a8-bab9-4182ef06ffca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.128418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b7a3d10e-bca8-4bb7-bd1e-309dc6916193 req-cf642589-1261-46a8-bab9-4182ef06ffca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:06.145537 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b7a3d10e-bca8-4bb7-bd1e-309dc6916193 req-cf642589-1261-46a8-bab9-4182ef06ffca service nova] Creating event network-vif-plugged:e291afc7-e012-4d7f-a4b4-577c9e9d1b00 for instance 0f9fee03-445e-4efc-96b9-379c4fc55497 on n-h1-858383-17 Oct 31 15:47:06.153400 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b7a3d10e-bca8-4bb7-bd1e-309dc6916193 req-cf642589-1261-46a8-bab9-4182ef06ffca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069977 Oct 31 15:47:06.154481 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2710/5538] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:06.313653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:06.338159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30a6965f-9ea8-433b-9ffb-097b65ba0c21 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1531 microversion: 2.1 time: 0.664146 Oct 31 15:47:06.339693 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2829/5539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:05 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1531 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:06.742514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:06.743494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:06.760895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.769288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.769976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:06.777772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.778518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.779226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.376895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:07.378348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:07.380040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:07.388320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-839c2c17-3414-443f-816e-08d88a9218d3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.651486 Oct 31 15:47:07.391544 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2711/5540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:06 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:07.408592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.410069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.411812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.413147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.417362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.417912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.322775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:08.338349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-158bb728-d377-4512-b949-6dd94bd1964f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1531 microversion: 2.1 time: 0.977361 Oct 31 15:47:08.340214 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2830/5541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:07 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1531 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:08.414131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:08.415359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:08.429792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.431134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.432286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.433219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.433862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.434524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.948605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-620db535-3346-4b74-ab77-cdd74fc7180f req-0ffe118c-0e6e-4782-bc8c-b5f06fc93c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbbfd71-d347-4c5f-835f-ffd490e40c06", "tag": "49d4a969-084c-413d-b158-6c2699668e68"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:08.962345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-620db535-3346-4b74-ab77-cdd74fc7180f req-0ffe118c-0e6e-4782-bc8c-b5f06fc93c2e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.965197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-620db535-3346-4b74-ab77-cdd74fc7180f req-0ffe118c-0e6e-4782-bc8c-b5f06fc93c2e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.967370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-620db535-3346-4b74-ab77-cdd74fc7180f req-0ffe118c-0e6e-4782-bc8c-b5f06fc93c2e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.998174 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-620db535-3346-4b74-ab77-cdd74fc7180f req-0ffe118c-0e6e-4782-bc8c-b5f06fc93c2e service nova] Creating event network-changed:49d4a969-084c-413d-b158-6c2699668e68 for instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 on n-h1-858383-17 Oct 31 15:47:09.010943 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-620db535-3346-4b74-ab77-cdd74fc7180f req-0ffe118c-0e6e-4782-bc8c-b5f06fc93c2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068738 Oct 31 15:47:09.013269 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2831/5542] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:09.370367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:09.371107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:09.393188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:09.393983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:09.394668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:09.399445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:09.407035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:09.407809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:09.408451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:09.409895 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e65257c-00c4-4046-9ab1-cbb80422f6ba tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.999921 Oct 31 15:47:09.413585 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2712/5543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:08 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:10.195129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:10.206957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f50a5444-8965-4583-86f8-ce8938dd6cfd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.841859 Oct 31 15:47:10.212889 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2832/5544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:09 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:10.438938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:10.442500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:10.460049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:10.461034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:10.463167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:10.464148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:10.464872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:10.465504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.237014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:11.238572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:11.251585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.256381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.257387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.261218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.262085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.265128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.389316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:11.401888 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d00f09f3-6de5-4b2e-b5d9-3883238c4dc7 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.967865 Oct 31 15:47:11.410684 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2713/5545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:10 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:11.539649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c37c7955-522f-47bb-b323-5ec6fc506c25 req-42338042-d399-4f8c-9fbc-a849c477b234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8", "tag": "bc488cb8-0dd7-475f-8245-350f28aa91cb"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:11.555242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:11.584272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c37c7955-522f-47bb-b323-5ec6fc506c25 req-42338042-d399-4f8c-9fbc-a849c477b234 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.584975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c37c7955-522f-47bb-b323-5ec6fc506c25 req-42338042-d399-4f8c-9fbc-a849c477b234 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.585445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c37c7955-522f-47bb-b323-5ec6fc506c25 req-42338042-d399-4f8c-9fbc-a849c477b234 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.613025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c37c7955-522f-47bb-b323-5ec6fc506c25 req-42338042-d399-4f8c-9fbc-a849c477b234 service nova] Creating event network-changed:bc488cb8-0dd7-475f-8245-350f28aa91cb for instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 on n-h2-858383-17 Oct 31 15:47:11.622278 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c37c7955-522f-47bb-b323-5ec6fc506c25 req-42338042-d399-4f8c-9fbc-a849c477b234 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089464 Oct 31 15:47:11.629295 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2714/5546] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 31 15:47:11.915618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:11.934844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c94975c-9c20-4a47-89cc-943de6156753 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.703222 Oct 31 15:47:11.935997 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2833/5547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:11 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:12.434229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:12.440056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:12.441061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:12.448482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.450184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.451221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.453377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.455032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.460224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.912612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:12.929290 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e18a83de-95be-44b6-a918-054daddd8858 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.489990 Oct 31 15:47:12.933126 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2715/5548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:12 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:12.966774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:12.968329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:12.975969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.983718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.986708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.988683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.993468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.995590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:13.438757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:13.459184 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23ca940e-986b-4e50-b492-8b7e7b84e601 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.496134 Oct 31 15:47:13.459867 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2834/5549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:12 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:13.956926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:13.957847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:13.970785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.971284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.971721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:13.972424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.986160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.988223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.370773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:14.384054 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9fe469da-8df0-47f6-86a4-00a21223eb1f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.431850 Oct 31 15:47:14.416389 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2716/5550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:13 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:14.497317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:14.497967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:14.521825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:14.525625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:14.529717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.531374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:14.537669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:14.539263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.886528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:14.895112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f75e7aea-2a50-4df9-9c0e-4c0f8be113f2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.413054 Oct 31 15:47:14.901412 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2835/5551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:14 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:15.408251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.409047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.411589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:15.422267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.433535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.434292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.435240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.435877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.436492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.776546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:15.786633 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d55ae309-7d39-4668-9eff-23e64b5da99e tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.383350 Oct 31 15:47:15.819795 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2717/5552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:15.928012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.928585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.937522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:15.951339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.955049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.955931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.956937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.962767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.963467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.311917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:16.330029 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7ca9fb0f-eda7-4d82-a6ff-5432f9a9f08b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.405397 Oct 31 15:47:16.342258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2836/5553] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:16.829359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:16.830151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:16.853874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.854301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.858103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.861627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.862138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.875901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:17.181083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:17.190038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f41704d-5a61-44dc-8439-26b9c3feb60a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.366350 Oct 31 15:47:17.211286 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2718/5554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:16 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:17.358808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:17.359813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:17.368327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:17.368875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:17.369315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:17.373627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:17.381730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:17.382624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:17.666500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:17.678158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f189c074-7fbf-4784-9fb9-560e96768df2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.322987 Oct 31 15:47:17.679374 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2837/5555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:17 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:18.221487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:18.222128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:18.237472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.239141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.241390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.246429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.247184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.247834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.275070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0b7d87bb-5dd4-4694-baf8-cacd9fe597dc req-2b1e468d-e959-48eb-ae90-306734ce273a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbbfd71-d347-4c5f-835f-ffd490e40c06", "name": "network-vif-plugged", "status": "completed", "tag": "49d4a969-084c-413d-b158-6c2699668e68"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:18.291167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0b7d87bb-5dd4-4694-baf8-cacd9fe597dc req-2b1e468d-e959-48eb-ae90-306734ce273a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.291592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0b7d87bb-5dd4-4694-baf8-cacd9fe597dc req-2b1e468d-e959-48eb-ae90-306734ce273a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.291889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0b7d87bb-5dd4-4694-baf8-cacd9fe597dc req-2b1e468d-e959-48eb-ae90-306734ce273a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.324726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0b7d87bb-5dd4-4694-baf8-cacd9fe597dc req-2b1e468d-e959-48eb-ae90-306734ce273a service nova] Creating event network-vif-plugged:49d4a969-084c-413d-b158-6c2699668e68 for instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 on n-h1-858383-17 Oct 31 15:47:18.337950 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0b7d87bb-5dd4-4694-baf8-cacd9fe597dc req-2b1e468d-e959-48eb-ae90-306734ce273a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067332 Oct 31 15:47:18.341481 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2838/5556] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:18.706599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:18.708325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:18.721390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.723677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.724135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.724952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.725429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.725865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.782585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:18.793314 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2917b0d-5e54-4e60-83db-aa302491f2e3 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.578384 Oct 31 15:47:18.797207 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2719/5557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:18 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:18.980279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:18.989968 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7757faab-677e-41e6-a60a-32aeac0b5d66 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.288281 Oct 31 15:47:18.990573 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2839/5558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:18 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:19.824813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:19.826761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:19.856071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:19.856071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:19.856974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:19.858035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:19.859070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:19.860352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.014282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:20.015680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:20.034437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.035029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.036205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.039441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.040290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.045162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.106704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:20.119856 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cabe6245-18b2-4044-96b5-364065e8007d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1314 microversion: 2.1 time: 0.302071 Oct 31 15:47:20.135695 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2720/5559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:19 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:20.371776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:20.381326 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5383f6f2-940f-4525-9b3b-462a67f89bb0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.370971 Oct 31 15:47:20.382520 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2840/5560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:20 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:21.146857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.147518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:21.175662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.181738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.185783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.186748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.187362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.188073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.409771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.410403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:21.431829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.433205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.435950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.440062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.446357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.447035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.482206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.491212 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5887de0b-b330-4855-af1d-85f491e08924 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1463 microversion: 2.1 time: 0.349283 Oct 31 15:47:21.503082 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2721/5561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1463 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:21.522786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10353028-66f6-4e8a-9f5d-b2da3f73eb8f", "device": "/dev/sdb"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:21.526851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:21.544172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.544965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.545593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.547482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.548120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.549704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.832291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.845384 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bfa4115-a2b4-47e5-ade3-4fe8c5e4af48 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.442774 Oct 31 15:47:21.847165 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2841/5562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:22.010902 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-84291d46-f90c-44df-b76a-b128d812890a tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "POST /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491720 Oct 31 15:47:22.012341 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2722/5563] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:47:21 2022] POST /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:22.875800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.877158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:22.895220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.898130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.898674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.901314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.909874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.911459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:23.313961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:23.313961 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6003f54-e76a-45fb-a222-5538ddbf79c6 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.424595 Oct 31 15:47:23.313961 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2842/5564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:22 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:24.327644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:24.328538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:24.343188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:24.344463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:24.345413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:24.346552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:24.347197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:24.347831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:24.627187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:24.645897 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5eb78ae8-1eca-4c19-9f0a-6fd830d05dcc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1526 microversion: 2.1 time: 0.323091 Oct 31 15:47:24.646853 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2723/5565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:24 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1526 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:25.669873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:25.670495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:25.678635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:25.679512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:25.680193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:25.681192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:25.681895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:25.682610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:25.866008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:25.871631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:25.885628 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54a21f8d-b3f0-4ca8-b8b0-0d5cdae0e71a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1508 microversion: 2.1 time: 0.215481 Oct 31 15:47:25.886900 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2843/5566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:25 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:26.924629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:26.925343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:26.939327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:26.939834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:26.940280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:26.945997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:26.946663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:26.947125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:27.219941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:27.230147 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c36d013f-f78e-4e11-9b0e-276b9e10285e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1508 microversion: 2.1 time: 0.317022 Oct 31 15:47:27.231135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2724/5567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:26 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:28.253161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:28.253789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:28.271646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:28.272158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:28.272607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:28.273366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:28.273830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:28.274261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:28.665222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:28.680457 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-325fbbd6-a417-4b7b-bb03-334f84cd3b86 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1508 microversion: 2.1 time: 0.431473 Oct 31 15:47:28.681162 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2844/5568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:28 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1508 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:29.706599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:29.707910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:29.716046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:29.716863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:29.718131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:29.719088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:29.719820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:29.720729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:29.750153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:29.908648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:29.917756 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a00c948-760b-4e03-bfc5-706e6fb9085a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1451 microversion: 2.1 time: 0.216329 Oct 31 15:47:29.918998 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2725/5569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:29 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1451 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:29.942627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:29.943896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:29.951328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:29.952596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:29.953062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:29.953771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:29.954231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:29.954663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.100292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:30.109325 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49268817-4d8a-4f1b-a7b4-19e3980a8d04 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1451 microversion: 2.1 time: 0.171818 Oct 31 15:47:30.109912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2845/5570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:29 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:30.173979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e1d31ef5-8942-4848-a95e-b75d46cfbfe3 req-bb1204bb-dca1-4ef2-8afb-07d9932d351e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "name": "network-vif-unplugged", "status": "completed", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:30.194555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e1d31ef5-8942-4848-a95e-b75d46cfbfe3 req-bb1204bb-dca1-4ef2-8afb-07d9932d351e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.196156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e1d31ef5-8942-4848-a95e-b75d46cfbfe3 req-bb1204bb-dca1-4ef2-8afb-07d9932d351e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.196730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:30.197033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e1d31ef5-8942-4848-a95e-b75d46cfbfe3 req-bb1204bb-dca1-4ef2-8afb-07d9932d351e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.197393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:30.205311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.205818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.206607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.207336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.207857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.208294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.211557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.compute.server_external_events [req-e1d31ef5-8942-4848-a95e-b75d46cfbfe3 req-bb1204bb-dca1-4ef2-8afb-07d9932d351e service nova] Unable to find a host for instance 0f9fee03-445e-4efc-96b9-379c4fc55497. Dropping event network-vif-unplugged {{(pid=120626) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:47:30.212933 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e1d31ef5-8942-4848-a95e-b75d46cfbfe3 req-bb1204bb-dca1-4ef2-8afb-07d9932d351e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045979 Oct 31 15:47:30.214150 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2726/5571] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:47:30.247594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lazy-loading 'flavor' on Instance uuid 0f9fee03-445e-4efc-96b9-379c4fc55497 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:30.278762 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'shelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state shelved_offloaded Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 14 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: {"shelve": {}} Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot 'shelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state shelved_offloaded Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'shelve': {}}} Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:47:30.282944 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state shelved_offloaded Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state shelved_offloaded Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'shelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state shelved_offloaded {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:30.288362 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c71fc432-88f2-4569-9259-2890d486a6bd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 155 microversion: 2.1 time: 0.095054 Oct 31 15:47:30.291080 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2846/5572] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:47:30 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 155 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:47:30.308297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:30.309160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:30.318071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.318834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.319443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.321016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.321634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.322210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.373153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120626) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:47:30.465683 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ace84ff7-cff1-44a2-ac76-5ba90081f49b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 202 len: 0 microversion: 2.1 time: 0.172133 Oct 31 15:47:30.467922 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2727/5573] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:47:30 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:47:30.475536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:30.476298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:30.482324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.484287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.485403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.486367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.487045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.487683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.719029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:30.730396 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aec94519-a299-497f-9a4f-fc5184aea6a1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1459 microversion: 2.1 time: 0.257524 Oct 31 15:47:30.731524 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2847/5574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:30 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1459 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:31.755919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:31.757160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:31.767597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:31.768089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:31.784122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:31.785388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:31.786040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:31.795067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:32.117181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:32.131736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e294aec-3563-400f-9b4b-bf6da7760e6a tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1459 microversion: 2.1 time: 0.379692 Oct 31 15:47:32.132678 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2728/5575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:31 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1459 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:33.157023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:33.157645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:33.164645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:33.165378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:33.166416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:33.167500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:33.168120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:33.168742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:33.571815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:33.581753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e7e7ccd-80ab-4269-9779-3f4538101bf1 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.428733 Oct 31 15:47:33.582634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2848/5576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:33 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:34.403020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-da729f73-8408-4ded-9a06-7913d409c73d req-95c1474e-deb1-435e-aed5-403ead8ee55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:34.414823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-da729f73-8408-4ded-9a06-7913d409c73d req-95c1474e-deb1-435e-aed5-403ead8ee55f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:34.415315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-da729f73-8408-4ded-9a06-7913d409c73d req-95c1474e-deb1-435e-aed5-403ead8ee55f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:34.415929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-da729f73-8408-4ded-9a06-7913d409c73d req-95c1474e-deb1-435e-aed5-403ead8ee55f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:34.431357 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-da729f73-8408-4ded-9a06-7913d409c73d req-95c1474e-deb1-435e-aed5-403ead8ee55f service nova] Creating event network-changed:e291afc7-e012-4d7f-a4b4-577c9e9d1b00 for instance 0f9fee03-445e-4efc-96b9-379c4fc55497 on n-h2-858383-17 Oct 31 15:47:34.437939 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-da729f73-8408-4ded-9a06-7913d409c73d req-95c1474e-deb1-435e-aed5-403ead8ee55f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039945 Oct 31 15:47:34.438619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2729/5577] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:34.607165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:34.608468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:34.615677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:34.616383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:34.616902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:34.617623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:34.618088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:34.618519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:35.347741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:35.358622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91d1ba7f-f1e5-4a3a-9712-6c1dc1fca439 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.755321 Oct 31 15:47:35.387413 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2849/5578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:34 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:36.392875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:36.394301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:36.449554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.453890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.456180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:36.458952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.459720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.465156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.270481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:37.321520 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a746ea9-4166-4355-a901-cb602feb1795 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.925183 Oct 31 15:47:37.324107 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2730/5579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:36 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:38.350322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:38.350999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:38.363818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.364345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.364929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.365559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.366074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.366530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.457773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:38.459013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:38.470309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.474301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.477897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.479948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.482477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.483357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.567849 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bf8969c-7230-409a-9e1f-5a7e8e8d2118 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/ips" status: 200 len: 151 microversion: 2.1 time: 0.114190 Oct 31 15:47:38.568461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2731/5580] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:47:38 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/ips => generated 151 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:38.933724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:38.957911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-183b9edd-767b-4104-98b2-2d71af7b3477 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.608322 Oct 31 15:47:38.960224 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2850/5581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:38 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:39.983616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:39.984915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:39.994716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.001610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.002325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.003294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.006864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.007524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.361570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:40.378077 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8de83c2f-49ed-43c8-add1-90c65ffb2408 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.398451 Oct 31 15:47:40.381817 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2732/5582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:39 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:41.406371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:41.407383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:41.429803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.432411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.434540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.436939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.439214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.439917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.852039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fef33887-b09e-41b5-a4a1-1c421c11a7c9"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:41.856232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:41.871891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.875298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.876225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.877228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.878491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:41.879292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.879943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.905099 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f91fdfc-d12c-48c2-b176-39bf52b94af2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.505061 Oct 31 15:47:41.908903 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2851/5583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:41 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:42.580361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7897056-edd4-4654-b792-11649d84be3b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731006 Oct 31 15:47:42.591080 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2733/5584] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:47:41 2022] POST /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:42.936504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:42.938729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:42.954493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:42.955387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:42.958734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:42.961321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:42.962356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:42.963891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.527159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:43.543666 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97388575-f61f-4d20-a70b-472ec25044b9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.610259 Oct 31 15:47:43.547361 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2852/5585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:42 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:44.584871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:44.586050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:44.623489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.633662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.635763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.639012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.640315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.641151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:45.398509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:45.411360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf2ed59f-b29d-45b8-9e6a-0c037334682f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.836328 Oct 31 15:47:45.413529 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2734/5586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:44 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:46.439196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:46.440480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:46.444469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=34 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:46.454323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.456676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.457364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.459964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.467600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.468314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.930431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:46.941378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b19a143-ca79-49b1-b7ca-d46e22680a42 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.505888 Oct 31 15:47:46.942697 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2853/5587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:46 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:47.969874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:47.971158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:47.975790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:48.001439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.002202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.002819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.003722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.004334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.006219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.877752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:48.899802 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f69cd36-5a53-4dbb-ad3c-5918e317f0db tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.930570 Oct 31 15:47:48.928511 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2735/5588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:47 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:49.967233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:49.967969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:49.979235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:49.979745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:49.983876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:49.988450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:49.989205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:49.989728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:50.419098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:50.442657 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c0ac71d-82c5-4c9d-b723-3b1300a76f41 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.480294 Oct 31 15:47:50.443258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2854/5589] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:49 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:51.469190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:51.469798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:51.484209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.498278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.502296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.503083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.503561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.504005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.746962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:51.757127 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a94b7247-d411-4cd9-8631-a11e4f530f09 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.293000 Oct 31 15:47:51.769650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2736/5590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:51 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:52.783139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:52.783767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:52.791299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.795324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.796187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.798471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.799142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.800728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.136046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:53.194716 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b13e393f-e96e-4f25-880c-bda25fdbd9d2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.415174 Oct 31 15:47:53.197684 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2855/5591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:52 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:54.224548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:54.225970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:54.241142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.242007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.243818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.248031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.250158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.251966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.581818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:54.602764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5162387-92d4-4a31-9753-953aacce027f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.383027 Oct 31 15:47:54.603606 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2737/5592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:54 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:54.642539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-976df96d-266b-4e4b-92a5-e877b5854fa5 req-be19bf70-8902-4cb2-b105-c18f7651fd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "name": "network-vif-plugged", "status": "completed", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:54.659565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-976df96d-266b-4e4b-92a5-e877b5854fa5 req-be19bf70-8902-4cb2-b105-c18f7651fd1e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.660428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-976df96d-266b-4e4b-92a5-e877b5854fa5 req-be19bf70-8902-4cb2-b105-c18f7651fd1e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.661194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-976df96d-266b-4e4b-92a5-e877b5854fa5 req-be19bf70-8902-4cb2-b105-c18f7651fd1e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.687143 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-976df96d-266b-4e4b-92a5-e877b5854fa5 req-be19bf70-8902-4cb2-b105-c18f7651fd1e service nova] Creating event network-vif-plugged:e291afc7-e012-4d7f-a4b4-577c9e9d1b00 for instance 0f9fee03-445e-4efc-96b9-379c4fc55497 on n-h2-858383-17 Oct 31 15:47:54.696257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-976df96d-266b-4e4b-92a5-e877b5854fa5 req-be19bf70-8902-4cb2-b105-c18f7651fd1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059965 Oct 31 15:47:54.697727 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2856/5593] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:55.649799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:55.650889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:55.676167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:55.683521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:55.684802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:55.690956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:55.691941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:55.693474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:55.900287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:55.925341 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e6b468b2-86cf-4519-b425-ae68c42cb08e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.283692 Oct 31 15:47:55.942519 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2738/5594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:55 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:56.963596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:56.964196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:56.983997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.984816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.985391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.985982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.986441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.989097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.010348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=76 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:57.272282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:57.282509 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c3c6228-0ce6-48e8-bd5a-21cebcbc51c5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1517 microversion: 2.1 time: 0.326734 Oct 31 15:47:57.284740 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2857/5595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:56 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1517 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:58.308151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:58.310434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:58.320684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.322431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.323119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.323859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.325180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.325826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.510285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:58.522052 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cca1a366-7f15-47ad-b0ed-1fb7e5ec353d tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.218231 Oct 31 15:47:58.533911 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2739/5596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:58 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:58.549407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:58.550182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:58.558285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.558936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.559619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.561045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.561627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.562166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.752622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:58.765282 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c354d2d0-3475-45ce-b7de-e69565cd4d22 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.221368 Oct 31 15:47:58.779996 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2858/5597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:58 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:58.799066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:58.800040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:58.810619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.812518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.813012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.816791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.817494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.819458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.184520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:59.198422 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8739c22b-aceb-4598-b92c-294c456f6f7b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.404605 Oct 31 15:47:59.199211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2740/5598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:58 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:59.226107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c126135-eb57-4c58-a22a-2e6d06c35489 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:59.238019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2c126135-eb57-4c58-a22a-2e6d06c35489 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 56521365-f6f3-4413-b66e-4c481910fe15 has no mapping to a cell. Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c126135-eb57-4c58-a22a-2e6d06c35489 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/56521365-f6f3-4413-b66e-4c481910fe15/action HTTP/1.1 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 15 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: {"os-stop": {}} Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 56521365-f6f3-4413-b66e-4c481910fe15 has no mapping to a cell. Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '56521365-f6f3-4413-b66e-4c481910fe15', 'body': {'os-stop': {}}} Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 56521365-f6f3-4413-b66e-4c481910fe15 has no mapping to a cell. Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:59.248304 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56521365-f6f3-4413-b66e-4c481910fe15 has no mapping to a cell. Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56521365-f6f3-4413-b66e-4c481910fe15 has no mapping to a cell. Oct 31 15:47:59.254104 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.256234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c126135-eb57-4c58-a22a-2e6d06c35489 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 56521365-f6f3-4413-b66e-4c481910fe15 has no mapping to a cell. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:59.257392 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c126135-eb57-4c58-a22a-2e6d06c35489 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/56521365-f6f3-4413-b66e-4c481910fe15/action" status: 404 len: 117 microversion: 2.1 time: 0.035237 Oct 31 15:47:59.258206 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2859/5599] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:47:59 2022] POST /compute/v2.1/servers/56521365-f6f3-4413-b66e-4c481910fe15/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:59.266894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:59.268436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:59.280690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.281208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.281643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.282344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.282798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.283222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.310578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:59.529161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:59.537985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bb16ce0a-d7fb-444d-8665-abc07a7a7815 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.275219 Oct 31 15:47:59.539716 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2741/5600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:59 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:59.566404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:59.566954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:59.577161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.579288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.579970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.585946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.587144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.587854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.859997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:59.864659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d502919e-bb39-4d86-a702-f33a2c5b5011 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.302071 Oct 31 15:47:59.869519 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2860/5601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:59 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:59.888571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41e04485-9094-4fa4-ba69-094faea728c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:59.889150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-41e04485-9094-4fa4-ba69-094faea728c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: ca870e66-97ff-448a-94e6-2651bc6b8512] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:59.899192 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-41e04485-9094-4fa4-ba69-094faea728c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance ca870e66-97ff-448a-94e6-2651bc6b8512 could not be found. Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41e04485-9094-4fa4-ba69-094faea728c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/ca870e66-97ff-448a-94e6-2651bc6b8512/action HTTP/1.1 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 15 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: {"suspend": {}} Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance ca870e66-97ff-448a-94e6-2651bc6b8512 could not be found. Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'ca870e66-97ff-448a-94e6-2651bc6b8512', 'body': {'suspend': {}}} Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca870e66-97ff-448a-94e6-2651bc6b8512 could not be found. Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca870e66-97ff-448a-94e6-2651bc6b8512 could not be found. Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:59.901518 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:59.906257 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:59.906257 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:59.906257 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca870e66-97ff-448a-94e6-2651bc6b8512 could not be found. Oct 31 15:47:59.906257 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:47:59.906257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41e04485-9094-4fa4-ba69-094faea728c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance ca870e66-97ff-448a-94e6-2651bc6b8512 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:59.906257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41e04485-9094-4fa4-ba69-094faea728c9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/ca870e66-97ff-448a-94e6-2651bc6b8512/action" status: 404 len: 111 microversion: 2.1 time: 0.018828 Oct 31 15:47:59.911040 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2742/5602] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:47:59 2022] POST /compute/v2.1/servers/ca870e66-97ff-448a-94e6-2651bc6b8512/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:59.920817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:59.922130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:59.947387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.948393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.953140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.953897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.954372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.954965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.163863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7fe81a73-cba2-4c3d-bf57-ce0681387412 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: .version_select at 0x7f5ca14d3790>, body: {"keypair": {"name": "tempest-keypair-1664986717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLk47F/Ft2bdvOAixFZEL6s8rkJ+0CHxZtJFaf1qRxhTaWjf3Wsj1LcsEx3JTmL7YDe6ZMfEflcm9zN5kmeXxhl37d84UFaWWnrXnr4sdX1OeGAhT4/EFrFNmTD/IGjM1Q=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:00.194835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-7fe81a73-cba2-4c3d-bf57-ce0681387412 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:48:00.203820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-7fe81a73-cba2-4c3d-bf57-ce0681387412 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:48:00.249906 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7fe81a73-cba2-4c3d-bf57-ce0681387412 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [e6149452-7858-4595-94fa-9010c8426312] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:48:00.322819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.332640 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25137b1d-8b6a-4753-9a4d-fa8a2100f366 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.423788 Oct 31 15:48:00.333614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2861/5603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:59 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:00.358658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:00.359637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.366312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.367051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.367997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.369160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.369908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.370564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.552345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.560968 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a08efd0-b21b-43d4-93ae-c553e9fd46ed tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.206901 Oct 31 15:48:00.562284 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2862/5604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:00 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:00.584624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:00.586549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.596782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.597864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.598493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.599397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.600033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.600631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.639430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lazy-loading 'flavor' on Instance uuid 0f9fee03-445e-4efc-96b9-379c4fc55497 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:00.791778 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a80ac24d-31f5-4b3f-bef4-3bfdb8015e4c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 202 len: 0 microversion: 2.1 time: 0.210758 Oct 31 15:48:00.793553 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2863/5605] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:00 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:48:00.822263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:00.829229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.838668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.839499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.840120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.842326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.843006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.843650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.095924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:01.105798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57c888ce-550c-4d7f-b697-e89f2c8dbb53 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1512 microversion: 2.1 time: 0.290689 Oct 31 15:48:01.106701 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2864/5606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:00 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:01.261586 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [None req-7fe81a73-cba2-4c3d-bf57-ce0681387412 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [e6149452-7858-4595-94fa-9010c8426312] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57252. Oct 31 15:48:01.285476 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7fe81a73-cba2-4c3d-bf57-ce0681387412 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.126466 Oct 31 15:48:01.287003 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2743/5607] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:48:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:02.130179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:02.130796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.154391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.155440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.159032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.160463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.161638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.162268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.629534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:02.641530 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-148c0314-fd1b-461a-8ac4-0ef821d4637f tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1495 microversion: 2.1 time: 0.516177 Oct 31 15:48:02.642364 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2865/5608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:02 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1495 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:02.673502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:02.674117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.689639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.690118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.690496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.691200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.691654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.692079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.754343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lazy-loading 'flavor' on Instance uuid 0f9fee03-445e-4efc-96b9-379c4fc55497 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:02.773114 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'suspend' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state suspended Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 15 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: {"suspend": {}} Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'suspend' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state suspended Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'suspend': {}}} Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 31 15:48:02.778862 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state suspended Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state suspended Oct 31 15:48:02.783696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:02.786480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'suspend' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state suspended {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:02.788092 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c5a10cc6-dbc1-47d8-aa04-d0cee40cbdcd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 148 microversion: 2.1 time: 0.121070 Oct 31 15:48:02.788948 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2744/5609] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:02 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 148 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:48:02.797455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:02.798293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.812573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.813388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.814023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.814931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.815583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.816203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.965722 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eeeda561-5e7a-41fb-9576-56ca2898a714 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 202 len: 0 microversion: 2.1 time: 0.169548 Oct 31 15:48:02.968061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2866/5610] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:02 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:48:02.976375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:02.977049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.984163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.984654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.993431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.994201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.994679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.995107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.396055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.412104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a78f8cc-765c-409c-b004-fc9f22c43fdf tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1501 microversion: 2.1 time: 0.435327 Oct 31 15:48:03.412104 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2745/5611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:02 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1501 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:04.316511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242396753", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e"}], "security_groups": [{"name": "tempest-securitygroup--1186929168"}], "key_name": "tempest-keypair-1664986717", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:04.438787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:04.440410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:04.440973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] validate_networks() for [('a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:48:04.448541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.449053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.449488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.450479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.451324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.451755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.698996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:04.710913 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d01fef5b-85ae-457f-bcef-faedd54b3aac tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1501 microversion: 2.1 time: 0.277520 Oct 31 15:48:04.711921 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2746/5612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:04 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:05.106981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:48:05.107576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:48:05.108195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:48:05.108995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:48:05.109590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:48:05.120155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.120892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.121611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.123672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.125110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.127151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.177171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:48:05.183385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:48:05.197705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:48:05.200309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:48:05.292536 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-461e9b55-8d55-4af5-aa7d-2cee4a313718 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.981359 Oct 31 15:48:05.301524 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2867/5613] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:48:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:48:05.306817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bec25ee7-a1e9-426e-a562-bbd55f3a2aaa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:05.307762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bec25ee7-a1e9-426e-a562-bbd55f3a2aaa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:05.416379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bec25ee7-a1e9-426e-a562-bbd55f3a2aaa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:05.426305 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bec25ee7-a1e9-426e-a562-bbd55f3a2aaa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1242 microversion: 2.1 time: 0.123456 Oct 31 15:48:05.444004 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2747/5614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:05 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:05.744902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:05.746462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:05.762974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.766951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.767502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.768268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.768781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.769228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.052948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.076022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f8a0b26-1be4-4a18-93ce-125db35c6a69 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.324374 Oct 31 15:48:06.078112 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2868/5615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:05 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:06.112198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:06.113176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.138069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.141454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.143822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.147163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.149027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.153473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.453840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:06.454695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.473833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.474655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.475727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.477177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.478018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.478736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.485467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.497532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b4f559f-7a8f-4959-9884-b3eacb834974 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.390295 Oct 31 15:48:06.500025 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2748/5616] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:06 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:06.524910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da62152b-609b-41de-b727-c2b5495933ff tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:06.525454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da62152b-609b-41de-b727-c2b5495933ff tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 2d267daa-c6bf-4083-bc95-437c900d7c97] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.551849 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-da62152b-609b-41de-b727-c2b5495933ff tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 2d267daa-c6bf-4083-bc95-437c900d7c97 could not be found. Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da62152b-609b-41de-b727-c2b5495933ff tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/2d267daa-c6bf-4083-bc95-437c900d7c97/action HTTP/1.1 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 15 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: {"unpause": {}} Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2d267daa-c6bf-4083-bc95-437c900d7c97 could not be found. Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2d267daa-c6bf-4083-bc95-437c900d7c97', 'body': {'unpause': {}}} Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d267daa-c6bf-4083-bc95-437c900d7c97 could not be found. Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d267daa-c6bf-4083-bc95-437c900d7c97 could not be found. Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:06.593516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:06.599081 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:06.599081 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:06.599081 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d267daa-c6bf-4083-bc95-437c900d7c97 could not be found. Oct 31 15:48:06.599081 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:06.599081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da62152b-609b-41de-b727-c2b5495933ff tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 2d267daa-c6bf-4083-bc95-437c900d7c97 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:06.599081 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da62152b-609b-41de-b727-c2b5495933ff tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/2d267daa-c6bf-4083-bc95-437c900d7c97/action" status: 404 len: 111 microversion: 2.1 time: 0.070132 Oct 31 15:48:06.603026 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2749/5617] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:06 2022] POST /compute/v2.1/servers/2d267daa-c6bf-4083-bc95-437c900d7c97/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:48:06.615413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:06.624669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.631988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.642256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.644053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.645650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.651687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.657162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.657835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.662944 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c1e9802-246b-4446-bcb5-72a5c1e17fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1294 microversion: 2.1 time: 0.217082 Oct 31 15:48:06.665143 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2869/5618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:06 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:07.596660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.607489 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b8a8f7c9-3963-493a-9b63-a62c58351532 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.997650 Oct 31 15:48:07.608948 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2750/5619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:06 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:07.645635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:07.646789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:07.664536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.665423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.666310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.667161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.667656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.668269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.692967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:07.693601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:07.703951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.707034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.707611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.710958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.711820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.712991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.848376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.859815 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-19e21d0e-93d5-47bf-a13a-23f2f1491f38 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1300 microversion: 2.1 time: 0.174341 Oct 31 15:48:07.877157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2751/5620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:07 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:08.155001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:08.164934 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-841a1853-cf10-462f-b469-c5a4e5bb0b72 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.524575 Oct 31 15:48:08.170244 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2870/5621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:07 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:08.200578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.201357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.209334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.210067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.210810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.212048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.212803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.213439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.249392 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'unpause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 15 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: {"unpause": {}} Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: exception: Cannot 'unpause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'unpause': {}}} Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state active. Cannot unpause while the instance is in this state. Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.251590 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.257485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.257485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:08.257485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:08.257485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:08.257485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.257485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'unpause' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.272996 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ef03164-3294-40e9-95d9-daf87843e9f5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 145 microversion: 2.1 time: 0.071263 Oct 31 15:48:08.274481 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2752/5622] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 145 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:48:08.283692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.284561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.295342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.298051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.298730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.299624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.301594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.302347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.593287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:08.605408 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93d56348-2070-4052-97f0-df82ec1113dd tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.326085 Oct 31 15:48:08.606447 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2871/5623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:08.636948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.637612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.648554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.652316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.653651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.656818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.657842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.659105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.885743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.886362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.911034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.911572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.912030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.912836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.913309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.913740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.007768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.015866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:09.020209 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dbfdccf8-3257-4f2b-8cb8-a4bde916cf7e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1300 microversion: 2.1 time: 0.138235 Oct 31 15:48:09.024276 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2872/5624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:09.070883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.118722 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12430353-24a4-4189-86de-9fd76c8340fb tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.486485 Oct 31 15:48:09.141982 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2753/5625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:09.145565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da8aa29d-197a-40fc-aaa9-095dceb09ad5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:09.147009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da8aa29d-197a-40fc-aaa9-095dceb09ad5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: de524c6c-fcaf-40be-95b2-e2c7cd2a1af1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.162850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-da8aa29d-197a-40fc-aaa9-095dceb09ad5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance de524c6c-fcaf-40be-95b2-e2c7cd2a1af1 could not be found. Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da8aa29d-197a-40fc-aaa9-095dceb09ad5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/de524c6c-fcaf-40be-95b2-e2c7cd2a1af1/action HTTP/1.1 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 18 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: {"unshelve": null} Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance de524c6c-fcaf-40be-95b2-e2c7cd2a1af1 could not be found. Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'de524c6c-fcaf-40be-95b2-e2c7cd2a1af1', 'body': {'unshelve': None}} Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de524c6c-fcaf-40be-95b2-e2c7cd2a1af1 could not be found. Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de524c6c-fcaf-40be-95b2-e2c7cd2a1af1 could not be found. Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.170161 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de524c6c-fcaf-40be-95b2-e2c7cd2a1af1 could not be found. Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.175748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da8aa29d-197a-40fc-aaa9-095dceb09ad5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance de524c6c-fcaf-40be-95b2-e2c7cd2a1af1 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:09.178749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da8aa29d-197a-40fc-aaa9-095dceb09ad5 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/de524c6c-fcaf-40be-95b2-e2c7cd2a1af1/action" status: 404 len: 111 microversion: 2.1 time: 0.037112 Oct 31 15:48:09.178749 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2873/5626] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:09 2022] POST /compute/v2.1/servers/de524c6c-fcaf-40be-95b2-e2c7cd2a1af1/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:09.188672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:09.190476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.202605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.203043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.203495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.217302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.218500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.219202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.509933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.521519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9118aab8-c8a2-4543-a6c4-9af0433def6b tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.337827 Oct 31 15:48:09.542224 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2754/5627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:09 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:09.555299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:09.556039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.567596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.568502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.570239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.571226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.572394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.573706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.001872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.012351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0f28fbe-74c7-4b49-8aa7-eef0e8c88fa4 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.463274 Oct 31 15:48:10.025070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2874/5628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:09 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:10.053868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:10.055820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.064472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.067570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:10.068175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.070113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.070585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.071452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.071915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.072339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.098472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.099195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.100284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.101240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.102466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.103087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.215966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Cannot 'unshelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action HTTP/1.1 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 18 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: {"unshelve": null} Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: exception: Cannot 'unshelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'unshelve': None}} Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 in vm_state active. Cannot unshelve while the instance is in this state. Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:48:10.218632 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 409 to user: Cannot 'unshelve' instance 0f9fee03-445e-4efc-96b9-379c4fc55497 while it is in vm_state active {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:10.223561 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62803be5-30f7-4f48-8feb-0f110d90c31e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action" status: 409 len: 146 microversion: 2.1 time: 0.158590 Oct 31 15:48:10.226182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2875/5629] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:10 2022] POST /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497/action => generated 146 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:48:10.235311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:10.237898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.254399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.254831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.255263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.255995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.256436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.266949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.522673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.535063 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ebe4832-c264-4ac2-96ea-4ebc74000ebc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1368 microversion: 2.1 time: 0.487135 Oct 31 15:48:10.536778 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2755/5630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:10 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1368 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:10.560195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.571593 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eaa501cb-395e-425e-aa79-4dd6110ac0e9 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.342936 Oct 31 15:48:10.573769 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2876/5631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:10 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:10.608938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:10.609558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.630735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.631477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.631940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.632884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.634159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.634773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.903984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.913747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e849913-de6f-49a2-b5fc-74ee54499ca2 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.308799 Oct 31 15:48:10.915213 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2756/5632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:10 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:10.939062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6600e71-de0e-4461-be74-11ba2d16899c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-948144471_updated"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:10.942062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6600e71-de0e-4461-be74-11ba2d16899c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 64987590-aabf-4ebf-9bca-75b71d3d1a8c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.949072 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e6600e71-de0e-4461-be74-11ba2d16899c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 64987590-aabf-4ebf-9bca-75b71d3d1a8c could not be found. Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6600e71-de0e-4461-be74-11ba2d16899c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/servers/64987590-aabf-4ebf-9bca-75b71d3d1a8c HTTP/1.1 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 80 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-948144471_updated"}} Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 64987590-aabf-4ebf-9bca-75b71d3d1a8c could not be found. Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '64987590-aabf-4ebf-9bca-75b71d3d1a8c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-948144471_updated'}}} Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64987590-aabf-4ebf-9bca-75b71d3d1a8c could not be found. Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 31 15:48:10.951253 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64987590-aabf-4ebf-9bca-75b71d3d1a8c could not be found. Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64987590-aabf-4ebf-9bca-75b71d3d1a8c could not be found. Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6600e71-de0e-4461-be74-11ba2d16899c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 64987590-aabf-4ebf-9bca-75b71d3d1a8c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6600e71-de0e-4461-be74-11ba2d16899c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "PUT /compute/v2.1/servers/64987590-aabf-4ebf-9bca-75b71d3d1a8c" status: 404 len: 111 microversion: 2.1 time: 0.018384 Oct 31 15:48:10.962366 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2877/5633] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:48:10 2022] PUT /compute/v2.1/servers/64987590-aabf-4ebf-9bca-75b71d3d1a8c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:10.967129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:10.967129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.979076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.979578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.980020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.987070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.987569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.988021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.010319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-abf8e94a-b5ea-4c67-ab4d-024b1e8989f6 req-95a6e45b-1a9f-4d2c-b039-f01cea7c0ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a327958f-0471-4554-a873-c2a08235296d", "tag": "1c0f7653-ea6d-483b-bda0-31fb5ba819c6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:11.024346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-abf8e94a-b5ea-4c67-ab4d-024b1e8989f6 req-95a6e45b-1a9f-4d2c-b039-f01cea7c0ae8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.025450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-abf8e94a-b5ea-4c67-ab4d-024b1e8989f6 req-95a6e45b-1a9f-4d2c-b039-f01cea7c0ae8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.026054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-abf8e94a-b5ea-4c67-ab4d-024b1e8989f6 req-95a6e45b-1a9f-4d2c-b039-f01cea7c0ae8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.040937 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-abf8e94a-b5ea-4c67-ab4d-024b1e8989f6 req-95a6e45b-1a9f-4d2c-b039-f01cea7c0ae8 service nova] Creating event network-changed:1c0f7653-ea6d-483b-bda0-31fb5ba819c6 for instance a327958f-0471-4554-a873-c2a08235296d on n-h2-858383-17 Oct 31 15:48:11.048453 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-abf8e94a-b5ea-4c67-ab4d-024b1e8989f6 req-95a6e45b-1a9f-4d2c-b039-f01cea7c0ae8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044035 Oct 31 15:48:11.049550 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2878/5634] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:48:11.427307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:11.436960 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7af19d5b-93f3-42c9-8e13-545b88461dbc tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.479194 Oct 31 15:48:11.439399 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2757/5635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:10 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:11.469789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:11.470616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:11.501676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.503239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.505140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.507128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.508305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.513266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.559986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:11.560613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:11.572358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.572890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.573335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.574050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.574695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.581806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.970640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:11.980210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a310bf0-e250-4ddb-b296-a5a1455b0807 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.516321 Oct 31 15:48:11.982622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2879/5636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:11 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:12.007534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cb760d8-b100-4b3f-90ec-8b20058f3603 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cb760d8-b100-4b3f-90ec-8b20058f3603 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 HTTP/1.1 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 280 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.014201 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:48:12.019700 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.027290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.040121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cb760d8-b100-4b3f-90ec-8b20058f3603 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:12.043688 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0cb760d8-b100-4b3f-90ec-8b20058f3603 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "PUT /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 400 len: 619 microversion: 2.1 time: 0.040537 Oct 31 15:48:12.050318 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2880/5637] 10.222.0.48 () {60 vars in 1257 bytes} [Mon Oct 31 15:48:12 2022] PUT /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:48:12.051189 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8aaa7ff-b632-405f-922d-8667f08740d0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1368 microversion: 2.1 time: 0.494188 Oct 31 15:48:12.054595 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2758/5638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:11 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1368 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:12.061074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:12.062495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:12.078060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.079028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.079835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.080886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.081572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.082361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.279340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.288771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8aaae64-a440-418b-a2b2-03ed1cfe6d2e tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.235136 Oct 31 15:48:12.289708 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2881/5639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:12 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:12.317061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:12.317745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:12.325851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.326771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.327385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.328375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.329040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.329634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.525920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.539161 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6047e73-057b-4358-af93-988505cb7c39 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.226335 Oct 31 15:48:12.558015 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2759/5640] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:12 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:12.572126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8611623-3953-4848-a8e2-586d74ad84c3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8611623-3953-4848-a8e2-586d74ad84c3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: request: PUT /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 HTTP/1.1 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 24 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: {"server": {"name": ""}} Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497', 'body': {'server': {'name': ''}}} Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '' Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:12.576996 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8611623-3953-4848-a8e2-586d74ad84c3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:12.583211 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8611623-3953-4848-a8e2-586d74ad84c3 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "PUT /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 400 len: 108 microversion: 2.1 time: 0.021966 Oct 31 15:48:12.589973 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2882/5641] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 15:48:12 2022] PUT /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:48:12.594918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:12.595596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:12.606857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.607580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.608067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.609380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.610759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.611733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.804626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.813179 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0713957c-1876-4b80-b025-3b8b1d253dd0 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1504 microversion: 2.1 time: 0.224112 Oct 31 15:48:12.822948 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2760/5642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:12 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:13.081440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:13.083287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:13.103447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.107003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.108348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.109208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.112400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.113826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.553140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:13.595994 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98033f80-b61c-456a-b368-2fccb8c9c2f4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1368 microversion: 2.1 time: 0.520824 Oct 31 15:48:13.603094 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2883/5643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:13 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1368 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:14.638191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:14.638809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:14.653724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:14.654218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:14.654655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:14.655366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:14.655817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:14.656242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:14.956399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:14.970190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ea9c8f6-72c2-4b33-b9ea-9a277f140231 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1368 microversion: 2.1 time: 0.336258 Oct 31 15:48:14.971234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2761/5644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:14 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:16.000747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:16.002432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:16.007323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:16.025940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:16.039932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:16.040611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:16.041086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:16.045592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:16.046253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:16.046858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:16.542288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:16.576934 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e7b4317-38d1-48b0-8a34-c823912249fe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1368 microversion: 2.1 time: 0.582512 Oct 31 15:48:16.609295 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2884/5645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:15 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1368 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:16.718724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7d057d58-5de1-4312-9b28-f573a253dacf req-96411db2-7d94-41b8-9bd6-bf7b191e85c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a327958f-0471-4554-a873-c2a08235296d", "name": "network-vif-plugged", "status": "completed", "tag": "1c0f7653-ea6d-483b-bda0-31fb5ba819c6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:16.733834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:16.744079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7d057d58-5de1-4312-9b28-f573a253dacf req-96411db2-7d94-41b8-9bd6-bf7b191e85c9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:16.745036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7d057d58-5de1-4312-9b28-f573a253dacf req-96411db2-7d94-41b8-9bd6-bf7b191e85c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:16.747622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7d057d58-5de1-4312-9b28-f573a253dacf req-96411db2-7d94-41b8-9bd6-bf7b191e85c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:16.789226 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7d057d58-5de1-4312-9b28-f573a253dacf req-96411db2-7d94-41b8-9bd6-bf7b191e85c9 service nova] Creating event network-vif-plugged:1c0f7653-ea6d-483b-bda0-31fb5ba819c6 for instance a327958f-0471-4554-a873-c2a08235296d on n-h2-858383-17 Oct 31 15:48:16.799605 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7d057d58-5de1-4312-9b28-f573a253dacf req-96411db2-7d94-41b8-9bd6-bf7b191e85c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088949 Oct 31 15:48:16.802427 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2762/5646] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:17.613456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:17.614794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:17.622530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:17.625682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:17.626612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:17.627383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:17.628617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:17.629466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:17.630115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:17.966270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:17.995415 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-156821da-c407-4c68-8d9a-93c8aa5c4abf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1368 microversion: 2.1 time: 0.372427 Oct 31 15:48:17.998866 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2885/5647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:17 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:19.023334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:19.024649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:19.032232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:19.034644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:19.035356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:19.036251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:19.037560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:19.038529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:19.039312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:19.049394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:19.226253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:19.239502 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cbd0eb56-c8b2-43b2-92ec-185f321d7478 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1558 microversion: 2.1 time: 0.222536 Oct 31 15:48:19.241302 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2763/5648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:19 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:19.273837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:19.275537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:19.294164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:19.294669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:19.295502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:19.296390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:19.297151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:19.297597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:19.406899 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f785e18-ec5f-43d7-8590-06b6996ac8f3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142421 Oct 31 15:48:19.419501 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2886/5649] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:48:19 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:19.966870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:19.967465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:19.980973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:19.986377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:19.987425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:19.991283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:19.993940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:19.994401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.029054 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d HTTP/1.1 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '63ab85ff-eb88-40e5-817e-795c4c07713d'} Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:20.039750 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.046845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:20.052505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db350729-bcbb-4f9c-8a23-b7aa5ee5d020 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "DELETE /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 404 len: 111 microversion: 2.1 time: 0.081329 Oct 31 15:48:20.052505 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2764/5650] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:19 2022] DELETE /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:20.056511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:20.057191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 63ab85ff-eb88-40e5-817e-795c4c07713d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:20.068237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:20.068826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:20.069190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.069891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:20.070353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:20.070973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.099249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d HTTP/1.1 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '63ab85ff-eb88-40e5-817e-795c4c07713d'} Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:20.100881 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. Oct 31 15:48:20.107387 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:48:20.113094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 63ab85ff-eb88-40e5-817e-795c4c07713d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:20.114331 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d88c95f-5618-44dc-ac20-cdb4d405d62c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d" status: 404 len: 111 microversion: 2.1 time: 0.061775 Oct 31 15:48:20.115101 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2887/5651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:20 2022] GET /compute/v2.1/servers/63ab85ff-eb88-40e5-817e-795c4c07713d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:20.124356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:20.125104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:20.132213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:20.132736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:20.133180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.133879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:20.134336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:20.134761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.211814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:20.361487 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9bdeac03-b3d0-46a1-8ceb-35fa8d63d526 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 204 len: 0 microversion: 2.1 time: 0.241787 Oct 31 15:48:20.362409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2765/5652] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:20 2022] DELETE /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:20.374299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:20.375563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:20.392302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:20.393639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:20.394689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.395769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:20.396250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:20.396685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:20.766123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:20.779544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8af0cc8-6e7c-4271-a5ec-62b156b3799c tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.412243 Oct 31 15:48:20.780828 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2888/5653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:20 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:21.803317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:21.807677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:21.821348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:21.821871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:21.822327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:21.823178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:21.823652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:21.824109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:22.113992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-049f741e-0fc9-41fe-aafd-4f56bee4b52b req-d9ca4edf-2f55-4346-b6a1-77848700d9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a327958f-0471-4554-a873-c2a08235296d", "tag": "1c0f7653-ea6d-483b-bda0-31fb5ba819c6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:22.139172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-049f741e-0fc9-41fe-aafd-4f56bee4b52b req-d9ca4edf-2f55-4346-b6a1-77848700d9cd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:22.139672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-049f741e-0fc9-41fe-aafd-4f56bee4b52b req-d9ca4edf-2f55-4346-b6a1-77848700d9cd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:22.140111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-049f741e-0fc9-41fe-aafd-4f56bee4b52b req-d9ca4edf-2f55-4346-b6a1-77848700d9cd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:22.164213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-049f741e-0fc9-41fe-aafd-4f56bee4b52b req-d9ca4edf-2f55-4346-b6a1-77848700d9cd service nova] Creating event network-changed:1c0f7653-ea6d-483b-bda0-31fb5ba819c6 for instance a327958f-0471-4554-a873-c2a08235296d on n-h2-858383-17 Oct 31 15:48:22.177311 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-049f741e-0fc9-41fe-aafd-4f56bee4b52b req-d9ca4edf-2f55-4346-b6a1-77848700d9cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.422947 Oct 31 15:48:22.178542 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2766/5654] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:22.282255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:22.296796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3d80393-2254-40ad-b1fe-4a6aff5afb94 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1510 microversion: 2.1 time: 0.494329 Oct 31 15:48:22.302046 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2889/5655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:21 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1510 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:23.138568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bfec8e42-fb98-4036-9e87-dad8db4fb891 req-10ed05a8-30b7-4979-88d0-e4654a4fc8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9fee03-445e-4efc-96b9-379c4fc55497", "name": "network-vif-deleted", "tag": "e291afc7-e012-4d7f-a4b4-577c9e9d1b00"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:23.196808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bfec8e42-fb98-4036-9e87-dad8db4fb891 req-10ed05a8-30b7-4979-88d0-e4654a4fc8e6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:23.197641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bfec8e42-fb98-4036-9e87-dad8db4fb891 req-10ed05a8-30b7-4979-88d0-e4654a4fc8e6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:23.198407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bfec8e42-fb98-4036-9e87-dad8db4fb891 req-10ed05a8-30b7-4979-88d0-e4654a4fc8e6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:23.249927 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bfec8e42-fb98-4036-9e87-dad8db4fb891 req-10ed05a8-30b7-4979-88d0-e4654a4fc8e6 service nova] Creating event network-vif-deleted:e291afc7-e012-4d7f-a4b4-577c9e9d1b00 for instance 0f9fee03-445e-4efc-96b9-379c4fc55497 on n-h2-858383-17 Oct 31 15:48:23.269793 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bfec8e42-fb98-4036-9e87-dad8db4fb891 req-10ed05a8-30b7-4979-88d0-e4654a4fc8e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137037 Oct 31 15:48:23.280201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2767/5656] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:23.334009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:23.335481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:23.347424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:23.348226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:23.348999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:23.350299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:23.351052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:23.351770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:23.488802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48adabd656cc43d8bfd0e1d1534062f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79012b90300346aea230c944a64eb70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:23.498721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3ea2ff9-af7c-4ee3-91f9-ce3ce5d44368 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 200 len: 1301 microversion: 2.1 time: 0.182627 Oct 31 15:48:23.499333 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2890/5657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:23 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 1301 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:24.525966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:24.526689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] [instance: 0f9fee03-445e-4efc-96b9-379c4fc55497] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:24.533847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:24.535068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:24.535692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:24.536623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:24.537288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:24.537894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:24.563781 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] HTTP exception thrown: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 could not be found. Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Request method failure captured: Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 HTTP/1.1 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-2LL6MaRrm7RwBVIbsJj5aKIKTVJdlZYfhLwVFN5u-rrawjLRxiNQfZT5I3-zWdexVdsjNzEKCmRYqizUPhXcMTHuCLtsl6lkwV5BaEMlMvKVEW927p0YjkJcpPWGepiLRM8PRL6Gxw8LZ6TaKn7KlS2FbzEaqOmOcAP987rbJ9N_k Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79012b90300346aea230c944a64eb70f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79012b90300346aea230c944a64eb70f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79012b90300346aea230c944a64eb70f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 79012b90300346aea230c944a64eb70f Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-879281223 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 48adabd656cc43d8bfd0e1d1534062f1 Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-879281223-project Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 could not be found. Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '0f9fee03-445e-4efc-96b9-379c4fc55497'} Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 could not be found. Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 could not be found. Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:24.566174 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 could not be found. Oct 31 15:48:24.571092 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:24.572595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] Returning 404 to user: Instance 0f9fee03-445e-4efc-96b9-379c4fc55497 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:24.573729 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4176da83-b516-481c-86fd-ccaabec24656 tempest-ServersNegativeTestJSON-879281223 tempest-ServersNegativeTestJSON-879281223-project] 10.222.0.48 "GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497" status: 404 len: 111 microversion: 2.1 time: 0.054796 Oct 31 15:48:24.580068 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2768/5658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:24 2022] GET /compute/v2.1/servers/0f9fee03-445e-4efc-96b9-379c4fc55497 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:44.672820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=11 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:44.674334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=73 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:44.825351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1365364726", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "493bddad-2fa2-489f-9a94-1d1bfce8184c"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:44.889076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] validate_networks() for [('493bddad-2fa2-489f-9a94-1d1bfce8184c', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:48:45.504358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:48:45.504912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:48:45.505462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:48:45.506239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:48:45.506731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:48:45.518322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:45.518984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:45.519433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:45.520616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:45.521205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:45.521630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:45.543551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Getting quotas for project 5d9a29688cae430abc57b5bd0a1a6bd5. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:48:45.550425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Getting quotas for user f85743a6739449c2907ee3a6b1242064 and project 5d9a29688cae430abc57b5bd0a1a6bd5. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:48:45.565985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:48:45.569139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:48:45.643445 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f59e056f-85cf-4d32-8762-3b8adadede5c tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976799 Oct 31 15:48:45.645492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2891/5659] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:48:45.656973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39b206ef-86ae-4688-b72f-e3f9aff12c8d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:45.657604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39b206ef-86ae-4688-b72f-e3f9aff12c8d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:45.661613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:45.662252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:45.759577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-39b206ef-86ae-4688-b72f-e3f9aff12c8d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:45.767841 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39b206ef-86ae-4688-b72f-e3f9aff12c8d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1214 microversion: 2.1 time: 0.114517 Oct 31 15:48:45.768414 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2769/5660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:45 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:46.792269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:46.793022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:46.802254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:46.802999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:46.803620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:46.804334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:46.804826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:46.805255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:46.883532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:46.895031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f41c822-92da-4287-8218-1ab68aee7e42 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1266 microversion: 2.1 time: 0.107340 Oct 31 15:48:46.895916 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2892/5661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:46 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:47.918988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:47.919596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:47.930599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:47.931515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:47.933332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:47.935006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:47.937488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:47.938130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:48.038426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:48.051634 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2995c82-c904-4fb4-9f30-75ccade256da tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1272 microversion: 2.1 time: 0.136583 Oct 31 15:48:48.053353 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2770/5662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:47 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:49.071320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ed509bb1-f38f-4d30-b291-cab302a32825 req-4cbb8340-328e-489a-98a4-0149c0e2bb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefaabfe-d966-4cad-b836-df96ecd366e7", "tag": "f390d82b-cfbf-46d2-a8d3-4b17a24577ab"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:49.078646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:49.079894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:49.087601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ed509bb1-f38f-4d30-b291-cab302a32825 req-4cbb8340-328e-489a-98a4-0149c0e2bb6a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.089379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ed509bb1-f38f-4d30-b291-cab302a32825 req-4cbb8340-328e-489a-98a4-0149c0e2bb6a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.089841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ed509bb1-f38f-4d30-b291-cab302a32825 req-4cbb8340-328e-489a-98a4-0149c0e2bb6a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.090452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.091126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.091861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.092785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.093723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.101882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.116615 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ed509bb1-f38f-4d30-b291-cab302a32825 req-4cbb8340-328e-489a-98a4-0149c0e2bb6a service nova] Creating event network-changed:f390d82b-cfbf-46d2-a8d3-4b17a24577ab for instance fefaabfe-d966-4cad-b836-df96ecd366e7 on n-h1-858383-17 Oct 31 15:48:49.124178 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ed509bb1-f38f-4d30-b291-cab302a32825 req-4cbb8340-328e-489a-98a4-0149c0e2bb6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063390 Oct 31 15:48:49.125406 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2893/5663] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:49.373836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:49.390095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e97c25c-98a4-4810-968a-9e8fa287fd18 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.315966 Oct 31 15:48:49.390883 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2771/5664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:49 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:50.419048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:50.420351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:50.427591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:50.428249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:50.428559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:50.430331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:50.430993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:50.431879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:50.652789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:50.662211 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7cbfed67-8dc3-435b-8d74-1e81030359a7 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.250041 Oct 31 15:48:50.677726 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2894/5665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:50 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:51.687898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:51.688865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:51.699525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:51.700004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:51.700466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:51.701209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:51.701608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:51.702028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:51.939570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:51.951944 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0885fb1-4883-4f80-a06c-d9aa61f7138e tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.268579 Oct 31 15:48:51.964726 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2772/5666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:51 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:52.978685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:52.979965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:52.988002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:52.988569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:52.989113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:52.989892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:52.990424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:52.991113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:53.151772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:53.168897 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d33f8b48-72f2-4496-b2f6-9c1b1397beca tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.193851 Oct 31 15:48:53.170472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2895/5667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:52 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:53.748098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:53.748618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:53.755619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:53.756104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:53.756543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:53.757488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:53.757717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:53.758145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:53.842768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lazy-loading 'services' on Instance uuid 1bbbfd71-d347-4c5f-835f-ffd490e40c06 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:53.918967 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3d694902-9f46-4efb-9472-ea6eb5686ed2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06/os-volume_attachments/10353028-66f6-4e8a-9f5d-b2da3f73eb8f" status: 202 len: 0 microversion: 2.1 time: 0.175283 Oct 31 15:48:53.922949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2773/5668] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:48:53 2022] DELETE /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06/os-volume_attachments/10353028-66f6-4e8a-9f5d-b2da3f73eb8f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:48:54.196083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:54.197348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:54.205231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.205722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.206165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.206873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.207391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.207766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.350930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:54.359117 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26062c4c-e79a-408e-87d4-955eb7617d00 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.167241 Oct 31 15:48:54.359694 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2896/5669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:54 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:55.384441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:55.385877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:55.392497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.393024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.393459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.394157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.394610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.395160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.552503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:55.571773 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbc68476-4202-45b9-a259-3d50470228b1 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.192004 Oct 31 15:48:55.573851 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2774/5670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:55 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:55.813042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:55.813546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:55.818198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:55.819285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:55.824892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.825395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.825838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.826905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.827626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.828066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.856366 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-657279d5-33e3-4cf1-95c9-5b0aa9a4b669 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/ips" status: 200 len: 148 microversion: 2.1 time: 0.047994 Oct 31 15:48:55.857156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2897/5671] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:48:55 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:48:55.870786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fef33887-b09e-41b5-a4a1-1c421c11a7c9"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:55.874483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:55.877315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:55.883098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.883585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.884023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.884783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.885259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.885668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.984196 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Invalid volume: volume fef33887-b09e-41b5-a4a1-1c421c11a7c9 is already attached to instances: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/os-volume_attachments HTTP/1.1 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 74 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: {"volumeAttachment": {"volumeId": "fef33887-b09e-41b5-a4a1-1c421c11a7c9"}} Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid volume: volume fef33887-b09e-41b5-a4a1-1c421c11a7c9 is already attached to instances: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': 'a327958f-0471-4554-a873-c2a08235296d', 'body': {'volumeAttachment': {'volumeId': 'fef33887-b09e-41b5-a4a1-1c421c11a7c9'}}} Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fef33887-b09e-41b5-a4a1-1c421c11a7c9 is already attached to instances: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:55.985972 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fef33887-b09e-41b5-a4a1-1c421c11a7c9 is already attached to instances: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fef33887-b09e-41b5-a4a1-1c421c11a7c9 is already attached to instances: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 400 to user: Invalid volume: volume fef33887-b09e-41b5-a4a1-1c421c11a7c9 is already attached to instances: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63a37a7f-c985-494d-9203-9d6ca952b311 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122145 Oct 31 15:48:55.992201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2775/5672] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:48:55 2022] POST /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:48:56.000966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:56.001466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:56.008434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.010148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.010613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.011381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.011874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.012304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.041768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:56.144823 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fc15440-ee03-4c39-9a26-4e2178cec0fc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 204 len: 0 microversion: 2.1 time: 0.149325 Oct 31 15:48:56.149070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2898/5673] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:55 2022] DELETE /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:56.154849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:56.155464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:56.162469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.162992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.163423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.164119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.164571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.165017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.328910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:56.338700 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d9b5256-cb0c-49c7-a36b-b9da4fec5e0c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1681 microversion: 2.1 time: 0.187606 Oct 31 15:48:56.339411 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2776/5674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:56 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:56.539549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0d42dff7-aba3-4de6-be13-bf84b96cbed8 req-269bdee6-d6f0-4712-a739-3e322f2156ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaabfe-d966-4cad-b836-df96ecd366e7", "name": "network-vif-plugged", "status": "completed", "tag": "f390d82b-cfbf-46d2-a8d3-4b17a24577ab"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:56.553136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0d42dff7-aba3-4de6-be13-bf84b96cbed8 req-269bdee6-d6f0-4712-a739-3e322f2156ce service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.553841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0d42dff7-aba3-4de6-be13-bf84b96cbed8 req-269bdee6-d6f0-4712-a739-3e322f2156ce service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.554560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0d42dff7-aba3-4de6-be13-bf84b96cbed8 req-269bdee6-d6f0-4712-a739-3e322f2156ce service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.582707 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0d42dff7-aba3-4de6-be13-bf84b96cbed8 req-269bdee6-d6f0-4712-a739-3e322f2156ce service nova] Creating event network-vif-plugged:f390d82b-cfbf-46d2-a8d3-4b17a24577ab for instance fefaabfe-d966-4cad-b836-df96ecd366e7 on n-h1-858383-17 Oct 31 15:48:56.596350 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0d42dff7-aba3-4de6-be13-bf84b96cbed8 req-269bdee6-d6f0-4712-a739-3e322f2156ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061352 Oct 31 15:48:56.598323 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2899/5675] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:56.603089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:56.606662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:56.615431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.615929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.616369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.617551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.618204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.618634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.846705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:56.862591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-adc1e902-a34b-48e4-bd28-4e766733b852 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.264624 Oct 31 15:48:56.864186 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2777/5676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:56 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:57.366564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:57.367722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:57.374826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.375534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.376146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.377012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.377614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.378104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.546754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:57.557887 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34ac011c-9576-4fa4-98e3-5f8fdf706eef tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1681 microversion: 2.1 time: 0.196240 Oct 31 15:48:57.558695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2900/5677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:57 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:57.886916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:57.887599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:57.894216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.895015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.895714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.896519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.897211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.897905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.043311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:58.054490 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dea19ff3-c12b-4540-9f5f-99525c2c4ecc tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1314 microversion: 2.1 time: 0.171952 Oct 31 15:48:58.055665 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2778/5678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:57 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:58.519530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6d8968c6-e4ef-4661-bfaf-5e8c5f5ca687 req-d7d87428-17fa-49d3-92a2-6806349eeb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a327958f-0471-4554-a873-c2a08235296d", "name": "network-vif-deleted", "tag": "1c0f7653-ea6d-483b-bda0-31fb5ba819c6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:58.538185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6d8968c6-e4ef-4661-bfaf-5e8c5f5ca687 req-d7d87428-17fa-49d3-92a2-6806349eeb44 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.542591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6d8968c6-e4ef-4661-bfaf-5e8c5f5ca687 req-d7d87428-17fa-49d3-92a2-6806349eeb44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.543292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6d8968c6-e4ef-4661-bfaf-5e8c5f5ca687 req-d7d87428-17fa-49d3-92a2-6806349eeb44 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.569830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6d8968c6-e4ef-4661-bfaf-5e8c5f5ca687 req-d7d87428-17fa-49d3-92a2-6806349eeb44 service nova] Creating event network-vif-deleted:1c0f7653-ea6d-483b-bda0-31fb5ba819c6 for instance a327958f-0471-4554-a873-c2a08235296d on n-h2-858383-17 Oct 31 15:48:58.582133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:58.582754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:58.590902 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6d8968c6-e4ef-4661-bfaf-5e8c5f5ca687 req-d7d87428-17fa-49d3-92a2-6806349eeb44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074985 Oct 31 15:48:58.591973 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2901/5679] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:48:58.594619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.595125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.595571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.596287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.596809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.597205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.738519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:58.749840 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5ec4e8a2-28e3-4758-957c-207dfc964872 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 200 len: 1327 microversion: 2.1 time: 0.171479 Oct 31 15:48:58.750760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2779/5680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:58 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:59.079220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:59.080319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:59.090940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.092201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.092895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.094030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.094750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.095356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.327149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:59.342648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-efd28e5f-2cb4-494a-a42d-038d37e0f4cd tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1496 microversion: 2.1 time: 0.267372 Oct 31 15:48:59.344982 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2902/5681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:59 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1496 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:59.435641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:59.436276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:59.443753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.444250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.444753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.445528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.445994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.446773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.479450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:59.578478 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6957b003-a65a-4c88-b9dc-87ebf03b2b2f tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 204 len: 0 microversion: 2.1 time: 0.146938 Oct 31 15:48:59.579619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2780/5682] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:59 2022] DELETE /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:59.590847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:59.592414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:59.601019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.601569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.602176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.602886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.604257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.604674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.774431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:59.780761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:59.781885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:59.785614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e79af1d-d2c3-47c1-9214-856ac293ea01 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1469 microversion: 2.1 time: 0.201144 Oct 31 15:48:59.789227 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2903/5683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:59 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:59.789580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.790163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.790763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.791704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:59.792234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:59.792761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d HTTP/1.1 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a327958f-0471-4554-a873-c2a08235296d'} Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:59.834194 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4f1de0ae-a1db-4ae7-8a51-23516501295f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 404 len: 111 microversion: 2.1 time: 0.056517 Oct 31 15:48:59.840683 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2781/5684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:59 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:48:59.844565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f3d3a00-e508-4c7e-80e6-5cfa5614629a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '.version_select at 0x7f5ca235c9d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:59.875368 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f3d3a00-e508-4c7e-80e6-5cfa5614629a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664986717" status: 202 len: 0 microversion: 2.1 time: 0.039070 Oct 31 15:48:59.876791 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2904/5685] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664986717 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:49:00.721733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:00.723049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:00.735999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:00.736763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:00.737872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:00.738097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:00.738803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:00.739371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:00.818162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:00.818925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:00.827682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:00.828273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:00.828917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:00.829835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:00.830372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:00.830870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:00.843703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lazy-loading 'services' on Instance uuid 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:49:00.956458 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e32f14f-a94a-4f4e-b6e4-09431678d9b9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments/fef33887-b09e-41b5-a4a1-1c421c11a7c9" status: 202 len: 0 microversion: 2.1 time: 0.250410 Oct 31 15:49:00.957488 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2782/5686] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:49:00 2022] DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments/fef33887-b09e-41b5-a4a1-1c421c11a7c9 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:49:00.982312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:00.985989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:01.008625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:01.010058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:01.011356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:01.012285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:01.014306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:01.014936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:01.038904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:01.047502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95727efb-c6cf-426b-bd7b-3df6479ff447 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1469 microversion: 2.1 time: 0.233150 Oct 31 15:49:01.051924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2905/5687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:00 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:01.054706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-daa45b9e-cc14-465f-908f-4c39b2be6ea3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080770 Oct 31 15:49:01.055283 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2783/5688] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:49:00 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:02.003729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-01a8dd76-359c-4027-8cca-dfcd04dd02c3 req-5c631897-dc8a-48b9-a87a-7fac657fdcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbbfd71-d347-4c5f-835f-ffd490e40c06", "name": "network-vif-deleted", "tag": "49d4a969-084c-413d-b158-6c2699668e68"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:02.021716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-01a8dd76-359c-4027-8cca-dfcd04dd02c3 req-5c631897-dc8a-48b9-a87a-7fac657fdcf9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.022658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-01a8dd76-359c-4027-8cca-dfcd04dd02c3 req-5c631897-dc8a-48b9-a87a-7fac657fdcf9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.023272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-01a8dd76-359c-4027-8cca-dfcd04dd02c3 req-5c631897-dc8a-48b9-a87a-7fac657fdcf9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.062541 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-01a8dd76-359c-4027-8cca-dfcd04dd02c3 req-5c631897-dc8a-48b9-a87a-7fac657fdcf9 service nova] Creating event network-vif-deleted:49d4a969-084c-413d-b158-6c2699668e68 for instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 on n-h1-858383-17 Oct 31 15:49:02.070272 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-01a8dd76-359c-4027-8cca-dfcd04dd02c3 req-5c631897-dc8a-48b9-a87a-7fac657fdcf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071879 Oct 31 15:49:02.070974 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2906/5689] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:02.082740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:02.083452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:02.086212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:02.089026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:02.093256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.093961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.094566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.095634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.096263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.096882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.101684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.102173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.102612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.115360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.115953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.116404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.159925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:02.189371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:02.209672 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19fdc433-cd61-4e25-b0a5-b2fe8783b17d tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1299 microversion: 2.1 time: 0.133942 Oct 31 15:49:02.211622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2907/5690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:02 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:02.214685 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4cbea01d-eca9-4853-8e57-d3d5bf9e9a55 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149648 Oct 31 15:49:02.215371 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2784/5691] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:49:02 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:02.360108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:02.360901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:02.385568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.386093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.386548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.397067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.398235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.399025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.445146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:49:02.515805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:02.547727 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad76bf29-8b7c-4c4a-9692-ea13e3fbbb7d tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 204 len: 0 microversion: 2.1 time: 0.191725 Oct 31 15:49:02.548644 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2908/5692] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:49:02 2022] DELETE /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:49:02.557376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:02.557981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:02.564284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.565101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.565704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.566788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:02.567433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:02.568118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:02.734815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:02.746738 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-46fc0b62-52fa-4d74-99c1-f30a28e0acd0 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1502 microversion: 2.1 time: 0.193552 Oct 31 15:49:02.747703 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2785/5693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:02 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:03.236269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:03.238059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:03.238231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:03.241048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:03.250946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.251686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.252374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.253577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.254981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.256220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.266312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.268091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.268753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.269702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.270773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.271404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.301814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.302431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.303061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.303635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lazy-loading 'fault' on Instance uuid 1bbbfd71-d347-4c5f-835f-ffd490e40c06 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:49:03.320183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a61a22f1-52d0-478e-a407-ad2a46bcc0b0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094250 Oct 31 15:49:03.322742 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2909/5694] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:49:03 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:03.357157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23bf433c36b64aad816c4e9c575905af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62e1d177a8864abb90145f5a4f040b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:03.366294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-26024616-393a-4c6f-b128-2ad4427121d2 tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 200 len: 1304 microversion: 2.1 time: 0.135661 Oct 31 15:49:03.366889 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2786/5695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:03 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:03.770663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:03.771843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:03.779616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.780511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.780972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.781876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.782525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.783124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.971416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:03.987419 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-099372cb-3e07-4b12-b50b-2ea53d290b17 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1502 microversion: 2.1 time: 0.220656 Oct 31 15:49:03.988019 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2910/5696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:03 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:04.334326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:04.338644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:04.346379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:04.347601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:04.348227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:04.349748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:04.350401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:04.351014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:04.390239 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69c067d0-ff81-4d1b-a25a-ace212e2b003 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059831 Oct 31 15:49:04.391166 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2787/5697] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:49:04 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:04.393157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:04.393905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] [instance: 1bbbfd71-d347-4c5f-835f-ffd490e40c06] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:04.405620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:04.406465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:04.407145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:04.408113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:04.408899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:04.409581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:04.427786 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] HTTP exception thrown: Instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 could not be found. Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Request method failure captured: Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 HTTP/1.1 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3xRy74PKTe8vk1FcGgOGTIVSAbe5HGZKDqFvDYA7h3-3U8vt0a9h3vWIYHZf3scORvdBG8ks5dGYw2WW8eHruDyxNpiBmJYdmCl6jLiM21zkPEZgU4xSCGMkfanU7LzjPWc2Yeb4M_7ABVozwz3ZOJ_pFzvUgSirZDhLRyBKOJdO4 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 62e1d177a8864abb90145f5a4f040b84 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesBackupsTest-269151558 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/62e1d177a8864abb90145f5a4f040b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62e1d177a8864abb90145f5a4f040b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_62e1d177a8864abb90145f5a4f040b84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62e1d177a8864abb90145f5a4f040b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesBackupsTest-269151558 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 62e1d177a8864abb90145f5a4f040b84 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesBackupsTest-269151558 Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesBackupsTest-269151558-project Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 23bf433c36b64aad816c4e9c575905af Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesBackupsTest-269151558-project Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 could not be found. Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '1bbbfd71-d347-4c5f-835f-ffd490e40c06'} Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 could not be found. Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 could not be found. Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:49:04.430555 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 could not be found. Oct 31 15:49:04.436526 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:04.438925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] Returning 404 to user: Instance 1bbbfd71-d347-4c5f-835f-ffd490e40c06 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:49:04.439954 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9b45bb5-d6a7-4dab-913f-0c6e24556dcd tempest-VolumesBackupsTest-269151558 tempest-VolumesBackupsTest-269151558-project] 10.222.0.48 "GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06" status: 404 len: 111 microversion: 2.1 time: 0.053198 Oct 31 15:49:04.441076 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2911/5698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:04 2022] GET /compute/v2.1/servers/1bbbfd71-d347-4c5f-835f-ffd490e40c06 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:49:05.012904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:05.013707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:05.026758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.028886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.030966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.032133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.039455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.042174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.303872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85743a6739449c2907ee3a6b1242064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9a29688cae430abc57b5bd0a1a6bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:05.323872 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a411d4ef-9782-4d15-a859-5e14b7342cc2 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 200 len: 1502 microversion: 2.1 time: 0.316250 Oct 31 15:49:05.324690 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2788/5699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:05 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:05.377502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9dc6a6d6-921b-40bc-9d89-d95172b0f445 req-08151ca0-326c-4f30-b17a-2370eab08cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefaabfe-d966-4cad-b836-df96ecd366e7", "name": "network-vif-deleted", "tag": "f390d82b-cfbf-46d2-a8d3-4b17a24577ab"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:05.388330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9dc6a6d6-921b-40bc-9d89-d95172b0f445 req-08151ca0-326c-4f30-b17a-2370eab08cad service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.388997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9dc6a6d6-921b-40bc-9d89-d95172b0f445 req-08151ca0-326c-4f30-b17a-2370eab08cad service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.389734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9dc6a6d6-921b-40bc-9d89-d95172b0f445 req-08151ca0-326c-4f30-b17a-2370eab08cad service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.404403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9dc6a6d6-921b-40bc-9d89-d95172b0f445 req-08151ca0-326c-4f30-b17a-2370eab08cad service nova] Creating event network-vif-deleted:f390d82b-cfbf-46d2-a8d3-4b17a24577ab for instance fefaabfe-d966-4cad-b836-df96ecd366e7 on n-h1-858383-17 Oct 31 15:49:05.406335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:05.408883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:05.411098 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9dc6a6d6-921b-40bc-9d89-d95172b0f445 req-08151ca0-326c-4f30-b17a-2370eab08cad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037238 Oct 31 15:49:05.412344 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2912/5700] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:05.422537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.423025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.423640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.425260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.426045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.426651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.487871 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2c858f0-e3db-492c-801b-5339531ebbdb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088214 Oct 31 15:49:05.489412 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2789/5701] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:49:05 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:49:06.351890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:06.352684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] [instance: fefaabfe-d966-4cad-b836-df96ecd366e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:06.360296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.361079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.361746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.362670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.363226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.363911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.387921 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] HTTP exception thrown: Instance fefaabfe-d966-4cad-b836-df96ecd366e7 could not be found. Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Request method failure captured: Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 HTTP/1.1 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-5aWNEkj7Z2HOPdWEiS0GOt2JgPp3NgwHUA3N9M8vsLgG3wyQTpTSAhzyCfuHuWOvTPz7fWOEfJ9AzrEhjZEUIrGnx9TYvkk33X_I8XCE5M3mQK0o2pKQ0chlZwa1q_HL03kb7WcZ78btkim9DMG_Ju_G2yNAYYId9KdD1kCFPh0UE Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 5d9a29688cae430abc57b5bd0a1a6bd5 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesActionsTest-2111873329 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d9a29688cae430abc57b5bd0a1a6bd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d9a29688cae430abc57b5bd0a1a6bd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d9a29688cae430abc57b5bd0a1a6bd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d9a29688cae430abc57b5bd0a1a6bd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesActionsTest-2111873329 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 5d9a29688cae430abc57b5bd0a1a6bd5 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesActionsTest-2111873329 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesActionsTest-2111873329-project Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: f85743a6739449c2907ee3a6b1242064 Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesActionsTest-2111873329-project Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance fefaabfe-d966-4cad-b836-df96ecd366e7 could not be found. Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'fefaabfe-d966-4cad-b836-df96ecd366e7'} Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefaabfe-d966-4cad-b836-df96ecd366e7 could not be found. Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefaabfe-d966-4cad-b836-df96ecd366e7 could not be found. Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:49:06.390355 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefaabfe-d966-4cad-b836-df96ecd366e7 could not be found. Oct 31 15:49:06.395323 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:06.398534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] Returning 404 to user: Instance fefaabfe-d966-4cad-b836-df96ecd366e7 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:49:06.399864 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab0641f8-5a8d-4b9a-9598-2dbfc0723254 tempest-VolumesActionsTest-2111873329 tempest-VolumesActionsTest-2111873329-project] 10.222.0.48 "GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7" status: 404 len: 111 microversion: 2.1 time: 0.053317 Oct 31 15:49:06.400761 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2913/5702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:06 2022] GET /compute/v2.1/servers/fefaabfe-d966-4cad-b836-df96ecd366e7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:49:06.501750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:06.504581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:06.524104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.524626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.525178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.525910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.526364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.527032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.562019 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-034d02ba-9250-4767-9442-dae71f031ae2 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064789 Oct 31 15:49:06.563151 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2790/5703] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:49:06 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:49:06.673911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:06.675605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:06.684903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.688362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.689060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.690051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.690734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.692345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.762852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:49:06.923042 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-06d8b116-25f9-49b5-a744-9cb5362807cb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 204 len: 0 microversion: 2.1 time: 0.254008 Oct 31 15:49:06.923939 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2914/5704] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:49:06 2022] DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:49:06.934698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:06.936081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:06.945251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.949239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.950000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:06.951063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:06.951793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:06.952402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:07.138179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:07.154298 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81e75a82-a8a6-41da-97de-001b8a80eb5f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1684 microversion: 2.1 time: 0.225463 Oct 31 15:49:07.155204 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2791/5705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:06 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1684 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:08.187423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:08.189860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:08.199535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:08.200284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:08.200809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:08.201717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:08.202528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:08.203264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:08.367777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:08.378106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c668aa8-8751-47e3-a4c9-bfba0d36b404 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1684 microversion: 2.1 time: 0.199307 Oct 31 15:49:08.379550 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2915/5706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:08 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1684 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:09.403147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:09.405060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:09.416187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:09.416934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:09.418203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:09.419131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:09.419766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:09.420536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:09.595328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:09.605590 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d29f34e9-3db1-4135-ba7d-e564fbfe760c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1616 microversion: 2.1 time: 0.206468 Oct 31 15:49:09.609728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2792/5707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:09 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1616 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:09.984082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fa497bf9-dc8f-449b-be16-48a285012f32 req-be3428ef-1379-4104-b5bb-12b495b3ddad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8", "name": "network-vif-deleted", "tag": "bc488cb8-0dd7-475f-8245-350f28aa91cb"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:10.003764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fa497bf9-dc8f-449b-be16-48a285012f32 req-be3428ef-1379-4104-b5bb-12b495b3ddad service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:10.004284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fa497bf9-dc8f-449b-be16-48a285012f32 req-be3428ef-1379-4104-b5bb-12b495b3ddad service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:10.004725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fa497bf9-dc8f-449b-be16-48a285012f32 req-be3428ef-1379-4104-b5bb-12b495b3ddad service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:10.057241 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fa497bf9-dc8f-449b-be16-48a285012f32 req-be3428ef-1379-4104-b5bb-12b495b3ddad service nova] Creating event network-vif-deleted:bc488cb8-0dd7-475f-8245-350f28aa91cb for instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 on n-h2-858383-17 Oct 31 15:49:10.067488 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fa497bf9-dc8f-449b-be16-48a285012f32 req-be3428ef-1379-4104-b5bb-12b495b3ddad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086250 Oct 31 15:49:10.069893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2916/5708] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:10.634403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:10.635602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:10.655427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:10.655947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:10.656401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:10.657183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:10.657649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:10.658079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:10.813861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:10.814381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:10.814830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:10.815298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lazy-loading 'fault' on Instance uuid 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:49:10.922088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:10.930632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1917fe11-89a2-4f6e-a971-081ddbd542da tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 200 len: 1332 microversion: 2.1 time: 0.301366 Oct 31 15:49:10.931223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2793/5709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:10 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 1332 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:11.963337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:11.964059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:11.985254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:11.986846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:11.988846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:11.989590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:11.990061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:11.992521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:12.016144 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 HTTP/1.1 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8'} Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:49:12.021838 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1cb2d32f-0273-4723-b9fc-17ffc44328cf tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 404 len: 111 microversion: 2.1 time: 0.068703 Oct 31 15:49:12.027514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2917/5710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:11 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:49:12.033131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0f0822ad-c8fe-4b18-9fe3-2871eecf724c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '.version_select at 0x7f5ca0f3cca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:12.061827 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0f0822ad-c8fe-4b18-9fe3-2871eecf724c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535724856" status: 202 len: 0 microversion: 2.1 time: 0.033020 Oct 31 15:49:12.063610 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2794/5711] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:49:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535724856 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:49:13.131386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d396c4a-f1c3-4868-a080-6048bb721560 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: .version_select at 0x7f5ca12a4940>, body: {"keypair": {"name": "tempest-keypair-1181386460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH6DQN0SEBySiVFkdBHaBWeN8EA6eO8X+WCNe1zanN3RCTZaPQ3MTPZ0mSC+oVFcaZ+k6b+z0dsiltSU7wz2HAkuyE+SdvS4RLSbNxwVuK7sawlOkZdy8dTkmjcA5t2ng=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:13.157023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7d396c4a-f1c3-4868-a080-6048bb721560 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:13.186759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7d396c4a-f1c3-4868-a080-6048bb721560 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:13.206919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:13.218980 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d396c4a-f1c3-4868-a080-6048bb721560 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094254 Oct 31 15:49:13.221002 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2918/5712] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:49:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:49:15.038427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-177216816", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e"}], "security_groups": [{"name": "tempest-securitygroup--1165967685"}], "key_name": "tempest-keypair-1181386460", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:15.235124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] validate_networks() for [('a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:49:15.995859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:49:15.996282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:49:15.996800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:49:15.997190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:49:15.997831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:49:16.003176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:16.009792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:16.010285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:16.010724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:16.011689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:16.012153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:16.012579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:16.034931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:16.042354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:16.057339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:49:16.059791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:49:16.111560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d71b2ffd-b975-481b-bc88-3652973fb5a9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.078404 Oct 31 15:49:16.112769 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2795/5713] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:49:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:49:16.125312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f91d301-5cdc-4928-ba1f-37d8749ed2ed tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:16.126079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f91d301-5cdc-4928-ba1f-37d8749ed2ed tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:16.213233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2f91d301-5cdc-4928-ba1f-37d8749ed2ed tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:16.224645 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f91d301-5cdc-4928-ba1f-37d8749ed2ed tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1241 microversion: 2.1 time: 0.104645 Oct 31 15:49:16.226589 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2919/5714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:16 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:17.251612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:17.252233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:17.261452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:17.261995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:17.262416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:17.263245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:17.264487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:17.265325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:17.357425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:17.366041 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dec2dbb-1238-471c-88b4-bd068c81733d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1293 microversion: 2.1 time: 0.121465 Oct 31 15:49:17.373104 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2796/5715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:17 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:18.392018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:18.393546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:18.405842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:18.411040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:18.412405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:18.414335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:18.415400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:18.417866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:18.523088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:18.534367 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba582730-e7a0-4e21-b9a6-80fad1db4c92 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1299 microversion: 2.1 time: 0.148015 Oct 31 15:49:18.551260 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2920/5716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:18 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:19.559602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:19.560232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:19.572453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:19.573038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:19.573413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:19.584381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:19.585307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:19.585640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:20.094070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:20.105240 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a3c2dcd2-2960-4738-8a82-06ce8b217dc0 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.550191 Oct 31 15:49:20.121990 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2797/5717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:19 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:20.369171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-86b17e41-d0f1-4d8a-9bb1-f8e952739e69 req-45434167-b76f-48ce-a36e-40511cd7f99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b56dd2f-4de7-44b7-9a19-d804a7879072", "tag": "c92630c5-3778-4a39-b234-7741ee17d8a6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:20.393688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-86b17e41-d0f1-4d8a-9bb1-f8e952739e69 req-45434167-b76f-48ce-a36e-40511cd7f99a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:20.396440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-86b17e41-d0f1-4d8a-9bb1-f8e952739e69 req-45434167-b76f-48ce-a36e-40511cd7f99a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:20.397704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-86b17e41-d0f1-4d8a-9bb1-f8e952739e69 req-45434167-b76f-48ce-a36e-40511cd7f99a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:20.417613 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-86b17e41-d0f1-4d8a-9bb1-f8e952739e69 req-45434167-b76f-48ce-a36e-40511cd7f99a service nova] Creating event network-changed:c92630c5-3778-4a39-b234-7741ee17d8a6 for instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 on n-h1-858383-17 Oct 31 15:49:20.423718 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-86b17e41-d0f1-4d8a-9bb1-f8e952739e69 req-45434167-b76f-48ce-a36e-40511cd7f99a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062067 Oct 31 15:49:20.425087 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2921/5718] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:21.137310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:21.137985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:21.145810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:21.146533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:21.147234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:21.148109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:21.149995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:21.150742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:21.343625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:21.356888 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd805abe-fa29-416f-9cbc-5b6d66f69248 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.225171 Oct 31 15:49:21.358161 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2798/5719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:21 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:22.389192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:22.390536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:22.398299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:22.399468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:22.400409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:22.401449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:22.402194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:22.403301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:22.612856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:22.628188 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0385cfdf-478d-45f7-ae5d-2c4c49196f9d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.250145 Oct 31 15:49:22.631869 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2922/5720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:22 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:23.656925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:23.658164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:23.673237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:23.674634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:23.675299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:23.676215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:23.676892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:23.677552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:23.847750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:23.856632 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-299c45d8-3964-4d30-aa6e-fe57d6e4eeff tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.205595 Oct 31 15:49:23.881215 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2799/5721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:23 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:24.879944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:24.880601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:24.894341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:24.895787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:24.896666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:24.898241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:24.899785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:24.900439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:25.135425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:25.150176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6370839f-ad08-418f-a14c-fddd3e32ec8b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.273895 Oct 31 15:49:25.165430 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2923/5722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:24 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:26.188377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:26.190107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:26.193491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:26.195479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:26.207166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:26.211068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:26.211068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:26.211068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:26.211068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:26.211979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:26.441880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:26.454284 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d17bb82-b9ec-4cd0-8360-5d9e0beec3dc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.277454 Oct 31 15:49:26.454870 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2800/5723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:26 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:26.647476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b00e100b-b166-484a-9076-619fbf6f9295 req-dae343ca-91b3-4fd3-be4a-29eadd123f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b56dd2f-4de7-44b7-9a19-d804a7879072", "name": "network-vif-plugged", "status": "completed", "tag": "c92630c5-3778-4a39-b234-7741ee17d8a6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:26.661459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:26.671425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b00e100b-b166-484a-9076-619fbf6f9295 req-dae343ca-91b3-4fd3-be4a-29eadd123f98 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:26.671985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b00e100b-b166-484a-9076-619fbf6f9295 req-dae343ca-91b3-4fd3-be4a-29eadd123f98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:26.672887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b00e100b-b166-484a-9076-619fbf6f9295 req-dae343ca-91b3-4fd3-be4a-29eadd123f98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:26.689548 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b00e100b-b166-484a-9076-619fbf6f9295 req-dae343ca-91b3-4fd3-be4a-29eadd123f98 service nova] Creating event network-vif-plugged:c92630c5-3778-4a39-b234-7741ee17d8a6 for instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 on n-h1-858383-17 Oct 31 15:49:26.697508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b00e100b-b166-484a-9076-619fbf6f9295 req-dae343ca-91b3-4fd3-be4a-29eadd123f98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064422 Oct 31 15:49:26.698738 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2924/5724] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:27.484321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:27.484978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:27.504407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:27.505107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:27.505800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:27.506654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:27.507153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:27.507759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:27.677873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:27.684253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:27.692919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4414b2eb-2231-4892-850f-9be86b018a10 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1367 microversion: 2.1 time: 0.212651 Oct 31 15:49:27.694246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2801/5725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:27 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:28.721189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:28.721891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:28.734634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:28.735461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:28.736162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:28.737266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:28.737928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:28.738622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:28.989957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:28.999595 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-086186da-a422-4abd-88ed-9130a3c19b62 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1557 microversion: 2.1 time: 0.285036 Oct 31 15:49:29.020878 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2925/5726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:28 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1557 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:29.028511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:29.029818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:29.037753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:29.038458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:29.039118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:29.040278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:29.041590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:29.042256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:29.245211 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f927467-87f0-493d-9620-b4c4eebda798 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220353 Oct 31 15:49:29.245734 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2802/5727] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:49:29 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:31.766410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c4565bb8-1a9b-4c0a-9f30-fe944f6dfc53 req-265b3494-3b97-48e0-b8b0-0fa52d7916ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b56dd2f-4de7-44b7-9a19-d804a7879072", "tag": "c92630c5-3778-4a39-b234-7741ee17d8a6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:31.795814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4565bb8-1a9b-4c0a-9f30-fe944f6dfc53 req-265b3494-3b97-48e0-b8b0-0fa52d7916ae service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:31.797142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4565bb8-1a9b-4c0a-9f30-fe944f6dfc53 req-265b3494-3b97-48e0-b8b0-0fa52d7916ae service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:31.797743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c4565bb8-1a9b-4c0a-9f30-fe944f6dfc53 req-265b3494-3b97-48e0-b8b0-0fa52d7916ae service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:31.820450 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c4565bb8-1a9b-4c0a-9f30-fe944f6dfc53 req-265b3494-3b97-48e0-b8b0-0fa52d7916ae service nova] Creating event network-changed:c92630c5-3778-4a39-b234-7741ee17d8a6 for instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 on n-h1-858383-17 Oct 31 15:49:31.830541 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c4565bb8-1a9b-4c0a-9f30-fe944f6dfc53 req-265b3494-3b97-48e0-b8b0-0fa52d7916ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068391 Oct 31 15:49:31.834664 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2926/5728] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:43.569270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:43.571036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:43.579829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1638302613", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "86dee2e1-79e6-4a29-8169-4c6be9a79259"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:43.884614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] validate_networks() for [('86dee2e1-79e6-4a29-8169-4c6be9a79259', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:50:44.045816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:44.047303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:44.054154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:44.055063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:44.063456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:44.064250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:44.064909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:44.065816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:44.066996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:44.067850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:44.096114 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5199d678-9be2-4c8c-acd0-ad14958f94fa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/ips" status: 200 len: 150 microversion: 2.1 time: 0.052330 Oct 31 15:50:44.096810 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2927/5729] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:50:44 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:50:44.342887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:50:44.344100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:50:44.344828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:50:44.345357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:50:44.345995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:50:44.358270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:44.359218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:44.359842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:44.360838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:44.361714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:44.362301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:44.382796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Getting quotas for project 8ce51d81994c418c9dc73e19539f0183. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:50:44.388514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Getting quotas for user c7e28603f1f9476081b205b32ac5782b and project 8ce51d81994c418c9dc73e19539f0183. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:50:44.413091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:50:44.413322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:50:44.482922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-124e065b-17aa-4b46-bcbe-91cbc7a8e23c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916647 Oct 31 15:50:44.497046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d92d07f-c431-46e3-a351-ca432b077799 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:44.498672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d92d07f-c431-46e3-a351-ca432b077799 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:44.500099 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2803/5730] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:50:44.690362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d92d07f-c431-46e3-a351-ca432b077799 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:44.705486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d92d07f-c431-46e3-a351-ca432b077799 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1214 microversion: 2.1 time: 0.212359 Oct 31 15:50:44.712833 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2928/5731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:44 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:45.730784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:45.731399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:45.738709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:45.739635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:45.740216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:45.741137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:45.741853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:45.742468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:45.825825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:45.834985 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-612dd85d-d727-4b15-9877-bbc406072881 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1266 microversion: 2.1 time: 0.108932 Oct 31 15:50:45.835578 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2804/5732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:45 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:46.789484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fbd69ca-147e-45f4-a650-2a548eebd5cc"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:46.791941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:46.803042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.803785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.804264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.804976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.805581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.806157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.861098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:46.865906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:46.886055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.888247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.890030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.891734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.897744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.898241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:47.002504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:47.018349 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dda698f-68be-4976-9b2c-fc78102f8503 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1272 microversion: 2.1 time: 0.162636 Oct 31 15:50:47.021150 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2805/5733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:46 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:47.231091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-897f4a71-c3ee-4d00-9164-b2e902f19fa1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445272 Oct 31 15:50:47.232119 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2929/5734] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:50:46 2022] POST /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:50:48.043253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:48.043890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:48.053830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:48.054254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:48.054906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:48.055889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:48.056473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:48.056958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:48.306447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:48.314797 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-15429f7e-c8c1-466d-9884-3e352dadb412 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1314 microversion: 2.1 time: 0.275353 Oct 31 15:50:48.316442 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2806/5735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:48 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:48.426194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f75d1556-7a85-40ff-b619-29963a64c9d8 req-ec5442fd-148c-4f41-bd64-6a91d5e1e3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b188dd58-6050-4d83-a234-d8056c903589", "tag": "d335e37b-ad65-494f-a30d-3100777b912b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:48.441489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f75d1556-7a85-40ff-b619-29963a64c9d8 req-ec5442fd-148c-4f41-bd64-6a91d5e1e3be service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:48.443100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f75d1556-7a85-40ff-b619-29963a64c9d8 req-ec5442fd-148c-4f41-bd64-6a91d5e1e3be service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:48.444449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f75d1556-7a85-40ff-b619-29963a64c9d8 req-ec5442fd-148c-4f41-bd64-6a91d5e1e3be service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:48.497895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f75d1556-7a85-40ff-b619-29963a64c9d8 req-ec5442fd-148c-4f41-bd64-6a91d5e1e3be service nova] Creating event network-changed:d335e37b-ad65-494f-a30d-3100777b912b for instance b188dd58-6050-4d83-a234-d8056c903589 on n-h2-858383-17 Oct 31 15:50:48.506455 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f75d1556-7a85-40ff-b619-29963a64c9d8 req-ec5442fd-148c-4f41-bd64-6a91d5e1e3be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087128 Oct 31 15:50:48.507549 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2930/5736] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:49.339446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:49.340051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:49.347570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:49.348172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:49.348632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:49.349458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:49.349916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:49.350341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:49.523819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:49.543248 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd816f5b-ff00-43d5-a4ac-9f958cc9be1b tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1314 microversion: 2.1 time: 0.207500 Oct 31 15:50:49.544317 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2807/5737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:49 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:50.570199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:50.571730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:50.579861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:50.580437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:50.580984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:50.581833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:50.582549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:50.583068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:50.751781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:50.760466 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-caf7e0d1-ea95-41e7-a985-b753c15cb2a5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1314 microversion: 2.1 time: 0.197065 Oct 31 15:50:50.761190 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2931/5738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:50 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:51.784131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:51.785438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:51.792939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:51.796192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:51.796797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:51.797755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:51.798263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:51.798806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:51.948822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:51.958975 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4f34a5b9-ae79-4294-80d8-fb7ea95a41e6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1314 microversion: 2.1 time: 0.178776 Oct 31 15:50:51.959638 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2808/5739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:51 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:52.984125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:52.984978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:52.993310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:52.993886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:52.994423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:52.995541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:52.996112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:52.996621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:53.197561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:53.212267 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-377d24fa-a4b9-4429-abcb-a7036cb8ab85 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1314 microversion: 2.1 time: 0.232157 Oct 31 15:50:53.213324 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2932/5740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:52 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:53.216630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-095e25b7-0285-4d92-80df-d7ca3184efa3 req-4fcdb7b4-8a7a-44ee-9da8-ef305ee39dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188dd58-6050-4d83-a234-d8056c903589", "name": "network-vif-plugged", "status": "completed", "tag": "d335e37b-ad65-494f-a30d-3100777b912b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:53.236646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-095e25b7-0285-4d92-80df-d7ca3184efa3 req-4fcdb7b4-8a7a-44ee-9da8-ef305ee39dea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:53.238853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-095e25b7-0285-4d92-80df-d7ca3184efa3 req-4fcdb7b4-8a7a-44ee-9da8-ef305ee39dea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:53.239290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-095e25b7-0285-4d92-80df-d7ca3184efa3 req-4fcdb7b4-8a7a-44ee-9da8-ef305ee39dea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:53.253378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-095e25b7-0285-4d92-80df-d7ca3184efa3 req-4fcdb7b4-8a7a-44ee-9da8-ef305ee39dea service nova] Creating event network-vif-plugged:d335e37b-ad65-494f-a30d-3100777b912b for instance b188dd58-6050-4d83-a234-d8056c903589 on n-h2-858383-17 Oct 31 15:50:53.258984 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-095e25b7-0285-4d92-80df-d7ca3184efa3 req-4fcdb7b4-8a7a-44ee-9da8-ef305ee39dea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049338 Oct 31 15:50:53.259937 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2809/5741] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:54.235481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:54.237294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:54.245700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:54.246166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:54.246608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:54.247320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:54.247961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:54.248539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:54.408059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:54.420409 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b579a732-63bc-4738-b40d-0e5f7e6210fe tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1314 microversion: 2.1 time: 0.188713 Oct 31 15:50:54.423001 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2933/5742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:54 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:54.554232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1398058268", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "c20ef085-5b5e-4462-8c54-f8aea3c41691"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:54.564990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:54.565995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:54.618527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] validate_networks() for [('c20ef085-5b5e-4462-8c54-f8aea3c41691', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:50:55.020893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:50:55.021484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:50:55.022153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:50:55.022566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:50:55.022972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:50:55.032062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.032486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.032949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.033835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.034292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.035319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.052846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Getting quotas for project a2de76361bde49ca878744614a51d9b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:50:55.058188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Getting quotas for user adc99219465143e2b38869de10ed5ec1 and project a2de76361bde49ca878744614a51d9b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:50:55.070842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:50:55.073260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:50:55.121293 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f4d85168-cff7-4257-bd82-dd342e003a88 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572268 Oct 31 15:50:55.122493 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2810/5743] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:50:55.133467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67f33a5e-fa85-4097-8e67-33fa4291bc25 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:55.134355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67f33a5e-fa85-4097-8e67-33fa4291bc25 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:55.136734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:55.210850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67f33a5e-fa85-4097-8e67-33fa4291bc25 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:55.219878 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67f33a5e-fa85-4097-8e67-33fa4291bc25 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1219 microversion: 2.1 time: 0.089299 Oct 31 15:50:55.220713 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2934/5744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:55 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:55.447246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:55.448141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:55.467642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.468457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.469037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.469857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.470451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.470989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.653888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:55.663497 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d59b658d-fd21-4166-8af2-1d9c307afeb6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1499 microversion: 2.1 time: 0.221409 Oct 31 15:50:55.664292 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2811/5745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:55 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1499 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:56.244835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:56.245355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:56.245468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:56.246221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:56.252998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.257669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.258344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.258883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.259540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.260383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.260958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.262194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.262406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.262933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.267788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.268365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.295523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:50:56.369566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:56.378119 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-860c6712-6a75-4e6f-a75d-503219b2d9fc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1271 microversion: 2.1 time: 0.136862 Oct 31 15:50:56.379312 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2812/5746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:56 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:56.388904 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a4fdfa0-6cc7-4241-93f2-2f0dd35600f3 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 204 len: 0 microversion: 2.1 time: 0.146562 Oct 31 15:50:56.389593 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2935/5747] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:50:56 2022] DELETE /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:50:56.403004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:56.403883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:56.411854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.412759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.413941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.414956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.415775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.416217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.917011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:56.926412 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1d2902c-cba6-4f6a-a2dc-4e90431ce0de tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1505 microversion: 2.1 time: 0.527999 Oct 31 15:50:56.927137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2813/5748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:56 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:57.404159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:57.405625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:57.413796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:57.414386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:57.414895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:57.415826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:57.416356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:57.416893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:57.666550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:57.680712 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c306886d-44e0-4696-906c-89968a5a3112 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.280780 Oct 31 15:50:57.681312 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2936/5749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:57 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:57.949856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:57.951226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:57.959618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:57.960355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:57.960989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:57.961853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:57.962485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:57.963513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:58.226662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0f9fe63b-d982-451d-9d45-f9be4e470194 req-0ac5829e-c1b6-4230-b6ec-d11c2ebc3280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188dd58-6050-4d83-a234-d8056c903589", "name": "network-vif-deleted", "tag": "d335e37b-ad65-494f-a30d-3100777b912b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:58.241974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f9fe63b-d982-451d-9d45-f9be4e470194 req-0ac5829e-c1b6-4230-b6ec-d11c2ebc3280 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:58.242734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f9fe63b-d982-451d-9d45-f9be4e470194 req-0ac5829e-c1b6-4230-b6ec-d11c2ebc3280 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:58.243333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0f9fe63b-d982-451d-9d45-f9be4e470194 req-0ac5829e-c1b6-4230-b6ec-d11c2ebc3280 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:58.259787 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0f9fe63b-d982-451d-9d45-f9be4e470194 req-0ac5829e-c1b6-4230-b6ec-d11c2ebc3280 service nova] Creating event network-vif-deleted:d335e37b-ad65-494f-a30d-3100777b912b for instance b188dd58-6050-4d83-a234-d8056c903589 on n-h2-858383-17 Oct 31 15:50:58.265632 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0f9fe63b-d982-451d-9d45-f9be4e470194 req-0ac5829e-c1b6-4230-b6ec-d11c2ebc3280 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042550 Oct 31 15:50:58.265796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:58.267061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2937/5750] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:50:58.289302 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a646cd9-e579-43ea-9c76-f7fea3564116 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 200 len: 1505 microversion: 2.1 time: 0.340141 Oct 31 15:50:58.294068 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2814/5751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:57 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:58.424241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-924164d3-4287-4a84-a3b0-faac0c2ff518 req-369d07a9-200f-481e-8f3a-ba78fa7c70d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be34b9a6-3633-47c7-9cd1-1576616055c1", "tag": "970dc951-b9fc-49b9-b54f-ad0871c3b692"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:58.438589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-924164d3-4287-4a84-a3b0-faac0c2ff518 req-369d07a9-200f-481e-8f3a-ba78fa7c70d1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:58.439331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-924164d3-4287-4a84-a3b0-faac0c2ff518 req-369d07a9-200f-481e-8f3a-ba78fa7c70d1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:58.439917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-924164d3-4287-4a84-a3b0-faac0c2ff518 req-369d07a9-200f-481e-8f3a-ba78fa7c70d1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:58.455345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-924164d3-4287-4a84-a3b0-faac0c2ff518 req-369d07a9-200f-481e-8f3a-ba78fa7c70d1 service nova] Creating event network-changed:970dc951-b9fc-49b9-b54f-ad0871c3b692 for instance be34b9a6-3633-47c7-9cd1-1576616055c1 on n-h1-858383-17 Oct 31 15:50:58.461237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-924164d3-4287-4a84-a3b0-faac0c2ff518 req-369d07a9-200f-481e-8f3a-ba78fa7c70d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144809 Oct 31 15:50:58.461775 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2938/5752] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:58.708027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:58.709315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:58.718049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:58.727132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:58.728272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:58.729193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:58.730578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:58.731121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:58.912444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:58.920372 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04a3b3d9-f985-47ca-8439-63fbb14f485a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.217583 Oct 31 15:50:58.920969 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2815/5753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:58 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:59.318099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:59.318810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: b188dd58-6050-4d83-a234-d8056c903589] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:59.325492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:59.325988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:59.326431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:59.327158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:59.327648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:59.328081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:59.343709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] HTTP exception thrown: Instance b188dd58-6050-4d83-a234-d8056c903589 could not be found. Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Request method failure captured: Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 HTTP/1.1 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-7RxHgwmAg4VZUAGwryFCok-V61HNdyBWvdLZVRfohf5Kfv7DUre5pjJxaVxi3lJxYzhZWaU7_frvkmXE2rfwxmQU0KFBnD_Yt3-IWIGpZbGlqf4lkh1zyj2GJ3vdv0MsbcCAS2_NDg_-x_PvhcFOmk1bAYcBo_zYgS4sALca4GORs Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 8ce51d81994c418c9dc73e19539f0183 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesActionsTest-3711613 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesActionsTest-3711613 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 8ce51d81994c418c9dc73e19539f0183 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesActionsTest-3711613 Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesActionsTest-3711613-project Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: c7e28603f1f9476081b205b32ac5782b Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesActionsTest-3711613-project Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b188dd58-6050-4d83-a234-d8056c903589 could not be found. Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b188dd58-6050-4d83-a234-d8056c903589'} Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b188dd58-6050-4d83-a234-d8056c903589 could not be found. Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b188dd58-6050-4d83-a234-d8056c903589 could not be found. Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:59.345579 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b188dd58-6050-4d83-a234-d8056c903589 could not be found. Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Returning 404 to user: Instance b188dd58-6050-4d83-a234-d8056c903589 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d94c6af9-8821-4677-aac0-706443fdb850 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589" status: 404 len: 111 microversion: 2.1 time: 0.033480 Oct 31 15:50:59.351120 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2939/5754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:59 2022] GET /compute/v2.1/servers/b188dd58-6050-4d83-a234-d8056c903589 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:50:59.401117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-496984062", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "86dee2e1-79e6-4a29-8169-4c6be9a79259"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:59.453762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] validate_networks() for [('86dee2e1-79e6-4a29-8169-4c6be9a79259', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:50:59.808337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:50:59.808803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:50:59.809289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:50:59.809736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:50:59.810160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:50:59.819261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:59.819747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:59.820181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:59.820955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:59.821409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:59.821834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:59.838511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Getting quotas for project 8ce51d81994c418c9dc73e19539f0183. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:50:59.843729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Getting quotas for user c7e28603f1f9476081b205b32ac5782b and project 8ce51d81994c418c9dc73e19539f0183. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:50:59.857215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:50:59.859692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:50:59.906200 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-deea2f54-5f2b-4c06-8938-3bb932283aed tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509302 Oct 31 15:50:59.907206 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2816/5755] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:50:59.918558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d2266a2-ab62-45e1-962e-fd5cd262dd4e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:59.919170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d2266a2-ab62-45e1-962e-fd5cd262dd4e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:59.944532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:59.945371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:59.954177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:59.955142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:59.955818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:59.957245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:59.958001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:59.959316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:59.983731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d2266a2-ab62-45e1-962e-fd5cd262dd4e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:00.006728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d2266a2-ab62-45e1-962e-fd5cd262dd4e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1213 microversion: 2.1 time: 0.091724 Oct 31 15:51:00.007575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2940/5756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:59 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:00.115890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:00.124584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c94ec71-d19a-4f02-9143-a97bfa5f3b37 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.184978 Oct 31 15:51:00.140787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2817/5757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:59 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:51:01.033137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:01.034579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:01.042422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.043146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.043766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.044887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.045526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.046125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.132091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:01.140877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-feebf763-2609-40d5-8477-8fbd4f6efa13 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1283 microversion: 2.1 time: 0.112666 Oct 31 15:51:01.152720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2941/5758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:01 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:01.152933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:01.152933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:01.158946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.158946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.158946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.158946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.158946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.158946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.594484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:01.604254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d4b07bd-fa74-40eb-b32c-e8ff86344376 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.460211 Oct 31 15:51:01.606957 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2818/5759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:01 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:51:02.167895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:02.168578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:02.175590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:02.176069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:02.177272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:02.180186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:02.180473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:02.181106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:02.340671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:02.349717 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f16da019-821b-497a-9216-b0d4ae1fd9f2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1313 microversion: 2.1 time: 0.186532 Oct 31 15:51:02.350789 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2942/5760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:02 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:02.496086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f4d9cab5-c6c8-4604-a1b7-20a4d12ef061 req-8dfadadd-f14f-4c3e-bb8c-7ec837a4c9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6b5615-5019-41df-b9a8-559e763db51c", "tag": "d6ea2850-1e91-4ab5-8962-36594e649169"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:02.513488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4d9cab5-c6c8-4604-a1b7-20a4d12ef061 req-8dfadadd-f14f-4c3e-bb8c-7ec837a4c9e5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:02.514223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4d9cab5-c6c8-4604-a1b7-20a4d12ef061 req-8dfadadd-f14f-4c3e-bb8c-7ec837a4c9e5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:02.514763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f4d9cab5-c6c8-4604-a1b7-20a4d12ef061 req-8dfadadd-f14f-4c3e-bb8c-7ec837a4c9e5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:02.527777 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f4d9cab5-c6c8-4604-a1b7-20a4d12ef061 req-8dfadadd-f14f-4c3e-bb8c-7ec837a4c9e5 service nova] Creating event network-changed:d6ea2850-1e91-4ab5-8962-36594e649169 for instance 2a6b5615-5019-41df-b9a8-559e763db51c on n-h2-858383-17 Oct 31 15:51:02.533685 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f4d9cab5-c6c8-4604-a1b7-20a4d12ef061 req-8dfadadd-f14f-4c3e-bb8c-7ec837a4c9e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047164 Oct 31 15:51:02.534697 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2819/5761] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:02.630526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:02.631340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:02.637838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:02.638338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:02.638854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:02.639623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:02.640088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:02.640516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:02.801518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:02.810087 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6337759-d87d-4781-99b2-8bbb45e6817f tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.183971 Oct 31 15:51:02.811197 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2943/5762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:02 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:03.375167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:03.375885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:03.383404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.383906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.384348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.385105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.385582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.386016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.539922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:03.548317 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04b2da26-39a9-48d9-b5ce-1805e12901f6 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1313 microversion: 2.1 time: 0.177562 Oct 31 15:51:03.549484 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2820/5763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:03 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:51:03.574630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fbd69ca-147e-45f4-a650-2a548eebd5cc"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:03.577158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:03.584411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.584920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.585357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.586046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.586498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.586914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.670535 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Invalid volume: volume 4fbd69ca-147e-45f4-a650-2a548eebd5cc is already attached to instances: 5b56dd2f-4de7-44b7-9a19-d804a7879072 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments HTTP/1.1 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 74 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: {"volumeAttachment": {"volumeId": "4fbd69ca-147e-45f4-a650-2a548eebd5cc"}} Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: exception: Invalid volume: volume 4fbd69ca-147e-45f4-a650-2a548eebd5cc is already attached to instances: 5b56dd2f-4de7-44b7-9a19-d804a7879072 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': '5b56dd2f-4de7-44b7-9a19-d804a7879072', 'body': {'volumeAttachment': {'volumeId': '4fbd69ca-147e-45f4-a650-2a548eebd5cc'}}} Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4fbd69ca-147e-45f4-a650-2a548eebd5cc is already attached to instances: 5b56dd2f-4de7-44b7-9a19-d804a7879072 Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:51:03.672269 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4fbd69ca-147e-45f4-a650-2a548eebd5cc is already attached to instances: 5b56dd2f-4de7-44b7-9a19-d804a7879072 Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4fbd69ca-147e-45f4-a650-2a548eebd5cc is already attached to instances: 5b56dd2f-4de7-44b7-9a19-d804a7879072 Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 400 to user: Invalid volume: volume 4fbd69ca-147e-45f4-a650-2a548eebd5cc is already attached to instances: 5b56dd2f-4de7-44b7-9a19-d804a7879072 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:03.675723 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f67bee9-9356-4b24-985f-fb844196e770 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103666 Oct 31 15:51:03.678678 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2944/5764] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:51:03 2022] POST /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:51:03.765442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:03.766072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:03.773453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.774258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.774920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.775861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.776525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.777176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.835701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:03.837177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:03.845835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.847016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.847624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.849070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.850219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.850911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.875167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lazy-loading 'services' on Instance uuid 5b56dd2f-4de7-44b7-9a19-d804a7879072 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:51:03.962407 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa0c3eb0-d001-492b-9b72-e3b12e2f922f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments/4fbd69ca-147e-45f4-a650-2a548eebd5cc" status: 202 len: 0 microversion: 2.1 time: 0.200933 Oct 31 15:51:03.967466 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2821/5765] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:51:03 2022] DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments/4fbd69ca-147e-45f4-a650-2a548eebd5cc => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:51:03.978754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:03.986909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:04.000151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:04.000729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:04.001611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:04.002507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:04.005357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:04.006715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:04.017440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:04.027117 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e970701e-1b43-46e7-855b-fa8a77b2191e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.195928 Oct 31 15:51:04.027987 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2945/5766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:03 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:04.043606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:04.062961 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f4b09a87-b8e0-484f-84c3-b18dd7d50c30 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094723 Oct 31 15:51:04.064062 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2822/5767] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:03 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:04.572390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:04.572960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:04.579125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:04.579692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:04.580046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:04.580770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:04.581241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:04.581673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:04.603526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:04.722706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:04.732537 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ef856ab-20dc-41b6-874d-6efc9a799965 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1313 microversion: 2.1 time: 0.164023 Oct 31 15:51:04.733403 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2946/5768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:04 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:05.053344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:05.054031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:05.061853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.062441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.062955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.063807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.064337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.065248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.075782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:05.079080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:05.086588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.087357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.088026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.088878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.089544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.090318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.134930 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c3e7588-e3f8-42a2-99ca-3d559bd6de02 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063163 Oct 31 15:51:05.135768 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2947/5769] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:05 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:05.142130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-981d2162-94bb-4064-b2c5-a389b78ddec7 req-6709900e-59e9-408f-aecb-18848e0d8dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34b9a6-3633-47c7-9cd1-1576616055c1", "name": "network-vif-plugged", "status": "completed", "tag": "970dc951-b9fc-49b9-b54f-ad0871c3b692"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:05.157871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-981d2162-94bb-4064-b2c5-a389b78ddec7 req-6709900e-59e9-408f-aecb-18848e0d8dd6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.158763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-981d2162-94bb-4064-b2c5-a389b78ddec7 req-6709900e-59e9-408f-aecb-18848e0d8dd6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.159914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-981d2162-94bb-4064-b2c5-a389b78ddec7 req-6709900e-59e9-408f-aecb-18848e0d8dd6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.186065 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-981d2162-94bb-4064-b2c5-a389b78ddec7 req-6709900e-59e9-408f-aecb-18848e0d8dd6 service nova] Creating event network-vif-plugged:970dc951-b9fc-49b9-b54f-ad0871c3b692 for instance be34b9a6-3633-47c7-9cd1-1576616055c1 on n-h1-858383-17 Oct 31 15:51:05.194360 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-981d2162-94bb-4064-b2c5-a389b78ddec7 req-6709900e-59e9-408f-aecb-18848e0d8dd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056242 Oct 31 15:51:05.197191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2948/5770] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:05.246018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:05.260101 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f15dcccd-1db4-4e0f-a8ea-fb2b59c05507 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.210548 Oct 31 15:51:05.276230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2823/5771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:05 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:05.757254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:05.758084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:05.764664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.765192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.765637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.766372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:05.766830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:05.767261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:05.904188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:05.913076 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8303541-adbb-4b7e-920e-de663fbc9a0f tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1313 microversion: 2.1 time: 0.161343 Oct 31 15:51:05.913661 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2949/5772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:05 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:06.148347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:06.150606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:06.157676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:06.158171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:06.158612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:06.159341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:06.159804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:06.160265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:06.192199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ba65947-ba28-4424-a3a5-937f52cd0c08 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048493 Oct 31 15:51:06.192899 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2824/5773] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:06 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:06.286807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:06.287451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:06.293744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:06.294235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:06.294676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:06.295373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:06.295838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:06.296264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:06.429072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:06.436889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fde21bb3-6982-467c-a061-de3cce39819e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1319 microversion: 2.1 time: 0.155029 Oct 31 15:51:06.437467 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2950/5774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:06 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:06.935566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:06.936101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:06.942843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:06.943322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:06.943762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:06.944458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:06.944943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:06.945371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:07.077269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:07.085860 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8579130e-b040-439c-ad3c-e3906f3ea0d5 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1313 microversion: 2.1 time: 0.154217 Oct 31 15:51:07.086713 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2825/5775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:06 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:51:07.205423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:07.209116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:07.216074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:07.217088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:07.217820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:07.219083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:07.219835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:07.220717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-37955eee-937c-49d4-bfc2-d1753f64e3ab req-31ff8818-7365-44a2-b24c-7141e71bf318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6b5615-5019-41df-b9a8-559e763db51c", "name": "network-vif-plugged", "status": "completed", "tag": "d6ea2850-1e91-4ab5-8962-36594e649169"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:07.221441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:07.234032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-37955eee-937c-49d4-bfc2-d1753f64e3ab req-31ff8818-7365-44a2-b24c-7141e71bf318 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:07.234522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-37955eee-937c-49d4-bfc2-d1753f64e3ab req-31ff8818-7365-44a2-b24c-7141e71bf318 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:07.234959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-37955eee-937c-49d4-bfc2-d1753f64e3ab req-31ff8818-7365-44a2-b24c-7141e71bf318 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:07.248513 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-37955eee-937c-49d4-bfc2-d1753f64e3ab req-31ff8818-7365-44a2-b24c-7141e71bf318 service nova] Creating event network-vif-plugged:d6ea2850-1e91-4ab5-8962-36594e649169 for instance 2a6b5615-5019-41df-b9a8-559e763db51c on n-h2-858383-17 Oct 31 15:51:07.255736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-37955eee-937c-49d4-bfc2-d1753f64e3ab req-31ff8818-7365-44a2-b24c-7141e71bf318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041181 Oct 31 15:51:07.256886 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2826/5776] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:51:07.259191 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1f23bf48-94e5-4f8e-8783-235bf247078b tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057693 Oct 31 15:51:07.264996 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2951/5777] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:07 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:07.462658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:07.463371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:07.469685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:07.470184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:07.470657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:07.471372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:07.471836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:07.472274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:07.609666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:07.618264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce4a48fb-897b-4394-9824-9079920a52bb tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1507 microversion: 2.1 time: 0.160945 Oct 31 15:51:07.618842 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2827/5778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:07 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:08.108622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:08.109386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:08.116560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.117227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.117746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.118621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.119031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.119568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.273091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:08.276343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:08.284067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.284565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.285050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.285165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:08.285813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.286266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.286689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.295595 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05cce287-209c-40bd-9740-a6a30ea79f75 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1313 microversion: 2.1 time: 0.190854 Oct 31 15:51:08.296274 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2952/5779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:08 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:08.321532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-81d80184-6639-410e-8f5a-c5e8c17ca1fb tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052570 Oct 31 15:51:08.322504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2828/5780] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:08 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:51:09.321384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:09.321947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:09.329604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:09.330531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:09.331355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:09.332329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:09.332811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:09.333655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:09.336933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:09.339999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:09.347508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:09.348541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:09.349364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:09.350324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:09.351004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:09.351616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:09.390160 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e3273962-b1b7-49dd-9249-a6080ea5168d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059869 Oct 31 15:51:09.391470 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2829/5781] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:09 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:51:09.490767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:09.498925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29b1166e-0d0b-45b4-aae8-b7e7b6a0a376 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1498 microversion: 2.1 time: 0.182173 Oct 31 15:51:09.499766 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2953/5782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:09 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:09.981870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:09.982376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:09.987496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:09.988935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:09.991036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:09.991822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:09.992315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:09.993166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:09.993620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:09.994058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.029125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:51:10.135640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:10.157167 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1a477668-03de-4ae0-9d4f-207ecff6f98c tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 204 len: 0 microversion: 2.1 time: 0.178801 Oct 31 15:51:10.158407 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2830/5783] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:51:09 2022] DELETE /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:51:10.168633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:10.169829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:10.176807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:10.180061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.180814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.181575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.182465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.183143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.185169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.404914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:10.409317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:10.419626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.420488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.421046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.422310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.423233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.425513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.468656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:10.471828 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02303794-44ca-429e-8755-a7123248f7aa tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072186 Oct 31 15:51:10.478300 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2831/5784] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:51:10 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:51:10.478454 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c52b8864-e42a-43b7-898b-c7122c9d9ba1 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1504 microversion: 2.1 time: 0.315457 Oct 31 15:51:10.482633 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2954/5785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:10 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:10.559577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:10.560338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:10.566645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.567545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.568059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.569017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.569674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.570350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.597996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:51:10.695989 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0118cd37-6877-4b4b-a232-d051970e6a00 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 204 len: 0 microversion: 2.1 time: 0.138868 Oct 31 15:51:10.698852 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2832/5786] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:51:10 2022] DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:51:10.705931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:10.706725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:10.716435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.717198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.717656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.718355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:10.719037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:10.719462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:10.866402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:10.874465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b72f3bf7-e383-45f8-82ca-f3fbc729855d tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1682 microversion: 2.1 time: 0.172533 Oct 31 15:51:10.879813 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2955/5787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:10 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:11.505732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:11.507473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:11.519581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:11.520783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:11.521866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:11.523240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:11.524198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:11.525023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:11.718500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e28603f1f9476081b205b32ac5782b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce51d81994c418c9dc73e19539f0183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:11.727041 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-810ccd63-eb15-4a79-8778-75370cce7e2e tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 200 len: 1504 microversion: 2.1 time: 0.227153 Oct 31 15:51:11.727627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2833/5788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:11 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:11.902019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:11.903436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:11.922305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:11.922552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:11.923416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:11.926926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:11.927739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:11.929138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:11.945552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6235a1dc-f13a-4b57-978b-41782b9f4572 req-cac2b820-d3f5-476b-8e7a-82cd708f588a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6b5615-5019-41df-b9a8-559e763db51c", "name": "network-vif-deleted", "tag": "d6ea2850-1e91-4ab5-8962-36594e649169"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:11.956842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6235a1dc-f13a-4b57-978b-41782b9f4572 req-cac2b820-d3f5-476b-8e7a-82cd708f588a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:11.961589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6235a1dc-f13a-4b57-978b-41782b9f4572 req-cac2b820-d3f5-476b-8e7a-82cd708f588a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:11.962048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6235a1dc-f13a-4b57-978b-41782b9f4572 req-cac2b820-d3f5-476b-8e7a-82cd708f588a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:11.983245 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6235a1dc-f13a-4b57-978b-41782b9f4572 req-cac2b820-d3f5-476b-8e7a-82cd708f588a service nova] Creating event network-vif-deleted:d6ea2850-1e91-4ab5-8962-36594e649169 for instance 2a6b5615-5019-41df-b9a8-559e763db51c on n-h2-858383-17 Oct 31 15:51:11.995338 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6235a1dc-f13a-4b57-978b-41782b9f4572 req-cac2b820-d3f5-476b-8e7a-82cd708f588a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053788 Oct 31 15:51:11.996859 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2834/5789] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:51:12.195130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:12.210665 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a6bde711-eabf-43e9-b42f-ca5633a35ec9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1682 microversion: 2.1 time: 0.314158 Oct 31 15:51:12.212992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2956/5790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:11 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1682 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:12.752209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:12.753574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] [instance: 2a6b5615-5019-41df-b9a8-559e763db51c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:12.760263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:12.760994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:12.761591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:12.762295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:12.762939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:12.763366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:12.798519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] HTTP exception thrown: Instance 2a6b5615-5019-41df-b9a8-559e763db51c could not be found. Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Request method failure captured: Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c HTTP/1.1 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-7RxHgwmAg4VZUAGwryFCok-V61HNdyBWvdLZVRfohf5Kfv7DUre5pjJxaVxi3lJxYzhZWaU7_frvkmXE2rfwxmQU0KFBnD_Yt3-IWIGpZbGlqf4lkh1zyj2GJ3vdv0MsbcCAS2_NDg_-x_PvhcFOmk1bAYcBo_zYgS4sALca4GORs Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 8ce51d81994c418c9dc73e19539f0183 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesActionsTest-3711613 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ce51d81994c418c9dc73e19539f0183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesActionsTest-3711613 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 8ce51d81994c418c9dc73e19539f0183 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesActionsTest-3711613 Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesActionsTest-3711613-project Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: c7e28603f1f9476081b205b32ac5782b Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesActionsTest-3711613-project Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 2a6b5615-5019-41df-b9a8-559e763db51c could not be found. Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '2a6b5615-5019-41df-b9a8-559e763db51c'} Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6b5615-5019-41df-b9a8-559e763db51c could not be found. Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6b5615-5019-41df-b9a8-559e763db51c could not be found. Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:12.800220 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6b5615-5019-41df-b9a8-559e763db51c could not be found. Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] Returning 404 to user: Instance 2a6b5615-5019-41df-b9a8-559e763db51c could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9331b86c-52fd-450f-b2b8-0688ff4b46b2 tempest-VolumesActionsTest-3711613 tempest-VolumesActionsTest-3711613-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c" status: 404 len: 111 microversion: 2.1 time: 0.055162 Oct 31 15:51:12.803906 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2835/5791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:12 2022] GET /compute/v2.1/servers/2a6b5615-5019-41df-b9a8-559e763db51c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:13.243690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:13.245209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:13.264957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:13.264957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:13.264957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:13.264957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:13.264957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:13.264957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:13.793128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:13.802082 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22a40bdf-2f6a-4f0e-9e5f-7dc3d5fe48bc tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1682 microversion: 2.1 time: 0.564042 Oct 31 15:51:13.803135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2957/5792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:13 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1682 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:14.509969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9082ae10-866a-46bf-84d0-433593b8afe9 req-0ae3c45c-117f-44c3-a353-ac5b14380740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b56dd2f-4de7-44b7-9a19-d804a7879072", "name": "network-vif-deleted", "tag": "c92630c5-3778-4a39-b234-7741ee17d8a6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:14.557212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9082ae10-866a-46bf-84d0-433593b8afe9 req-0ae3c45c-117f-44c3-a353-ac5b14380740 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:14.558470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9082ae10-866a-46bf-84d0-433593b8afe9 req-0ae3c45c-117f-44c3-a353-ac5b14380740 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:14.564477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9082ae10-866a-46bf-84d0-433593b8afe9 req-0ae3c45c-117f-44c3-a353-ac5b14380740 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:14.578649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9082ae10-866a-46bf-84d0-433593b8afe9 req-0ae3c45c-117f-44c3-a353-ac5b14380740 service nova] Creating event network-vif-deleted:c92630c5-3778-4a39-b234-7741ee17d8a6 for instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 on n-h1-858383-17 Oct 31 15:51:14.586644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9082ae10-866a-46bf-84d0-433593b8afe9 req-0ae3c45c-117f-44c3-a353-ac5b14380740 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089680 Oct 31 15:51:14.588448 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2836/5793] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:14.827072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:14.827907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:14.846456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:14.867446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:14.868532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:14.869647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:14.873524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:14.874134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:14.874869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:14.948523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:14.949166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:14.949705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:14.950329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lazy-loading 'fault' on Instance uuid 5b56dd2f-4de7-44b7-9a19-d804a7879072 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:51:15.028106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:15.037767 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82f55b35-989c-4877-9de8-33fbc9d42c37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 200 len: 1331 microversion: 2.1 time: 0.215786 Oct 31 15:51:15.039029 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2958/5794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:14 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 1331 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:16.071670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:16.072371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:16.088795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:16.095120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:16.098535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:16.100989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:16.101938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:16.102449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:16.162250 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 HTTP/1.1 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5b56dd2f-4de7-44b7-9a19-d804a7879072'} Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:16.174467 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-15812f82-9b7c-46da-9dca-e6011767ffb1 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 404 len: 111 microversion: 2.1 time: 0.115698 Oct 31 15:51:16.179516 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2837/5795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:16 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:16.187864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-750a9525-7e5a-4003-8bea-982819af88d4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '.version_select at 0x7f5ca12adb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:16.219053 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-750a9525-7e5a-4003-8bea-982819af88d4 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181386460" status: 202 len: 0 microversion: 2.1 time: 0.033769 Oct 31 15:51:16.220207 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2959/5796] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181386460 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:51:17.399644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-301af783-6c05-487f-b0cd-78aaec0f95f5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: .version_select at 0x7f5ca1346dc0>, body: {"keypair": {"name": "tempest-keypair-1412756500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJdK3taixcfGywfTixfmj8AmtaDf7SQumTpy92rWdhEzJBmSdhSPgsJ9inXOq4Bi2Fr7XoWreuf4MNxWRa+4BjxRC/JhfgSOJYYmA8l88S1/ibYI6/gQMoKvFBWLTjppA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:17.422714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-301af783-6c05-487f-b0cd-78aaec0f95f5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:51:17.431998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-301af783-6c05-487f-b0cd-78aaec0f95f5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:51:17.469077 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-301af783-6c05-487f-b0cd-78aaec0f95f5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072986 Oct 31 15:51:17.478461 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2838/5797] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:51:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:19.937003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-877912438", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e"}], "security_groups": [{"name": "tempest-securitygroup--169510465"}], "key_name": "tempest-keypair-1412756500", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:24.416083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] validate_networks() for [('a5b4ed80-8cc8-41e7-aa48-4e0f653d5e6e', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:51:25.029682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:51:25.030112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:51:25.030594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:51:25.031008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:51:25.031422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:51:25.036436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=72 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:25.047735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:25.048489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:25.049189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:25.050815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:25.051479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:25.052315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:25.092114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:51:25.105291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Getting quotas for user 79fbcb523e324b31b9355301804e5e5f and project 4c85914a951543f99f9851adbe39784d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:51:25.136155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:51:25.141150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:51:25.237093 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41ed4503-b8d5-4a7a-89b1-4ef9bb36bc6c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.305316 Oct 31 15:51:25.239001 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2960/5798] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:51:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 5308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:51:25.251461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae37c911-13a3-4768-adec-4ab9f0e5c799 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:25.252647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae37c911-13a3-4768-adec-4ab9f0e5c799 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:25.345958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ae37c911-13a3-4768-adec-4ab9f0e5c799 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:25.354585 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae37c911-13a3-4768-adec-4ab9f0e5c799 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1241 microversion: 2.1 time: 0.108221 Oct 31 15:51:25.384812 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2839/5799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:25 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:26.384787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:26.385412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:26.401753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:26.405329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:26.405954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:26.409405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:26.410349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:26.410988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:26.523162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:26.531630 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9041e49d-97e9-4ef2-8d5d-62325dbe818a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1293 microversion: 2.1 time: 0.151528 Oct 31 15:51:26.533609 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2961/5800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:26 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:27.556718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:27.558563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:27.561200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:27.583558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:27.584149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:27.584666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:27.585652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:27.586286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:27.586728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:27.717973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:27.726561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c5ffe57b-ad61-4224-9d24-4bafce57add7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1299 microversion: 2.1 time: 0.175108 Oct 31 15:51:27.727152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2840/5801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:27 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:28.753496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:28.755485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:28.798367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:28.801126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:28.802228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:28.804264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:28.806964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:28.810616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:29.056020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:29.064427 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-526903ae-0a6c-4c1c-8840-89b5667686b7 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1366 microversion: 2.1 time: 0.314720 Oct 31 15:51:29.065035 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2962/5802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:28 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:29.921799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0b897cdd-2e78-4950-9ce2-f71ebee73092 req-a916cfda-1b03-4c75-b67b-4008d682a25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b177db2b-5dce-4f7f-bd92-795622cff08a", "tag": "b788c1a0-4c2c-4ec6-a4d2-60464aade7f5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:29.954358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0b897cdd-2e78-4950-9ce2-f71ebee73092 req-a916cfda-1b03-4c75-b67b-4008d682a25c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:29.960418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0b897cdd-2e78-4950-9ce2-f71ebee73092 req-a916cfda-1b03-4c75-b67b-4008d682a25c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:29.967216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0b897cdd-2e78-4950-9ce2-f71ebee73092 req-a916cfda-1b03-4c75-b67b-4008d682a25c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:30.016631 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0b897cdd-2e78-4950-9ce2-f71ebee73092 req-a916cfda-1b03-4c75-b67b-4008d682a25c service nova] Creating event network-changed:b788c1a0-4c2c-4ec6-a4d2-60464aade7f5 for instance b177db2b-5dce-4f7f-bd92-795622cff08a on n-h2-858383-17 Oct 31 15:51:30.033231 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0b897cdd-2e78-4950-9ce2-f71ebee73092 req-a916cfda-1b03-4c75-b67b-4008d682a25c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115781 Oct 31 15:51:30.035670 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2841/5803] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:30.125555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:30.126152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:30.153736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:30.158112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:30.158571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:30.163409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:30.165279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:30.165850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:30.420571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:30.430608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b0c31df-2c72-4713-bc59-bdcb50bb4801 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1366 microversion: 2.1 time: 0.332971 Oct 31 15:51:30.437843 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2963/5804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:30 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:31.467526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:31.475336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:31.482196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:31.489297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:31.490032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:31.493620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:31.494368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:31.495035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:31.713179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:31.727537 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09293935-e913-40de-a098-7668c52e03c6 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1366 microversion: 2.1 time: 0.271921 Oct 31 15:51:31.737826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2842/5805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:31 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:32.756106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:32.757575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:32.783197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:32.786976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:32.787475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:32.788364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:32.788931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:32.789384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:33.189743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:33.209515 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d99f49e2-caba-48fb-ba4d-9c4b9abbec1c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1366 microversion: 2.1 time: 0.457788 Oct 31 15:51:33.215166 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2964/5806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:32 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:34.235525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:34.237082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:34.269800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:34.270581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:34.271195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:34.272067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:34.272839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:34.273466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:34.545963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:34.557550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b6b17827-e7ee-4503-9789-e13b1f9aab90 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1366 microversion: 2.1 time: 0.326065 Oct 31 15:51:34.559186 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2843/5807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:34 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:35.460951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e5645889-54c9-4917-b51e-25629e14feba req-63dba820-4e02-496e-9a43-0bec0fed36ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b177db2b-5dce-4f7f-bd92-795622cff08a", "name": "network-vif-plugged", "status": "completed", "tag": "b788c1a0-4c2c-4ec6-a4d2-60464aade7f5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:35.479266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:35.483408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:35.489384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e5645889-54c9-4917-b51e-25629e14feba req-63dba820-4e02-496e-9a43-0bec0fed36ae service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:35.490096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e5645889-54c9-4917-b51e-25629e14feba req-63dba820-4e02-496e-9a43-0bec0fed36ae service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:35.497506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e5645889-54c9-4917-b51e-25629e14feba req-63dba820-4e02-496e-9a43-0bec0fed36ae service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:35.520385 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e5645889-54c9-4917-b51e-25629e14feba req-63dba820-4e02-496e-9a43-0bec0fed36ae service nova] Creating event network-vif-plugged:b788c1a0-4c2c-4ec6-a4d2-60464aade7f5 for instance b177db2b-5dce-4f7f-bd92-795622cff08a on n-h2-858383-17 Oct 31 15:51:35.529938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e5645889-54c9-4917-b51e-25629e14feba req-63dba820-4e02-496e-9a43-0bec0fed36ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074557 Oct 31 15:51:35.530563 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2965/5808] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:35.582049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:35.582671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:35.591092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:35.602061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fd0be27-25f5-4e07-b61c-6c095b46250e", "device": "/dev/sdb"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:35.604639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:35.621663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:35.622576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:35.623202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:35.623564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:35.624292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:35.625301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:35.626540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:35.626830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:35.628663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:35.629054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:35.630367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:35.630976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:35.859391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:35.870365 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-68611d82-2967-4590-a249-9ab1f2cd814a tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1366 microversion: 2.1 time: 0.293200 Oct 31 15:51:35.872423 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2844/5809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:35 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:36.063977 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3300237e-e555-45e2-96aa-b15373fb3cbc tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "POST /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466358 Oct 31 15:51:36.064884 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2966/5810] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:51:35 2022] POST /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:36.898027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:36.899265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:36.917596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:36.918516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:36.919166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:36.919886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:36.920441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:36.920912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:37.118167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:51:37.128561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e4f54a7-4a34-4521-92a8-4f3b17e3b491 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1557 microversion: 2.1 time: 0.237475 Oct 31 15:51:37.129551 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2845/5811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:36 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1557 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:37.153262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:37.154482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:37.162624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:37.163364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:37.163960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:37.165098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:37.165719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:37.166305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:37.314024 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40b99610-f6b0-4896-a206-a9a45065d2c5 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166179 Oct 31 15:51:37.330338 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2967/5812] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 15:51:37 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:38.590827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-cd31048b-f9de-4402-a46a-eabf3d1fc44e req-a007cbdd-8d84-4304-ab5a-00b023f77102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b177db2b-5dce-4f7f-bd92-795622cff08a", "tag": "b788c1a0-4c2c-4ec6-a4d2-60464aade7f5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:38.612456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-cd31048b-f9de-4402-a46a-eabf3d1fc44e req-a007cbdd-8d84-4304-ab5a-00b023f77102 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:38.613458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-cd31048b-f9de-4402-a46a-eabf3d1fc44e req-a007cbdd-8d84-4304-ab5a-00b023f77102 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:38.618013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-cd31048b-f9de-4402-a46a-eabf3d1fc44e req-a007cbdd-8d84-4304-ab5a-00b023f77102 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:38.641004 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-cd31048b-f9de-4402-a46a-eabf3d1fc44e req-a007cbdd-8d84-4304-ab5a-00b023f77102 service nova] Creating event network-changed:b788c1a0-4c2c-4ec6-a4d2-60464aade7f5 for instance b177db2b-5dce-4f7f-bd92-795622cff08a on n-h2-858383-17 Oct 31 15:51:38.653553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-cd31048b-f9de-4402-a46a-eabf3d1fc44e req-a007cbdd-8d84-4304-ab5a-00b023f77102 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066447 Oct 31 15:51:38.654760 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2846/5813] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:04.731738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:04.732354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:04.743950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:04.745837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:04.755489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:04.756287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:04.757063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:04.758100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:04.758979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:04.759114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:04.877594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lazy-loading 'services' on Instance uuid be34b9a6-3633-47c7-9cd1-1576616055c1 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:52:04.971114 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ecdb7c40-06a4-4a84-b98e-25ad4f8ba6e3 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "DELETE /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1/os-volume_attachments/0fd0be27-25f5-4e07-b61c-6c095b46250e" status: 202 len: 0 microversion: 2.1 time: 0.244391 Oct 31 15:52:04.971944 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2968/5814] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:52:04 2022] DELETE /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1/os-volume_attachments/0fd0be27-25f5-4e07-b61c-6c095b46250e => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:52:08.944135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:08.944679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=34 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:09.192633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:09.194666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:09.201336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:09.201846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:09.202300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:09.203013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:09.203482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:09.204457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:09.230358 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ac3fc2c-9ab9-4114-8330-9156fb1cd923 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/ips" status: 200 len: 151 microversion: 2.1 time: 0.294260 Oct 31 15:52:09.230929 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2847/5815] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Oct 31 15:52:08 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/ips => generated 151 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:10.659947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:10.660958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:10.680374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:10.680994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:10.681382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:10.682256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:10.683062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:10.684084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:10.738059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:52:10.872925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5808596-019b-420f-86d2-1fbbf52d3caa tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "DELETE /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 204 len: 0 microversion: 2.1 time: 0.215473 Oct 31 15:52:10.873865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2969/5816] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:52:10 2022] DELETE /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:52:10.884290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:10.886054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:10.897729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:10.898179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:10.898847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:10.899690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:10.900257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:10.900801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:11.090579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:11.102124 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-455daacc-73be-4bc3-b24b-42efb7822059 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1513 microversion: 2.1 time: 0.221937 Oct 31 15:52:11.102735 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2848/5817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:10 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:11.807856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba991ceb-cb21-42d9-b8bb-eff65b17058e"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:11.811453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:11.826482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:11.827684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:11.828474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:11.830348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:11.831385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:11.832622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:12.131512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:12.141500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:12.156238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:12.156238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:12.157016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:12.157813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:12.158425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:12.159031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:12.315342 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cca1916d-c109-4d94-9112-257d5017f6e8 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "POST /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515697 Oct 31 15:52:12.315971 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2970/5818] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:52:11 2022] POST /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:12.459369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:12.469119 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3485fb6d-9639-4462-b681-b21b5ff5ee5e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1513 microversion: 2.1 time: 0.345245 Oct 31 15:52:12.471109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2849/5819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:12 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:52:13.501501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:13.503633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:13.518065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:13.518769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:13.519413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:13.520370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:13.520970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:13.522333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:13.648915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2896bd5b-535d-40da-aa92-8e2f90382b00 req-75cc2cf3-d95b-4dd7-90c9-33dcf22e75e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be34b9a6-3633-47c7-9cd1-1576616055c1", "name": "network-vif-deleted", "tag": "970dc951-b9fc-49b9-b54f-ad0871c3b692"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:13.663197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2896bd5b-535d-40da-aa92-8e2f90382b00 req-75cc2cf3-d95b-4dd7-90c9-33dcf22e75e0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:13.664045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2896bd5b-535d-40da-aa92-8e2f90382b00 req-75cc2cf3-d95b-4dd7-90c9-33dcf22e75e0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:13.664689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2896bd5b-535d-40da-aa92-8e2f90382b00 req-75cc2cf3-d95b-4dd7-90c9-33dcf22e75e0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:13.696002 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2896bd5b-535d-40da-aa92-8e2f90382b00 req-75cc2cf3-d95b-4dd7-90c9-33dcf22e75e0 service nova] Creating event network-vif-deleted:970dc951-b9fc-49b9-b54f-ad0871c3b692 for instance be34b9a6-3633-47c7-9cd1-1576616055c1 on n-h1-858383-17 Oct 31 15:52:13.702087 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2896bd5b-535d-40da-aa92-8e2f90382b00 req-75cc2cf3-d95b-4dd7-90c9-33dcf22e75e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057311 Oct 31 15:52:13.704750 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2850/5820] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:13.735864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:13.760290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc3b19c1-c91f-4b5e-9edc-486b0c350c87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 200 len: 1471 microversion: 2.1 time: 0.269109 Oct 31 15:52:13.761356 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2971/5821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:13 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:14.803733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:14.804811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: be34b9a6-3633-47c7-9cd1-1576616055c1] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:14.818372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:14.819548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:14.820940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:14.822274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:14.823302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:14.824285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:14.855473 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] HTTP exception thrown: Instance be34b9a6-3633-47c7-9cd1-1576616055c1 could not be found. Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Request method failure captured: Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 HTTP/1.1 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-6gCssaMEPoxze3EAfwdRrh--ebqmh24ts5U-NebpkBduKvbKqb5ciCBRf3_mf8agP-R-0W6577_ATkBrsl6RS2J3qXAQclM4yk03UYRAvu9uKRjwzotDCQzlHC02rBC8PimQLRskicdi1vqsa4bDV5ZKotFezsSnnnGWY2hkA9Z8I Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a2de76361bde49ca878744614a51d9b5 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesSnapshotTestJSON-3607924 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2de76361bde49ca878744614a51d9b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2de76361bde49ca878744614a51d9b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2de76361bde49ca878744614a51d9b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2de76361bde49ca878744614a51d9b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesSnapshotTestJSON-3607924 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a2de76361bde49ca878744614a51d9b5 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-3607924 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesSnapshotTestJSON-3607924-project Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: adc99219465143e2b38869de10ed5ec1 Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesSnapshotTestJSON-3607924-project Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance be34b9a6-3633-47c7-9cd1-1576616055c1 could not be found. Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'be34b9a6-3633-47c7-9cd1-1576616055c1'} Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be34b9a6-3633-47c7-9cd1-1576616055c1 could not be found. Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be34b9a6-3633-47c7-9cd1-1576616055c1 could not be found. Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:14.859306 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be34b9a6-3633-47c7-9cd1-1576616055c1 could not be found. Oct 31 15:52:14.870833 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:14.876952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Returning 404 to user: Instance be34b9a6-3633-47c7-9cd1-1576616055c1 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:14.879720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00056e1c-622e-4126-8362-fc621d346752 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1" status: 404 len: 111 microversion: 2.1 time: 0.090085 Oct 31 15:52:14.887254 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2851/5822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:14 2022] GET /compute/v2.1/servers/be34b9a6-3633-47c7-9cd1-1576616055c1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:52:23.567072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2066991463", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "c20ef085-5b5e-4462-8c54-f8aea3c41691"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:23.576688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:23.641965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] validate_networks() for [('c20ef085-5b5e-4462-8c54-f8aea3c41691', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:52:23.742944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:24.086427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:52:24.086931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:52:24.087487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:52:24.087972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:52:24.088462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:52:24.098318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:24.099095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:24.099623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:24.100462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:24.101036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:24.101538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:24.135900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Getting quotas for project a2de76361bde49ca878744614a51d9b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:52:24.145386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Getting quotas for user adc99219465143e2b38869de10ed5ec1 and project a2de76361bde49ca878744614a51d9b5. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:52:24.183985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:52:24.188490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:52:24.262860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b87039ca-7593-4f02-8c2c-f69cd2612e87 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700188 Oct 31 15:52:24.263690 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2972/5823] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:52:24.287868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e8bfddd-ecd7-4aee-ab09-d577193a4794 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:24.288503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e8bfddd-ecd7-4aee-ab09-d577193a4794 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:24.362941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e8bfddd-ecd7-4aee-ab09-d577193a4794 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:24.372578 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e8bfddd-ecd7-4aee-ab09-d577193a4794 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1219 microversion: 2.1 time: 0.088592 Oct 31 15:52:24.373780 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2852/5824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:24 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:25.402447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:25.403175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:25.410828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:25.411321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:25.411761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:25.412483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:25.413095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:25.413525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:25.481588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:25.490269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6e78c2b-39ce-49fd-ba7f-371fe2338940 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1271 microversion: 2.1 time: 0.092521 Oct 31 15:52:25.490850 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2973/5825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:25 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:25.873851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:25.875769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:25.881568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=20 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:25.884331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:25.885121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:25.885810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:25.901242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:25.901828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:25.902282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:26.030294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lazy-loading 'services' on Instance uuid b177db2b-5dce-4f7f-bd92-795622cff08a {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:52:26.122312 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-783197b3-0d1a-4e98-aee8-919e02ef1e03 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments/ba991ceb-cb21-42d9-b8bb-eff65b17058e" status: 202 len: 0 microversion: 2.1 time: 0.253188 Oct 31 15:52:26.123300 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2853/5826] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:52:25 2022] DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments/ba991ceb-cb21-42d9-b8bb-eff65b17058e => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:52:26.133129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:26.135752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:26.143043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:26.143601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:26.145382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:26.146733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:26.147476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:26.148087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:26.191234 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f823fa8e-9da1-4e63-adc0-158793bc0ebe tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062024 Oct 31 15:52:26.192289 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2974/5827] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:52:26 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:26.520055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:26.521245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:26.529150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:26.530841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:26.531410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:26.532268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:26.533454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:26.533454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:26.762228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:26.775292 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b500f66-6512-4ce9-9c29-5dceab80f99e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.257138 Oct 31 15:52:26.775955 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2854/5828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:26 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:27.204500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:27.212273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:27.232773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:27.233518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:27.234720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:27.238728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:27.239786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:27.247617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:27.320782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c83feaa-595f-435c-b4b2-1d2c5f78d7df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120795 Oct 31 15:52:27.322039 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2975/5829] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:52:27 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:27.673219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a57cea17-6114-4c0b-bceb-826e2b1e154e req-9071659b-92ae-4646-8542-a70e0c29a97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24e8e88-2b43-4a0f-8998-3c776989f36f", "tag": "0f9357ba-7d19-4c1e-b5af-065ab461ac32"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:27.686257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a57cea17-6114-4c0b-bceb-826e2b1e154e req-9071659b-92ae-4646-8542-a70e0c29a97e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:27.687139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a57cea17-6114-4c0b-bceb-826e2b1e154e req-9071659b-92ae-4646-8542-a70e0c29a97e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:27.688552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a57cea17-6114-4c0b-bceb-826e2b1e154e req-9071659b-92ae-4646-8542-a70e0c29a97e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:27.701437 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a57cea17-6114-4c0b-bceb-826e2b1e154e req-9071659b-92ae-4646-8542-a70e0c29a97e service nova] Creating event network-changed:0f9357ba-7d19-4c1e-b5af-065ab461ac32 for instance d24e8e88-2b43-4a0f-8998-3c776989f36f on n-h1-858383-17 Oct 31 15:52:27.726603 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a57cea17-6114-4c0b-bceb-826e2b1e154e req-9071659b-92ae-4646-8542-a70e0c29a97e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057348 Oct 31 15:52:27.729601 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2855/5830] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:27.804790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:27.805967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:27.819462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:27.820092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:27.820736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:27.821681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:27.824662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:27.825488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:28.162266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:28.193658 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f04c2be-704b-4112-bc84-b1f68e780915 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.393309 Oct 31 15:52:28.199181 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2976/5831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:27 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:28.340821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:28.361192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:28.369955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:28.370686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:28.371621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:28.372831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:28.373567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:28.374248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:28.415770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd959020-5101-4f77-a77f-75aed20fb605 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080582 Oct 31 15:52:28.417408 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2856/5832] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:52:28 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:29.241476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:29.245485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:29.264415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:29.264748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:29.267880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:29.270147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:29.270664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:29.271505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:29.428935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:29.444228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:29.453992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:29.454822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:29.455367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:29.456271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:29.457570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:29.458222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:29.504963 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf89d15a-2db1-4591-904f-23fb81d7fa76 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080630 Oct 31 15:52:29.505756 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2857/5833] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:52:29 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:29.516965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:29.544022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6ed9241-aef7-489d-b8a3-7b4ad677069e tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.315705 Oct 31 15:52:29.568660 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2977/5834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:29 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:30.518028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:30.521360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:30.538825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:30.539769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:30.540481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:30.541367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:30.542021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:30.542681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:30.573533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:30.574166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:30.583670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:30.583670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:30.583670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:30.584108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:30.584418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:30.584874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:30.643244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80d31d71-4050-48d4-a9dd-eed0362614db tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129277 Oct 31 15:52:30.649164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2858/5835] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:52:30 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:31.002998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:31.011332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41c30c18-3fec-4609-8eb4-e5f4711ddf21 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.441666 Oct 31 15:52:31.011913 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2978/5836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:30 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:31.660579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:31.664766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:31.673522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:31.674288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:31.674896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:31.675756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:31.676431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:31.677266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:31.741891 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a6a22e7-6a13-4483-bc9c-7c4c5f81eaf9 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086326 Oct 31 15:52:31.749128 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2859/5837] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 15:52:31 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:52:31.826880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:31.827417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:31.836734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:31.837434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:31.837870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:31.838803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:31.839516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:31.840135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:31.871224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:52:32.002698 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f4d324b-bc95-4f2f-b6ad-72a9c0cc4a37 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 204 len: 0 microversion: 2.1 time: 0.179752 Oct 31 15:52:32.003606 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2979/5838] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:52:31 2022] DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:52:32.015009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:32.016120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:32.023778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:32.024540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:32.025283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:32.026176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:32.026820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:32.027570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:32.037396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:32.038162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:32.062734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:32.064185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:32.064906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:32.065645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:32.066491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:32.081701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:32.265770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:32.277416 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9248776-eee6-4d84-a6d5-ac4e128a5016 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1682 microversion: 2.1 time: 0.266204 Oct 31 15:52:32.279570 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2860/5839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:32 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:32.377774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:32.403771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-561eb035-e409-4de9-87c4-7755e3d3169b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.370831 Oct 31 15:52:32.422748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2980/5840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:32 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:52:33.304174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:33.305438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:33.313092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:33.313587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:33.314030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:33.314744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:33.315243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:33.315637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:33.426920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:33.427806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:33.438904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:33.439336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:33.439773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:33.440484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:33.440970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:33.441399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:33.610700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:33.619155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-360074fd-1c15-44d5-90f5-ae30f5f4c30e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1682 microversion: 2.1 time: 0.319184 Oct 31 15:52:33.641432 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2861/5841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:33 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1682 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:33.754197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:33.762092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5e77343-c178-4475-b49f-489ff0308a4c tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.338923 Oct 31 15:52:33.782106 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2981/5842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:33 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:52:33.847982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e3e16908-8e7a-44d9-a024-cdc13914d0f5 req-17b47629-7e43-4fe6-808d-28ebccb04a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24e8e88-2b43-4a0f-8998-3c776989f36f", "name": "network-vif-plugged", "status": "completed", "tag": "0f9357ba-7d19-4c1e-b5af-065ab461ac32"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:33.859828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e3e16908-8e7a-44d9-a024-cdc13914d0f5 req-17b47629-7e43-4fe6-808d-28ebccb04a0e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:33.863464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e3e16908-8e7a-44d9-a024-cdc13914d0f5 req-17b47629-7e43-4fe6-808d-28ebccb04a0e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:33.864191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e3e16908-8e7a-44d9-a024-cdc13914d0f5 req-17b47629-7e43-4fe6-808d-28ebccb04a0e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:33.880456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e3e16908-8e7a-44d9-a024-cdc13914d0f5 req-17b47629-7e43-4fe6-808d-28ebccb04a0e service nova] Creating event network-vif-plugged:0f9357ba-7d19-4c1e-b5af-065ab461ac32 for instance d24e8e88-2b43-4a0f-8998-3c776989f36f on n-h1-858383-17 Oct 31 15:52:33.886120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e3e16908-8e7a-44d9-a024-cdc13914d0f5 req-17b47629-7e43-4fe6-808d-28ebccb04a0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189567 Oct 31 15:52:33.887090 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2862/5843] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:52:34.647423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:34.648630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:34.662625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:34.680900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:34.688527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:34.689296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:34.689899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:34.690777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:34.691442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:34.692026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:34.775916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:34.777080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79fbcb523e324b31b9355301804e5e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c85914a951543f99f9851adbe39784d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:34.781822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-13339b32-b9b8-4243-ba03-b8ddff414fe9 req-b9fea0e9-00aa-4991-bc2f-0f1b1a340bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b177db2b-5dce-4f7f-bd92-795622cff08a", "name": "network-vif-deleted", "tag": "b788c1a0-4c2c-4ec6-a4d2-60464aade7f5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:34.791880 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1af12b05-2b49-43c6-ad98-daedbdf90952 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 200 len: 1615 microversion: 2.1 time: 0.148226 Oct 31 15:52:34.792670 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2982/5844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:34 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 1615 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:34.804986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:34.808019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:34.811726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-13339b32-b9b8-4243-ba03-b8ddff414fe9 req-b9fea0e9-00aa-4991-bc2f-0f1b1a340bfa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:34.818404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-13339b32-b9b8-4243-ba03-b8ddff414fe9 req-b9fea0e9-00aa-4991-bc2f-0f1b1a340bfa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:34.818874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-13339b32-b9b8-4243-ba03-b8ddff414fe9 req-b9fea0e9-00aa-4991-bc2f-0f1b1a340bfa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:34.838043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:34.838767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:34.840796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:34.841844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:34.845303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:34.845947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:34.856406 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-13339b32-b9b8-4243-ba03-b8ddff414fe9 req-b9fea0e9-00aa-4991-bc2f-0f1b1a340bfa service nova] Creating event network-vif-deleted:b788c1a0-4c2c-4ec6-a4d2-60464aade7f5 for instance b177db2b-5dce-4f7f-bd92-795622cff08a on n-h2-858383-17 Oct 31 15:52:34.862604 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-13339b32-b9b8-4243-ba03-b8ddff414fe9 req-b9fea0e9-00aa-4991-bc2f-0f1b1a340bfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091235 Oct 31 15:52:34.863823 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2863/5845] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:35.095437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:35.105447 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6af859fc-c94b-4cac-94c8-5a2518521079 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1319 microversion: 2.1 time: 0.306849 Oct 31 15:52:35.106423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2983/5846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:34 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:35.822167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:35.825176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:35.835740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:35.836602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:35.837417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:35.838401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:35.839414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:35.840447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:35.867213 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a HTTP/1.1 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b177db2b-5dce-4f7f-bd92-795622cff08a'} Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:35.878918 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c590b471-45ad-46e4-b061-44d185be552f tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 404 len: 111 microversion: 2.1 time: 0.064442 Oct 31 15:52:35.884364 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2864/5847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:35 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:52:35.894725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26ff3267-6899-43c7-b179-c755117ef85c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '.version_select at 0x7f5ca12c1c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:35.931659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26ff3267-6899-43c7-b179-c755117ef85c tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412756500" status: 202 len: 0 microversion: 2.1 time: 0.042612 Oct 31 15:52:35.935583 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2984/5848] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 15:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412756500 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:52:36.138253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:36.141715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:36.154830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:36.157507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:36.158231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:36.159561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:36.181765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:36.182160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:36.513858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:52:36.525370 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c67280c-6b91-4098-bf18-d31d1fc39052 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1507 microversion: 2.1 time: 0.396074 Oct 31 15:52:36.526595 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2865/5849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:36 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:52:36.549832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa3bcbfc-cc15-4f6e-99e4-50b1ebbe4801", "device": "/dev/sdb"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:52:36.552853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:36.560180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:36.561292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:36.562013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:36.563139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:36.563832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:36.564481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:36.912796 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee00ab29-476e-4663-8de3-adf8b16dcc6d tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "POST /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367108 Oct 31 15:52:36.916380 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2985/5850] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 15:52:36 2022] POST /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:52:41.239431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:41.240462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:41.247746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=41 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:41.251334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:41.252059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:41.252668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:41.253580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:41.254230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:41.254972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:41.272136 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a HTTP/1.1 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'b177db2b-5dce-4f7f-bd92-795622cff08a'} Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:41.274121 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:41.278465 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92aac81c-458d-411b-8433-c390b935463e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 404 len: 111 microversion: 2.1 time: 0.040153 Oct 31 15:52:41.280749 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2866/5851] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:52:41 2022] DELETE /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:52:41.285107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:41.285861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: b177db2b-5dce-4f7f-bd92-795622cff08a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:41.308661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:41.309235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:41.309683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:41.310411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:41.310879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:41.311319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:41.345918 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a HTTP/1.1 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b177db2b-5dce-4f7f-bd92-795622cff08a'} Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:41.347600 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance b177db2b-5dce-4f7f-bd92-795622cff08a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:41.351302 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3fa72425-5226-4c3a-842a-1bb41662f440 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a" status: 404 len: 111 microversion: 2.1 time: 0.068621 Oct 31 15:52:41.353058 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2986/5852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:41 2022] GET /compute/v2.1/servers/b177db2b-5dce-4f7f-bd92-795622cff08a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:52:46.611877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:46.612517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:46.622625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.623327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.623988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.625004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.625627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.626228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.643251 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 HTTP/1.1 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '5b56dd2f-4de7-44b7-9a19-d804a7879072'} Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:46.645085 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.649516 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.650938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:46.651945 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d75b2312-9103-46fb-a501-d2f046cded0e tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 404 len: 111 microversion: 2.1 time: 0.044818 Oct 31 15:52:46.655995 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2867/5853] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:52:46 2022] DELETE /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:52:46.660860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:46.662026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 5b56dd2f-4de7-44b7-9a19-d804a7879072] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:46.669623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.670320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.671588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.672652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.673312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.673895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.688461 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 HTTP/1.1 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '5b56dd2f-4de7-44b7-9a19-d804a7879072'} Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.690308 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. Oct 31 15:52:46.694847 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.695946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance 5b56dd2f-4de7-44b7-9a19-d804a7879072 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:46.696959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae27a6d5-9237-4cef-841a-c22763c692a3 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072" status: 404 len: 111 microversion: 2.1 time: 0.039913 Oct 31 15:52:46.698024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2987/5854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:46 2022] GET /compute/v2.1/servers/5b56dd2f-4de7-44b7-9a19-d804a7879072 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:52:46.706201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:46.707196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:46.713770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.714544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.715194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.716122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.716850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.717545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.732245 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d HTTP/1.1 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a327958f-0471-4554-a873-c2a08235296d'} Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:46.734713 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.739003 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.742265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:46.743384 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-194fe785-a3d4-452f-9fd9-41af3d812201 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 404 len: 111 microversion: 2.1 time: 0.041630 Oct 31 15:52:46.748933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2868/5855] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:52:46 2022] DELETE /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:52:46.752433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:46.753285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: a327958f-0471-4554-a873-c2a08235296d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:46.767017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.767508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.767946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.768660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:46.769147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:46.769575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:46.802531 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d HTTP/1.1 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a327958f-0471-4554-a873-c2a08235296d'} Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:46.804436 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. Oct 31 15:52:46.809062 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:46.812387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance a327958f-0471-4554-a873-c2a08235296d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:46.813741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b90eccb8-dffb-473d-a1d0-d9fcc2cbe042 tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d" status: 404 len: 111 microversion: 2.1 time: 0.065184 Oct 31 15:52:46.831293 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2988/5856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:46 2022] GET /compute/v2.1/servers/a327958f-0471-4554-a873-c2a08235296d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:52:52.266644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:52.267151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:52.274090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:52.274576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:52.275012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:52.275703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:52.276159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:52.276585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:52.292470 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 HTTP/1.1 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8'} Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:52.294089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2ed9951-5858-4961-a19a-0eddb4a473df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 404 len: 111 microversion: 2.1 time: 0.032994 Oct 31 15:52:52.302787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2869/5857] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:52:52 2022] DELETE /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:52:52.304217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:52:52.304851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] [instance: 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:52:52.312401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:52.312926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:52.313363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:52.314068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:52:52.314672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:52:52.315105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:52:52.319565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:52:52.591076 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] HTTP exception thrown: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Request method failure captured: Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 HTTP/1.1 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-3kfguXvlJrWAgnjTnSG_D2CwDXOJ09KW24VzNL0pz0E7Ygi5RkoCXL8VVLZ7YPUFFWUREliy4w6ovQnRcB0AO7gupHlwBaYqejBZCX2KhL_lbfdlcSvSTzbUuOExIVElBSL0rXP48XK3JFRVkAqCBAnv-8_kJbT8IXCHLF7ksJ6_U Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c85914a951543f99f9851adbe39784d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c85914a951543f99f9851adbe39784d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c85914a951543f99f9851adbe39784d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 4c85914a951543f99f9851adbe39784d Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-775943138 Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 79fbcb523e324b31b9355301804e5e5f Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-775943138-project Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8'} Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:52:52.592960 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] Returning 404 to user: Instance 37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:52:52.598223 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85835807-a095-4959-9a6f-67c5fcef89df tempest-AttachVolumeNegativeTest-775943138 tempest-AttachVolumeNegativeTest-775943138-project] 10.222.0.48 "GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8" status: 404 len: 111 microversion: 2.1 time: 0.294032 Oct 31 15:52:52.598856 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2989/5858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:52:52 2022] GET /compute/v2.1/servers/37849d8a-e5c8-49a1-9ce1-3d537ea7ffe8 => generated 111 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:53:08.007924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:08.009362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:08.013451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:08.014593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:08.018810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:08.020116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:08.021126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:08.022176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:08.023028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:08.023646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:08.176459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lazy-loading 'services' on Instance uuid d24e8e88-2b43-4a0f-8998-3c776989f36f {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:53:08.316863 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d50e25fd-e0ca-4e59-addd-85edb10ef120 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f/os-volume_attachments/aa3bcbfc-cc15-4f6e-99e4-50b1ebbe4801" status: 202 len: 0 microversion: 2.1 time: 0.313177 Oct 31 15:53:08.330970 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2870/5859] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 15:53:08 2022] DELETE /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f/os-volume_attachments/aa3bcbfc-cc15-4f6e-99e4-50b1ebbe4801 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:53:13.988122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:13.990518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:13.998953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:14.005558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:14.006237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:14.006965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:14.007932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:14.008579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:14.009176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:14.039786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:53:14.139611 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd46b8e2-3d68-4ece-b6b6-424e0b7a7fb7 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 204 len: 0 microversion: 2.1 time: 0.154779 Oct 31 15:53:14.140384 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2990/5860] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:53:13 2022] DELETE /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:53:14.150230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:14.150933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:14.159085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:14.159595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:14.160052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:14.160889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:14.161360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:14.161792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:14.354959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:14.372271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee3233a1-b6dc-4b56-adca-845ea2b1b11b tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1513 microversion: 2.1 time: 0.227151 Oct 31 15:53:14.374200 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2871/5861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:14 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:15.402966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:15.404330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:15.412835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:15.413714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:15.414361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:15.415346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:15.415917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:15.416584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:15.680653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:15.696799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c984b00-8e57-411b-8a77-c7fb1cb92eda tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1513 microversion: 2.1 time: 0.298243 Oct 31 15:53:15.717058 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2991/5862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:15 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:16.591537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2a3345c8-7dba-44a5-b686-bb9206d07889 req-f8c7239f-2c2b-4cb4-a738-312e8dc15672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24e8e88-2b43-4a0f-8998-3c776989f36f", "name": "network-vif-deleted", "tag": "0f9357ba-7d19-4c1e-b5af-065ab461ac32"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:16.603870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a3345c8-7dba-44a5-b686-bb9206d07889 req-f8c7239f-2c2b-4cb4-a738-312e8dc15672 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:16.604389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a3345c8-7dba-44a5-b686-bb9206d07889 req-f8c7239f-2c2b-4cb4-a738-312e8dc15672 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:16.604835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a3345c8-7dba-44a5-b686-bb9206d07889 req-f8c7239f-2c2b-4cb4-a738-312e8dc15672 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:16.618477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2a3345c8-7dba-44a5-b686-bb9206d07889 req-f8c7239f-2c2b-4cb4-a738-312e8dc15672 service nova] Creating event network-vif-deleted:0f9357ba-7d19-4c1e-b5af-065ab461ac32 for instance d24e8e88-2b43-4a0f-8998-3c776989f36f on n-h1-858383-17 Oct 31 15:53:16.625698 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2a3345c8-7dba-44a5-b686-bb9206d07889 req-f8c7239f-2c2b-4cb4-a738-312e8dc15672 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041423 Oct 31 15:53:16.627771 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2872/5863] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:53:16.725414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:16.726100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:16.734772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:16.735271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:16.735900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:16.736618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:16.737112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:16.737539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:16.772031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:16.772530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:16.773061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:16.773615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lazy-loading 'fault' on Instance uuid d24e8e88-2b43-4a0f-8998-3c776989f36f {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:53:16.836868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adc99219465143e2b38869de10ed5ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2de76361bde49ca878744614a51d9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:16.846027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d21fab89-ebe2-442f-bf02-2aa90830d322 tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 200 len: 1309 microversion: 2.1 time: 0.124337 Oct 31 15:53:16.846676 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2992/5864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:16 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:17.871409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:17.872911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] [instance: d24e8e88-2b43-4a0f-8998-3c776989f36f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:17.879369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:17.879963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:17.880465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:17.881256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:17.881786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:17.882405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:17.898190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] HTTP exception thrown: Instance d24e8e88-2b43-4a0f-8998-3c776989f36f could not be found. Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Request method failure captured: Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f HTTP/1.1 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX-6gCssaMEPoxze3EAfwdRrh--ebqmh24ts5U-NebpkBduKvbKqb5ciCBRf3_mf8agP-R-0W6577_ATkBrsl6RS2J3qXAQclM4yk03UYRAvu9uKRjwzotDCQzlHC02rBC8PimQLRskicdi1vqsa4bDV5ZKotFezsSnnnGWY2hkA9Z8I Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: a2de76361bde49ca878744614a51d9b5 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-VolumesSnapshotTestJSON-3607924 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2de76361bde49ca878744614a51d9b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2de76361bde49ca878744614a51d9b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2de76361bde49ca878744614a51d9b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2de76361bde49ca878744614a51d9b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-VolumesSnapshotTestJSON-3607924 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: a2de76361bde49ca878744614a51d9b5 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-3607924 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-VolumesSnapshotTestJSON-3607924-project Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: adc99219465143e2b38869de10ed5ec1 Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-VolumesSnapshotTestJSON-3607924-project Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance d24e8e88-2b43-4a0f-8998-3c776989f36f could not be found. Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'd24e8e88-2b43-4a0f-8998-3c776989f36f'} Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24e8e88-2b43-4a0f-8998-3c776989f36f could not be found. Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24e8e88-2b43-4a0f-8998-3c776989f36f could not be found. Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:53:17.900107 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24e8e88-2b43-4a0f-8998-3c776989f36f could not be found. Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] Returning 404 to user: Instance d24e8e88-2b43-4a0f-8998-3c776989f36f could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:53:17.905113 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9db3a1e6-cf60-40e9-aa0f-654675210c4a tempest-VolumesSnapshotTestJSON-3607924 tempest-VolumesSnapshotTestJSON-3607924-project] 10.222.0.48 "GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f" status: 404 len: 111 microversion: 2.1 time: 0.036450 Oct 31 15:53:17.913362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2873/5865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:17 2022] GET /compute/v2.1/servers/d24e8e88-2b43-4a0f-8998-3c776989f36f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:54:47.183572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:47.185018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:47.187100 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 15:54:47.187248 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 15:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 31 15:54:47.194048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1936510986", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "679a42f5-b580-4774-8ab5-a911b43f4942", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:47.354217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:54:48.305403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:54:48.306050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:54:48.306441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:54:48.306860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:54:48.307301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:54:48.317379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:48.317861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:48.318302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:48.319034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:48.319498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:48.319928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:48.339435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:54:48.345696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:54:48.416484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:54:48.444661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='679a42f5-b580-4774-8ab5-a911b43f4942',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:54:48.640815 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ff4e91a-52c4-45c6-a260-fb31ee306bc8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456604 Oct 31 15:54:48.642035 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2993/5866] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:54:48.652133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:48.652921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:48.654104 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:54:48.654104 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 15:54:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea (ip 10.222.0.48) !!! Oct 31 15:54:48.654919 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:54:48.655404 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 15:54:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea (ip 10.222.0.48) !!! Oct 31 15:54:48.660209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a9873e5-1194-4712-99df-acc263fcf495 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:48.661650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7a9873e5-1194-4712-99df-acc263fcf495 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:48.756573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-723262926", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:48.812573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a9873e5-1194-4712-99df-acc263fcf495 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:48.822254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a9873e5-1194-4712-99df-acc263fcf495 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1057 microversion: 2.1 time: 0.172043 Oct 31 15:54:48.823400 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2874/5867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:48 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1057 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:48.868853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:54:49.292774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:54:49.293465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:54:49.293954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:54:49.294376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:54:49.294789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:54:49.305515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:49.306146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:49.307281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:49.308208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:49.308790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:49.309477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:49.341627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Getting quotas for project 301e701ed7b64ff384e7f87d6fd465f4. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:54:49.348402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Getting quotas for user 3920e58d36d04e708731ba070b2d59ad and project 301e701ed7b64ff384e7f87d6fd465f4. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:54:49.369365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:54:49.371770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:54:49.431720 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdfac611-4751-45e7-83b9-296cb19497ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679467 Oct 31 15:54:49.432615 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2994/5868] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:54:49.443858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9c629da-2fb5-459b-a2da-cf6d08b2696e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:49.444485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9c629da-2fb5-459b-a2da-cf6d08b2696e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:49.537380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c9c629da-2fb5-459b-a2da-cf6d08b2696e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:49.550816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9c629da-2fb5-459b-a2da-cf6d08b2696e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1214 microversion: 2.1 time: 0.110769 Oct 31 15:54:49.552031 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2875/5869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:49 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:49.850256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:49.851220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:49.861134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:49.865061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:49.865708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:49.866426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:49.866887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:49.867875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:49.952572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:49.963559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d2e3655-0ae7-43af-b523-9d0cf0fd1efd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1155 microversion: 2.1 time: 0.117088 Oct 31 15:54:49.964122 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2995/5870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:49 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1155 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:50.575825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:50.576459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:50.600725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:50.602702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:50.604755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:50.606248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:50.607125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:50.607971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:50.751431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:50.766053 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd313ced-a121-4c32-9b4a-994ea6591761 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1266 microversion: 2.1 time: 0.193748 Oct 31 15:54:50.767404 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2876/5871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:50 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:50.987562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:50.996323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:51.014896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.015851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.016788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:51.018235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.018930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.019610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:51.180016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:51.198307 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-edfd6e23-8638-4b09-b9e7-f5b59aa7ab74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1173 microversion: 2.1 time: 0.212965 Oct 31 15:54:51.199142 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2996/5872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:50 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1173 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:54:51.792605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:51.793477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:51.815054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.815843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.816310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:51.817110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.817582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.818023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:52.193421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:52.203346 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50ecadc0-f8c3-4493-8b79-7ba2110cd933 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1272 microversion: 2.1 time: 0.415391 Oct 31 15:54:52.220313 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2877/5873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:51 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:52.227814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:52.228832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:52.236172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:52.237038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:52.237641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:52.238530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:52.243957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:52.244642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:52.749866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:52.758790 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71e22e21-df2b-4efd-8201-8adc853f794b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1215 microversion: 2.1 time: 0.534934 Oct 31 15:54:52.759610 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2997/5874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:52 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1215 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:53.232132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:53.232927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:53.244494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:53.245313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:53.246377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:53.247326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:53.248009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:53.248823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:53.403029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:53.411778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bc9cd3c6-1c67-4233-88fd-422ee308ef0e tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1272 microversion: 2.1 time: 0.184401 Oct 31 15:54:53.414124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2878/5875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:53 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:53.787132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:53.787764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:53.807559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:53.807925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:53.808488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:53.821356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:53.822158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:53.822801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:54.264669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:54.280486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e662a84d-5a7d-4880-bca5-b863ec9d9c69 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1215 microversion: 2.1 time: 0.502136 Oct 31 15:54:54.281117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2998/5876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:53 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1215 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:54.444438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:54.445430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:54.456239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:54.456753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:54.457192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:54.457897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:54.458355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:54.458823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:55.056747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9becf764-4edd-4b8e-961e-5d2d6dccbe61 req-e6f5fec0-5ec6-4889-a1c2-0e8293ac49fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb967bbe-36e6-44d3-b8e4-9990559aa0ea", "tag": "92341369-7b44-48ae-bb3c-27ef02f60b79"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:55.071379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9becf764-4edd-4b8e-961e-5d2d6dccbe61 req-e6f5fec0-5ec6-4889-a1c2-0e8293ac49fc service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:55.072221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9becf764-4edd-4b8e-961e-5d2d6dccbe61 req-e6f5fec0-5ec6-4889-a1c2-0e8293ac49fc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:55.072908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9becf764-4edd-4b8e-961e-5d2d6dccbe61 req-e6f5fec0-5ec6-4889-a1c2-0e8293ac49fc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:55.085252 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9becf764-4edd-4b8e-961e-5d2d6dccbe61 req-e6f5fec0-5ec6-4889-a1c2-0e8293ac49fc service nova] Creating event network-changed:92341369-7b44-48ae-bb3c-27ef02f60b79 for instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea on n-h1-858383-17 Oct 31 15:54:55.091663 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9becf764-4edd-4b8e-961e-5d2d6dccbe61 req-e6f5fec0-5ec6-4889-a1c2-0e8293ac49fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040223 Oct 31 15:54:55.093006 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2999/5877] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:55.201174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:55.209277 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-497af459-1668-4a7a-aa0c-2a10aa09b4ba tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.768608 Oct 31 15:54:55.209880 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2879/5878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:54 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:55.304837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:55.305894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:55.312575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:55.313480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:55.313927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:55.314645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:55.315113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:55.315546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:55.659589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:55.667759 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cda36090-649c-4770-87a0-e2990b224a2b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1215 microversion: 2.1 time: 0.367824 Oct 31 15:54:55.668572 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3000/5879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:55 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:56.233762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:56.234976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:56.242735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.243545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.244180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.245133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.245812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.246433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.627212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:56.642784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b94427b8-e7d8-4f3e-bfca-bdd288c97814 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.412782 Oct 31 15:54:56.659939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2880/5880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:56 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:56.691700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:56.695361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:56.704318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.705812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.706554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.708574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.709256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.709857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:57.135678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:57.135859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a83a294e-ad6e-4eb8-86a8-794393b89be3 req-ce6e7e5d-baea-488f-a62a-0571f50b0fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7fed9e-9128-48f2-9c0e-5655c506fef4", "tag": "1f406a46-4e82-40d8-95f5-9768b877a30f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:57.152071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48ba7ccb-e000-4359-966f-d451b9135234 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1215 microversion: 2.1 time: 0.464512 Oct 31 15:54:57.178089 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3001/5881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:56 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1215 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:57.187186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a83a294e-ad6e-4eb8-86a8-794393b89be3 req-ce6e7e5d-baea-488f-a62a-0571f50b0fd3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:57.189322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a83a294e-ad6e-4eb8-86a8-794393b89be3 req-ce6e7e5d-baea-488f-a62a-0571f50b0fd3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:57.189889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a83a294e-ad6e-4eb8-86a8-794393b89be3 req-ce6e7e5d-baea-488f-a62a-0571f50b0fd3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:57.220230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a83a294e-ad6e-4eb8-86a8-794393b89be3 req-ce6e7e5d-baea-488f-a62a-0571f50b0fd3 service nova] Creating event network-changed:1f406a46-4e82-40d8-95f5-9768b877a30f for instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 on n-h1-858383-17 Oct 31 15:54:57.239788 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a83a294e-ad6e-4eb8-86a8-794393b89be3 req-ce6e7e5d-baea-488f-a62a-0571f50b0fd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119177 Oct 31 15:54:57.241633 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2881/5882] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:54:57.667962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:57.668591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:57.674972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:57.675710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:57.676359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:57.677111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:57.677577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:57.678008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:57.820865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:57.828932 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea634d6d-c441-42a2-81d8-308413aa1528 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.165144 Oct 31 15:54:57.829616 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3002/5883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:57 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:58.193553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:58.194281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:58.203423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:58.204177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:58.205192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:58.206147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:58.206848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:58.207494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:58.369988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:58.381033 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8c5245c-2d7e-4fb9-bc68-40f16d0f9fda tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1215 microversion: 2.1 time: 0.193068 Oct 31 15:54:58.382967 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2882/5884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:58 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:58.853674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:58.854447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:58.862589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:58.863171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:58.863700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:58.864481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:58.865047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:58.865962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:59.115271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:59.125276 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d87e129-d567-414b-87b0-fecf59c395d6 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.276486 Oct 31 15:54:59.126509 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3003/5885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:58 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:59.407488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:59.409318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:59.423643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:59.424652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:59.425461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:59.426580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:59.427260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:59.428073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:59.545631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:59.974152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:59.982946 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90d2ffc0-6332-41b5-a905-f7deed3cf9fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.581019 Oct 31 15:54:59.983537 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2883/5886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:59 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:00.151396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:00.153559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:00.160098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:00.161523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:00.166790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:00.177604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:00.178074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:00.179163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:00.181939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:00.182565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:00.444486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:00.454470 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01055a59-8cb1-497b-b2a6-905d4b8c37ad tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.309440 Oct 31 15:55:00.455410 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3004/5887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:00 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:01.007499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:01.009251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:01.023490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:01.024334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:01.025088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:01.026032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:01.026726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:01.027390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:01.274186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:01.282378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cee29185-ffde-45f5-ad16-2e56652274fa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.279535 Oct 31 15:55:01.283345 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2884/5888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:01 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:01.479752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:01.480816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:01.487602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:01.488102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:01.488527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:01.489432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:01.490055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:01.490778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:01.637239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:01.647396 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57f45661-8578-4957-9ae6-220c9d17fead tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.173348 Oct 31 15:55:01.648373 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3005/5889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:01 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:02.235568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-94cfc63f-1d82-42a4-9040-d64cd27ecab2 req-bb33e5b6-38d8-4e28-bf39-6611f0a6b378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7fed9e-9128-48f2-9c0e-5655c506fef4", "name": "network-vif-plugged", "status": "completed", "tag": "1f406a46-4e82-40d8-95f5-9768b877a30f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:02.256832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-94cfc63f-1d82-42a4-9040-d64cd27ecab2 req-bb33e5b6-38d8-4e28-bf39-6611f0a6b378 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:02.257609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-94cfc63f-1d82-42a4-9040-d64cd27ecab2 req-bb33e5b6-38d8-4e28-bf39-6611f0a6b378 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:02.258058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-94cfc63f-1d82-42a4-9040-d64cd27ecab2 req-bb33e5b6-38d8-4e28-bf39-6611f0a6b378 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:02.297253 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-94cfc63f-1d82-42a4-9040-d64cd27ecab2 req-bb33e5b6-38d8-4e28-bf39-6611f0a6b378 service nova] Creating event network-vif-plugged:1f406a46-4e82-40d8-95f5-9768b877a30f for instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 on n-h1-858383-17 Oct 31 15:55:02.303490 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-94cfc63f-1d82-42a4-9040-d64cd27ecab2 req-bb33e5b6-38d8-4e28-bf39-6611f0a6b378 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071958 Oct 31 15:55:02.304232 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2885/5890] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:02.307883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:02.312778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:02.324908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:02.325491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:02.326062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:02.326794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:02.327773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:02.328216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:02.550810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:02.558748 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16a70eae-0874-4359-9d81-ab3b3149125c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.256682 Oct 31 15:55:02.559334 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3006/5891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:02 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:02.676646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:02.678079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:02.688026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:02.689504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:02.690030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:02.690827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:02.691370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:02.691878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:02.854327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:02.863038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f0a18cc8-37ce-4f04-8bdb-1939082faf4a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.195261 Oct 31 15:55:02.863623 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2886/5892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:02 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:03.583204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:03.584398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:03.593527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:03.593640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:03.594004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:03.594704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:03.595168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:03.595592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:03.743388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:03.752871 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0a89de9-08fd-479b-9c73-e64f5afd4edb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.173688 Oct 31 15:55:03.753948 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3007/5893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:03 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:03.888729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:03.890016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:03.903377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:03.904151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:03.904823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:03.905743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:03.908122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:03.908780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:04.097888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:04.108784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-54cdac76-67c2-4547-b2ed-295b8ca65c52 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1314 microversion: 2.1 time: 0.223757 Oct 31 15:55:04.109936 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2887/5894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:03 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:04.776637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:04.777279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:04.784643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:04.785247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:04.785759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:04.786533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:04.787088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:04.787625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:04.936181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:04.944990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f75ad7a-3c30-432f-ad6f-1f678a1af30e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.172198 Oct 31 15:55:04.946763 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3008/5895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:04 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:05.133414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:05.134164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:05.140759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.141384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.141928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.142990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.143569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.144115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.362373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:05.370609 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-683710cc-8819-4a5f-af38-29d1644a1c85 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1463 microversion: 2.1 time: 0.241261 Oct 31 15:55:05.371590 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2888/5896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:05 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:05.430115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:05.430898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:05.440652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.441267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.441817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.442546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.443017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.443452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.472370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:55:05.537117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:05.577735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-342fae41-ceb8-4f86-8f54-62ab04541e27 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 204 len: 0 microversion: 2.1 time: 0.154267 Oct 31 15:55:05.578513 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3009/5897] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:55:05 2022] DELETE /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:55:05.587825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:05.588878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:05.595545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.596339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.596991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.597897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.598610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.599213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.880017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:05.894130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd3c6a28-9d36-4749-99a3-802d733fc83d tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1469 microversion: 2.1 time: 0.310467 Oct 31 15:55:05.895986 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2889/5898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:05 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:05.969954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:05.971367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:05.979752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.980577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.981497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:05.982478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:05.983170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:05.983815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:06.393481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:06.404122 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3f49071-66b7-4468-8937-7db527e26710 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.438394 Oct 31 15:55:06.416727 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3010/5899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:05 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:06.921453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:06.922239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:06.928418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:06.929895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:06.930459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:06.931396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:06.932109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:06.932798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:07.084521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:07.093374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6df16396-2201-484b-9d5e-50a6c6d1969a tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1469 microversion: 2.1 time: 0.176969 Oct 31 15:55:07.104363 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2890/5900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:06 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:07.432553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:07.434092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:07.441842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:07.442372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:07.442995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:07.444034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:07.445427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:07.446218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:07.642047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:07.653934 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-087c4faa-63f0-4507-a7fc-16c1e6351257 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.226733 Oct 31 15:55:07.654574 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3011/5901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:07 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:08.117741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:08.119121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:08.126567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:08.127314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:08.127893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:08.128926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:08.129572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:08.130150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:08.436719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:08.460990 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a75e6220-3386-4739-8028-3eb065794162 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1469 microversion: 2.1 time: 0.346029 Oct 31 15:55:08.461949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2891/5902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:08 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:08.683821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:08.690930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:08.717165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:08.722353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:08.722811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:08.723559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:08.724022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:08.725357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:08.777157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3fc114d1-ff2a-4363-8cbf-a957d9b96899 req-9e48828f-bed8-4030-9201-4fe8bf647bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7fed9e-9128-48f2-9c0e-5655c506fef4", "name": "network-vif-deleted", "tag": "1f406a46-4e82-40d8-95f5-9768b877a30f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:08.790320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3fc114d1-ff2a-4363-8cbf-a957d9b96899 req-9e48828f-bed8-4030-9201-4fe8bf647bc0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:08.791085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3fc114d1-ff2a-4363-8cbf-a957d9b96899 req-9e48828f-bed8-4030-9201-4fe8bf647bc0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:08.791705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3fc114d1-ff2a-4363-8cbf-a957d9b96899 req-9e48828f-bed8-4030-9201-4fe8bf647bc0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:08.828471 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3fc114d1-ff2a-4363-8cbf-a957d9b96899 req-9e48828f-bed8-4030-9201-4fe8bf647bc0 service nova] Creating event network-vif-deleted:1f406a46-4e82-40d8-95f5-9768b877a30f for instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 on n-h1-858383-17 Oct 31 15:55:08.840373 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3fc114d1-ff2a-4363-8cbf-a957d9b96899 req-9e48828f-bed8-4030-9201-4fe8bf647bc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068071 Oct 31 15:55:08.845182 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2892/5903] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:55:08.951754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:08.964376 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa734bab-934b-4bcd-bb7a-082a30a56bab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.286546 Oct 31 15:55:08.965029 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3012/5904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:08 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:09.486510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:09.487379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:09.496073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:09.496733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:09.497330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:09.498151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:09.498712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:09.499238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:09.543476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:09.544150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:09.544802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:09.545406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lazy-loading 'fault' on Instance uuid fe7fed9e-9128-48f2-9c0e-5655c506fef4 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:55:09.603910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3920e58d36d04e708731ba070b2d59ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e701ed7b64ff384e7f87d6fd465f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:09.614210 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb2aa54c-4666-4e08-a22d-4f6245d68175 tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 200 len: 1304 microversion: 2.1 time: 0.132150 Oct 31 15:55:09.615242 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2893/5905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:09 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:09.992148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:09.992786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:09.999877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:10.000369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:10.000833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:10.001538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:10.002003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:10.003087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:10.155187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:10.165588 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0500b13-7abe-45e1-a446-c544a707b938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.177840 Oct 31 15:55:10.166455 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3013/5906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:09 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:55:10.266212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-34a934f7-00d7-4488-b105-30f8870f86b3 req-9503c178-3cbd-472e-8e19-0bdd5daa30ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb967bbe-36e6-44d3-b8e4-9990559aa0ea", "name": "network-vif-plugged", "status": "completed", "tag": "92341369-7b44-48ae-bb3c-27ef02f60b79"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:10.281024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-34a934f7-00d7-4488-b105-30f8870f86b3 req-9503c178-3cbd-472e-8e19-0bdd5daa30ea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:10.281833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-34a934f7-00d7-4488-b105-30f8870f86b3 req-9503c178-3cbd-472e-8e19-0bdd5daa30ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:10.282714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-34a934f7-00d7-4488-b105-30f8870f86b3 req-9503c178-3cbd-472e-8e19-0bdd5daa30ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:10.288306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:10.299775 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-34a934f7-00d7-4488-b105-30f8870f86b3 req-9503c178-3cbd-472e-8e19-0bdd5daa30ea service nova] Creating event network-vif-plugged:92341369-7b44-48ae-bb3c-27ef02f60b79 for instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea on n-h1-858383-17 Oct 31 15:55:10.306675 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-34a934f7-00d7-4488-b105-30f8870f86b3 req-9503c178-3cbd-472e-8e19-0bdd5daa30ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046089 Oct 31 15:55:10.307843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2894/5907] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:10.638745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:10.639637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] [instance: fe7fed9e-9128-48f2-9c0e-5655c506fef4] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:10.646627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:10.647939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:10.648382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:10.649128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:10.649599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:10.650159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:10.664216 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] HTTP exception thrown: Instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 could not be found. Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Request method failure captured: Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 HTTP/1.1 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX-_FiZGENOb1xypy78h1ZbLJL0MkH-QtarzUmDXE21eZTO9qbL0rrwpI8YfNiqPnEIdn8mMcC0ZNNUfckMS3FkmN8d10gPX7uUEjdQni7Gh4n3PRgwZvCm8Nib8uwyY9Kf_bAF577-rVFKIyfATs9p5f7knVjeSDnQ_K2quhf26OFxA Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 301e701ed7b64ff384e7f87d6fd465f4 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-252076978 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/301e701ed7b64ff384e7f87d6fd465f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/301e701ed7b64ff384e7f87d6fd465f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_301e701ed7b64ff384e7f87d6fd465f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/301e701ed7b64ff384e7f87d6fd465f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-252076978 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 301e701ed7b64ff384e7f87d6fd465f4 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-252076978 Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-252076978-project Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 3920e58d36d04e708731ba070b2d59ad Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-252076978-project Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 could not be found. Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'fe7fed9e-9128-48f2-9c0e-5655c506fef4'} Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 could not be found. Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 could not be found. Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:55:10.666637 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 could not be found. Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] Returning 404 to user: Instance fe7fed9e-9128-48f2-9c0e-5655c506fef4 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48c650c3-8dd1-4217-a7b6-feb7b8eb378c tempest-VolumesNegativeTest-252076978 tempest-VolumesNegativeTest-252076978-project] 10.222.0.48 "GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4" status: 404 len: 111 microversion: 2.1 time: 0.033233 Oct 31 15:55:10.670971 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3014/5908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:10 2022] GET /compute/v2.1/servers/fe7fed9e-9128-48f2-9c0e-5655c506fef4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:55:11.188941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:11.190533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:11.201394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:11.202284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:11.203158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:11.204765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:11.205834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:11.206491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:11.469713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:11.478623 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a1ed494-c480-4c7c-9512-def78d971bf5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1203 microversion: 2.1 time: 0.294047 Oct 31 15:55:11.480016 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2895/5909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:11 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1203 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:12.505522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:12.507286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:12.520318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:12.521369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:12.522052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:12.522981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:12.523891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:12.524641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:12.763307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:12.772688 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f430678-b0cc-4761-aa90-60cf0c716d31 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1390 microversion: 2.1 time: 0.271165 Oct 31 15:55:12.773614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3015/5910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:12 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:55:12.800280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:12.801080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:12.810547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:12.811041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:12.811480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:12.812182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:12.812634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:12.814605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:12.998707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:13.017035 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3f6461b-1473-4aaa-b85f-e85973f98ba5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1390 microversion: 2.1 time: 0.220972 Oct 31 15:55:13.017638 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2896/5911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:12 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:13.045422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:13.047035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:13.055353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:13.056082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:13.056732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:13.057613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:13.073980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:13.075162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:13.410746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:13.423433 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51a97b85-d7a4-404f-81df-9966acf63a7b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1390 microversion: 2.1 time: 0.384219 Oct 31 15:55:13.425690 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3016/5912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:13 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1390 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:13.452722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:13.453226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:13.460278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:13.460795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:13.461235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:13.461938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:13.462397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:13.462826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:13.503990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:55:13.619413 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa1c60ec-1146-469d-9916-3af8ce43f439 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 204 len: 0 microversion: 2.1 time: 0.169440 Oct 31 15:55:13.624762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2897/5913] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:55:13 2022] DELETE /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:55:13.632807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:13.634069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:13.643551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:13.644324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:13.645009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:13.646126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:13.646707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:13.647707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:13.870016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:13.879668 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab84dd91-9459-448b-b844-1c9a227d5eb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1396 microversion: 2.1 time: 0.252522 Oct 31 15:55:13.880492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3017/5914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:13 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1396 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:14.907357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:14.909636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:14.919292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:14.920914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:14.921521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:14.922404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:14.923053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:14.923636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:15.274203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:15.285395 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4667939-e07a-4f06-9042-c170d07186c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1396 microversion: 2.1 time: 0.380010 Oct 31 15:55:15.291163 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2898/5915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:14 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1396 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:16.315710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:16.317743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:16.331403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:16.337579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:16.338367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:16.339363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:16.340056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:16.340735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:16.567545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7ace113c-e74f-4cb0-a100-f9a663cebc53 req-fba65efc-2252-43f5-88a6-bd76b66fbf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb967bbe-36e6-44d3-b8e4-9990559aa0ea", "name": "network-vif-deleted", "tag": "92341369-7b44-48ae-bb3c-27ef02f60b79"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:16.586642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:16.594250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7ace113c-e74f-4cb0-a100-f9a663cebc53 req-fba65efc-2252-43f5-88a6-bd76b66fbf9a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:16.594997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7ace113c-e74f-4cb0-a100-f9a663cebc53 req-fba65efc-2252-43f5-88a6-bd76b66fbf9a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:16.595616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7ace113c-e74f-4cb0-a100-f9a663cebc53 req-fba65efc-2252-43f5-88a6-bd76b66fbf9a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:16.597289 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33d19e8e-5c1a-4185-a54a-66ef1517bf00 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1354 microversion: 2.1 time: 0.286712 Oct 31 15:55:16.600350 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3018/5916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:16 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1354 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:16.610212 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7ace113c-e74f-4cb0-a100-f9a663cebc53 req-fba65efc-2252-43f5-88a6-bd76b66fbf9a service nova] Creating event network-vif-deleted:92341369-7b44-48ae-bb3c-27ef02f60b79 for instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea on n-h1-858383-17 Oct 31 15:55:16.624177 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7ace113c-e74f-4cb0-a100-f9a663cebc53 req-fba65efc-2252-43f5-88a6-bd76b66fbf9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059639 Oct 31 15:55:16.626640 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2899/5917] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:55:17.627146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:17.628134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:17.644383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:17.647746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:17.648619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:17.649659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:17.652411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:17.653399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:17.654055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:17.961295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:17.973703 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f542dec-db28-4172-99f1-378389f9b613 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1188 microversion: 2.1 time: 0.352619 Oct 31 15:55:17.982656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3019/5918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:17 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:19.012634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:19.014557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:19.021413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:19.039114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:19.043654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:19.043654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:19.048658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:19.051583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:19.053250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:19.312303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:19.338465 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee73d9a8-cc4d-4c95-b1dd-4dbd485ca02f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1188 microversion: 2.1 time: 0.333286 Oct 31 15:55:19.380861 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2900/5919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:19 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1188 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:20.380206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:20.381556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:20.395632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:20.398644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:20.399652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:20.403558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:20.405294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:20.406327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:20.704939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:20.721583 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e85e8b0-8189-4013-847f-217b948e227d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1188 microversion: 2.1 time: 0.345235 Oct 31 15:55:20.724747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3020/5920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:20 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:21.750000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:21.751246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:21.766779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:21.767968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:21.768643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:21.770259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:21.770895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:21.773256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:21.926317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:21.936670 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b800960a-ad33-4176-8808-057a2c3541c0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1188 microversion: 2.1 time: 0.191084 Oct 31 15:55:21.960455 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2901/5921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:21 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1188 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:22.969900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:22.970571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:22.984583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:22.985333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:22.985982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:22.991771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:22.992409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:22.992978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:23.113250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:23.126551 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a2e5959-30bd-4894-a976-a06278592119 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1188 microversion: 2.1 time: 0.162727 Oct 31 15:55:23.127841 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3021/5922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:22 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1188 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:24.155914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:24.156383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:24.166018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:24.174521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:24.175154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:24.176068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:24.176722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:24.181447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:24.390272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:24.400992 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c00070d9-4e09-4439-a684-fd290f721c51 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 200 len: 1188 microversion: 2.1 time: 0.251060 Oct 31 15:55:24.407888 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2902/5923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:24 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 1188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:25.432304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:25.433091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: fb967bbe-36e6-44d3-b8e4-9990559aa0ea] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:25.446347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:25.446850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:25.447291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:25.448011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:25.457911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:25.458367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:25.497347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea could not be found. Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea HTTP/1.1 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea could not be found. Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'fb967bbe-36e6-44d3-b8e4-9990559aa0ea'} Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea could not be found. Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea could not be found. Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:55:25.498961 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea could not be found. Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance fb967bbe-36e6-44d3-b8e4-9990559aa0ea could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f21f82f-d10d-4976-a569-0337880afd45 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea" status: 404 len: 111 microversion: 2.1 time: 0.073669 Oct 31 15:55:25.504290 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3022/5924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:25 2022] GET /compute/v2.1/servers/fb967bbe-36e6-44d3-b8e4-9990559aa0ea => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:55:34.969781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-431040468", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "33da71af-4752-4237-8e1d-2e87c2639f82", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:34.993677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:34.997675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:35.110017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:55:36.853565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:55:36.854205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:55:36.854443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:55:36.855219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:55:36.857322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:55:36.874937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:36.877890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:36.883533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:36.884432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:36.884842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:36.885268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:36.939512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:55:36.953091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:55:37.094316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:55:37.096857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33da71af-4752-4237-8e1d-2e87c2639f82',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:55:37.322432 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f3fc76e-0f0b-409e-9c81-ab6d31d43bb6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.357245 Oct 31 15:55:37.325531 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2903/5925] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:55:37.341058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ba45747-bf71-409e-885d-5ba613a7d803 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:37.342388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ba45747-bf71-409e-885d-5ba613a7d803 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:37.353020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=7 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:37.361862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=70 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:37.457421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ba45747-bf71-409e-885d-5ba613a7d803 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:37.474241 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ba45747-bf71-409e-885d-5ba613a7d803 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1056 microversion: 2.1 time: 0.139995 Oct 31 15:55:37.476514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3023/5926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:37 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1056 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:38.504803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:38.508670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:38.517391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:38.518304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:38.519128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:38.520007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:38.520918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:38.521765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:38.776546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:38.801476 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3eee8e29-aa74-4557-93d5-1a224ecd901a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1154 microversion: 2.1 time: 0.301224 Oct 31 15:55:38.805588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2904/5927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:38 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1154 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:39.827759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:39.829404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:39.849283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:39.850144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:39.850639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:39.853217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:39.861030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:39.861610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:40.004118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bb11b5af-7d75-4808-a179-3ff7c8b0e144 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-822192467", "availability_zone": "foo_zone"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:40.011486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.aggregate [None req-bb11b5af-7d75-4808-a179-3ff7c8b0e144 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Generated uuid c0e89deb-306c-4f7a-886d-a412f879d2a0 for aggregate {{(pid=120625) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:55:40.013416 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb11b5af-7d75-4808-a179-3ff7c8b0e144 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] [b1ad4042-2481-4b13-86d4-01577420aa37] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:55:40.268690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:40.284337 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bd020797-8393-486c-b820-36dbfcd788ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1172 microversion: 2.1 time: 0.460393 Oct 31 15:55:40.285650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2905/5928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:39 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1172 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:41.028593 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb11b5af-7d75-4808-a179-3ff7c8b0e144 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] [b1ad4042-2481-4b13-86d4-01577420aa37] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42158. Oct 31 15:55:41.116948 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bb11b5af-7d75-4808-a179-3ff7c8b0e144 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.474998 Oct 31 15:55:41.119764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3024/5929] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Oct 31 15:55:39 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:41.132606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bbb1a09-78b2-44da-9ed5-4bf6553a1c9e tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:41.212290 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bbb1a09-78b2-44da-9ed5-4bf6553a1c9e tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.085407 Oct 31 15:55:41.213523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2906/5930] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:55:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:41.226915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:41.233432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:41.235613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:41.236355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:41.238825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:41.241894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:41.243935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:41.311321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:41.313031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:41.326589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:41.331151 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5fc4cbe8-8dd6-4d45-9555-c445cb0ea85a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.109362 Oct 31 15:55:41.332146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:41.334285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:41.334704 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3025/5931] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Oct 31 15:55:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:41.337769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:41.338506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:41.342160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:41.365183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09cd6f58-60fa-4e48-8ccd-5ed693d0e22e tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:41.382610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09cd6f58-60fa-4e48-8ccd-5ed693d0e22e tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.037299 Oct 31 15:55:41.383549 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3026/5932] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Oct 31 15:55:41 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:55:41.395519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7431acd8-1687-4adf-a860-d1fa7fccb02a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-17"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:41.421027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7431acd8-1687-4adf-a860-d1fa7fccb02a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:41.424613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7431acd8-1687-4adf-a860-d1fa7fccb02a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:41.425321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7431acd8-1687-4adf-a860-d1fa7fccb02a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:41.882784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:41.891270 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33db34a5-efe5-413a-b36f-b35870f8139f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1214 microversion: 2.1 time: 0.585205 Oct 31 15:55:41.898653 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2907/5933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:41 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1214 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:55:42.005977 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7431acd8-1687-4adf-a860-d1fa7fccb02a tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.613406 Oct 31 15:55:42.009630 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3027/5934] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:55:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:55:42.022549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-11297526-1bdc-4015-8fa4-0550b2e91c86 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:42.052603 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-11297526-1bdc-4015-8fa4-0550b2e91c86 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.035215 Oct 31 15:55:42.057726 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2908/5935] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:55:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:42.068645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8b16373-9c4e-4702-8879-2c77cd3eb2f5 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-252867110", "availability_zone": "foo_zone"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:42.191922 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8b16373-9c4e-4702-8879-2c77cd3eb2f5 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.128567 Oct 31 15:55:42.193980 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3028/5936] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Oct 31 15:55:42 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:42.208249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3439fc21-efa9-4787-aab1-070946c11ddb tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:42.315056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3439fc21-efa9-4787-aab1-070946c11ddb tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.113782 Oct 31 15:55:42.321110 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2909/5937] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:55:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:42.338193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f74a8ca-bea4-4eda-8522-f7d000d208a9 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:42.357073 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f74a8ca-bea4-4eda-8522-f7d000d208a9 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.021941 Oct 31 15:55:42.367577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3029/5938] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Oct 31 15:55:42 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:42.373542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-decd1bc3-ff04-4a49-8a64-b6303657f48c tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-17"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:42.392593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decd1bc3-ff04-4a49-8a64-b6303657f48c tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:42.393114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decd1bc3-ff04-4a49-8a64-b6303657f48c tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:42.393562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-decd1bc3-ff04-4a49-8a64-b6303657f48c tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:42.540649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d130a48a-ae4d-4fb5-86b2-cd0ca20d772c req-52da8e72-56ac-470a-9dc5-b24d7979a7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de8adedc-1133-426d-bbe8-2a5e25dd6442", "tag": "79da5d43-e11b-49b6-adde-6bf4390dffe8"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:42.563213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d130a48a-ae4d-4fb5-86b2-cd0ca20d772c req-52da8e72-56ac-470a-9dc5-b24d7979a7cf service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:42.565060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d130a48a-ae4d-4fb5-86b2-cd0ca20d772c req-52da8e72-56ac-470a-9dc5-b24d7979a7cf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:42.566918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d130a48a-ae4d-4fb5-86b2-cd0ca20d772c req-52da8e72-56ac-470a-9dc5-b24d7979a7cf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:42.594756 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d130a48a-ae4d-4fb5-86b2-cd0ca20d772c req-52da8e72-56ac-470a-9dc5-b24d7979a7cf service nova] Creating event network-changed:79da5d43-e11b-49b6-adde-6bf4390dffe8 for instance de8adedc-1133-426d-bbe8-2a5e25dd6442 on n-h1-858383-17 Oct 31 15:55:42.609184 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d130a48a-ae4d-4fb5-86b2-cd0ca20d772c req-52da8e72-56ac-470a-9dc5-b24d7979a7cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073561 Oct 31 15:55:42.613839 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3030/5939] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:55:42.778927 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-decd1bc3-ff04-4a49-8a64-b6303657f48c tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.408154 Oct 31 15:55:42.779695 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2910/5940] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Oct 31 15:55:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:42.793986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c82929a-e6f6-4d64-a65f-ce529a9b4c96 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:42.830412 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c82929a-e6f6-4d64-a65f-ce529a9b4c96 tempest-TestAggregatesBasicOps-763515738 tempest-TestAggregatesBasicOps-763515738-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.040345 Oct 31 15:55:42.831854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3031/5941] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Oct 31 15:55:42 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:55:42.917399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:42.918205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:42.931365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:42.938793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:42.947889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:42.948930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:42.953134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:42.953813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:43.681698 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:43.690670 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc5e0342-f019-48a7-aeb3-12d2e7d76478 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1214 microversion: 2.1 time: 0.777363 Oct 31 15:55:43.702106 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2911/5942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:42 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1214 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:44.730115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:44.731517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:44.742076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:44.743861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:44.750346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:44.751344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:44.752003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:44.752598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:45.330559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:45.343865 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5da6f36-aaec-4524-807e-73539b6cdc18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1214 microversion: 2.1 time: 0.613764 Oct 31 15:55:45.345603 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3032/5943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:44 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1214 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:46.372755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:46.373452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:46.391686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:46.394349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:46.395801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:46.397536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:46.405767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:46.406709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:46.912629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:46.981299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:47.494845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:47.528752 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4022dbb-60d8-45f6-9398-7c5c3dd139da tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1214 microversion: 2.1 time: 1.159802 Oct 31 15:55:47.530663 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2912/5944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:46 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1214 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:48.555052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:48.562647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:48.563737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:48.585411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:48.589466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:48.591863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:48.593058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:48.593888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:48.595432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:49.001733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:49.018977 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e3081d4-071f-427b-baee-a518e39e4567 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1214 microversion: 2.1 time: 0.462587 Oct 31 15:55:49.020677 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3033/5945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:48 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1214 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:50.050345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:50.052252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:50.061876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:50.062636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:50.063076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:50.063988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:50.064629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:50.065261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:50.253967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:50.263805 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-10b9a217-c0d0-41d1-a640-79dd3e6717e3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.221179 Oct 31 15:55:50.264402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2913/5946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:50 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:51.288481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:51.289294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:51.295460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:51.304817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:51.305392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:51.305842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:51.306592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:51.307055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:51.307481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:51.630238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:51.647031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dce67721-aa2a-49f5-9172-3aacb0d9707b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.362838 Oct 31 15:55:51.649667 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3034/5947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:51 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:52.675891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:52.676867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:52.693102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:52.693601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:52.694071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:52.694791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:52.695250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:52.695675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:52.948842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:52.962734 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ee358ff3-9e39-448b-8ce0-0cfb62357813 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.290648 Oct 31 15:55:52.974722 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2914/5948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:52 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:53.987955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:53.989266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:54.008362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:54.008895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:54.009350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:54.010125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:54.010596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:54.011027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:54.421426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:54.436571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea1df265-1972-4f34-bab7-36e55758cd52 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.451473 Oct 31 15:55:54.437523 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3035/5949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:53 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:55.461656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:55.462287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:55.473236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:55.481737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:55.482197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:55.483185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:55.483813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:55.484440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:55.799612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:55.809824 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ec1d99a-88ab-403e-8d8f-b1cf025987e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.353183 Oct 31 15:55:55.829682 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2915/5950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:55 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:56.843928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:56.844640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:56.875591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:56.879803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:56.885053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:56.885792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:56.886151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:56.886578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:57.159823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:57.182473 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98102ec5-a1e0-432d-b03a-94db2c329d76 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.342896 Oct 31 15:55:57.197657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3036/5951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:56 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:58.212239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:58.214017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:58.222167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:58.222990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:58.224551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:58.225831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:58.226827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:58.227620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:58.377118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:58.387589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a505ef22-ea52-4950-89ea-cb21c79bb5ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.180424 Oct 31 15:55:58.404489 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2916/5952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:58 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:59.411945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:59.412563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:59.424110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:59.424614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:59.425084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:59.426282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:59.426761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:59.427193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:59.643451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:59.652131 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea350476-362d-4cc5-a7dc-607bc4c69e65 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.244610 Oct 31 15:55:59.652746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3037/5953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:59 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:00.533336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-75661ec9-711f-49ea-b239-1dc178a7a814 req-b5aeccb6-f33f-4f7a-b7cf-e71f0798af19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8adedc-1133-426d-bbe8-2a5e25dd6442", "name": "network-vif-plugged", "status": "completed", "tag": "79da5d43-e11b-49b6-adde-6bf4390dffe8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:00.559235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-75661ec9-711f-49ea-b239-1dc178a7a814 req-b5aeccb6-f33f-4f7a-b7cf-e71f0798af19 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:00.559769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-75661ec9-711f-49ea-b239-1dc178a7a814 req-b5aeccb6-f33f-4f7a-b7cf-e71f0798af19 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:00.560214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-75661ec9-711f-49ea-b239-1dc178a7a814 req-b5aeccb6-f33f-4f7a-b7cf-e71f0798af19 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:00.600847 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-75661ec9-711f-49ea-b239-1dc178a7a814 req-b5aeccb6-f33f-4f7a-b7cf-e71f0798af19 service nova] Creating event network-vif-plugged:79da5d43-e11b-49b6-adde-6bf4390dffe8 for instance de8adedc-1133-426d-bbe8-2a5e25dd6442 on n-h1-858383-17 Oct 31 15:56:00.606192 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-75661ec9-711f-49ea-b239-1dc178a7a814 req-b5aeccb6-f33f-4f7a-b7cf-e71f0798af19 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077461 Oct 31 15:56:00.610427 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2917/5954] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:00.679982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:00.680672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:00.690740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:00.693245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:00.693499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:00.694251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:00.694739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:00.695186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:00.955316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:00.963857 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d209645-12c6-41b2-aec8-9d94fabcab72 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.288827 Oct 31 15:56:00.964715 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3038/5955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:00 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:01.289235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1131616537", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "a9b2dfe5-d6fb-4cd8-ab7f-086f8accfc79"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:01.346885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] validate_networks() for [('a9b2dfe5-d6fb-4cd8-ab7f-086f8accfc79', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:56:01.987418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:01.988145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:01.995641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:01.996155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:01.996582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:01.997324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:01.997788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:01.998218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:02.287608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:56:02.288121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:56:02.288771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:56:02.288936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:56:02.289548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:56:02.304452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:02.305056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:02.305574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:02.306480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:02.307023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:02.307548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:02.328196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Getting quotas for project 071545ca0c1c419aa8b517aeb5f98e0f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:56:02.335263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Getting quotas for user 821098dabe5b4968b421781926084e3e and project 071545ca0c1c419aa8b517aeb5f98e0f. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:56:02.349498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:56:02.352657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:56:02.362911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:02.387352 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75f39e96-db38-47b9-b9fa-baacbc831e13 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1202 microversion: 2.1 time: 0.403411 Oct 31 15:56:02.390565 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3039/5956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:01 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:02.408456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8d7eb2c-8044-47f1-9a0b-fa18ca7d20a9 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.243895 Oct 31 15:56:02.409535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2918/5957] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:56:02.423611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98a046c3-e161-4a4c-add7-2c49ff8b17d6 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:02.427803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98a046c3-e161-4a4c-add7-2c49ff8b17d6 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:02.503272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-98a046c3-e161-4a4c-add7-2c49ff8b17d6 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:02.523078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98a046c3-e161-4a4c-add7-2c49ff8b17d6 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1215 microversion: 2.1 time: 0.103686 Oct 31 15:56:02.524487 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3040/5958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:02 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:03.415998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:03.417625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:03.429257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:03.429900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:03.430314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:03.431205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:03.431837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:03.432278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:03.549953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:03.552594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:03.563316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:03.564438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:03.565250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:03.567449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:03.568383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:03.569314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:03.742848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:03.751284 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-543b7744-3554-4dee-9302-37267fe2532f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1275 microversion: 2.1 time: 0.206676 Oct 31 15:56:03.751871 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3041/5959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:03 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:56:03.799588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:03.818050 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-63bbd959-e91d-4732-b0f5-fc2be7c0a686 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1389 microversion: 2.1 time: 0.407537 Oct 31 15:56:03.818650 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2919/5960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:03 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1389 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:03.842191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:03.843220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:03.849897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:03.850767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:03.851486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:03.852213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:03.852869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:03.853534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.039376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:04.047625 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c737eb4-50c2-40af-9886-3f25b16410de tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1389 microversion: 2.1 time: 0.209288 Oct 31 15:56:04.048206 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3042/5961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:03 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1389 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:04.071673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:04.072352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:04.082029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.082867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.083392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.084197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.084776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.085316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.234203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:04.270783 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6376220-2ba7-4727-9573-eab4d2e57018 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1389 microversion: 2.1 time: 0.202122 Oct 31 15:56:04.273711 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2920/5962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:04 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1389 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:04.297173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:04.297173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:04.306874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.307368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.307803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.308511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.308992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.309422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.335644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:56:04.429571 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-82904577-0ca8-44d3-b905-0f6a5aeb598f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 204 len: 0 microversion: 2.1 time: 0.136319 Oct 31 15:56:04.434514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3043/5963] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:56:04 2022] DELETE /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:56:04.442030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:04.442843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:04.451042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.451675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.452273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.455663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.457074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.458107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.608280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:04.618293 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5e6e789f-5e31-4347-948e-2fc998f3521e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1395 microversion: 2.1 time: 0.182887 Oct 31 15:56:04.619185 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2921/5964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:04 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1395 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:04.778093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:04.778810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:04.787085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.787791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.788398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:04.789336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:04.789965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:04.790575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:05.047675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:05.059069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64ae3b06-936d-48e6-93ae-95bf3b037887 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.285227 Oct 31 15:56:05.059657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3044/5965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:04 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:05.642564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:05.643388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:05.648407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:05.656273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:05.657850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:05.658549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:05.659650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:05.661282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:05.661993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:05.671462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=83 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:05.872370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:05.887661 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-30835312-1c5e-4064-badd-b8835d821c70 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1395 microversion: 2.1 time: 0.248717 Oct 31 15:56:05.889469 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2922/5966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:05 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1395 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:06.087725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:06.103748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:06.119647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.121856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.122385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:06.123973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.129488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.130143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:06.631300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-53ef3e5b-8c1a-433f-88af-f0dc54a3372c req-14ec79f9-1c14-4052-994c-b980d291f555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440b60ee-4bd4-4299-8349-5932aff8efcb", "tag": "b0b79e32-c094-47c7-8bb1-984764f9ab88"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:06.655489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-53ef3e5b-8c1a-433f-88af-f0dc54a3372c req-14ec79f9-1c14-4052-994c-b980d291f555 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.656840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-53ef3e5b-8c1a-433f-88af-f0dc54a3372c req-14ec79f9-1c14-4052-994c-b980d291f555 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.657491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-53ef3e5b-8c1a-433f-88af-f0dc54a3372c req-14ec79f9-1c14-4052-994c-b980d291f555 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:06.670875 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-53ef3e5b-8c1a-433f-88af-f0dc54a3372c req-14ec79f9-1c14-4052-994c-b980d291f555 service nova] Creating event network-changed:b0b79e32-c094-47c7-8bb1-984764f9ab88 for instance 440b60ee-4bd4-4299-8349-5932aff8efcb on n-h2-858383-17 Oct 31 15:56:06.687051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:06.688927 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-53ef3e5b-8c1a-433f-88af-f0dc54a3372c req-14ec79f9-1c14-4052-994c-b980d291f555 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274080 Oct 31 15:56:06.689749 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2923/5967] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:06.695519 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e16e617d-bf27-4764-81f8-90d3b5b3ae76 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.616738 Oct 31 15:56:06.702586 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3045/5968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:06 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:06.912057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:06.913641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:06.924911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.925859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.926513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:06.927807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.930158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.934338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:07.015784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:07.027843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9fbc5bd9-955b-482e-8743-1cefb8afbdd1 req-2cf528f3-ad4f-4b09-8872-9c9b45d1f10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de8adedc-1133-426d-bbe8-2a5e25dd6442", "name": "network-vif-deleted", "tag": "79da5d43-e11b-49b6-adde-6bf4390dffe8"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:07.045245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9fbc5bd9-955b-482e-8743-1cefb8afbdd1 req-2cf528f3-ad4f-4b09-8872-9c9b45d1f10b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:07.047127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9fbc5bd9-955b-482e-8743-1cefb8afbdd1 req-2cf528f3-ad4f-4b09-8872-9c9b45d1f10b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:07.048918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9fbc5bd9-955b-482e-8743-1cefb8afbdd1 req-2cf528f3-ad4f-4b09-8872-9c9b45d1f10b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:07.065640 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9fbc5bd9-955b-482e-8743-1cefb8afbdd1 req-2cf528f3-ad4f-4b09-8872-9c9b45d1f10b service nova] Creating event network-vif-deleted:79da5d43-e11b-49b6-adde-6bf4390dffe8 for instance de8adedc-1133-426d-bbe8-2a5e25dd6442 on n-h1-858383-17 Oct 31 15:56:07.072401 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9fbc5bd9-955b-482e-8743-1cefb8afbdd1 req-2cf528f3-ad4f-4b09-8872-9c9b45d1f10b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184259 Oct 31 15:56:07.073425 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2924/5969] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:07.146674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:07.174285 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59e1d9b6-0193-42ed-9361-914f4e3c3301 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1187 microversion: 2.1 time: 0.266731 Oct 31 15:56:07.175789 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3046/5970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:06 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1187 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:56:07.729765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:07.730486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:07.741890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:07.742400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:07.742848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:07.743577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:07.744045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:07.744487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:07.938472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:07.947454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dac4a9f5-69f0-45c6-a32e-0b4ab6e809d3 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.222779 Oct 31 15:56:07.948616 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2925/5971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:07 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:08.202117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:08.202727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:08.209694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:08.214748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.215283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.215738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.223795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.224459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.224943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.330435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:08.340553 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b62e1b92-d34a-4646-a88a-32ee0097b5ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1187 microversion: 2.1 time: 0.141911 Oct 31 15:56:08.342443 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3047/5972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:08 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1187 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:08.978440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:08.979716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:08.989056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.989903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.990556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.991476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.992160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.992842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:09.187103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:09.198847 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90af7c88-173d-4fbd-9d63-6a1bbe99d8ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.227333 Oct 31 15:56:09.214842 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2926/5973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:08 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:09.364822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:09.366036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:09.373305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:09.374069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:09.374674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:09.375552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:09.376177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:09.376806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:09.449334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:09.458158 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca24203b-06b9-486a-95f0-cbdf792875e9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1187 microversion: 2.1 time: 0.097887 Oct 31 15:56:09.458742 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3048/5974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:09 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:10.226314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:10.227284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:10.251840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:10.254041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:10.264843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:10.266219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:10.267379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:10.268021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:10.481749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:10.482637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:10.493876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:10.496449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:10.496948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:10.497693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:10.498169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:10.498609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:10.581078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:10.600675 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9692d4e6-5dfb-440d-b344-d3b819e5bd8a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.379904 Oct 31 15:56:10.601983 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2927/5975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:10 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:10.676325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:10.698996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef25567b-bd74-4dc8-bf0c-f48fe36c5748 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1187 microversion: 2.1 time: 0.219790 Oct 31 15:56:10.701965 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3049/5976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:10 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1187 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:11.632646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:11.633451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:11.646401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.647199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.647804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:11.648920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.649477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.649996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:11.725183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:11.727107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:11.736077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.738102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.738734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:11.739650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.740280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.740923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:12.055037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:12.069062 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c38d8b9f-5085-4b61-b3ff-fa1f40dd240e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 200 len: 1187 microversion: 2.1 time: 0.348670 Oct 31 15:56:12.081962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3050/5977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:11 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 1187 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:56:12.319160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:12.344113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:12.409315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:12.412226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1a9300a6-12d6-499e-ac7f-f78648fad328 req-da05cc1d-5fc8-4009-ad50-565aed74c1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b60ee-4bd4-4299-8349-5932aff8efcb", "name": "network-vif-plugged", "status": "completed", "tag": "b0b79e32-c094-47c7-8bb1-984764f9ab88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:12.426307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b3f8a91-3c39-482e-9f0f-f3d900d3c094 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.803661 Oct 31 15:56:12.430329 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2928/5978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:11 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:12.434076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1a9300a6-12d6-499e-ac7f-f78648fad328 req-da05cc1d-5fc8-4009-ad50-565aed74c1ef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:12.434566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1a9300a6-12d6-499e-ac7f-f78648fad328 req-da05cc1d-5fc8-4009-ad50-565aed74c1ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:12.435006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1a9300a6-12d6-499e-ac7f-f78648fad328 req-da05cc1d-5fc8-4009-ad50-565aed74c1ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:12.456938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1a9300a6-12d6-499e-ac7f-f78648fad328 req-da05cc1d-5fc8-4009-ad50-565aed74c1ef service nova] Creating event network-vif-plugged:b0b79e32-c094-47c7-8bb1-984764f9ab88 for instance 440b60ee-4bd4-4299-8349-5932aff8efcb on n-h2-858383-17 Oct 31 15:56:12.466538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1a9300a6-12d6-499e-ac7f-f78648fad328 req-da05cc1d-5fc8-4009-ad50-565aed74c1ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057332 Oct 31 15:56:12.481421 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3051/5979] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:56:13.103977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:13.104611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: de8adedc-1133-426d-bbe8-2a5e25dd6442] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:13.119464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:13.120579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:13.121361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:13.122881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:13.123630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:13.124397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:13.152309 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance de8adedc-1133-426d-bbe8-2a5e25dd6442 could not be found. Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 HTTP/1.1 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance de8adedc-1133-426d-bbe8-2a5e25dd6442 could not be found. Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'de8adedc-1133-426d-bbe8-2a5e25dd6442'} Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de8adedc-1133-426d-bbe8-2a5e25dd6442 could not be found. Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de8adedc-1133-426d-bbe8-2a5e25dd6442 could not be found. Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:13.154679 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de8adedc-1133-426d-bbe8-2a5e25dd6442 could not be found. Oct 31 15:56:13.159933 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:13.162490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance de8adedc-1133-426d-bbe8-2a5e25dd6442 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:56:13.163719 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b29424ee-448a-4bf0-a04c-a4df5a55d785 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442" status: 404 len: 111 microversion: 2.1 time: 0.063901 Oct 31 15:56:13.164787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2929/5980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:13 2022] GET /compute/v2.1/servers/de8adedc-1133-426d-bbe8-2a5e25dd6442 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:56:13.462435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:13.463495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:13.472258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:13.476518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:13.477040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:13.477670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:13.478564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:13.479182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:13.479767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:13.711841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:13.743928 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30065768-4861-4800-a29c-52ab2eecd62e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1315 microversion: 2.1 time: 0.283890 Oct 31 15:56:13.746469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3052/5981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:13 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:14.772176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:14.773483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:14.783931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:14.789362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:14.790038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:14.790961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:14.791757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:14.792586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.327929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:15.336218 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d772b9d4-a82e-4dd3-aab2-222a64116ee2 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1502 microversion: 2.1 time: 0.568953 Oct 31 15:56:15.345016 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2930/5982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:14 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1502 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:15.360822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:15.361420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:15.380543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.381204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.382824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.384766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.385432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.386949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.816393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:15.825108 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-79e39825-f8e9-4eb4-a6bb-c84fede60460 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1502 microversion: 2.1 time: 0.469651 Oct 31 15:56:15.829444 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3053/5983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:15 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1502 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:15.857830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:15.858378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:15.873886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.874677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.875298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.877607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.878592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.879042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.946805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lazy-loading 'flavor' on Instance uuid 440b60ee-4bd4-4299-8349-5932aff8efcb {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:56:16.087838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3b3c665b-9b2d-4287-80e4-3357580c3759 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action" status: 202 len: 0 microversion: 2.1 time: 0.234285 Oct 31 15:56:16.088784 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2931/5984] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:56:15 2022] POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:56:16.101152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:16.103451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:16.111651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:16.112634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:16.113675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:16.114843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:16.115501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:16.116191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:16.469197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:16.478584 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67a440df-631f-49bd-ba93-9b1b88ec8a72 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1510 microversion: 2.1 time: 0.384678 Oct 31 15:56:16.503600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3054/5985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:16 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:17.506705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:17.508583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:17.517870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:17.518702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:17.521640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:17.523895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:17.524563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:17.525208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:17.860802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:17.869969 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d1557ae5-695e-4039-b3da-fa002a8db346 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1493 microversion: 2.1 time: 0.371359 Oct 31 15:56:17.872570 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2932/5986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:17 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1493 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:17.903263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:17.904192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:17.917884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:17.919359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:17.921462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:17.922314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:17.923625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:17.929406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:18.109295 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e14718b9-1dbe-429e-890d-9705824195ff tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action" status: 202 len: 0 microversion: 2.1 time: 0.210473 Oct 31 15:56:18.109962 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3055/5987] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:56:17 2022] POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:56:18.133149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:18.136466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:18.162158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:18.171833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:18.172579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:18.177927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:18.187064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:18.207280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:18.740633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:18.750032 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4e1e313-13e7-48ed-aff7-a79bde92ee4e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1499 microversion: 2.1 time: 0.632053 Oct 31 15:56:18.755235 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2933/5988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:18 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1499 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:19.777717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:19.778529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:19.804118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:19.805099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:19.805231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:19.808730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:19.808730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:19.808730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:20.106421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:20.120106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ffbd539-6298-479d-80d2-c7dd6460aba0 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1499 microversion: 2.1 time: 0.347993 Oct 31 15:56:20.133747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3056/5989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:19 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1499 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:21.167744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:21.171066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:21.246972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:21.247489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:21.247934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:21.250564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:21.251217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:21.251662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:21.604634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:21.622697 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f20ba391-e671-440e-bcd4-041efcfb8782 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1502 microversion: 2.1 time: 0.464409 Oct 31 15:56:21.623315 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2934/5990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:21 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1502 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:21.653141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:21.653814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:21.662253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:21.663301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:21.663913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:21.665098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:21.665994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:21.666664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:21.695351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lazy-loading 'flavor' on Instance uuid 440b60ee-4bd4-4299-8349-5932aff8efcb {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:56:21.811737 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e83c4aa-dc5d-4418-a8a9-8ba999b90b59 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action" status: 202 len: 0 microversion: 2.1 time: 0.166065 Oct 31 15:56:21.830390 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3057/5991] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:56:21 2022] POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:56:21.836944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:21.837567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:21.848523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:21.855050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:21.855786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:21.856743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:21.857664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:21.858848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:22.350288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:22.375434 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7cfcbab1-40ff-4723-8bd0-267413bed65f tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1510 microversion: 2.1 time: 0.543732 Oct 31 15:56:22.377397 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2935/5992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:21 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:23.406400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:23.407717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:23.419332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.422701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.424964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:23.425742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.426187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.431260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:23.676122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:23.685586 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6120f394-cb49-4d53-965d-29aac0a02f9b tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1493 microversion: 2.1 time: 0.283474 Oct 31 15:56:23.699454 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3058/5993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:23 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1493 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:23.728406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:23.729005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:23.738178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.738690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.739138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:23.740094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.741000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.741815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:23.841812 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78fef036-8444-4c9d-8971-2c88ad14c43e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action" status: 202 len: 0 microversion: 2.1 time: 0.117351 Oct 31 15:56:23.844538 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2936/5994] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:56:23 2022] POST /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:56:23.852921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:23.854701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:23.867187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.868422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.869980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:23.871010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.871772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.872483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:24.298641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:24.318343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20303aa9-1ae9-4862-ab0a-b8d5d48fb99e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1499 microversion: 2.1 time: 0.469016 Oct 31 15:56:24.318955 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3059/5995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:23 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1499 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:25.358126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:25.359231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:25.377857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:25.381519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:25.382066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:25.382912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:25.383457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:25.383962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:26.002868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:26.016443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e18ab82-0611-474f-b43a-557f3eb40272 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1499 microversion: 2.1 time: 0.664582 Oct 31 15:56:26.023467 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2937/5996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:25 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1499 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:27.048526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:27.049428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:27.062820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:27.063319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:27.064565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.066626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:27.068127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:27.068782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.267402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:27.275807 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b66b3d63-a27f-4462-a517-a6de1b40c647 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1502 microversion: 2.1 time: 0.232566 Oct 31 15:56:27.277173 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3060/5997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:27 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:27.302106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:27.302661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:27.314659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:27.315779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:27.316229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.316963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:27.317421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:27.317931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.335381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:27.374249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:56:27.499431 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1050f4d5-5f1f-46ef-976c-213c594c684a tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "DELETE /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 204 len: 0 microversion: 2.1 time: 0.201496 Oct 31 15:56:27.500266 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2938/5998] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:56:27 2022] DELETE /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:56:27.508803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:27.509715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:27.516806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:27.517608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:27.518750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.519641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:27.520276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:27.520952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.525960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:27.785802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:27.794266 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb81a902-8e52-457d-93c4-e28710ae685e tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1508 microversion: 2.1 time: 0.289466 Oct 31 15:56:27.795547 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3061/5999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:27 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:28.821189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:28.821946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:28.845598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:28.847359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:28.847966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:28.848883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:28.850541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:28.851928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:29.215872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:29.225236 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b63e4a2-daa5-43d6-b106-90dd1913e440 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1508 microversion: 2.1 time: 0.409169 Oct 31 15:56:29.226410 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2939/6000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:28 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:30.251447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:30.252589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:30.264989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:30.265832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:30.266494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:30.267418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:30.268177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:30.268952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:30.523998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:30.533310 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-359d0f8a-2ba0-48aa-b5fa-80c5886c07c1 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1508 microversion: 2.1 time: 0.285410 Oct 31 15:56:30.550537 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3062/6001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:30 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:30.907674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6c45b9f0-38d2-4475-9208-fb35625f7793 req-4cb427b3-c373-4581-8abd-80e450ee12c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b60ee-4bd4-4299-8349-5932aff8efcb", "name": "network-vif-deleted", "tag": "b0b79e32-c094-47c7-8bb1-984764f9ab88"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:30.937310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c45b9f0-38d2-4475-9208-fb35625f7793 req-4cb427b3-c373-4581-8abd-80e450ee12c1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:30.938727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c45b9f0-38d2-4475-9208-fb35625f7793 req-4cb427b3-c373-4581-8abd-80e450ee12c1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:30.940229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c45b9f0-38d2-4475-9208-fb35625f7793 req-4cb427b3-c373-4581-8abd-80e450ee12c1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:30.956799 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6c45b9f0-38d2-4475-9208-fb35625f7793 req-4cb427b3-c373-4581-8abd-80e450ee12c1 service nova] Creating event network-vif-deleted:b0b79e32-c094-47c7-8bb1-984764f9ab88 for instance 440b60ee-4bd4-4299-8349-5932aff8efcb on n-h2-858383-17 Oct 31 15:56:30.965342 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6c45b9f0-38d2-4475-9208-fb35625f7793 req-4cb427b3-c373-4581-8abd-80e450ee12c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064447 Oct 31 15:56:30.966309 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2940/6002] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:31.559918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:31.561124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:31.580468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:31.581416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:31.582073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:31.583670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:31.586618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:31.587311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:31.672165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:31.675324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:31.677247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:31.681616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lazy-loading 'fault' on Instance uuid 440b60ee-4bd4-4299-8349-5932aff8efcb {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:56:31.758682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821098dabe5b4968b421781926084e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071545ca0c1c419aa8b517aeb5f98e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:31.772628 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7350f2b-7475-4f07-8273-d21359a0ea9d tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 200 len: 1305 microversion: 2.1 time: 0.216953 Oct 31 15:56:31.801002 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3063/6003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:31 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 1305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:32.815910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:32.816828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] [instance: 440b60ee-4bd4-4299-8349-5932aff8efcb] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:32.827666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:32.828425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:32.836916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:32.837713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:32.838199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:32.838642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:32.887575 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] HTTP exception thrown: Instance 440b60ee-4bd4-4299-8349-5932aff8efcb could not be found. Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Request method failure captured: Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb HTTP/1.1 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_APchSwpbBV0CMfBwTToaYc2y6V1jE7RLHspOCX-JNRY6PBbYmfnUR-4Ib7QgVv-RXTQXkpqnlgBRGob3rsqUJNLE1qLRUznl2BjaPUgTAjG3Ox8SD9RxamlR2jN3kMNnVTuYUplUcqpUtOnySHQfp3fBvfzG9qBtvG_NzvVMiQs1A Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 071545ca0c1c419aa8b517aeb5f98e0f Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestServerAdvancedOps-134113513 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/071545ca0c1c419aa8b517aeb5f98e0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/071545ca0c1c419aa8b517aeb5f98e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_071545ca0c1c419aa8b517aeb5f98e0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/071545ca0c1c419aa8b517aeb5f98e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestServerAdvancedOps-134113513 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 071545ca0c1c419aa8b517aeb5f98e0f Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestServerAdvancedOps-134113513 Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestServerAdvancedOps-134113513-project Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 821098dabe5b4968b421781926084e3e Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestServerAdvancedOps-134113513-project Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 440b60ee-4bd4-4299-8349-5932aff8efcb could not be found. Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '440b60ee-4bd4-4299-8349-5932aff8efcb'} Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440b60ee-4bd4-4299-8349-5932aff8efcb could not be found. Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440b60ee-4bd4-4299-8349-5932aff8efcb could not be found. Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:32.889320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440b60ee-4bd4-4299-8349-5932aff8efcb could not be found. Oct 31 15:56:32.895139 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:56:32.897753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] Returning 404 to user: Instance 440b60ee-4bd4-4299-8349-5932aff8efcb could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:56:32.898896 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1ea3bd7-57ce-4d80-a27a-4cd22543bf21 tempest-TestServerAdvancedOps-134113513 tempest-TestServerAdvancedOps-134113513-project] 10.222.0.48 "GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb" status: 404 len: 111 microversion: 2.1 time: 0.089721 Oct 31 15:56:32.899651 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2941/6004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:32 2022] GET /compute/v2.1/servers/440b60ee-4bd4-4299-8349-5932aff8efcb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:56:49.487453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1599040084", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7f17b70d-f662-4c13-9f27-835754142e8e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:49.507354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=35 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:49.508023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:49.600544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:56:50.426302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:56:50.426734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:56:50.427220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:56:50.427637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:56:50.428055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:56:50.482622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:50.483135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:50.483588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:50.484316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:50.484803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:50.485232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:50.544898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:56:50.563981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:56:50.592680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:56:50.597098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7f17b70d-f662-4c13-9f27-835754142e8e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:56:50.741086 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64d48d17-040d-4c0f-b441-eb95cfeceadc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258432 Oct 31 15:56:50.754373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-99a6089c-8999-4f31-9534-244b972cf2a8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:50.755063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-99a6089c-8999-4f31-9534-244b972cf2a8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:50.757888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:50.765299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:50.772862 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3064/6005] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:56:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:56:51.020126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-99a6089c-8999-4f31-9534-244b972cf2a8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:51.036677 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-99a6089c-8999-4f31-9534-244b972cf2a8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1057 microversion: 2.1 time: 0.286936 Oct 31 15:56:51.037318 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2942/6006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:50 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1057 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:56:52.064940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:52.065571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:52.076027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:52.085644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:52.086312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:52.087243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:52.087882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:52.088496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:52.253118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:52.263424 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24aee2ef-86de-4233-a19d-957928bdffa7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1109 microversion: 2.1 time: 0.203867 Oct 31 15:56:52.264328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3065/6007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:52 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1109 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:53.288238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:53.289571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:53.301871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:53.303392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:53.304398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:53.305775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:53.307221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:53.308238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:53.459780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:53.479741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bc9d447f-9d17-4bf7-a38f-1521b3290cb9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1127 microversion: 2.1 time: 0.195301 Oct 31 15:56:53.480348 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2943/6008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:53 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1127 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:54.507078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:54.508371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:54.531132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:54.533543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:54.544756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:54.545612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:54.546112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:54.546557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:54.680032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:54.698171 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b55ed601-49c5-410d-925b-8c25edbeb553 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1127 microversion: 2.1 time: 0.194878 Oct 31 15:56:54.699285 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3066/6009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:54 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1127 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:55.723939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:55.724682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:55.747907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:55.748417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:55.748896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:55.749622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:55.750089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:55.750521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:56.184510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:56.193426 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-51dbbb4b-4328-4ad6-aaa3-8f1ba78bad7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.474553 Oct 31 15:56:56.194551 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2944/6010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:55 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:57.220567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:57.221831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:57.239237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:57.246249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:57.246943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:57.247924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:57.248893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:57.249946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:57.739961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:57.751185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3003746a-5d2f-4a12-a98e-cb4b2682954f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.535213 Oct 31 15:56:57.758097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3067/6011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:57 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:58.781484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:58.782190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:58.794869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:58.799389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:58.800122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:58.801101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:58.801801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:58.802431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:00.101528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:00.130185 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8f03ad0-3755-4640-9edc-2e5ce658d5bb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 1.340386 Oct 31 15:57:00.130185 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2945/6012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:58 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:00.337346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9b5d7002-4149-4550-b94b-e42aa55c214f req-3c3fb65f-5be2-4b30-901d-07ff28316d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61275b68-506e-4f50-834b-2d04be707559", "tag": "dfc4e822-0f05-477f-afe5-5ff49abeafc3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:00.365034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9b5d7002-4149-4550-b94b-e42aa55c214f req-3c3fb65f-5be2-4b30-901d-07ff28316d77 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:00.378922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9b5d7002-4149-4550-b94b-e42aa55c214f req-3c3fb65f-5be2-4b30-901d-07ff28316d77 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:00.389373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9b5d7002-4149-4550-b94b-e42aa55c214f req-3c3fb65f-5be2-4b30-901d-07ff28316d77 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:00.423091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9b5d7002-4149-4550-b94b-e42aa55c214f req-3c3fb65f-5be2-4b30-901d-07ff28316d77 service nova] Creating event network-changed:dfc4e822-0f05-477f-afe5-5ff49abeafc3 for instance 61275b68-506e-4f50-834b-2d04be707559 on n-h1-858383-17 Oct 31 15:57:00.437313 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9b5d7002-4149-4550-b94b-e42aa55c214f req-3c3fb65f-5be2-4b30-901d-07ff28316d77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106266 Oct 31 15:57:00.445570 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3068/6013] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:57:01.144755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:01.146459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:01.153769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:01.156512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:01.158002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:01.158810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:01.159783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:01.182370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:01.183946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:01.590654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:01.603503 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4dec6262-1245-412d-ab0c-efeab08dd136 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.463517 Oct 31 15:57:01.604769 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2946/6014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:01 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:02.630748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:02.633558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:02.649260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:02.650440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:02.662190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:02.663181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:02.663860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:02.664893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:02.665469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:02.666285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:02.992143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:03.009262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d6f10dc-04bf-410f-b16b-f8065d9161ec tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.379134 Oct 31 15:57:03.014307 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3069/6015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:02 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:04.040989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:04.043005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:04.052947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:04.053790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:04.054528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:04.055753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:04.056292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:04.057004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:04.238997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:04.265500 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ca7a2a2-4927-46c1-bf10-ee01bc9537dd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.228751 Oct 31 15:57:04.280722 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2947/6016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:04 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:05.293208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:05.293832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:05.302526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:05.305243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:05.306676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:05.307791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:05.311310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:05.311957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:05.545155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:05.553492 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4706d0d2-e3eb-4c7e-9ef0-a45fa8e006dc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.265176 Oct 31 15:57:05.572576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3070/6017] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:05 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:06.579082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:06.579658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:06.586356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:06.586847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:06.587474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:06.588355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:06.588855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:06.589295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:06.738028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:06.747971 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2bba1e9c-efa5-4841-af5f-6ddc32f65e83 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.173799 Oct 31 15:57:06.749655 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2948/6018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:06 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:07.772076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:07.773049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:07.780048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:07.780569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:07.781044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:07.782273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:07.782769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:07.783204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:07.931979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:07.947865 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1049f22e-490d-41f1-a0b5-cc357f76ed0d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.180056 Oct 31 15:57:07.948478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3071/6019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:07 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:08.973257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:08.974045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:08.985390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:08.986127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:08.986526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:08.987266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:08.987968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:08.988406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:09.164540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:09.176798 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9c274904-217a-4e12-9b39-d6e6b7f6444c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.208378 Oct 31 15:57:09.194617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2949/6020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:08 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:10.212926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:10.212926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:10.212926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:10.213588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:10.213688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:10.216261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:10.216261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:10.216261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:10.370293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:10.378662 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a5f40c1-5dfe-4a32-ad30-b09814d8c203 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.178883 Oct 31 15:57:10.379248 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3072/6021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:10 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:11.402119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:11.402736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:11.410627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:11.411111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:11.411549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:11.412242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:11.412710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:11.413140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:11.545723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:11.554625 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2f391b8-0cbd-434a-8851-bc98e085995f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.156429 Oct 31 15:57:11.555211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2950/6022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:11 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:12.399096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ab38151-a241-4a8f-aa2a-5a36b53ca0d7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Action: 'create', calling method: .version_select at 0x7f5ca13bbe50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-854988582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnr8lUqbXBzbU0mw5t5Bw6spt1N9ejSWiEVAt2qo5w6k/Me1S1VzL1fNSsbQ5RIy9WM114S5DhtQoWxqUNhTi80CW1Ls0byCBLUNa4zJztt4rn+QpKmENZMR/6Tx1+KNg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:12.415465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-9ab38151-a241-4a8f-aa2a-5a36b53ca0d7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Getting quotas for project 3513ff79862f43be96d889c513b952f6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:57:12.422799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-9ab38151-a241-4a8f-aa2a-5a36b53ca0d7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Getting quotas for user d22170d4ff3144a499422db890d7361a and project 3513ff79862f43be96d889c513b952f6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:57:12.453534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ab38151-a241-4a8f-aa2a-5a36b53ca0d7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.061438 Oct 31 15:57:12.454425 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3073/6023] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:57:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:12.581743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:12.583426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:12.591580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:12.592967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:12.594229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:12.595450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:12.595922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:12.596682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:12.776329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:12.784911 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3525680-1830-4203-934d-94bae2114043 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.209667 Oct 31 15:57:12.798320 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2951/6024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:12 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:13.816133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:13.817120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:13.827250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:13.828187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:13.828802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:13.830445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:13.831182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:13.831775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:13.937818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1886716298", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6b4678f2-7c90-44af-9bd3-af3b818c4452", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-854988582", "security_groups": [{"name": "tempest-secgroup-smoke-785956388"}], "networks": [{"uuid": "54a1e760-86f9-41eb-af78-e9eac36a0cbd"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:14.047519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:14.059439 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15a2efd4-3268-4340-aeed-5bc92287939e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.250771 Oct 31 15:57:14.066329 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3074/6025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:13 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:14.086324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] validate_networks() for [('54a1e760-86f9-41eb-af78-e9eac36a0cbd', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:57:14.526396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:57:14.526935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:57:14.527917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:57:14.528752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:57:14.529276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:57:14.540725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:14.541387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:14.542074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:14.543123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:14.543694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:14.544229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:14.564469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Getting quotas for project 3513ff79862f43be96d889c513b952f6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:57:14.570516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Getting quotas for user d22170d4ff3144a499422db890d7361a and project 3513ff79862f43be96d889c513b952f6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:57:14.641846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:57:14.644223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b4678f2-7c90-44af-9bd3-af3b818c4452',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:57:14.795347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c9e1dde0-2c19-4a65-ad26-c31e70d94b16 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.861524 Oct 31 15:57:14.796073 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2952/6026] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:57:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:57:14.807875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e511c851-5455-4640-b275-afe94eb62e10 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:14.808506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e511c851-5455-4640-b275-afe94eb62e10 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:14.895774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e511c851-5455-4640-b275-afe94eb62e10 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:14.903854 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e511c851-5455-4640-b275-afe94eb62e10 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1098 microversion: 2.1 time: 0.099863 Oct 31 15:57:14.904453 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3075/6027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:14 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1098 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:15.085911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:15.087190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:15.096847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:15.097652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:15.098316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:15.099408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:15.100042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:15.101179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:15.319938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:15.335875 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22516e29-85b6-43ab-afac-0fd3b35b9742 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1169 microversion: 2.1 time: 0.255346 Oct 31 15:57:15.337202 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2953/6028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:15 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:15.930567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:15.931093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:15.939606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:15.940378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:15.940887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:15.941771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:15.942400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:15.942996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:16.036505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:16.047249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8b4bc6c-ac56-498d-8ee5-ee8418723990 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1196 microversion: 2.1 time: 0.120461 Oct 31 15:57:16.048137 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3076/6029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:15 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1196 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:16.364363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:16.365087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:16.376952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:16.381267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:16.381734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:16.382540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:16.383571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:16.385370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:16.644053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:16.653704 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93a4c064-6e24-406b-8662-82c9312181fd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1215 microversion: 2.1 time: 0.293481 Oct 31 15:57:16.657743 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2954/6030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:16 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:17.075146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:17.076085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:17.087487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:17.088619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:17.089178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:17.090280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:17.091042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:17.091589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:17.295522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:17.307228 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-925c3fd5-6ddb-40aa-a2cb-0432636e47ad tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1281 microversion: 2.1 time: 0.236097 Oct 31 15:57:17.308425 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3077/6031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:17 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:17.680418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:17.681126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:17.691303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:17.691989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:17.692804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:17.693925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:17.694561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:17.695297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:17.882048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:17.892308 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da2b57c4-b69a-43b3-9d42-2a7c2f50a254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.215991 Oct 31 15:57:17.911745 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2955/6032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:17 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:17.923625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-60d6fcc1-1901-4ee3-a4c2-9f70604016c4 req-56cea780-3cbe-4661-93c7-927e07a97959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:17.944766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60d6fcc1-1901-4ee3-a4c2-9f70604016c4 req-56cea780-3cbe-4661-93c7-927e07a97959 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:17.945267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60d6fcc1-1901-4ee3-a4c2-9f70604016c4 req-56cea780-3cbe-4661-93c7-927e07a97959 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:17.945806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60d6fcc1-1901-4ee3-a4c2-9f70604016c4 req-56cea780-3cbe-4661-93c7-927e07a97959 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:17.975589 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-60d6fcc1-1901-4ee3-a4c2-9f70604016c4 req-56cea780-3cbe-4661-93c7-927e07a97959 service nova] Creating event network-changed:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:57:17.982050 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-60d6fcc1-1901-4ee3-a4c2-9f70604016c4 req-56cea780-3cbe-4661-93c7-927e07a97959 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062426 Oct 31 15:57:17.983522 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3078/6033] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:18.336299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:18.337310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:18.345960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:18.353463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:18.354377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:18.355433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:18.356207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:18.356861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:18.543028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:18.552377 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b4724d2-6b01-4a82-8226-e9892f964447 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1281 microversion: 2.1 time: 0.220549 Oct 31 15:57:18.568863 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2956/6034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:18 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1281 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:18.918797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:18.919505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:18.931110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:18.932667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:18.933853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:18.934859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:18.935979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:18.938261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:19.113239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:19.122099 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-25022a9e-6885-4304-bd90-fb1f1d5fb766 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.207407 Oct 31 15:57:19.123075 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3079/6035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:18 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:19.575415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:19.576432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:19.585344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:19.586524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:19.587151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:19.588425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:19.589083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:19.589969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:19.737895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:19.746639 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-87f70969-7b86-405f-a37d-487a1f1b946b tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1281 microversion: 2.1 time: 0.175123 Oct 31 15:57:19.756965 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2957/6036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:19 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:20.148195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:20.148775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:20.151462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:20.156670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:20.157200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:20.157640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:20.158334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:20.158975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:20.159404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:20.162925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=73 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:20.303088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:20.310844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22012652-4b3a-4573-9830-5b29e01ddfaa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.166594 Oct 31 15:57:20.311424 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3080/6037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:20 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:20.772311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:20.774041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:20.784303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:20.785417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:20.786311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:20.787242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:20.787902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:20.788525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:20.955327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:20.961997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=91 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:20.965499 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f3a8340a-c624-4ea3-b7c9-34fcf4bcbea7 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1281 microversion: 2.1 time: 0.197838 Oct 31 15:57:20.966330 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2958/6038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:20 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1281 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:21.334513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:21.335401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:21.342936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:21.344249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:21.344937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:21.346961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:21.347667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:21.348327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:21.504675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:21.513979 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ba28976-074d-468c-bd8b-9ca41dfa4ca2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.183352 Oct 31 15:57:21.515658 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3081/6039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:21 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:21.989848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:21.990642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:21.993507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:22.000273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:22.000857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:22.001306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:22.002028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:22.002490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:22.003062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:22.146777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:22.154570 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-28e1c289-8908-47f7-96f4-f070eeed361d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.169468 Oct 31 15:57:22.155140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2959/6040] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:21 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:22.539365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:22.540011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:22.547584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:22.548070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:22.548504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:22.549232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:22.549695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:22.550122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:22.688718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:22.697277 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0d608b9-53ae-473d-9e97-a7a27ba8e943 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.161941 Oct 31 15:57:22.697879 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3082/6041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:22 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:23.177352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:23.177966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:23.185171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:23.185696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:23.186134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:23.187435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:23.187908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:23.188330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:23.326851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:23.335589 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4082b62-62c7-48f3-9f73-a8aeea9e5af2 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.162147 Oct 31 15:57:23.336169 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2960/6042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:23 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:23.721493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:23.722137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:23.728976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:23.729484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:23.729915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:23.730604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:23.731089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:23.731510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:23.872075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:23.880626 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c7d16d9-2529-461b-a5e7-644168e9495f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.163065 Oct 31 15:57:23.881247 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3083/6043] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:23 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:24.367311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:24.368006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:24.392906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:24.393409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:24.393850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:24.394558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:24.395016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:24.395442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:24.554760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:24.561153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:24.569767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a330d69-7928-43a6-85d6-b94d2073d923 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.206209 Oct 31 15:57:24.570583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2961/6044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:24 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:24.910376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:24.917047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:24.922650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:24.930297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:24.931036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:24.931552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:24.932682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:24.933494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:24.934002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:25.075877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:25.085209 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3b4bc4eb-9e0d-489c-a5a2-d03be0d0e824 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.183503 Oct 31 15:57:25.085823 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3084/6045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:24 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:25.594155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:25.594777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:25.596656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:25.602845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:25.603333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:25.603775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:25.606735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:25.607230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:25.607670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:25.751281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:25.759307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ab28a19-080f-4a23-9b7d-c943a03c5c7c tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.169528 Oct 31 15:57:25.759875 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2962/6046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:25 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:26.109605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:26.110392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:26.117403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:26.117831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:26.118271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:26.119177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:26.119712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:26.120107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:26.256243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:26.264403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df2492ea-2b1d-453b-b0f4-14d3fcd8cb4e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.159285 Oct 31 15:57:26.265299 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3085/6047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:26 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:26.782865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:26.784219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:26.791459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:26.791944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:26.792565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:26.793452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:26.794073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:26.794523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:26.842181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9ce3b2d4-f9d1-4204-a406-fd5948924492 req-aae4ff74-6203-47f1-8b83-c8081a7e50fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61275b68-506e-4f50-834b-2d04be707559", "name": "network-vif-plugged", "status": "completed", "tag": "dfc4e822-0f05-477f-afe5-5ff49abeafc3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:26.856068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9ce3b2d4-f9d1-4204-a406-fd5948924492 req-aae4ff74-6203-47f1-8b83-c8081a7e50fa service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:26.856540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9ce3b2d4-f9d1-4204-a406-fd5948924492 req-aae4ff74-6203-47f1-8b83-c8081a7e50fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:26.857231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9ce3b2d4-f9d1-4204-a406-fd5948924492 req-aae4ff74-6203-47f1-8b83-c8081a7e50fa service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:26.871771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9ce3b2d4-f9d1-4204-a406-fd5948924492 req-aae4ff74-6203-47f1-8b83-c8081a7e50fa service nova] Creating event network-vif-plugged:dfc4e822-0f05-477f-afe5-5ff49abeafc3 for instance 61275b68-506e-4f50-834b-2d04be707559 on n-h1-858383-17 Oct 31 15:57:26.877536 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9ce3b2d4-f9d1-4204-a406-fd5948924492 req-aae4ff74-6203-47f1-8b83-c8081a7e50fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038786 Oct 31 15:57:26.878304 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3086/6048] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:57:26.975958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:26.985258 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c438b217-97e5-4ac3-8a8b-ba6d8e657b8e tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.205912 Oct 31 15:57:26.985993 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2963/6049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:26 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:27.288296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:27.288947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:27.296080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:27.296563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:27.297028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:27.297714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:27.298217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:27.298620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:27.429860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:27.439454 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce94cae0-8bf3-43c9-8f76-bc7ecb943d74 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1203 microversion: 2.1 time: 0.155462 Oct 31 15:57:27.440133 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3087/6050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:27 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:28.009561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:28.010191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:28.017315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:28.017807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:28.018245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:28.018938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:28.019397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:28.019855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:28.158575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:28.166636 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2441e6e2-c1c3-462e-bc92-27e3f9b29877 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.161795 Oct 31 15:57:28.167557 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2964/6051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:28 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:28.582214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:28.582950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:28.594527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:28.595135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:28.595727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:28.596510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:28.596999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:28.597475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:28.767113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:28.775922 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68f5882e-7374-4dc9-a8df-5ccb778503ea tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1391 microversion: 2.1 time: 0.199793 Oct 31 15:57:28.777161 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3088/6052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:28 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:28.799095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:28.799714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:28.806040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:28.806543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:28.806994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:28.807702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:28.808163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:28.808593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:28.960351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:28.969154 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8c69bd76-e8a2-4fc1-8a1a-1026ca03241b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1391 microversion: 2.1 time: 0.173570 Oct 31 15:57:28.969973 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2965/6053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:28 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:28.992866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:28.993585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:29.002525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.010611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.011340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.012346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.013291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.014190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.169670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:29.180393 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a823c1f0-e87a-492c-bbb7-5993748c0281 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1391 microversion: 2.1 time: 0.191409 Oct 31 15:57:29.181020 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3089/6054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:28 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:29.204796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:29.209617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:29.225838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.227619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.228253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.230368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.232733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.233593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.282742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:29.283256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:29.289793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.290552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.291002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.291717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.292182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.292613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.323724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:57:29.425691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:29.430121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22abf5ac-6041-4824-9ba1-17ca8de8417e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 204 len: 0 microversion: 2.1 time: 0.150945 Oct 31 15:57:29.431365 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3090/6055] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:57:29 2022] DELETE /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:57:29.434544 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39e04d8c-95a9-45b2-b366-88c040bd3224 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.240297 Oct 31 15:57:29.438454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2966/6056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:29 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:29.442439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:29.443242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:29.449651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.450226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.450775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.451553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:29.452126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:29.452613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:29.604816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:29.614742 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7b11c1c9-c17c-49f8-b715-79b1ef026fe0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1397 microversion: 2.1 time: 0.178447 Oct 31 15:57:29.615811 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3091/6057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:29 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1397 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:30.460518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:30.461165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:30.469934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:30.470405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:30.470876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:30.471816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:30.472454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:30.472917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:30.634886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:30.638983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b7c1cc92-919c-44b1-b3c8-1b57557713a8 req-0dc4280f-5f4b-4e79-925b-c5b1d71e3b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "name": "network-vif-plugged", "status": "completed", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:30.644546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ff888560-0b9f-462b-af8f-f793f61e82ae tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.187915 Oct 31 15:57:30.645515 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2967/6058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:30 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:30.650381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:30.651152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:30.656340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b7c1cc92-919c-44b1-b3c8-1b57557713a8 req-0dc4280f-5f4b-4e79-925b-c5b1d71e3b26 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:30.656887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b7c1cc92-919c-44b1-b3c8-1b57557713a8 req-0dc4280f-5f4b-4e79-925b-c5b1d71e3b26 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:30.657393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b7c1cc92-919c-44b1-b3c8-1b57557713a8 req-0dc4280f-5f4b-4e79-925b-c5b1d71e3b26 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:30.664001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:30.664512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:30.665047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:30.665717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:30.666184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:30.666623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:30.671244 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b7c1cc92-919c-44b1-b3c8-1b57557713a8 req-0dc4280f-5f4b-4e79-925b-c5b1d71e3b26 service nova] Creating event network-vif-plugged:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:57:30.677509 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b7c1cc92-919c-44b1-b3c8-1b57557713a8 req-0dc4280f-5f4b-4e79-925b-c5b1d71e3b26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044528 Oct 31 15:57:30.678452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3092/6059] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:30.877691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:30.909756 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea60357f-34e8-49c3-ab72-bcbfa3f771ad tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1397 microversion: 2.1 time: 0.262847 Oct 31 15:57:30.910512 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2968/6060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:30 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:31.673978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-98e807c0-ad07-421f-8999-d0c97ece7891 req-e46a3f9e-c084-42ed-897b-004d7e54e16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61275b68-506e-4f50-834b-2d04be707559", "name": "network-vif-deleted", "tag": "dfc4e822-0f05-477f-afe5-5ff49abeafc3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:31.675981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:31.677528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:31.687744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.688344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.688895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:31.689077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-98e807c0-ad07-421f-8999-d0c97ece7891 req-e46a3f9e-c084-42ed-897b-004d7e54e16a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.689735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.689879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-98e807c0-ad07-421f-8999-d0c97ece7891 req-e46a3f9e-c084-42ed-897b-004d7e54e16a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.690223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-98e807c0-ad07-421f-8999-d0c97ece7891 req-e46a3f9e-c084-42ed-897b-004d7e54e16a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:31.690829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.691462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:31.705434 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-98e807c0-ad07-421f-8999-d0c97ece7891 req-e46a3f9e-c084-42ed-897b-004d7e54e16a service nova] Creating event network-vif-deleted:dfc4e822-0f05-477f-afe5-5ff49abeafc3 for instance 61275b68-506e-4f50-834b-2d04be707559 on n-h1-858383-17 Oct 31 15:57:31.714502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-98e807c0-ad07-421f-8999-d0c97ece7891 req-e46a3f9e-c084-42ed-897b-004d7e54e16a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044886 Oct 31 15:57:31.715308 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3093/6061] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:31.881356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:31.893573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-60951bc9-04c2-4176-bd65-f3bf50b177c5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1269 microversion: 2.1 time: 0.226243 Oct 31 15:57:31.894836 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2969/6062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:31 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:31.937736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:31.938943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:31.946842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.947425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.948089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:31.948869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.949532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.950137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:32.020760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:32.028903 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9bda129f-45e0-4a44-8534-bae3bce3a5f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1188 microversion: 2.1 time: 0.097091 Oct 31 15:57:32.029657 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3094/6063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:31 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:32.698658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9b37b1a-06b9-43fa-a90b-75ee9a8118b0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: .version_select at 0x7f5ca14e99d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1167731125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl1f+VHW/hSnN6GjSWDK37Uhk3ZXXRz3z2n9BFQsqptDqBc6HjhRUUVu+cd0b7o0kHzhnebvsjoGSOZwjr7asSArvrWiw5Bqbdf5PN7YME66N42rT2knkn3ubbsco1fFw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:32.714742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f9b37b1a-06b9-43fa-a90b-75ee9a8118b0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:57:32.721539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f9b37b1a-06b9-43fa-a90b-75ee9a8118b0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:57:32.746498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9b37b1a-06b9-43fa-a90b-75ee9a8118b0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.221304 Oct 31 15:57:32.747135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2970/6064] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:57:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:32.918266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:32.919648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:32.927550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:32.928242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:32.928895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:32.929938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:32.930569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:32.931156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:33.052450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:33.053365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:33.059423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:33.060177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:33.060813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:33.061694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:33.062191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:33.063166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:33.093252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:33.101511 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0d8827b-6149-4003-8871-0c39e3b2c4f5 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1457 microversion: 2.1 time: 0.187679 Oct 31 15:57:33.105035 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3095/6065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:32 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1457 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:33.128584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:33.129668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:33.141300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:33.141766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:33.142411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:33.143020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:33.144068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:33.145850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:33.146305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:33.153195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0765c59c-f4ee-4fce-925a-549642e184c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1188 microversion: 2.1 time: 0.104702 Oct 31 15:57:33.154419 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2971/6066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:33 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:33.305659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:33.315610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd759309-03f5-4916-94d0-de60ca373fdb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1457 microversion: 2.1 time: 0.192694 Oct 31 15:57:33.317130 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3096/6067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:33 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1457 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:34.179757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:34.181083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:34.197606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:34.198701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:34.199424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:34.200409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:34.201126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:34.201806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:34.306960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:34.323601 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac1d573a-0167-42f8-8e5e-fc88874dec94 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1188 microversion: 2.1 time: 0.148736 Oct 31 15:57:34.325801 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2972/6068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:34 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1188 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:35.350238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:35.351593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:35.359016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:35.360583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:35.361300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:35.362102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:35.362812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:35.363454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:35.389927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:35.445645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:35.460105 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdf1f1fd-1562-4d11-add7-4c7561a45e7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1188 microversion: 2.1 time: 0.113694 Oct 31 15:57:35.461072 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3097/6069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:35 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:35.717044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f8cb2e67-5889-4481-b7b4-937f86faa792 req-a361e510-c5dc-4d3e-90ce-7fa2e7b046d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:35.739262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f8cb2e67-5889-4481-b7b4-937f86faa792 req-a361e510-c5dc-4d3e-90ce-7fa2e7b046d9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:35.740081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f8cb2e67-5889-4481-b7b4-937f86faa792 req-a361e510-c5dc-4d3e-90ce-7fa2e7b046d9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:35.740736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f8cb2e67-5889-4481-b7b4-937f86faa792 req-a361e510-c5dc-4d3e-90ce-7fa2e7b046d9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:35.775681 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f8cb2e67-5889-4481-b7b4-937f86faa792 req-a361e510-c5dc-4d3e-90ce-7fa2e7b046d9 service nova] Creating event network-changed:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:57:35.786014 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f8cb2e67-5889-4481-b7b4-937f86faa792 req-a361e510-c5dc-4d3e-90ce-7fa2e7b046d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075294 Oct 31 15:57:35.787259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2973/6070] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:36.485654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:36.486939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:36.502027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:36.503377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:36.504003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:36.505678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:36.510103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:36.510799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:36.680932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:36.697583 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1bd68f94-ba0b-4326-9414-efd477f61223 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 200 len: 1188 microversion: 2.1 time: 0.209277 Oct 31 15:57:36.699461 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3098/6071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:36 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 1188 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:37.727477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:37.729593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:37.737270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:37.738115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:37.738619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:37.739597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:37.740932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:37.741609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:37.761941 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 HTTP/1.1 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '61275b68-506e-4f50-834b-2d04be707559'} Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:37.763902 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:37.768649 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:37.772637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:57:37.776066 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47cc66a4-0b46-4b77-ab70-bd64dc92baa8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 404 len: 111 microversion: 2.1 time: 0.053046 Oct 31 15:57:37.780361 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2974/6072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:37 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:57:37.815825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}, {"name": "network-changed", "server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:37.829448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:37.830052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:37.830555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:37.862467 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] Creating event network-changed:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:57:37.864850 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] Creating event network-changed:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:57:37.894987 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b51c1684-378c-4d98-8a19-479215a5fc30 req-ad8b47fe-1b08-4188-9f63-1ab4dc7c054d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081473 Oct 31 15:57:37.895805 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3099/6073] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:41.200776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:41.201857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:41.218590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:41.219309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:41.220201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:41.221888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:41.222467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:41.222972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:41.245588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 HTTP/1.1 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '61275b68-506e-4f50-834b-2d04be707559'} Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:57:41.247535 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.252206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.254527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:57:41.255635 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9952a375-3563-461f-90f0-346fd3598938 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 404 len: 111 microversion: 2.1 time: 0.060090 Oct 31 15:57:41.256824 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2975/6074] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:57:41 2022] DELETE /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:57:41.266781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:41.267495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 61275b68-506e-4f50-834b-2d04be707559] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:41.277162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:41.277764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:41.278439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:41.280074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:41.280978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:41.282203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:41.301988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 HTTP/1.1 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '61275b68-506e-4f50-834b-2d04be707559'} Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:41.304542 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. Oct 31 15:57:41.309738 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:57:41.311879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 61275b68-506e-4f50-834b-2d04be707559 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:57:41.318728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9204528-81c1-4e0c-8f7a-dab12b3ac7fc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559" status: 404 len: 111 microversion: 2.1 time: 0.051936 Oct 31 15:57:41.319712 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3100/6075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:41 2022] GET /compute/v2.1/servers/61275b68-506e-4f50-834b-2d04be707559 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:57:41.675460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-378954702", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "bdfd165b-ee0d-4864-b18e-04789fe34100"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1167731125", "security_groups": [{"name": "tempest-secgroup-smoke-671553704"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:41.796521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] validate_networks() for [('bdfd165b-ee0d-4864-b18e-04789fe34100', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:57:42.309492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:57:42.310085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:57:42.310438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:57:42.310780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:57:42.311203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:57:42.321250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:42.321743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:42.322393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:42.323134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:42.323591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:42.324211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:42.343143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:57:42.349393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:57:42.364224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:57:42.366787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:57:42.418035 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-765a6d0f-ba12-4eb2-92bd-b0339d1d098d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746877 Oct 31 15:57:42.419344 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2976/6076] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:57:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:57:42.431222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5141d1a9-bfb1-4b70-b591-95466410ad98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:42.432500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5141d1a9-bfb1-4b70-b591-95466410ad98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:42.501756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5141d1a9-bfb1-4b70-b591-95466410ad98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:42.521913 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5141d1a9-bfb1-4b70-b591-95466410ad98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1266 microversion: 2.1 time: 0.084402 Oct 31 15:57:42.537437 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3101/6077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:42 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:43.555690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:43.555690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:43.574327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:43.575090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:43.575720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:43.576621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:43.577347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:43.578089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:43.674900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:43.698915 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-be54dd7d-dcbb-4c80-9908-6afa293c6af9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1318 microversion: 2.1 time: 0.149521 Oct 31 15:57:43.699849 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2977/6078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:43 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:44.724501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:44.725143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:44.746664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:44.747155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:44.747801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:44.748720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:44.749541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:44.750333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:44.904483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:44.913653 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccb43724-14ff-4bab-a265-6a8f30bcd9b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1324 microversion: 2.1 time: 0.192924 Oct 31 15:57:44.914236 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3102/6079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:44 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1324 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:45.843624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-e169c54c-163e-4be1-9a6e-b6960750a17e req-29a469a9-31db-4c97-a124-fe2d9d463588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:45.863039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e169c54c-163e-4be1-9a6e-b6960750a17e req-29a469a9-31db-4c97-a124-fe2d9d463588 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:45.863856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e169c54c-163e-4be1-9a6e-b6960750a17e req-29a469a9-31db-4c97-a124-fe2d9d463588 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:45.864288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-e169c54c-163e-4be1-9a6e-b6960750a17e req-29a469a9-31db-4c97-a124-fe2d9d463588 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:45.878615 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-e169c54c-163e-4be1-9a6e-b6960750a17e req-29a469a9-31db-4c97-a124-fe2d9d463588 service nova] Creating event network-changed:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h1-858383-17 Oct 31 15:57:45.884281 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-e169c54c-163e-4be1-9a6e-b6960750a17e req-29a469a9-31db-4c97-a124-fe2d9d463588 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048781 Oct 31 15:57:45.885460 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2978/6080] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:45.936933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:45.937691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:45.945699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:45.946335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:45.947066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:45.948120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:45.948689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:45.949377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:46.209968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:46.222596 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-578eda12-004e-4cd6-9eb6-1a7ba3400852 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1391 microversion: 2.1 time: 0.288870 Oct 31 15:57:46.223709 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3103/6081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:45 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:47.248956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:47.249666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:47.256594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:47.257127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:47.257569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:47.258290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:47.258779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:47.259443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:47.402616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:47.405164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=100 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:47.413216 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64390b2e-ddaa-434f-b2b4-31728ca14d1a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1391 microversion: 2.1 time: 0.169298 Oct 31 15:57:47.413807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2979/6082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:47 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:48.436517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:48.437855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:48.447230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:48.447968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:48.448806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:48.449820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:48.450629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:48.451332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:48.708093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:48.719572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8165e4af-1d0b-4299-9bbd-2906712791f4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1391 microversion: 2.1 time: 0.287650 Oct 31 15:57:48.732719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3104/6083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:48 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:49.743697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:49.744320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:49.751397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:49.754145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:49.754145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:49.754145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:49.754145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:49.754614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:49.905814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:49.915186 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8be56c1c-b181-429b-b71a-22de652349f8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1391 microversion: 2.1 time: 0.175277 Oct 31 15:57:49.915832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2980/6084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:49 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:50.939495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:50.940495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:50.944159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:50.949586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:50.950139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:50.950967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:50.951728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:50.952481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:50.953073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:51.063389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7320f2e5-8f04-420b-a773-245962eb4f44 req-fbe4b7b1-68af-4766-b37c-f6c681e57241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "name": "network-vif-plugged", "status": "completed", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:51.082542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7320f2e5-8f04-420b-a773-245962eb4f44 req-fbe4b7b1-68af-4766-b37c-f6c681e57241 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:51.083133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7320f2e5-8f04-420b-a773-245962eb4f44 req-fbe4b7b1-68af-4766-b37c-f6c681e57241 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:51.083576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7320f2e5-8f04-420b-a773-245962eb4f44 req-fbe4b7b1-68af-4766-b37c-f6c681e57241 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:51.095457 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7320f2e5-8f04-420b-a773-245962eb4f44 req-fbe4b7b1-68af-4766-b37c-f6c681e57241 service nova] Creating event network-vif-plugged:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h1-858383-17 Oct 31 15:57:51.101135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7320f2e5-8f04-420b-a773-245962eb4f44 req-fbe4b7b1-68af-4766-b37c-f6c681e57241 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141763 Oct 31 15:57:51.102165 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2981/6085] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:57:51.122367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:51.131150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41f4146c-61c1-417f-9952-c0a0433442eb tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1391 microversion: 2.1 time: 0.195900 Oct 31 15:57:51.131732 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3105/6086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:50 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:52.156639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:52.157521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:52.159508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:52.165088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:52.165584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:52.166220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:52.167263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:52.167735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:52.168174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:52.319122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:52.327307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eee3be4a-352c-400b-b8c1-54be6ee3ab26 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1391 microversion: 2.1 time: 0.175795 Oct 31 15:57:52.327993 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2982/6087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:52 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:53.351683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:53.352212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:53.355582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:53.361836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:53.362335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:53.362783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:53.363500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:53.364204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:53.364647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:53.526451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:53.535135 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2eac6dcb-b956-4edb-a1ad-3c91d3ec74df tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1563 microversion: 2.1 time: 0.187488 Oct 31 15:57:53.535737 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3106/6088] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:53 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:53.557447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:53.558059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:53.559922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:53.560595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:53.568301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:53.568929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:53.569524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:53.570231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:53.570692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:53.571119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:53.718854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:53.727770 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa30e79f-d8a4-4e37-af53-4b711681b170 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1563 microversion: 2.1 time: 0.174204 Oct 31 15:57:53.728367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2983/6089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:53 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:55.469470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:55.471596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b8236907-d73f-4034-8769-c553c0dd3c57 req-0def415c-c610-464e-9a66-0294deb621ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:55.478968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:55.486121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:55.490222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b8236907-d73f-4034-8769-c553c0dd3c57 req-0def415c-c610-464e-9a66-0294deb621ba service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:55.491006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:55.491528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:55.492304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:55.492865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:55.493360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:55.498302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b8236907-d73f-4034-8769-c553c0dd3c57 req-0def415c-c610-464e-9a66-0294deb621ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:55.498748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b8236907-d73f-4034-8769-c553c0dd3c57 req-0def415c-c610-464e-9a66-0294deb621ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:55.511690 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b8236907-d73f-4034-8769-c553c0dd3c57 req-0def415c-c610-464e-9a66-0294deb621ba service nova] Creating event network-changed:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h1-858383-17 Oct 31 15:57:55.519310 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b8236907-d73f-4034-8769-c553c0dd3c57 req-0def415c-c610-464e-9a66-0294deb621ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056619 Oct 31 15:57:55.524350 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2984/6090] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:55.756163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:55.764524 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c474ab7f-063d-4e81-8928-ba16a4882b9c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1563 microversion: 2.1 time: 0.304324 Oct 31 15:57:55.765916 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3107/6091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:55 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1563 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:02.476202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1150270841", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d250759f-d515-4d5c-8698-4c944884cf46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:02.537602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:58:03.193825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:58:03.194239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:58:03.194719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:58:03.195132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:58:03.195547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:58:03.204529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:03.205056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:03.205500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:03.207126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:03.207684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:03.208166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:03.224933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:58:03.230128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:58:03.290007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:58:03.292250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d250759f-d515-4d5c-8698-4c944884cf46',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:58:03.419350 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-29c5783a-31f3-40fa-911d-0684f2bd14cd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949071 Oct 31 15:58:03.420003 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2985/6092] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:58:03.431907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60ae1320-32d3-48dd-8fc7-813c2b9c2c68 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:03.432525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60ae1320-32d3-48dd-8fc7-813c2b9c2c68 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:03.490015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60ae1320-32d3-48dd-8fc7-813c2b9c2c68 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:03.497236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60ae1320-32d3-48dd-8fc7-813c2b9c2c68 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1071 microversion: 2.1 time: 0.068964 Oct 31 15:58:03.497812 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3108/6093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:03 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1071 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:04.521779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:04.522393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:04.530722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:04.531753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:04.532210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:04.533023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:04.533492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:04.534687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:04.603516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:04.612881 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-408e6dd4-f39e-4aed-ad35-4a6008a3728f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1187 microversion: 2.1 time: 0.095303 Oct 31 15:58:04.613477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2986/6094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:04 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:05.637674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:05.638428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:05.646762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:05.647473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:05.647947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:05.648830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:05.649581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:05.650017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:05.654173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=52 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:05.793792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:05.802970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a1132a5-d532-4c45-be1a-b1ddff350b38 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1229 microversion: 2.1 time: 0.169365 Oct 31 15:58:05.803846 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3109/6095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:05 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1229 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:05.835349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bee2a007-9e40-4885-a477-23819e7651f5 req-b11d624f-e242-47c8-8e4a-30548ab81d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94", "tag": "32782dee-b19d-472f-83e6-6c6a55e3c103"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:05.848754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bee2a007-9e40-4885-a477-23819e7651f5 req-b11d624f-e242-47c8-8e4a-30548ab81d1f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:05.849641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bee2a007-9e40-4885-a477-23819e7651f5 req-b11d624f-e242-47c8-8e4a-30548ab81d1f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:05.851045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bee2a007-9e40-4885-a477-23819e7651f5 req-b11d624f-e242-47c8-8e4a-30548ab81d1f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:05.867329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bee2a007-9e40-4885-a477-23819e7651f5 req-b11d624f-e242-47c8-8e4a-30548ab81d1f service nova] Creating event network-changed:32782dee-b19d-472f-83e6-6c6a55e3c103 for instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 on n-h2-858383-17 Oct 31 15:58:05.873271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bee2a007-9e40-4885-a477-23819e7651f5 req-b11d624f-e242-47c8-8e4a-30548ab81d1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044174 Oct 31 15:58:05.874344 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2987/6096] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:06.827125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:06.827722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:06.834821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:06.835323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:06.835768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:06.836504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:06.836979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:06.837410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:06.974570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:06.982686 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ebeefc5b-b4c0-4b56-9f06-fdb7df489d47 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1229 microversion: 2.1 time: 0.159798 Oct 31 15:58:06.983270 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3110/6097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:06 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:08.009060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:08.009781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:08.016046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:08.016526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:08.017064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:08.017896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:08.018400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:08.018849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:08.150889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:08.158688 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-13b1d6be-302e-4148-898e-da06b34f632b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1229 microversion: 2.1 time: 0.155573 Oct 31 15:58:08.159285 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2988/6098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:08 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1229 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:09.182555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:09.183178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:09.190997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:09.191565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:09.192009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:09.192885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:09.193351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:09.193801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:09.340948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:09.349829 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-afb86fc8-0508-4c2f-b3c0-1b4bfea3e2a1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1229 microversion: 2.1 time: 0.171284 Oct 31 15:58:09.350928 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3111/6099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:09 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:10.373476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:10.374100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:10.382380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:10.382878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:10.383315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:10.384015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:10.384474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:10.385006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:10.517679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:10.525477 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-06f1cca9-5489-4cfe-9434-f6eba7826687 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.156226 Oct 31 15:58:10.526331 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2989/6100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:10 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:11.550757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:11.551662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:11.559703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.560161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.560650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.561448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.561910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.562341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.604127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:11.604685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:11.612104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.615001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.615001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.615895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.616570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.617118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.648123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:58:11.702390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:11.712904 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7aae926-53c7-4c58-aa3c-19d490c6aba3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.166586 Oct 31 15:58:11.713524 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3112/6101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:11 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:11.719120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-20473f45-5094-450f-8fd0-1c33a2198dde req-6886f2bb-930c-4c2a-8020-58b08a625d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:11.731110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-20473f45-5094-450f-8fd0-1c33a2198dde req-6886f2bb-930c-4c2a-8020-58b08a625d77 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.731591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-20473f45-5094-450f-8fd0-1c33a2198dde req-6886f2bb-930c-4c2a-8020-58b08a625d77 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.732020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-20473f45-5094-450f-8fd0-1c33a2198dde req-6886f2bb-930c-4c2a-8020-58b08a625d77 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.744909 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-20473f45-5094-450f-8fd0-1c33a2198dde req-6886f2bb-930c-4c2a-8020-58b08a625d77 service nova] Creating event network-changed:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:58:11.747377 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-40a0af42-dbca-4821-81a0-71dd90ac3c19 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 204 len: 0 microversion: 2.1 time: 0.146956 Oct 31 15:58:11.748969 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2990/6102] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:58:11 2022] DELETE /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:58:11.750907 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-20473f45-5094-450f-8fd0-1c33a2198dde req-6886f2bb-930c-4c2a-8020-58b08a625d77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Oct 31 15:58:11.751527 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3113/6103] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:11.758830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:11.759542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:11.765965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.766761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.767246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.767964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:11.768438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:11.769548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:11.911948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:11.920882 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2e409bb6-58ac-4c95-83ce-ad159473f781 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1581 microversion: 2.1 time: 0.166877 Oct 31 15:58:11.921471 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2991/6104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:11 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1581 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:12.740580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:12.741457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:12.748814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:12.749735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:12.750183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:12.750930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:12.751468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:12.752181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:12.916941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:12.925152 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f674dc21-4bb1-4b91-9780-c73286080314 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.190536 Oct 31 15:58:12.925946 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3114/6105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:12 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:12.948450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:12.949106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:12.956408 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:12.957803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:12.958318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:12.959040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:12.959513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:12.960035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:13.100591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:13.108747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac21a5b5-ae9d-414f-9c5f-89fd2274681d tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1581 microversion: 2.1 time: 0.165794 Oct 31 15:58:13.109258 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2992/6106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:12 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1581 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:13.699838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c8d5aef4-3f66-4085-9a65-0c79521441ce req-4763e7cb-e2c7-4925-9ade-72119ea3df0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa58b2d-be95-43dd-8560-c7846d8432e2", "name": "network-vif-deleted", "tag": "b96a3782-b5ad-47ae-b4a8-52d6584d2c5f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:13.705322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:13.711852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c8d5aef4-3f66-4085-9a65-0c79521441ce req-4763e7cb-e2c7-4925-9ade-72119ea3df0f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:13.712338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c8d5aef4-3f66-4085-9a65-0c79521441ce req-4763e7cb-e2c7-4925-9ade-72119ea3df0f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:13.712837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c8d5aef4-3f66-4085-9a65-0c79521441ce req-4763e7cb-e2c7-4925-9ade-72119ea3df0f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:13.724720 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c8d5aef4-3f66-4085-9a65-0c79521441ce req-4763e7cb-e2c7-4925-9ade-72119ea3df0f service nova] Creating event network-vif-deleted:b96a3782-b5ad-47ae-b4a8-52d6584d2c5f for instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 on n-h2-858383-17 Oct 31 15:58:13.729406 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c8d5aef4-3f66-4085-9a65-0c79521441ce req-4763e7cb-e2c7-4925-9ade-72119ea3df0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Oct 31 15:58:13.730010 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3115/6107] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:13.951675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:13.952211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:13.954246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:13.955163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:13.963108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:13.963616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:13.964065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:13.964814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:13.965278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:13.965714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:14.114893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:14.124140 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57998d8a-6076-4243-8e8b-f48e8a0e747d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.176424 Oct 31 15:58:14.124940 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2993/6108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:13 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:14.136674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:14.138135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:14.145929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:14.146561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:14.147072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:14.147891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:14.148420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:14.148946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:14.223394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:14.231226 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68801dc4-65a8-48c2-beda-db1955df6e85 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1229 microversion: 2.1 time: 0.099413 Oct 31 15:58:14.231802 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3116/6109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:14 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:15.148329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:15.149123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:15.156175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:15.156661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:15.157124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:15.157821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:15.158278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:15.158718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:15.254619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:15.255822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:15.264158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:15.264962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:15.265588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:15.266483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:15.267112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:15.267721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:15.310381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:15.318896 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-20bc4a04-abd5-49ba-b715-04529d85fe0a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.174509 Oct 31 15:58:15.320143 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2994/6110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:15 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:15.350695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:15.359267 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0691098-3c07-414d-9680-7d71f4d3f346 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1229 microversion: 2.1 time: 0.108552 Oct 31 15:58:15.360033 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3117/6111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:15 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:58:16.342747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:16.343299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:16.350354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:16.350849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:16.351298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:16.352012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:16.352475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:16.352954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:16.384016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:16.384808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:16.392014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:16.392588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:16.393166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:16.393975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:16.395620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:16.396141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:16.478413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:16.486677 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e94357a-2e29-4dd5-8459-f69fd38ad671 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1229 microversion: 2.1 time: 0.106862 Oct 31 15:58:16.487264 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3118/6112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:16 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:58:16.510455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:16.518401 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e33704d6-d7ad-4b26-b3a0-f986ba530262 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.179720 Oct 31 15:58:16.519578 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2995/6113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:16 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:17.510230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:17.510866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:17.518073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:17.518570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:17.519550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:17.520353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:17.520846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:17.521283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:17.542383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:17.543627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:17.551385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:17.552160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:17.552802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:17.553670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:17.554291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:17.554882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:17.559524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:17.616175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22170d4ff3144a499422db890d7361a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3513ff79862f43be96d889c513b952f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:17.624903 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a8c46d5-4828-4e3b-8c66-d242ac7f8a98 tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 200 len: 1229 microversion: 2.1 time: 0.118747 Oct 31 15:58:17.625500 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3119/6114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:17 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:17.787123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:17.795324 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ccc08fd3-8a85-418d-85d0-2beabb198733 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.256632 Oct 31 15:58:17.796148 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2996/6115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:17 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:18.647688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:18.648306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] [instance: 8fa58b2d-be95-43dd-8560-c7846d8432e2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:18.655353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:18.655838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:18.656278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:18.656993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:18.657449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:18.657875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:18.671800 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] HTTP exception thrown: Instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 could not be found. Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Request method failure captured: Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 HTTP/1.1 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--gnAPGJNmDO9aeW-wVhvQesOBkAnMbl8-DQg1K3hLGCRkvp5NmzSR1LIeutPCUWDdwwSWtRVbdlzdYDEoTwF-_ENPOVEoUw06p3Fow2OsuDQ7-J4PR1c0wOzuMXHHYcLhEvaWznP2UchUBgRemAeCamz55tHp1FKdc_XS6j-8kKIU Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 3513ff79862f43be96d889c513b952f6 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBackupRestore-2098001681 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3513ff79862f43be96d889c513b952f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3513ff79862f43be96d889c513b952f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3513ff79862f43be96d889c513b952f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3513ff79862f43be96d889c513b952f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBackupRestore-2098001681 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 3513ff79862f43be96d889c513b952f6 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2098001681 Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBackupRestore-2098001681-project Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: d22170d4ff3144a499422db890d7361a Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBackupRestore-2098001681-project Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 could not be found. Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '8fa58b2d-be95-43dd-8560-c7846d8432e2'} Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 could not be found. Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 could not be found. Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:58:18.673584 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 could not be found. Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Returning 404 to user: Instance 8fa58b2d-be95-43dd-8560-c7846d8432e2 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37d14f96-52e6-452d-90b3-a577aad829cb tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2" status: 404 len: 111 microversion: 2.1 time: 0.031306 Oct 31 15:58:18.679839 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3120/6116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:18 2022] GET /compute/v2.1/servers/8fa58b2d-be95-43dd-8560-c7846d8432e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:58:18.820940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:18.822711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:18.830736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:18.831495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:18.832753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:18.833959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:18.837145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:18.837145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:18.842121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dc5a6442-9591-44a8-b462-fa6cfa566c7a tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] Calling method '.version_select at 0x7f5ca13929d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:18.877075 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dc5a6442-9591-44a8-b462-fa6cfa566c7a tempest-TestVolumeBackupRestore-2098001681 tempest-TestVolumeBackupRestore-2098001681-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-854988582" status: 202 len: 0 microversion: 2.1 time: 0.038647 Oct 31 15:58:18.881248 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3121/6117] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 15:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-854988582 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:58:18.916908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8d8ceb27-84b9-43db-85ae-549c18e6802f req-e6d0d371-46c2-4daa-861f-062c62d8c8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94", "name": "network-vif-plugged", "status": "completed", "tag": "32782dee-b19d-472f-83e6-6c6a55e3c103"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:18.930915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8d8ceb27-84b9-43db-85ae-549c18e6802f req-e6d0d371-46c2-4daa-861f-062c62d8c8ba service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:18.931373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8d8ceb27-84b9-43db-85ae-549c18e6802f req-e6d0d371-46c2-4daa-861f-062c62d8c8ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:18.931815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8d8ceb27-84b9-43db-85ae-549c18e6802f req-e6d0d371-46c2-4daa-861f-062c62d8c8ba service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:18.942986 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8d8ceb27-84b9-43db-85ae-549c18e6802f req-e6d0d371-46c2-4daa-861f-062c62d8c8ba service nova] Creating event network-vif-plugged:32782dee-b19d-472f-83e6-6c6a55e3c103 for instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 on n-h2-858383-17 Oct 31 15:58:18.949647 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8d8ceb27-84b9-43db-85ae-549c18e6802f req-e6d0d371-46c2-4daa-861f-062c62d8c8ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036357 Oct 31 15:58:18.950478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3122/6118] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:58:19.102463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:19.122073 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8221e36-7f8f-4a9e-9a7b-9297fb2b5777 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.298606 Oct 31 15:58:19.148929 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2997/6119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:18 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:20.159747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:20.161519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:20.182950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:20.185203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:20.185918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:20.187940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:20.190150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:20.190775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:20.449615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:20.459754 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a01460f-b233-417e-a927-02b99ade0d6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1217 microversion: 2.1 time: 0.306494 Oct 31 15:58:20.460403 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3123/6120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:20 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:21.483620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:21.484224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:21.497133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:21.497837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:21.498469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:21.499537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:21.502136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:21.502715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:21.682540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:21.692835 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80145f6a-6c66-4d87-b542-5fa77b17a4d8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1405 microversion: 2.1 time: 0.212590 Oct 31 15:58:21.693593 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2998/6121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:21 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:21.719948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:21.720443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:21.727536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:21.729113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:21.729929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:21.730382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:21.731106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:21.731657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:21.732127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:21.908949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:21.923334 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e642e7da-97c1-4e19-9a0e-3dc84e0b069b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1405 microversion: 2.1 time: 0.207718 Oct 31 15:58:21.923923 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3124/6122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:21 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:21.947546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-812184737"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:21.950497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:21.961592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:21.962446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:21.962976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:21.963792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:21.964603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:21.965061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:22.128906 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Attempting to quiesce instance before volume snapshot. Oct 31 15:58:22.193014 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 31 15:58:22.303503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Creating snapshot from volume d250759f-d515-4d5c-8698-4c944884cf46. {{(pid=120626) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 31 15:58:23.467420 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-125c1613-548a-4407-9ed0-aa115b6c1fbf tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94/action" status: 202 len: 0 microversion: 2.1 time: 1.524202 Oct 31 15:58:23.468286 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 2999/6123] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:58:21 2022] POST /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94/action => generated 0 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:58:24.640596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1164804102", "imageRef": "77296d84-9425-44d8-9fae-621b12868e22", "flavorRef": "452", "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:24.698758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:58:25.104955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:58:25.105456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:58:25.106149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:58:25.106760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:58:25.107241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:58:25.116641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:25.117426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:25.117933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:25.119339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:25.119878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:25.120411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:25.138359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:58:25.143836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:58:25.156908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:58:25.159499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='abcc9b46-782c-45db-b103-75b89da0ab49',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:58:25.242610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c3acced-25ba-4495-adee-4d07f066fe32 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605985 Oct 31 15:58:25.244830 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3125/6124] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:58:25.259507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86a403ce-11fb-4ae5-8ee1-0cf78b4910e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:25.261482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-86a403ce-11fb-4ae5-8ee1-0cf78b4910e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:25.264542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:25.338124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-86a403ce-11fb-4ae5-8ee1-0cf78b4910e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:25.347174 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-86a403ce-11fb-4ae5-8ee1-0cf78b4910e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1230 microversion: 2.1 time: 0.096137 Oct 31 15:58:25.365277 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3000/6125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:25 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:26.372395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:26.373057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:26.381106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:26.381603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:26.382048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:26.382760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:26.383229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:26.383663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:26.551493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:26.560669 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7b8d708-8229-48f9-b2a9-c7b112c78566 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1282 microversion: 2.1 time: 0.193031 Oct 31 15:58:26.561663 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3126/6126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:26 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:58:27.586188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:27.589980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:27.605899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:27.606626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:27.607006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:27.607801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:27.612675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:27.614477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:27.986875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:27.996524 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2f21b9e4-2990-4d31-9bc1-ac4215d3ece5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.414782 Oct 31 15:58:28.004758 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3001/6127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:27 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:28.714271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-af14c666-092a-48ef-923e-485b4188ee08 req-18812019-59a7-4331-861f-10a1f0aa3737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9d0e4d-f490-40bf-8f64-5847cee5ba3f", "tag": "6360e86c-9dad-456b-985b-ae6950ac69ff"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:28.735716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-af14c666-092a-48ef-923e-485b4188ee08 req-18812019-59a7-4331-861f-10a1f0aa3737 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:28.736928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-af14c666-092a-48ef-923e-485b4188ee08 req-18812019-59a7-4331-861f-10a1f0aa3737 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:28.737614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-af14c666-092a-48ef-923e-485b4188ee08 req-18812019-59a7-4331-861f-10a1f0aa3737 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:28.757589 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-af14c666-092a-48ef-923e-485b4188ee08 req-18812019-59a7-4331-861f-10a1f0aa3737 service nova] Creating event network-changed:6360e86c-9dad-456b-985b-ae6950ac69ff for instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f on n-h1-858383-17 Oct 31 15:58:28.765016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-af14c666-092a-48ef-923e-485b4188ee08 req-18812019-59a7-4331-861f-10a1f0aa3737 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067057 Oct 31 15:58:28.766238 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3127/6128] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:29.026274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:29.027228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:29.041488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:29.042298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:29.045692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:29.046847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:29.049434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:29.050834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:29.099178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:29.102305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:29.118627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:29.121078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:29.122245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:29.123627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:29.124205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:29.125692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:29.225617 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d75506a-6234-43cc-899d-e9db6ff4cd34 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action" status: 200 len: 24575 microversion: 2.1 time: 0.131552 Oct 31 15:58:29.226558 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3128/6129] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:58:29 2022] POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action => generated 24575 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:58:29.766139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:29.782157 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47f63214-1d7f-40de-b7d1-65304def6131 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.755152 Oct 31 15:58:29.783164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3002/6130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:29 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:30.808925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:30.810398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:30.818069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:30.818608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:30.819173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:30.820061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:30.820672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:30.821134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:31.020077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:31.030288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8726620d-3ff5-4632-9a42-463dca3f46cc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.224229 Oct 31 15:58:31.031362 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3129/6131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:30 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:32.062740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:32.065625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:32.079072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:32.079590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:32.080111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:32.081242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:32.083136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:32.085106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:32.337431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:32.350674 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-88c25dfc-44e8-420b-8c6c-60256d69ef6e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.295568 Oct 31 15:58:32.365127 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3003/6132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:32 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:33.387177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:33.388008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:33.403432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:33.403432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:33.403432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:33.403898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:33.404361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:33.404974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:33.720988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:33.733072 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74e4a236-4779-4338-8cdf-6ed0d4b66797 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.356148 Oct 31 15:58:33.741306 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3130/6133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:33 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:34.759807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:34.760432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:34.767394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:34.767887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:34.768520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:34.769418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:34.769876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:34.770984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:34.904502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:34.912988 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-363e854f-f2cb-43f1-8400-ee52eb23c796 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.156938 Oct 31 15:58:34.913955 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3004/6134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:34 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:35.936422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:35.937070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:35.939841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:35.940754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:35.947233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:35.947730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:35.948169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:35.948899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:35.949364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:35.949839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:35.952389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:36.088766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:36.096765 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0d6e6a0-dec3-48b8-a200-3e7917b2aad6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.164192 Oct 31 15:58:36.097340 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3131/6135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:35 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:37.120598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:37.121260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:37.123202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:37.130599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:37.131107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:37.131562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:37.132283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:37.132782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:37.133233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:37.273733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:37.282426 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b7baaba6-81ae-497c-94fd-006c4410bdc0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.165742 Oct 31 15:58:37.297413 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3005/6136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:37 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:38.307676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:38.308262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:38.315273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:38.315776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:38.316216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:38.316971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:38.317440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:38.318534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:38.462491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:38.471420 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97829355-d541-460f-ae2d-3a7e08e92216 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.167742 Oct 31 15:58:38.471998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3132/6137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:38 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:39.495574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:39.496111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:39.502870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:39.503369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:39.503816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:39.504523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:39.505022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:39.506106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:39.641163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:39.650240 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-89aeb2d6-29b7-481a-a353-e571f3d034ba tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.158541 Oct 31 15:58:39.651018 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3006/6138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:39 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:40.674840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:40.675522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:40.683351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:40.683849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:40.684286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:40.685030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:40.685490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:40.685916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:40.828785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:40.837476 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09fd4bed-1a93-46f0-a6fe-3a42f8cc5446 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1342 microversion: 2.1 time: 0.166559 Oct 31 15:58:40.838053 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3133/6139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:40 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:41.862243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:41.862906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:41.869329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:41.869830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:41.870284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:41.870996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:41.871475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:41.871920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:42.003554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:42.011549 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5228ba06-e004-4bfa-84c9-c90ab837e71c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.153308 Oct 31 15:58:42.012125 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3007/6140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:41 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:43.035520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:43.036138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:43.044085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:43.044580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:43.045046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:43.045753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:43.046219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:43.046653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:43.187278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:43.195236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d7d556e-7beb-44d2-b4eb-f194a9ab50f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.163659 Oct 31 15:58:43.195814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3134/6141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:43 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:44.219933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:44.220817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:44.228865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:44.229373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:44.229831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:44.230548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:44.231027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:44.231478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:44.374150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:44.384061 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcd98cc5-d65a-4b6f-a301-38e7374d22b2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.168462 Oct 31 15:58:44.384712 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3008/6142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:44 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:45.408051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:45.408663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:45.416109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:45.416590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:45.417056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:45.417754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:45.418212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:45.418640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:45.551862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:45.559893 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e60f3ff2-c344-4a1e-997d-5cb5d3c0c6a3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.155740 Oct 31 15:58:45.560470 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3135/6143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:45 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:46.582833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:46.583439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:46.590871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:46.591364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:46.591813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:46.592520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:46.593024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:46.593465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:46.730037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:46.737937 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e0f0ce4-82bc-480a-b510-1b64b12605f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.159113 Oct 31 15:58:46.738503 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3009/6144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:46 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:47.761517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:47.762137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:47.769360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:47.769788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:47.770227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:47.770980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:47.771444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:47.771869 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:47.953189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:47.961538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a1e7b62d-517f-4992-87e3-896288615cf8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.203995 Oct 31 15:58:47.962147 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3136/6145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:47 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:48.986728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:48.987383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:48.995576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:48.996121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:48.996742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:48.998160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:48.998666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:48.999152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:49.002303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:49.155322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:49.164456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c107c9f-27c4-45a5-9bc2-ab747474e2d9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.181915 Oct 31 15:58:49.165279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3010/6146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:48 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:50.191707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:50.192339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:50.200782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:50.201351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:50.201870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:50.202651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:50.203282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:50.203717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:50.344789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:50.353830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8920c1da-5b60-4203-98b6-157a249ccdfd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.166749 Oct 31 15:58:50.354512 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3137/6147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:50 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:51.379229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:51.379899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:51.386854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:51.387360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:51.387811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:51.388527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:51.389096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:51.389542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:51.525897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:51.534890 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-909c3f09-0c64-4307-9dfb-2fad963f24a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.159544 Oct 31 15:58:51.535496 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3011/6148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:51 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:52.559532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:52.560894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:52.563600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:52.569120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:52.569610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:52.570045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:52.570733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:52.571191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:52.571616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:52.704011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:52.711910 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-042f1213-a1c9-41dc-b0a0-e1d85aee155a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.156352 Oct 31 15:58:52.712477 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3138/6149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:52 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:53.330768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-75946b7e-d5b3-4c65-89c1-5e5635f519aa req-e2564209-3963-4632-a91c-8eb290c37fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9d0e4d-f490-40bf-8f64-5847cee5ba3f", "name": "network-vif-plugged", "status": "completed", "tag": "6360e86c-9dad-456b-985b-ae6950ac69ff"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:53.343055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-75946b7e-d5b3-4c65-89c1-5e5635f519aa req-e2564209-3963-4632-a91c-8eb290c37fa6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:53.343560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-75946b7e-d5b3-4c65-89c1-5e5635f519aa req-e2564209-3963-4632-a91c-8eb290c37fa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:53.344091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-75946b7e-d5b3-4c65-89c1-5e5635f519aa req-e2564209-3963-4632-a91c-8eb290c37fa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:53.355527 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-75946b7e-d5b3-4c65-89c1-5e5635f519aa req-e2564209-3963-4632-a91c-8eb290c37fa6 service nova] Creating event network-vif-plugged:6360e86c-9dad-456b-985b-ae6950ac69ff for instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f on n-h1-858383-17 Oct 31 15:58:53.361387 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-75946b7e-d5b3-4c65-89c1-5e5635f519aa req-e2564209-3963-4632-a91c-8eb290c37fa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Oct 31 15:58:53.362070 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3012/6150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:53.735857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:53.736471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:53.743729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:53.744271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:53.744648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:53.745365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:53.745855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:53.746283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:53.879436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:53.887246 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a1d763a-b28c-4378-ad88-ca2d64cc21c5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1376 microversion: 2.1 time: 0.155991 Oct 31 15:58:53.888340 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3139/6151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:53 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:54.912606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:54.913374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:54.919772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:54.920931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:54.921545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:54.922276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:54.922764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:54.923212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.057103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:55.065012 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b912324-ad96-479d-8d62-3fc490930e78 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1563 microversion: 2.1 time: 0.157601 Oct 31 15:58:55.065588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3013/6152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:54 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:55.088030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:55.088664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:55.096034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:55.096521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:55.096989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.097688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:55.098160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:55.098588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.231327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:55.239794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-04508e5e-0d64-478f-b207-2b11ff4ee937 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1563 microversion: 2.1 time: 0.155888 Oct 31 15:58:55.240381 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3140/6153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:55 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:55.321090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:55.321695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:55.323677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=30 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:55.329055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:55.329553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:55.330009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.330706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:55.331176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:55.331620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.359427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:58:55.436421 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4eceac73-7147-449b-9002-a26daf435a43 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 204 len: 0 microversion: 2.1 time: 0.117969 Oct 31 15:58:55.437105 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3014/6154] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:58:55 2022] DELETE /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:58:55.445315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:55.445934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:55.452272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:55.452834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:55.453467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.454638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:55.455486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:55.455973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:55.587524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:55.596059 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30366239-bba3-4dcc-8121-0c3d8e12732c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1569 microversion: 2.1 time: 0.154658 Oct 31 15:58:55.596634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3141/6155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:55 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:56.621087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:56.621807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:56.629572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:56.630060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:56.630504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:56.631199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:56.631664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:56.632098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:56.772836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:56.782245 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b57b5d1-5867-4d2e-acef-98e33d28b30c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1569 microversion: 2.1 time: 0.166211 Oct 31 15:58:56.782874 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3015/6156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:56 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:57.677308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-738f4485-b1e7-47bb-aa24-f713e2dd0d8c req-45bbd88f-d188-4ed1-9187-5bf26deca754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9d0e4d-f490-40bf-8f64-5847cee5ba3f", "name": "network-vif-deleted", "tag": "6360e86c-9dad-456b-985b-ae6950ac69ff"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:57.688862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-738f4485-b1e7-47bb-aa24-f713e2dd0d8c req-45bbd88f-d188-4ed1-9187-5bf26deca754 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:57.689385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-738f4485-b1e7-47bb-aa24-f713e2dd0d8c req-45bbd88f-d188-4ed1-9187-5bf26deca754 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:57.689812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-738f4485-b1e7-47bb-aa24-f713e2dd0d8c req-45bbd88f-d188-4ed1-9187-5bf26deca754 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:57.704629 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-738f4485-b1e7-47bb-aa24-f713e2dd0d8c req-45bbd88f-d188-4ed1-9187-5bf26deca754 service nova] Creating event network-vif-deleted:6360e86c-9dad-456b-985b-ae6950ac69ff for instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f on n-h1-858383-17 Oct 31 15:58:57.710208 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-738f4485-b1e7-47bb-aa24-f713e2dd0d8c req-45bbd88f-d188-4ed1-9187-5bf26deca754 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036794 Oct 31 15:58:57.711435 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3142/6157] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:57.807628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:57.808371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:57.819388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:57.819909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:57.820368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:57.821137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:57.821619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:57.822067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:57.895037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:57.903146 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e64b2513-7711-4c75-84d1-70fe88b90a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1361 microversion: 2.1 time: 0.099494 Oct 31 15:58:57.903726 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3016/6158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:57 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:58.928266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:58.929009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:58.935980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:58.936480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:58.936948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:58.938231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:58.938679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:58.939113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:59.014097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:59.022443 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e2cc75cc-a39d-4004-b4d4-492c90cd1bef tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1361 microversion: 2.1 time: 0.099590 Oct 31 15:58:59.036871 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3143/6159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:58 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1361 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:59.677195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:59.677835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:59.685017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:59.685522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:59.685973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:59.686696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:59.687169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:59.687837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:59.926848 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e6a94b3f-1bb2-4c26-b5de-e61285f97587 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1834 microversion: 2.1 time: 0.253592 Oct 31 15:58:59.940884 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3017/6160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:59 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1834 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:59.949522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:59.950759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:59.958862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:59.959381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:59.959833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:59.960555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:59.961137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:59.961579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.046859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:00.047718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:00.060202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.060732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.061235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.061960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.062597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.063152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.123511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:00.132127 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5dca5ee3-0f6f-4572-a369-a42af7fabcce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1681 microversion: 2.1 time: 0.186764 Oct 31 15:59:00.133057 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3144/6161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:59 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:00.143370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:00.162038 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d68a1f8e-8cbb-4d70-b9f5-c2b8ffbbeb1f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1361 microversion: 2.1 time: 0.119380 Oct 31 15:59:00.163083 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3018/6162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:00 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1361 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:00.243143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:00.246066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:00.254050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.254861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.255371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.256153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.256633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.257187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.331894 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38c60fdc-a46e-4ee7-b801-8076d15d129a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action" status: 200 len: 32634 microversion: 2.1 time: 0.093003 Oct 31 15:59:00.332895 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3145/6163] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:59:00 2022] POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action => generated 32634 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:59:00.524837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:00.525418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:00.532788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.533278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.533737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.534461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.535053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.535504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.575922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '99147d76045d41e9aadd3535d5b0cf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b1bf4a802a41a88ae77c5b673c8d75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:00.576527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 2613f814-2a75-4901-9097-84d86b929281] flavor_id is None. Assuming migration. {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:59:00.577088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 2613f814-2a75-4901-9097-84d86b929281] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:59:00.696805 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe73d3e0-2a9b-4d21-a062-2b11d1f50bc5 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action" status: 202 len: 0 microversion: 2.1 time: 0.176079 Oct 31 15:59:00.697767 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3019/6164] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:59:00 2022] POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:59:00.707296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:00.708635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:00.716559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.717328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.717762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.719617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:00.720124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:00.720652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:00.880536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:00.890199 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e7d03a2-dd85-4a80-b8d3-5a0c4e5ec358 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1690 microversion: 2.1 time: 0.188209 Oct 31 15:59:00.891790 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3146/6165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:00 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:01.189044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:01.189746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:01.196185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:01.196733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:01.197189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:01.197928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:01.198411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:01.199013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:01.284467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:01.294605 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-36183ccc-b20c-497f-b2e3-4edf31ee29eb tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1361 microversion: 2.1 time: 0.110770 Oct 31 15:59:01.303762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3020/6166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:01 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:01.916194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:01.916837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:01.925568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:01.926392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:01.927082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:01.927873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:01.928430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:01.929136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:02.076382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:02.085824 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8adb65a0-745a-47da-97dd-e71be3410cbf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1690 microversion: 2.1 time: 0.174074 Oct 31 15:59:02.086425 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3147/6167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:01 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:02.320776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:02.321443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:02.329202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:02.329729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:02.330191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:02.330925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:02.331404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:02.331848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:02.372479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:02.373036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:02.373574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:02.374114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lazy-loading 'fault' on Instance uuid 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:59:02.429251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:02.437072 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa6cd491-c192-43c0-95f4-bea6e521f18c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 200 len: 1366 microversion: 2.1 time: 0.121777 Oct 31 15:59:02.437869 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3021/6168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:02 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:03.110065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:03.111223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:03.118293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:03.118795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:03.119490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:03.120211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:03.120883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:03.121324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:03.281697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:03.285815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:03.295378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f546291-8fae-4624-9f4e-d85700575bf8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1690 microversion: 2.1 time: 0.189377 Oct 31 15:59:03.296077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3148/6169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:03 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:03.462400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:03.463099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:03.470126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:03.470624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:03.471075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:03.471781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:03.472250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:03.472690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:03.486408 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f HTTP/1.1 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1a9d0e4d-f490-40bf-8f64-5847cee5ba3f'} Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:03.488079 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f55395c-e6fd-4c0c-807b-92a243d44768 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 404 len: 111 microversion: 2.1 time: 0.031424 Oct 31 15:59:03.493950 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3022/6170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:03 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:04.319620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:04.320197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:04.327010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:04.327496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:04.327933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:04.329316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:04.329873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:04.330781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:04.463887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:04.472685 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58dfa229-6fa4-459c-ac42-d71fe8c24917 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.157151 Oct 31 15:59:04.473478 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3149/6171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:04 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:05.495946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:05.496517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:05.504017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:05.504535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:05.505036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:05.505787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:05.506276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:05.506719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:05.646126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:05.656002 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7de82361-aebf-48f5-9b91-c8bce2329ad7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.164281 Oct 31 15:59:05.656627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3023/6172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:05 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:06.679416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:06.680145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:06.686922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:06.687418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:06.688684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:06.689405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:06.689872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:06.690308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:06.834677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:06.843631 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db82768b-b744-4ff0-8a0d-491a48337dc6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.167962 Oct 31 15:59:06.847042 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3150/6173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:06 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:07.772915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:07.773455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:07.780334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:07.780882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:07.781338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:07.782547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:07.783017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:07.783455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:07.799120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:07.810814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:59:07.867860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:07.868569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:07.875567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:07.876055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:07.876493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:07.877354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:07.877815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:07.878244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:07.891195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ba6d5d2-da6e-4c6b-b30a-f553bd993212 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 204 len: 0 microversion: 2.1 time: 0.122009 Oct 31 15:59:07.892092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3024/6174] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:59:07 2022] DELETE /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:59:07.901101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:07.901821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:07.907760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:07.908899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:07.909509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:07.910232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:07.910724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:07.911156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:08.087150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:08.090722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:08.095262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e932c3c8-7732-49b1-8c50-3d992bde9160 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.231619 Oct 31 15:59:08.096476 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3151/6175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:07 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:08.099586 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-739ec76e-8758-4ad9-bd79-51fe02a59e40 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1411 microversion: 2.1 time: 0.202649 Oct 31 15:59:08.100161 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3025/6176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:07 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1411 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:09.118999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:09.119619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:09.122398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:09.123056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:09.126725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.127287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.127828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.128542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.129039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.129474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.130209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.130706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.131151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.131852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.132320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.132796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.325415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:09.332481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:09.333325 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d38eec0-6b23-4b13-a2ad-e3e00fd6ade1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.218260 Oct 31 15:59:09.333921 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3152/6177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:09 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:09.341117 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c2815c16-4694-41f9-81ac-709e10f1cd25 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1411 microversion: 2.1 time: 0.222444 Oct 31 15:59:09.341764 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3026/6178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:09 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1411 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:09.829280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6ff03ef4-0d24-4a53-99fc-39b377dbf92c req-4556a0c9-beb5-43ea-af8c-5815a1a71350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94", "name": "network-vif-deleted", "tag": "32782dee-b19d-472f-83e6-6c6a55e3c103"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:09.840795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6ff03ef4-0d24-4a53-99fc-39b377dbf92c req-4556a0c9-beb5-43ea-af8c-5815a1a71350 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.841283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6ff03ef4-0d24-4a53-99fc-39b377dbf92c req-4556a0c9-beb5-43ea-af8c-5815a1a71350 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.841713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6ff03ef4-0d24-4a53-99fc-39b377dbf92c req-4556a0c9-beb5-43ea-af8c-5815a1a71350 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.854018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6ff03ef4-0d24-4a53-99fc-39b377dbf92c req-4556a0c9-beb5-43ea-af8c-5815a1a71350 service nova] Creating event network-vif-deleted:32782dee-b19d-472f-83e6-6c6a55e3c103 for instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 on n-h2-858383-17 Oct 31 15:59:09.859351 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6ff03ef4-0d24-4a53-99fc-39b377dbf92c req-4556a0c9-beb5-43ea-af8c-5815a1a71350 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Oct 31 15:59:09.859948 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3153/6179] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:10.356829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:10.357378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:10.365393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.365909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.366367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.367094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.367610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.368066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.368668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:10.369500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:10.376365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.377702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.378290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.379107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.379689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.380212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.466236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:10.474761 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-88e4a10d-a998-49f0-b2f1-1206e26c4e49 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1202 microversion: 2.1 time: 0.112238 Oct 31 15:59:10.475456 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3154/6180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:10 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:10.526482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:10.534628 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad7a892c-e73c-4176-a0e5-a1b402fe2a5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.181824 Oct 31 15:59:10.535207 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3027/6181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:10 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:11.498185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:11.498809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:11.506480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.506979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.507420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.508127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.508591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.509059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.557943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:11.558630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:11.566721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.567231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.567684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.568621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.569183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.569635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.575304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:11.584081 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea4e26e3-fe0e-4b21-9615-ce4b182a2b26 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1202 microversion: 2.1 time: 0.089722 Oct 31 15:59:11.584725 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3155/6182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:11 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:11.705657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:11.713812 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-932f34c4-b4ec-4532-a769-a6ca46fdc55c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.159792 Oct 31 15:59:11.714386 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3028/6183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:11 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:12.607758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:12.609027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:12.615886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:12.616385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:12.616861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.617578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:12.618095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:12.618532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.681488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:12.689341 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50d5ccef-737f-41d0-bf8f-58b9a0750027 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1202 microversion: 2.1 time: 0.085824 Oct 31 15:59:12.689975 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3156/6184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:12 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:12.738510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:12.739088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:12.746223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:12.746736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:12.747216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.747929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:12.748407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:12.748890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.886161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:12.894395 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0088dbd8-9e46-4a3a-aa46-b8601c3af83d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.160137 Oct 31 15:59:12.894975 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3029/6185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:12 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:13.712643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:13.713552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:13.720563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:13.721138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:13.721581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:13.722281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:13.722745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:13.723176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:13.786452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:13.794985 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cec71b04-1e36-422b-b882-7e69da3b2b9a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 200 len: 1202 microversion: 2.1 time: 0.086321 Oct 31 15:59:13.795586 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3157/6186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:13 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 1202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:13.917644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:13.918280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:13.925458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:13.925963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:13.926421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:13.927137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:13.927617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:13.928065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:14.083308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:14.093517 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b548b38b-7b9e-4d52-8343-1c0e5a56c538 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.179770 Oct 31 15:59:14.094027 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3030/6187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:13 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:14.820454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:14.821279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:14.830460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:14.831304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:14.832037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:14.833256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:14.834013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:14.834857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:14.850837 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 HTTP/1.1 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94'} Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:14.852522 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a285dfb3-be75-4ad9-8459-4fb2ea1e4bb0 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 404 len: 111 microversion: 2.1 time: 0.039621 Oct 31 15:59:14.857574 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3158/6188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:14 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:15.118897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:15.119532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:15.127761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:15.129357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:15.129817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:15.131329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:15.131933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:15.132384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:15.309080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:15.318526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-418d7701-b262-4067-92c4-9bfd3b6575bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1695 microversion: 2.1 time: 0.204308 Oct 31 15:59:15.319960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3031/6189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:15 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:16.343231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:16.343857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:16.351571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:16.352066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:16.352510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:16.353252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:16.353724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:16.354155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:16.500102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "name": "network-vif-unplugged", "status": "completed", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:16.512322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:16.512934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:16.513457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:16.529775 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] Creating event network-vif-unplugged:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h2-858383-17 Oct 31 15:59:16.535952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] Instance 2613f814-2a75-4901-9097-84d86b929281 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:59:16.547598 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-30e42940-28c6-4063-8142-ff2e6798253f req-15fc82ef-1eff-4b1a-b5cf-0dbf7195dbb0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051612 Oct 31 15:59:16.548571 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3032/6190] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:16.584394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:16.594897 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9c93584-62a8-4311-8054-592b735be2b1 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1694 microversion: 2.1 time: 0.255488 Oct 31 15:59:16.595693 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3159/6191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:16 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:17.034807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:17.036941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:17.045123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.045724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.046846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.047674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.048412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.050264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.064550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f HTTP/1.1 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1a9d0e4d-f490-40bf-8f64-5847cee5ba3f'} Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:17.066380 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:17.071591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c072eeb-3b86-4f76-9fe0-1f6a91417772 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 404 len: 111 microversion: 2.1 time: 0.040328 Oct 31 15:59:17.076824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:17.077718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:17.083127 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3033/6192] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:59:17 2022] DELETE /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:17.084899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.085593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.086222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.086954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.087422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.087856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.102838 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f HTTP/1.1 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '1a9d0e4d-f490-40bf-8f64-5847cee5ba3f'} Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.105230 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 1a9d0e4d-f490-40bf-8f64-5847cee5ba3f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:17.110572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e345ec5-2d4b-4612-bf8a-8227a763e6aa tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f" status: 404 len: 111 microversion: 2.1 time: 0.034039 Oct 31 15:59:17.111428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3160/6193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:17 2022] GET /compute/v2.1/servers/1a9d0e4d-f490-40bf-8f64-5847cee5ba3f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:17.621024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:17.622610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:17.632255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.633193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.633668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.634591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.635248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.635695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.673192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:17.673758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:17.680823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.681327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.681770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.682486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.682952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.683386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.698497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 HTTP/1.1 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94'} Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:17.700447 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.705502 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.707489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:17.708583 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f069e4b-bb6b-4a9f-ba91-5e243634dae5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 404 len: 111 microversion: 2.1 time: 0.039313 Oct 31 15:59:17.709677 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3161/6194] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:59:17 2022] DELETE /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:17.717711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:17.718577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:17.725565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.726067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.726514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.727228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:17.727702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:17.728267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:17.744334 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 HTTP/1.1 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94'} Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:17.746158 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. Oct 31 15:59:17.751454 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:17.753765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:17.754639 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94baaf88-0862-4ba0-a8e4-a0965996e9c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94" status: 404 len: 111 microversion: 2.1 time: 0.040782 Oct 31 15:59:17.755487 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3162/6195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:17 2022] GET /compute/v2.1/servers/b10ce2a2-269e-4cfb-ae6b-2f875aa9ab94 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:59:17.803851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:17.823061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e612ce5f-822b-4e8c-8ce9-33526d31224b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: .version_select at 0x7f5ca29783a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1128586012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsX7HN+bd4U+1K6HVEIYEXLNIxyt4+euZvhElUycowtKWHiisHnG+PdM3u3EGF7WJ5alTrox4rRoN+PnkVduOSEArg8yGh3qzOcqnUip6XwjNFkQf5f0M6OvDKdRHjNlA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:17.825343 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da853252-bdcb-4250-8e05-3659680eff55 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1694 microversion: 2.1 time: 0.210328 Oct 31 15:59:17.825988 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3034/6196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:17 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1694 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:17.840538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e612ce5f-822b-4e8c-8ce9-33526d31224b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:59:17.845800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e612ce5f-822b-4e8c-8ce9-33526d31224b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:59:17.870357 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e612ce5f-822b-4e8c-8ce9-33526d31224b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051698 Oct 31 15:59:17.870980 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3163/6197] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:59:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:59:18.572881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:18.582771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:18.583271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:18.583719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:18.595767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] Creating event network-changed:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h2-858383-17 Oct 31 15:59:18.601854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] Instance 2613f814-2a75-4901-9097-84d86b929281 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:59:18.612714 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b5a0176f-dbcd-4a72-bbc1-e38123703dfd req-fb31d5fc-6b98-4e8a-8a0c-b2cbb01fdec3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043666 Oct 31 15:59:18.613336 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3035/6198] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:18.849852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:18.850531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:18.862129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:18.862635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:18.863071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:18.863775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:18.864236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:18.864660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:19.136533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:19.155328 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-40081cac-4d33-4730-8639-6f279a16c582 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1692 microversion: 2.1 time: 0.309601 Oct 31 15:59:19.158150 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3164/6199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:18 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1692 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:20.183622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:20.184356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:20.190926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:20.191442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:20.191902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:20.192628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:20.193138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:20.193595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:20.337901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:20.346337 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea4b71ba-5c81-44cf-9f95-0a652fe74db2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1689 microversion: 2.1 time: 0.167688 Oct 31 15:59:20.346934 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3036/6200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:20 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:20.369171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:20.370328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:20.377266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:20.378510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:20.378955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:20.379664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:20.380122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:20.380677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:20.441465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-541b3e43-c82f-4fa2-96c8-2df96ab524c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action" status: 204 len: 0 microversion: 2.1 time: 0.075891 Oct 31 15:59:20.442347 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3165/6201] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:59:20 2022] POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:59:20.451152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:20.451781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:20.459793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:20.460507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:20.460994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:20.461716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:20.462805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:20.463802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:20.717417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:20.726206 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4943bbf7-9392-4690-b705-8b4a73970bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1689 microversion: 2.1 time: 0.279695 Oct 31 15:59:20.726804 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3037/6202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:20 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1689 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:21.235881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "name": "network-vif-plugged", "status": "completed", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:21.249199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:21.249957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:21.250626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:21.267090 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] Creating event network-vif-plugged:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h2-858383-17 Oct 31 15:59:21.274970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] Instance 2613f814-2a75-4901-9097-84d86b929281 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:59:21.290691 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fcbd0025-09a4-47a4-a412-54f66ebc8635 req-d10dc4ce-f2a3-4b4c-8da9-edebef3016fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061590 Oct 31 15:59:21.291760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3166/6203] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:21.750021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:21.750667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:21.759471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:21.760181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:21.760843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:21.761734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:21.762207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:21.762649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:21.912996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:21.922301 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7421d4cc-43d4-4e46-a31b-e68316353dad tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1689 microversion: 2.1 time: 0.176191 Oct 31 15:59:21.923221 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3038/6204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:21 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:22.950865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:22.951567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:22.953502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:22.960129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:22.960620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:22.961086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:22.961792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:22.962251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:22.962683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:23.103412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:23.111667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e78426db-75dc-46db-809a-eaa52089e79c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1681 microversion: 2.1 time: 0.165879 Oct 31 15:59:23.112860 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3167/6205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:22 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:34.302052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1379486235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1128586012", "security_groups": [{"name": "tempest-secgroup-smoke-285117054"}], "block_device_mapping_v2": [{"uuid": "04fb6ebc-ab53-48c6-a018-4f8304bfb092", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:34.312986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:34.313719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:34.416575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:59:34.787830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:59:34.788272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:59:34.788822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:59:34.789250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:59:34.789679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:59:34.798593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:34.799091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:34.799542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:34.800355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:34.800864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:34.801308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:34.818714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:59:34.824108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:59:34.881791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:59:34.883934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04fb6ebc-ab53-48c6-a018-4f8304bfb092',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:59:35.009996 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6553fcd4-e902-4cba-9897-3198c49656e1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712389 Oct 31 15:59:35.010651 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3039/6206] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 15:59:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:59:35.022193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-17f9b3a0-4cc4-4bf2-84f0-709c572bc563 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:35.022814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-17f9b3a0-4cc4-4bf2-84f0-709c572bc563 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:35.026472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:35.027501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:35.028358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:35.085314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17f9b3a0-4cc4-4bf2-84f0-709c572bc563 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:35.092621 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-17f9b3a0-4cc4-4bf2-84f0-709c572bc563 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1095 microversion: 2.1 time: 0.074740 Oct 31 15:59:35.096043 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3168/6207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:35 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:36.117490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:36.119056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:36.126731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:36.127400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:36.127962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:36.129101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:36.129582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:36.130028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:36.211995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:36.220058 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7b04ae9-4410-4d48-bde7-152c92b9b235 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1211 microversion: 2.1 time: 0.107868 Oct 31 15:59:36.220803 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3040/6208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:36 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:37.248991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:37.250265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:37.265105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:37.265616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:37.266329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:37.267062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:37.267536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:37.268114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:37.500547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:37.513649 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c302df2d-bffb-43b3-a748-9d799c27fa55 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1278 microversion: 2.1 time: 0.271501 Oct 31 15:59:37.514234 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3169/6209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:37 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:37.919891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0640d18a-03be-4588-8061-dd06d9582b12 req-d22a8bc2-8a10-4cdd-9106-e3c8598754ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96d8a61-4beb-4908-92e4-e64d23879837", "tag": "940a5150-34ea-4393-9374-af3a856d319a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:37.936507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0640d18a-03be-4588-8061-dd06d9582b12 req-d22a8bc2-8a10-4cdd-9106-e3c8598754ce service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:37.937192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0640d18a-03be-4588-8061-dd06d9582b12 req-d22a8bc2-8a10-4cdd-9106-e3c8598754ce service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:37.937750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0640d18a-03be-4588-8061-dd06d9582b12 req-d22a8bc2-8a10-4cdd-9106-e3c8598754ce service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:37.950144 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0640d18a-03be-4588-8061-dd06d9582b12 req-d22a8bc2-8a10-4cdd-9106-e3c8598754ce service nova] Creating event network-changed:940a5150-34ea-4393-9374-af3a856d319a for instance a96d8a61-4beb-4908-92e4-e64d23879837 on n-h1-858383-17 Oct 31 15:59:37.955415 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0640d18a-03be-4588-8061-dd06d9582b12 req-d22a8bc2-8a10-4cdd-9106-e3c8598754ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039541 Oct 31 15:59:37.956931 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3041/6210] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:38.540037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:38.540688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:38.548081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:38.548574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:38.549067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:38.549984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:38.551202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:38.551815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:38.811013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:38.819798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4b26eb3-7678-4e58-a53f-4074720aef84 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1278 microversion: 2.1 time: 0.286059 Oct 31 15:59:38.831460 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3170/6211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:38 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:39.844506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:39.845250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:39.852310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:39.852843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:39.853293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:39.854014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:39.854469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:39.854908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:39.988311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:39.996298 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-edeb0011-07a5-46f4-bed6-d2a58125b46e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1278 microversion: 2.1 time: 0.157126 Oct 31 15:59:39.996910 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3042/6212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:39 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:41.019675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:41.020294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:41.028632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:41.029226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:41.029667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:41.030370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:41.030826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:41.031267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:41.177264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:41.185004 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-615a41e1-4f30-43b5-9319-9af769f267c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1278 microversion: 2.1 time: 0.169456 Oct 31 15:59:41.185582 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3171/6213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:41 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:42.210316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:42.210963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:42.217792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:42.218298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:42.218764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:42.219480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:42.219958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:42.220436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:42.355952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:42.364430 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17f72253-4961-4351-8f80-cb60745021f3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.158909 Oct 31 15:59:42.365116 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3043/6214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:42 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:43.321261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:43.323577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:43.330391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:43.330873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:43.331310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:43.332229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:43.332712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:43.333162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:43.387569 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f891111-bee6-48a3-b376-f31a23ace136 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action" status: 200 len: 24575 microversion: 2.1 time: 0.071110 Oct 31 15:59:43.388229 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3172/6215] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 15:59:43 2022] POST /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281/action => generated 24575 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:59:43.445040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:43.445679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:43.451768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:43.452274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:43.452752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:43.453470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:43.453951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:43.454400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:43.586355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:43.594413 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b415dd2a-dc95-4cac-ae47-913a70ecb021 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.210423 Oct 31 15:59:43.594985 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3044/6216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:43 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:44.618169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:44.618873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:44.626320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:44.626810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:44.627251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:44.627944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:44.628945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:44.629440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:44.759499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:44.767676 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d9774f76-fa95-4e0e-90b2-e6740c5a755d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.153795 Oct 31 15:59:44.768243 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3173/6217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:44 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:45.792719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:45.793360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:45.796161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:45.796863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:45.803002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:45.803502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:45.803954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:45.804662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:45.805158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:45.805602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:45.942795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:45.950625 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1fdad7c5-ef78-43e6-960e-7cc946495254 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.161823 Oct 31 15:59:45.951129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3045/6218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:45 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:46.975181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:46.975743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:46.978244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:46.985072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:46.985565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:46.986009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:46.986715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:46.987182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:46.987618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:47.117814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:47.125478 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76792f3d-6e07-47db-9c2a-93d665569763 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.154859 Oct 31 15:59:47.126048 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3174/6219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:46 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:48.150015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:48.150649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:48.157603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:48.158099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:48.158549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:48.159256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:48.159805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:48.160839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:48.376304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:48.385012 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e97427f-8724-4d32-8f43-ca1f6c0cf8e4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.238755 Oct 31 15:59:48.385602 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3046/6220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:48 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:49.408891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:49.409556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:49.417038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:49.417521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:49.417956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:49.418645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:49.419111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:49.419533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:49.553980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:49.561882 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a200f79-1e9a-41d1-b4d5-1d1eaf51402e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.156921 Oct 31 15:59:49.562465 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3175/6221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:49 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:49.577518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:49.578150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:49.585286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:49.585866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:49.586406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:49.587211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:49.587871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:49.588310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:49.721963 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-78940133-3ba5-4dd9-8417-bc9650d55548 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1834 microversion: 2.1 time: 0.148320 Oct 31 15:59:49.723064 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3047/6222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:49 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1834 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:50.571142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:50.571661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:50.572933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0536f96c-0fd1-43d5-aa1c-cbbb420a4a98 req-32ce5005-bd33-47db-b590-c5ff558c69a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:50.578158 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:59:50.578729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.578853 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 15:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 31 15:59:50.578950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.582783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.583528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.584179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.585263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.586353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0536f96c-0fd1-43d5-aa1c-cbbb420a4a98 req-32ce5005-bd33-47db-b590-c5ff558c69a2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.586851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0536f96c-0fd1-43d5-aa1c-cbbb420a4a98 req-32ce5005-bd33-47db-b590-c5ff558c69a2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.587303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0536f96c-0fd1-43d5-aa1c-cbbb420a4a98 req-32ce5005-bd33-47db-b590-c5ff558c69a2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.599903 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0536f96c-0fd1-43d5-aa1c-cbbb420a4a98 req-32ce5005-bd33-47db-b590-c5ff558c69a2 service nova] Creating event network-changed:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h2-858383-17 Oct 31 15:59:50.604928 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0536f96c-0fd1-43d5-aa1c-cbbb420a4a98 req-32ce5005-bd33-47db-b590-c5ff558c69a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035618 Oct 31 15:59:50.605766 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3048/6223] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:59:50.611802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:50.612524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:50.619904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.620653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.621319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.622219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.622860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.623489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.629437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:59:50.728436 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd43b773-3873-4044-9807-e3d67ed29aa6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 204 len: 0 microversion: 2.1 time: 0.161406 Oct 31 15:59:50.729085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3176/6224] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 15:59:50 2022] DELETE /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:59:50.740191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:50.741193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:50.748343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.748943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.749461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.750240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:50.750775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:50.751307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:50.795992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:50.803925 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d8190a1d-cfdf-40e4-9871-c62c30f26f62 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.196808 Oct 31 15:59:50.804731 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3049/6225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:50 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:50.899139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:50.906946 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa8a9b22-d7ec-4389-a1cf-2849276318d2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1687 microversion: 2.1 time: 0.172200 Oct 31 15:59:50.907556 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3177/6226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:50 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:51.659737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3394ff63-098a-4b00-acb4-608f1b972299 req-3fca14e0-30d0-4d73-ab05-fb224e556a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96d8a61-4beb-4908-92e4-e64d23879837", "name": "network-vif-plugged", "status": "completed", "tag": "940a5150-34ea-4393-9374-af3a856d319a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:51.672101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3394ff63-098a-4b00-acb4-608f1b972299 req-3fca14e0-30d0-4d73-ab05-fb224e556a3a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:51.672609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3394ff63-098a-4b00-acb4-608f1b972299 req-3fca14e0-30d0-4d73-ab05-fb224e556a3a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:51.673263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3394ff63-098a-4b00-acb4-608f1b972299 req-3fca14e0-30d0-4d73-ab05-fb224e556a3a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:51.685329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3394ff63-098a-4b00-acb4-608f1b972299 req-3fca14e0-30d0-4d73-ab05-fb224e556a3a service nova] Creating event network-vif-plugged:940a5150-34ea-4393-9374-af3a856d319a for instance a96d8a61-4beb-4908-92e4-e64d23879837 on n-h1-858383-17 Oct 31 15:59:51.690777 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3394ff63-098a-4b00-acb4-608f1b972299 req-3fca14e0-30d0-4d73-ab05-fb224e556a3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034267 Oct 31 15:59:51.691992 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3050/6227] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:51.828171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:51.828823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:51.835953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:51.836446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:51.837000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:51.837743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:51.838217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:51.838652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:51.932263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:51.933145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:51.939512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:51.940018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:51.940713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:51.942031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:51.942703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:51.943320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:51.973819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:51.981719 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31fb0003-c22a-4618-bf68-1cb7020c9b7c tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.157426 Oct 31 15:59:51.982312 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3178/6228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:51 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:52.149797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:52.163232 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-af5a0462-8899-45ad-9bb3-0ebe6d0ea7e7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1687 microversion: 2.1 time: 0.235108 Oct 31 15:59:52.164189 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3051/6229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:51 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:52.773811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b1e70782-4eaa-47cb-96fa-9a5cd19d8e0e req-c2c365e7-05a9-4f6c-8a09-b3c9af00ad65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2613f814-2a75-4901-9097-84d86b929281", "name": "network-vif-deleted", "tag": "64afba3e-8061-4a6d-bc07-7ccd470587a3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:52.783716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b1e70782-4eaa-47cb-96fa-9a5cd19d8e0e req-c2c365e7-05a9-4f6c-8a09-b3c9af00ad65 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:52.784199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b1e70782-4eaa-47cb-96fa-9a5cd19d8e0e req-c2c365e7-05a9-4f6c-8a09-b3c9af00ad65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:52.784629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b1e70782-4eaa-47cb-96fa-9a5cd19d8e0e req-c2c365e7-05a9-4f6c-8a09-b3c9af00ad65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:52.797573 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b1e70782-4eaa-47cb-96fa-9a5cd19d8e0e req-c2c365e7-05a9-4f6c-8a09-b3c9af00ad65 service nova] Creating event network-vif-deleted:64afba3e-8061-4a6d-bc07-7ccd470587a3 for instance 2613f814-2a75-4901-9097-84d86b929281 on n-h2-858383-17 Oct 31 15:59:52.802908 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b1e70782-4eaa-47cb-96fa-9a5cd19d8e0e req-c2c365e7-05a9-4f6c-8a09-b3c9af00ad65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033438 Oct 31 15:59:52.803508 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3179/6230] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:53.006184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:53.006750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:53.014437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:53.014934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:53.015563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:53.016273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:53.016767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:53.017208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:53.156116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:53.166561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d5d3a9a-9058-4f73-97aa-b58163efec48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1266 microversion: 2.1 time: 0.164571 Oct 31 15:59:53.167166 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3052/6231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:53 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:53.189739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:53.190578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:53.198466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:53.199034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:53.199483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:53.200194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:53.200651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:53.201114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:53.236472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:53.236988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:53.237427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:53.237881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lazy-loading 'fault' on Instance uuid 2613f814-2a75-4901-9097-84d86b929281 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:59:53.282016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:53.292003 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29af528c-f4e7-4ac7-8b28-bcbe74fef322 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 200 len: 1356 microversion: 2.1 time: 0.108065 Oct 31 15:59:53.292637 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3180/6232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:53 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:54.190184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:54.190813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:54.198471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:54.198965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:54.199413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:54.200115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:54.200584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:54.201047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:54.315643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:54.316903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 2613f814-2a75-4901-9097-84d86b929281] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:54.324083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:54.324509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:54.324989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:54.325701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:54.326169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:54.326633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:54.340677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:54.341444 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] HTTP exception thrown: Instance 2613f814-2a75-4901-9097-84d86b929281 could not be found. Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Request method failure captured: Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 HTTP/1.1 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_BrAEMsdDgTOS65WgvdA_K_U3aO3wZSHFW2yc9-QoRkT_5VdBKNY6Qd-eWIeDszi1h-SYlx40HBcKrxlPxcB7NZsfdtAJMKANGMg6pjW58_ZGQAtb4E50u5dW1TaY9ZfBsX10OtC9SFv6l9znfhq2UuMbLota6w60dO6FTpp-aAzTk Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: a0b4bb114e7c4b06b2643c593868f3a2 Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 2613f814-2a75-4901-9097-84d86b929281 could not be found. Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '2613f814-2a75-4901-9097-84d86b929281'} Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2613f814-2a75-4901-9097-84d86b929281 could not be found. Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2613f814-2a75-4901-9097-84d86b929281 could not be found. Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:54.343131 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2613f814-2a75-4901-9097-84d86b929281 could not be found. Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Returning 404 to user: Instance 2613f814-2a75-4901-9097-84d86b929281 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20a2dfd5-5840-4e73-8861-32472a8a54bc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281" status: 404 len: 111 microversion: 2.1 time: 0.033008 Oct 31 15:59:54.349275 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3181/6233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:54 2022] GET /compute/v2.1/servers/2613f814-2a75-4901-9097-84d86b929281 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:59:54.350315 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4b33908-0769-4481-b9bd-130e9399ca48 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1454 microversion: 2.1 time: 0.162988 Oct 31 15:59:54.358315 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3053/6234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:54 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:54.371651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:54.372270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:54.378281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:54.379656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:54.379980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:54.380723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:54.381180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:54.381607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:54.624540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:54.633771 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f85a4348-3406-48ca-8dc7-a0dfad367cdd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1454 microversion: 2.1 time: 0.265960 Oct 31 15:59:54.634356 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3182/6235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:54 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:56.952963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-251b51fe-989a-4a6e-9b25-914d31cda7d8 req-a8f4ffff-4d0a-4bdd-8394-282107040220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96d8a61-4beb-4908-92e4-e64d23879837", "tag": "940a5150-34ea-4393-9374-af3a856d319a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:56.964182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-251b51fe-989a-4a6e-9b25-914d31cda7d8 req-a8f4ffff-4d0a-4bdd-8394-282107040220 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:56.964984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-251b51fe-989a-4a6e-9b25-914d31cda7d8 req-a8f4ffff-4d0a-4bdd-8394-282107040220 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:56.965672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-251b51fe-989a-4a6e-9b25-914d31cda7d8 req-a8f4ffff-4d0a-4bdd-8394-282107040220 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:56.978347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-251b51fe-989a-4a6e-9b25-914d31cda7d8 req-a8f4ffff-4d0a-4bdd-8394-282107040220 service nova] Creating event network-changed:940a5150-34ea-4393-9374-af3a856d319a for instance a96d8a61-4beb-4908-92e4-e64d23879837 on n-h1-858383-17 Oct 31 15:59:56.985014 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-251b51fe-989a-4a6e-9b25-914d31cda7d8 req-a8f4ffff-4d0a-4bdd-8394-282107040220 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035622 Oct 31 15:59:56.989134 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3054/6236] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:58.705583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21841e6b-1e80-4883-965d-d7ebca99b0e8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '.version_select at 0x7f5ca6748ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:58.729718 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21841e6b-1e80-4883-965d-d7ebca99b0e8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167731125" status: 202 len: 0 microversion: 2.1 time: 0.029405 Oct 31 15:59:58.731461 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3183/6237] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Oct 31 15:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167731125 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:59:58.762526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9495e16f-e6de-4298-94ea-e385686ee7fc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: .version_select at 0x7f5ca2425790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-741600832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgD5X2yHbFZrHzPesspKfqTNSVtEcAzOqz8UY4ADpPrlMVVVY7UCzYKs6zxTMC7qObsBr8VkOrDcD4Rk/nCSqo6Me6c04D8CaHdS/+4K7molEfZBH5NEQO4WT4MtpELkA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:58.779267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9495e16f-e6de-4298-94ea-e385686ee7fc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:59:58.788931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9495e16f-e6de-4298-94ea-e385686ee7fc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:59:58.825496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9495e16f-e6de-4298-94ea-e385686ee7fc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.068123 Oct 31 15:59:58.829237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3055/6238] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 15:59:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:00:04.691346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1308609164", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "d38d975d-4568-458a-a477-387a64a1249b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-741600832", "security_groups": [{"name": "tempest-secgroup-smoke-1940545528"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:04.705843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:04.819295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] validate_networks() for [('d38d975d-4568-458a-a477-387a64a1249b', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:00:05.307751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:00:05.308191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:00:05.308882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:00:05.309952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:00:05.310389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:00:05.315388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:05.325457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.325957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.326555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.327296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.327758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.328223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.354092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:00:05.360954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:00:05.375272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:00:05.377664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:00:05.434721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0aae279-d696-4a4a-82b4-32dc7aff7706 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748351 Oct 31 16:00:05.442910 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3184/6239] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:00:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:00:05.447914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2603301-a91e-4f1f-88c7-fba964129fdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:05.449372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2603301-a91e-4f1f-88c7-fba964129fdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:05.460180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:05.545908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2603301-a91e-4f1f-88c7-fba964129fdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:05.555657 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2603301-a91e-4f1f-88c7-fba964129fdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1266 microversion: 2.1 time: 0.111641 Oct 31 16:00:05.556483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3056/6240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:05 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:06.580093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:06.581078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:06.589937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:06.590879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:06.591635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.592836 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:06.593448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:06.594175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.684347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:06.692827 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d9b1d01-82be-45bd-8d93-759d6dbc2354 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1336 microversion: 2.1 time: 0.116662 Oct 31 16:00:06.693438 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3185/6241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:06 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:07.719006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:07.719773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:07.722557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=76 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:07.729830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:07.730339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:07.730797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:07.731516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:07.731994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:07.732440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:07.875995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:07.885904 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e86703c8-26c4-404b-adb9-fece6d8061c5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1392 microversion: 2.1 time: 0.170984 Oct 31 16:00:07.886845 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3057/6242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:07 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:08.088950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ac66ba7e-c158-49d1-8194-77b28ccaeb09 req-de2aaba8-6182-452d-8ce4-5df1096a9992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:08.107919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ac66ba7e-c158-49d1-8194-77b28ccaeb09 req-de2aaba8-6182-452d-8ce4-5df1096a9992 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.108422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ac66ba7e-c158-49d1-8194-77b28ccaeb09 req-de2aaba8-6182-452d-8ce4-5df1096a9992 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.108948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ac66ba7e-c158-49d1-8194-77b28ccaeb09 req-de2aaba8-6182-452d-8ce4-5df1096a9992 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:08.125458 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ac66ba7e-c158-49d1-8194-77b28ccaeb09 req-de2aaba8-6182-452d-8ce4-5df1096a9992 service nova] Creating event network-changed:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:00:08.132010 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ac66ba7e-c158-49d1-8194-77b28ccaeb09 req-de2aaba8-6182-452d-8ce4-5df1096a9992 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046947 Oct 31 16:00:08.132639 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3186/6243] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:00:08.910082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:08.911379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:08.918498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.919003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.919469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:08.920172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.920648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.921116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:09.055190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:09.063878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bc517e42-9457-406b-8b1e-8197e635b2f2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1392 microversion: 2.1 time: 0.157625 Oct 31 16:00:09.064475 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3058/6244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:08 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:10.089024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:10.089731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:10.096573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:10.097107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:10.097559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:10.098870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:10.099395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:10.100478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:10.247491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:10.255931 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d067dfdc-2103-4511-931c-f71da96c2281 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1392 microversion: 2.1 time: 0.172179 Oct 31 16:00:10.256535 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3187/6245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:10 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:11.281046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:11.281706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:11.288810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:11.289319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:11.289775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:11.290491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:11.290961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:11.291405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:11.425870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:11.434257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2899abfb-5a04-4540-95c0-7f664a1282ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1392 microversion: 2.1 time: 0.157444 Oct 31 16:00:11.434844 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3059/6246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:11 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:12.457154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:12.457784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:12.465883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:12.466407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:12.466822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:12.467797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:12.468272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:12.468729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:12.604831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:12.612618 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a94235bb-3c33-4ddc-aca4-53b7a913ed6a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1392 microversion: 2.1 time: 0.159347 Oct 31 16:00:12.613233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3188/6247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:12 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:13.377660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a838586d-26b5-434d-abd2-994841b64418 req-b1344606-2a86-4959-b6fd-7647149a44ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "name": "network-vif-plugged", "status": "completed", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:13.388440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a838586d-26b5-434d-abd2-994841b64418 req-b1344606-2a86-4959-b6fd-7647149a44ca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:13.389043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a838586d-26b5-434d-abd2-994841b64418 req-b1344606-2a86-4959-b6fd-7647149a44ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:13.389571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a838586d-26b5-434d-abd2-994841b64418 req-b1344606-2a86-4959-b6fd-7647149a44ca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:13.402475 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a838586d-26b5-434d-abd2-994841b64418 req-b1344606-2a86-4959-b6fd-7647149a44ca service nova] Creating event network-vif-plugged:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:00:13.407661 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a838586d-26b5-434d-abd2-994841b64418 req-b1344606-2a86-4959-b6fd-7647149a44ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033897 Oct 31 16:00:13.408281 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3060/6248] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:00:13.637421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:13.638040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:13.644968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:13.645452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:13.645888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:13.646581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:13.647038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:13.647463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:13.786493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:13.794357 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b6c3873-4e5e-4fca-87a1-1ead9dceb4b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1392 microversion: 2.1 time: 0.161831 Oct 31 16:00:13.794942 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3189/6249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:13 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:14.819420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:14.820397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:14.827246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.827758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.828216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.829023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.829511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.829995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.969376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:14.978319 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32a1b34b-f7be-47f2-99e0-6d5f717262bd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1563 microversion: 2.1 time: 0.164574 Oct 31 16:00:14.979222 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3061/6250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:14 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:15.002056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:15.002653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:15.009795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:15.010294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:15.010729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:15.011447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:15.011903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:15.012333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:15.179582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:15.189453 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6cb6ed71-e26f-4e2d-b0ae-5f9d5893d7a9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1563 microversion: 2.1 time: 0.191134 Oct 31 16:00:15.190064 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3190/6251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:14 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:16.982396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:16.982802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:16.984844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:16.988475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-55d801d4-f116-4161-b36e-486dab29374a req-86945c9a-68f5-4d6d-9d96-0fff1fdd44b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:16.992138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:16.993808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:16.994068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:16.994405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:16.995066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:16.995235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:16.996075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:16.996552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:17.002762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-55d801d4-f116-4161-b36e-486dab29374a req-86945c9a-68f5-4d6d-9d96-0fff1fdd44b1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:17.003246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-55d801d4-f116-4161-b36e-486dab29374a req-86945c9a-68f5-4d6d-9d96-0fff1fdd44b1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:17.003693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-55d801d4-f116-4161-b36e-486dab29374a req-86945c9a-68f5-4d6d-9d96-0fff1fdd44b1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:17.016579 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-55d801d4-f116-4161-b36e-486dab29374a req-86945c9a-68f5-4d6d-9d96-0fff1fdd44b1 service nova] Creating event network-changed:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:00:17.021506 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-55d801d4-f116-4161-b36e-486dab29374a req-86945c9a-68f5-4d6d-9d96-0fff1fdd44b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036655 Oct 31 16:00:17.025212 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3191/6252] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:00:17.139033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:17.147233 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd25e2b2-7731-43f2-b1d2-3d58fb1cae85 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1563 microversion: 2.1 time: 0.168943 Oct 31 16:00:17.148389 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3062/6253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:16 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:38.423840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:38.424718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=36 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:38.429698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:38.431948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:38.440065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:38.440553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:38.441030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:38.441762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:38.442227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:38.442657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:38.498877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-23fc1118-74d7-42e5-8d7f-04d7075ab28d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action" status: 200 len: 24569 microversion: 2.1 time: 0.077269 Oct 31 16:00:38.499634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3192/6254] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:00:38 2022] POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action => generated 24569 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:00:49.546480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:49.547108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:49.549508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=15 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:49.550320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=32 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:49.555890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:49.556315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:49.556798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:49.557509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:49.557981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:49.558422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:49.758116 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9a22738-eefe-4135-ab42-8f4958c9e7a8 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1834 microversion: 2.1 time: 0.215360 Oct 31 16:00:49.758690 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3063/6255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:49 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1834 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:49.781411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:49.782121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:49.785594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:49.786273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:49.792648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:49.793183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:49.793607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:49.794310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:49.794770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:49.795199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:49.982852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:49.991256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a7e0a70-4e0e-4ab9-93c7-a541877a4af5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1681 microversion: 2.1 time: 0.214134 Oct 31 16:00:49.991828 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3193/6256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:49 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:50.087097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:50.089371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:50.096222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:50.096744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:50.097203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:50.097914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:50.098387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:50.098835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:50.148438 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3cc5be2b-d4c3-4844-a3e3-d0490532a184 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action" status: 200 len: 32637 microversion: 2.1 time: 0.065213 Oct 31 16:00:50.149375 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3064/6257] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:00:50 2022] POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:00:50.311795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:50.312373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:50.318917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:50.319398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:50.319831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:50.320522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:50.321005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:50.321431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:50.360014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '99147d76045d41e9aadd3535d5b0cf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b1bf4a802a41a88ae77c5b673c8d75', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:50.360684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] flavor_id is None. Assuming migration. {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 16:00:50.361191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:00:50.540274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7aba9cf7-92c3-49fa-b93c-4ce3225ccf4f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action" status: 202 len: 0 microversion: 2.1 time: 0.232002 Oct 31 16:00:50.544171 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3194/6258] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:00:50 2022] POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:00:50.550970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:50.552066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:50.559919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:50.560441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:50.561052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:50.561819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:50.562352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:50.562836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:50.703423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:50.712479 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-405305fc-e50f-4939-bc38-24d419d95e78 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1690 microversion: 2.1 time: 0.165783 Oct 31 16:00:50.713102 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3065/6259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:50 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:51.738046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:51.738642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:51.744842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:51.745331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:51.745771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:51.746491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:51.746945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:51.747374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:51.884419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:51.893166 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6472111e-2aa0-43db-bed1-9ddcf563f990 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1690 microversion: 2.1 time: 0.160578 Oct 31 16:00:51.893745 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3195/6260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:51 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:52.915951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:52.916577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:52.924103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:52.924601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:52.925076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:52.925788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:52.926256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:52.926695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:53.061753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:53.069638 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3afe4fd-6597-47d6-b5c4-e5c9877af91c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1690 microversion: 2.1 time: 0.157640 Oct 31 16:00:53.070454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3066/6261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:52 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:54.092999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:54.093554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:54.100908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:54.101400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:54.101840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:54.102537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:54.103000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:54.103436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:54.238962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:54.246863 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e9885e6-b2ad-4d1e-8467-8cd21ce9cdb2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.157910 Oct 31 16:00:54.247440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3196/6262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:54 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:55.273225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:55.273853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:55.280618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:55.281148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:55.281602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:55.282302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:55.283307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:55.283747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:55.414527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:55.422384 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5739d12a-b8dc-4645-8074-a8571a04670d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.153098 Oct 31 16:00:55.423039 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3067/6263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:55 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:56.446242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:56.446865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:56.453727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:56.454212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:56.454966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:56.455662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:56.456122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:56.456549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:56.590578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:56.599156 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d3f8ea3-ce1e-490a-be91-cf8ee5487237 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.156789 Oct 31 16:00:56.599719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3197/6264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:56 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:57.622437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:57.623107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:57.630186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:57.630691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:57.631149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:57.631861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:57.632341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:57.632843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:57.765185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:57.773606 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e4215ae8-a90f-4894-b0a3-d406d3ace919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.155139 Oct 31 16:00:57.774185 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3068/6265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:57 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:58.797626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:58.798235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:58.805717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:58.806209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:58.806656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:58.807355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:58.807821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:58.808254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:58.939934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:58.947804 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed31e67a-2e94-4510-a06e-5d73985e858f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.154100 Oct 31 16:00:58.948379 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3198/6266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:58 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:59.971754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:59.972402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:59.979360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:59.979889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:59.980341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:59.981062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:59.981557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:59.981994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:00.434436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:00.442273 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb0ebfe4-0ee6-4d52-8655-9397df96aeaf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.474734 Oct 31 16:01:00.442850 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3069/6267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:59 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:01.465509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:01.466257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:01.474157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:01.474642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:01.475080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:01.475776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:01.476237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:01.476660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:01.607470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:01.615332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f54e5b01-6420-4380-b837-1874c3d2d261 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.153821 Oct 31 16:01:01.615893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3199/6268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:01 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:02.638514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:02.639138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:02.646113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:02.646603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:02.647049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:02.647744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:02.648208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:02.648643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:02.780558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:02.788903 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-287cb6ce-9d65-44f9-a38d-03fa5ff832b8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.154392 Oct 31 16:01:02.789480 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3070/6269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:02 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:03.812018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:03.812629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:03.819592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:03.820075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:03.820600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:03.821310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:03.821768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:03.822193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:03.952105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:03.960514 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1345847e-5e62-45c0-907a-aa37289af543 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.152358 Oct 31 16:01:03.961120 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3200/6270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:03 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:04.984835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:04.985459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:04.992463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:04.992988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:04.993437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:04.994149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:04.994600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:04.995038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:05.129218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:05.136993 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1cd34d90-1bcb-4fe6-95a4-2e30e306474d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.156113 Oct 31 16:01:05.137565 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3071/6271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:04 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:06.160506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:06.161154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:06.168141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:06.168627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:06.169301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:06.169804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:06.170258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:06.170689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:06.302240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:06.310005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dbe9e68d-7370-42e2-aa68-74a1c5c49a94 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.153479 Oct 31 16:01:06.310590 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3201/6272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:06 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:07.333821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:07.334401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:07.341232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:07.341725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:07.342174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:07.342873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:07.343340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:07.343776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:07.474127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:07.481784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-226380d3-b3e9-4cfb-baae-646242289849 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.152761 Oct 31 16:01:07.482351 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3072/6273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:07 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:08.505806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:08.506381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:08.513174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:08.513672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:08.514120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:08.514830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:08.515298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:08.515739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:08.650871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:08.658611 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee8851e3-6072-406b-abaa-8925e99779ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.157026 Oct 31 16:01:08.659181 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3202/6274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:08 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:09.681900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:09.682527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:09.690031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:09.690528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:09.690974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:09.691680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:09.692147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:09.692588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:09.824235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:09.832399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e132eefe-7d3e-4988-809f-034bd1f9858a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.154461 Oct 31 16:01:09.833008 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3073/6275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:09 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:10.855979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:10.856588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:10.864082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:10.864564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:10.865029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:10.865722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:10.866184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:10.866614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:11.004141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:11.011846 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7df07cd6-7a26-4cf4-9bd2-6112d07bc823 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.159833 Oct 31 16:01:11.012417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3203/6276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:10 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:12.034753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:12.035364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:12.042294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:12.042802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:12.043258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:12.043996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:12.044504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:12.044974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:12.176012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:12.183884 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f74e858-e475-4d2e-ba60-2b6175629708 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.153221 Oct 31 16:01:12.184462 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3074/6277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:12 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:13.207279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:13.207954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:13.215042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:13.215533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:13.215977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:13.216762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:13.217231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:13.217666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:13.352524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:13.360259 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d70e4662-6c58-47b5-be64-aeab92931741 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.157091 Oct 31 16:01:13.360855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3204/6278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:13 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:14.384862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:14.385449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:14.392264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:14.392792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:14.393402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:14.394103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:14.394569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:14.395007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:14.532951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:14.541178 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df50b0eb-233c-4d5f-96e6-2dd1ce5b3110 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.160374 Oct 31 16:01:14.541746 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3075/6279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:14 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:15.564820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:15.565618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:15.572514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:15.573036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:15.573476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:15.574177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:15.574634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:15.575115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:15.710921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:15.718719 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0a55451-cfd3-4993-aaf7-6da4320b2bdf tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.157983 Oct 31 16:01:15.719292 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3205/6280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:15 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:16.742350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:16.742979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:16.749892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:16.750396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:16.750851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:16.751559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:16.752654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:16.753148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:16.887773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:16.895827 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69b1e259-2319-4ea1-b324-e16154a9aa8c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.157474 Oct 31 16:01:16.896401 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3076/6281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:16 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:17.919537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:17.920168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:17.927659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:17.928146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:17.928584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:17.929349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:17.929815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:17.930248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:18.059472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:18.067316 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6fcfc04-e7d2-414e-84b6-ded9db7287ee tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.151706 Oct 31 16:01:18.067902 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3206/6282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:17 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:19.090778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:19.091411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:19.099281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:19.099780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:19.100237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:19.100997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:19.101476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:19.101923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:19.238118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:19.245919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0ea6a9e-f715-4ec6-8d92-250fe4b4c918 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.159131 Oct 31 16:01:19.246493 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3077/6283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:19 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:20.269971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:20.270882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:20.274451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=31 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:20.280090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:20.280621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:20.281097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:20.282345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:20.282832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:20.283308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:20.286256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:20.431246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:20.439222 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16bbda5e-9485-4fd8-be69-3c9a7a0213b2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1695 microversion: 2.1 time: 0.173612 Oct 31 16:01:20.439876 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3207/6284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:20 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:20.935984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "name": "network-vif-unplugged", "status": "completed", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:20.941880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=31 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:20.947784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:20.948275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:20.948738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:20.952617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=89 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:20.961562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] Creating event network-vif-unplugged:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h1-858383-17 Oct 31 16:01:20.967088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:01:20.979205 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-522130a0-55fb-4e42-adbe-0e824e47612e req-7a8f5eb9-f9ba-4cbf-bdbf-8e4891ef1ef8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114424 Oct 31 16:01:20.980078 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3078/6285] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:21.462343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:21.462975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:21.470613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:21.471732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:21.472803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:21.473628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:21.474095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:21.474927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:21.628049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:21.636045 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b4ff6b73-132f-4564-8838-258fdfc42a1b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1694 microversion: 2.1 time: 0.177783 Oct 31 16:01:21.636652 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3208/6286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:21 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:22.661686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:22.662405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:22.668791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:22.669290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:22.669741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:22.670441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:22.670912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:22.671349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:22.804041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:22.811655 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d3dd1f2-5dca-4d92-8bb9-ded72a06e883 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1692 microversion: 2.1 time: 0.155895 Oct 31 16:01:22.812223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3079/6287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:22 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:22.997316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:23.007838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:23.008312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:23.008777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:23.020429 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] Creating event network-changed:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h1-858383-17 Oct 31 16:01:23.025715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:01:23.037185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-32880a88-ae74-4090-a440-5f9ffb8e8577 req-30a4fd1a-d153-4e64-adf8-2aa8e4b4ab54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043589 Oct 31 16:01:23.037776 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3209/6288] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:23.835996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:23.836655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:23.843812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:23.844346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:23.844832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:23.845546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:23.846092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:23.846609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:23.983087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:23.991031 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-02d09e22-b57c-41af-a281-e00b00722bc0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1692 microversion: 2.1 time: 0.158933 Oct 31 16:01:23.991608 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3080/6289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:23 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:25.015862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:25.016809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:25.023360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:25.023859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:25.024304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:25.025043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:25.025513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:25.025949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:25.315461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:25.325112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4a12061-ff99-4344-b8f5-21b9091ca97c tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1692 microversion: 2.1 time: 0.314487 Oct 31 16:01:25.328875 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3210/6290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:25 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1692 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:26.350825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:26.351394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:26.358284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.358785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.359240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.359948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.360423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.360893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.501782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:26.509966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f94116dd-44f5-4834-8412-67319bd2d825 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1689 microversion: 2.1 time: 0.163951 Oct 31 16:01:26.510569 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3081/6291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:26 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:26.533303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:26.534745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:26.541498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.542091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.542530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.543229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.543686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.544113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.654769 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-311be7e9-e30c-444d-9093-4c36a7702fa4 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action" status: 202 len: 0 microversion: 2.1 time: 0.125155 Oct 31 16:01:26.655303 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3211/6292] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:01:26 2022] POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:01:26.663642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:26.664374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:26.670515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.671101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.671655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.672439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.673026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.673610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.871427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:26.880145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fe20546f-77ed-493d-9f9e-c7c619d58344 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1688 microversion: 2.1 time: 0.220393 Oct 31 16:01:26.880738 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3082/6293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:26 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:01:27.904947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:27.906169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:27.913475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:27.913966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:27.914406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:27.915118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:27.915581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:27.916015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:28.056191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:28.065329 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f42f3f92-2a8a-4c98-a712-4d8e8b3ae678 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1688 microversion: 2.1 time: 0.164830 Oct 31 16:01:28.066322 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3212/6294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:27 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:28.069855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "name": "network-vif-plugged", "status": "completed", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:28.081346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:28.082056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:28.082608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:28.095161 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] Creating event network-vif-plugged:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h1-858383-17 Oct 31 16:01:28.101406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:01:28.112487 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-66d31750-8e0e-4d37-8a89-f22d5748efb5 req-64b62fbb-1997-4be4-8b8d-d49d53683693 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047679 Oct 31 16:01:28.113137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3083/6295] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:01:29.089077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:29.089784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:29.097243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:29.097811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:29.098623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:29.099224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:29.099683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:29.100118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:29.234864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:29.242846 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-baeb41d4-756b-4368-8b33-52e42284226b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1688 microversion: 2.1 time: 0.157585 Oct 31 16:01:29.243413 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3213/6296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:29 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:30.207998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "name": "network-vif-unplugged", "status": "completed", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:30.219541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:30.220193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:30.220612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:30.237522 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] Creating event network-vif-unplugged:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:01:30.245523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:01:30.260150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8ef903f0-3884-4213-a8d4-4b8decc5d574 req-05c926bb-cea1-4423-ab0e-e16c16b93b3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139056 Oct 31 16:01:30.261271 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3084/6297] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:30.268840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:30.270104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:30.278366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:30.278922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:30.279360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:30.280067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:30.280531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:30.280987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:30.443629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:30.452066 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db68888f-f1bb-453b-b750-bfe3cbbf7f03 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1688 microversion: 2.1 time: 0.189289 Oct 31 16:01:30.452651 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3214/6298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:30 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:31.482879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:31.483676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:31.490120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:31.490621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:31.491074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:31.491781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:31.492256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:31.492726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:31.635745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:31.644298 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c70ec98e-a5a3-400b-8152-001f8336da5a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1688 microversion: 2.1 time: 0.167361 Oct 31 16:01:31.644981 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3085/6299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:31 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:32.282325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:32.293512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:32.293994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:32.294423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:32.306069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] Creating event network-changed:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:01:32.311256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:01:32.322343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-15282181-2cda-4343-b6dd-b619b3837d98 req-1fb0bb88-da33-40fd-9ce0-3903fdcd4e03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043845 Oct 31 16:01:32.322932 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3215/6300] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:32.670783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:32.672522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:32.684655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:32.685599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:32.686440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:32.687963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:32.688850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:32.689896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:32.927521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:32.935555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-590ef409-c478-4b6a-9ff2-31340ea7f641 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1681 microversion: 2.1 time: 0.271692 Oct 31 16:01:32.936155 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3086/6301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:32 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:35.814214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a2145f1b-c673-4c0b-b6e1-9ebedea50008 req-30b89c5d-9210-444f-b5ee-2925dcf50844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "name": "network-vif-plugged", "status": "completed", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:35.824468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a2145f1b-c673-4c0b-b6e1-9ebedea50008 req-30b89c5d-9210-444f-b5ee-2925dcf50844 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:35.824979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a2145f1b-c673-4c0b-b6e1-9ebedea50008 req-30b89c5d-9210-444f-b5ee-2925dcf50844 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:35.825499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a2145f1b-c673-4c0b-b6e1-9ebedea50008 req-30b89c5d-9210-444f-b5ee-2925dcf50844 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:35.840151 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a2145f1b-c673-4c0b-b6e1-9ebedea50008 req-30b89c5d-9210-444f-b5ee-2925dcf50844 service nova] Creating event network-vif-plugged:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:01:35.845237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a2145f1b-c673-4c0b-b6e1-9ebedea50008 req-30b89c5d-9210-444f-b5ee-2925dcf50844 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036107 Oct 31 16:01:35.845882 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3216/6302] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:51.962886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:51.963478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:51.966022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=17 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:51.966768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=47 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:51.973550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:51.974055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:51.974762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:51.975464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:51.975934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:51.976371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:52.001012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:01:52.076207 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd1891d2-4221-4d2c-a71e-a58ff989ab44 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 204 len: 0 microversion: 2.1 time: 0.116968 Oct 31 16:01:52.076872 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3087/6303] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:01:51 2022] DELETE /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:01:52.084365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=23 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:52.085133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:52.089470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:52.090183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:52.097793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:52.098287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:52.098736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:52.099735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:52.100204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:52.100640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:52.234950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:52.243039 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa844f69-c672-4f5d-86a9-9ae27d7762f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1578 microversion: 2.1 time: 0.161594 Oct 31 16:01:52.243614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3217/6304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:52 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:53.268053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:53.269010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:53.275975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:53.276476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:53.276960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:53.277665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:53.278134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:53.278573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:53.416045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:53.423965 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01bd63ed-515a-4b75-bf40-016074957a86 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1578 microversion: 2.1 time: 0.160219 Oct 31 16:01:53.424477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3088/6305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:53 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:54.447630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:54.448192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:54.455173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:54.455656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:54.456123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:54.456880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:54.457342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:54.457766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:54.674593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:54.683239 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b140aca-fd6f-4455-873e-253a82fb01e6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1578 microversion: 2.1 time: 0.239626 Oct 31 16:01:54.683826 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3218/6306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:54 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1578 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:55.047596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9603bb84-6e67-4d87-9137-69cdf6386385 req-780207d3-bebd-4b7d-b308-b49500d4d6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96d8a61-4beb-4908-92e4-e64d23879837", "name": "network-vif-deleted", "tag": "940a5150-34ea-4393-9374-af3a856d319a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:55.059704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9603bb84-6e67-4d87-9137-69cdf6386385 req-780207d3-bebd-4b7d-b308-b49500d4d6e9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:55.061175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9603bb84-6e67-4d87-9137-69cdf6386385 req-780207d3-bebd-4b7d-b308-b49500d4d6e9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:55.062326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9603bb84-6e67-4d87-9137-69cdf6386385 req-780207d3-bebd-4b7d-b308-b49500d4d6e9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:55.079861 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9603bb84-6e67-4d87-9137-69cdf6386385 req-780207d3-bebd-4b7d-b308-b49500d4d6e9 service nova] Creating event network-vif-deleted:940a5150-34ea-4393-9374-af3a856d319a for instance a96d8a61-4beb-4908-92e4-e64d23879837 on n-h1-858383-17 Oct 31 16:01:55.085495 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9603bb84-6e67-4d87-9137-69cdf6386385 req-780207d3-bebd-4b7d-b308-b49500d4d6e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042157 Oct 31 16:01:55.086153 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3089/6307] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:55.708817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:55.709484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:55.716392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:55.716946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:55.717392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:55.718355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:55.718840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:55.719277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:55.787563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:55.796295 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1ddb0a4-3a8c-474e-b750-3384059eeb6f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1226 microversion: 2.1 time: 0.092433 Oct 31 16:01:55.797137 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3219/6308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:55 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:56.821061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:56.821903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:56.829124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:56.829695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:56.830214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:56.830980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:56.832113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:56.832620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:56.896598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:56.904634 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d48739f7-a720-4b28-81d1-0f8d2c339a1d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1226 microversion: 2.1 time: 0.088863 Oct 31 16:01:56.905246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3090/6309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:56 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:57.133782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:57.136180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:57.143361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:57.144354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:57.144827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:57.145524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:57.146019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:57.146443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:57.203196 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9a73d67-afdc-488f-87b3-4c92d801d5d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action" status: 200 len: 63184 microversion: 2.1 time: 0.073120 Oct 31 16:01:57.204167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3220/6310] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:01:57 2022] POST /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69/action => generated 63184 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:01:57.929147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:57.929790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:57.936685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:57.937219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:57.937677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:57.938389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:57.938876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:57.939384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:58.005767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:58.013898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-40e8bb2a-7a88-4860-b13f-38f54effc783 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1226 microversion: 2.1 time: 0.089338 Oct 31 16:01:58.014485 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3091/6311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:57 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:59.038821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:59.039545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:59.047516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:59.048024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:59.048472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:59.049219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:59.049694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:59.050160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:59.118566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:59.127100 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5cb1a2cb-48ad-4242-99c3-002b1088a9a9 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 200 len: 1226 microversion: 2.1 time: 0.092628 Oct 31 16:01:59.127676 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3221/6312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:59 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:00.151265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:00.151930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:00.158873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:00.159378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:00.160795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:00.161525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:00.162015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:00.162466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:00.177099 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 HTTP/1.1 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a96d8a61-4beb-4908-92e4-e64d23879837'} Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:02:00.178811 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0921b164-1f20-404a-9498-a704377152c1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 404 len: 111 microversion: 2.1 time: 0.032914 Oct 31 16:02:00.184105 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3092/6313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:00 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:02:00.229932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1051857256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1128586012", "security_groups": [{"name": "tempest-secgroup-smoke-285117054"}], "block_device_mapping_v2": [{"uuid": "04fb6ebc-ab53-48c6-a018-4f8304bfb092", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:00.346187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:02:00.708660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:02:00.709128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:02:00.709606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:02:00.710018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:02:00.710455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:02:00.719275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:00.719756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:00.720208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:00.720949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:00.721407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:00.721832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:00.739562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:02:00.745182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:02:00.803013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:02:00.805180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04fb6ebc-ab53-48c6-a018-4f8304bfb092',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:02:00.931173 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-72b640b4-adfa-48af-95ab-a603fa9318e7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705859 Oct 31 16:02:00.931963 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3222/6314] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:02:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:02:00.943409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f4a04892-89e8-434b-9987-499c692580b5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:00.944139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f4a04892-89e8-434b-9987-499c692580b5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:00.998381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f4a04892-89e8-434b-9987-499c692580b5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:01.005644 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f4a04892-89e8-434b-9987-499c692580b5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1095 microversion: 2.1 time: 0.066335 Oct 31 16:02:01.006232 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3093/6315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:00 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:02.029262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:02.030772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:02.040987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:02.041583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:02.042234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:02.042955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:02.043421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:02.043855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:02.121837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:02.129729 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-134ce542-1a7e-402d-b7bd-194dca1fa7a7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1201 microversion: 2.1 time: 0.105197 Oct 31 16:02:02.130524 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3223/6316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:02 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:03.154313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:03.155150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:03.164084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:03.165034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:03.165681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:03.166613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:03.167093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:03.167745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:03.401949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:03.402477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:03.403762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:03.412640 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e871d56b-4759-403a-9fb1-3ba44574bfb2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1278 microversion: 2.1 time: 0.262599 Oct 31 16:02:03.414289 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3094/6317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:03 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:03.429238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:03.430136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:03.430751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:03.431498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:03.431970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:03.432437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:03.637037 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a2a7c07-0b3a-4b06-876d-417c2c5f2e3c tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1834 microversion: 2.1 time: 0.239375 Oct 31 16:02:03.639340 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3224/6318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:03 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1834 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:03.657574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-7006008a-d25d-4010-ac00-0afa97ae7626 req-8f4acad2-caf1-4c09-a9a4-9eae2ca9eb88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69992a37-972a-4166-9c78-808b04f2e1e7", "tag": "d482b833-3c55-4c61-9e4c-db9339f99ea6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:03.678928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7006008a-d25d-4010-ac00-0afa97ae7626 req-8f4acad2-caf1-4c09-a9a4-9eae2ca9eb88 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:03.679861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7006008a-d25d-4010-ac00-0afa97ae7626 req-8f4acad2-caf1-4c09-a9a4-9eae2ca9eb88 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:03.680318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-7006008a-d25d-4010-ac00-0afa97ae7626 req-8f4acad2-caf1-4c09-a9a4-9eae2ca9eb88 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:03.696831 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-7006008a-d25d-4010-ac00-0afa97ae7626 req-8f4acad2-caf1-4c09-a9a4-9eae2ca9eb88 service nova] Creating event network-changed:d482b833-3c55-4c61-9e4c-db9339f99ea6 for instance 69992a37-972a-4166-9c78-808b04f2e1e7 on n-h1-858383-17 Oct 31 16:02:03.702816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-7006008a-d25d-4010-ac00-0afa97ae7626 req-8f4acad2-caf1-4c09-a9a4-9eae2ca9eb88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054667 Oct 31 16:02:03.704006 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3095/6319] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:04.437571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:04.438160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:04.445669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:04.446560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:04.447223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:04.448418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:04.449660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:04.450353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:04.691601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:04.705590 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ad4740e-816f-4188-bb02-73a09552d376 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1278 microversion: 2.1 time: 0.271959 Oct 31 16:02:04.706983 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3225/6320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:04 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:04.963042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:04.964223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:04.969701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b6990bf0-8d78-459f-8720-820e72578e04 req-3c803427-8e13-45ab-b934-f00bac4ef1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:04.982790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b6990bf0-8d78-459f-8720-820e72578e04 req-3c803427-8e13-45ab-b934-f00bac4ef1e3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:04.983206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:04.983348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b6990bf0-8d78-459f-8720-820e72578e04 req-3c803427-8e13-45ab-b934-f00bac4ef1e3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:04.983710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b6990bf0-8d78-459f-8720-820e72578e04 req-3c803427-8e13-45ab-b934-f00bac4ef1e3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:04.983841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:04.984165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:04.984922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:04.985403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:04.985859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:04.996773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b6990bf0-8d78-459f-8720-820e72578e04 req-3c803427-8e13-45ab-b934-f00bac4ef1e3 service nova] Creating event network-changed:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:02:05.002120 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b6990bf0-8d78-459f-8720-820e72578e04 req-3c803427-8e13-45ab-b934-f00bac4ef1e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035996 Oct 31 16:02:05.003055 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3226/6321] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:05.028157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:02:05.127608 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4d3f5ef9-a0e8-43b7-8ef1-ddb79cab91e5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 204 len: 0 microversion: 2.1 time: 0.169704 Oct 31 16:02:05.128282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3096/6322] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:02:04 2022] DELETE /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:02:05.141499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:05.142219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:05.151196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:05.151971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:05.152613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:05.153536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:05.154465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:05.155132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:05.335743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:05.344187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48e48715-9d49-49c1-aad1-dad75c6a3451 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1687 microversion: 2.1 time: 0.210996 Oct 31 16:02:05.349452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3227/6323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:05 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1687 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:05.730600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:05.731319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:05.737250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:05.737747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:05.738196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:05.738891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:05.740064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:05.740502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:05.888465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:05.897706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-16ca92ce-57f3-4481-9c7c-3c0f36b0ac02 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1278 microversion: 2.1 time: 0.171313 Oct 31 16:02:05.900737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3097/6324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:05 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:06.369851 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:06.370553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:06.389219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.389774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.390236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.391032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.391445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.392152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.611616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:06.620505 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37ff1d63-3ead-4119-a349-06d686697bf2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 200 len: 1687 microversion: 2.1 time: 0.254459 Oct 31 16:02:06.621504 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3228/6325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:06 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 1687 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:06.920931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-218aa9dc-9628-408b-83af-4e1598d0afca req-c9305e92-782c-4935-a4d6-be5f1f5cac80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd726296-ee91-4143-aeaa-3adcc64a5c69", "name": "network-vif-deleted", "tag": "eea9a050-06ab-406f-ab93-0e751f8ac2b7"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:06.923591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:06.924751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:06.933469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.934503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.936249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-218aa9dc-9628-408b-83af-4e1598d0afca req-c9305e92-782c-4935-a4d6-be5f1f5cac80 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.936780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.937397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-218aa9dc-9628-408b-83af-4e1598d0afca req-c9305e92-782c-4935-a4d6-be5f1f5cac80 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.938152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-218aa9dc-9628-408b-83af-4e1598d0afca req-c9305e92-782c-4935-a4d6-be5f1f5cac80 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.938308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.939012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.939849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.955287 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-218aa9dc-9628-408b-83af-4e1598d0afca req-c9305e92-782c-4935-a4d6-be5f1f5cac80 service nova] Creating event network-vif-deleted:eea9a050-06ab-406f-ab93-0e751f8ac2b7 for instance fd726296-ee91-4143-aeaa-3adcc64a5c69 on n-h2-858383-17 Oct 31 16:02:06.964897 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-218aa9dc-9628-408b-83af-4e1598d0afca req-c9305e92-782c-4935-a4d6-be5f1f5cac80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048749 Oct 31 16:02:06.966699 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3098/6326] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:07.095751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:07.104852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-674a86b3-2445-4776-9821-30134db649d7 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1278 microversion: 2.1 time: 0.185772 Oct 31 16:02:07.105439 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3229/6327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:06 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:07.644429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:07.646358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: fd726296-ee91-4143-aeaa-3adcc64a5c69] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:07.653074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:07.653567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:07.654014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:07.654711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:07.655179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:07.655618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:07.669603 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] HTTP exception thrown: Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 could not be found. Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Request method failure captured: Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 HTTP/1.1 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_BrAEMsdDgTOS65WgvdA_K_U3aO3wZSHFW2yc9-QoRkT_5VdBKNY6Qd-eWIeDszi1h-SYlx40HBcKrxlPxcB7NZsfdtAJMKANGMg6pjW58_ZGQAtb4E50u5dW1TaY9ZfBsX10OtC9SFv6l9znfhq2UuMbLota6w60dO6FTpp-aAzTk Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a0b4bb114e7c4b06b2643c593868f3a2 Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 could not be found. Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'fd726296-ee91-4143-aeaa-3adcc64a5c69'} Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 could not be found. Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 could not be found. Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:07.671201 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 could not be found. Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Returning 404 to user: Instance fd726296-ee91-4143-aeaa-3adcc64a5c69 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e87689d-6c93-4c46-b2b4-f6fe208bba6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69" status: 404 len: 111 microversion: 2.1 time: 0.032454 Oct 31 16:02:07.676234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3099/6328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:07 2022] GET /compute/v2.1/servers/fd726296-ee91-4143-aeaa-3adcc64a5c69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:02:08.130805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:08.131605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:08.138830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:08.139323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:08.139757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:08.140470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:08.140957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:08.141438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:08.585289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:08.593277 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6f3616e-1097-4356-82ca-8207c8194d18 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.466954 Oct 31 16:02:08.593924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3230/6329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:08 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:09.618605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:09.619317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:09.628455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:09.629191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:09.630133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:09.631116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:09.631607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:09.632056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:09.836470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:09.845148 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cfd72000-5a6e-4f40-b073-5a789e2db282 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.231154 Oct 31 16:02:09.846063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3100/6330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:09 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:10.870446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:10.871188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:10.874421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:10.875213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:10.882342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:10.884105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:10.884646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:10.885514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:10.886060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:10.886568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:11.068846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:11.079936 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d2107b7-f1ee-489a-ac5d-9743f4237196 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.214188 Oct 31 16:02:11.085192 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3231/6331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:10 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:11.230135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f64f69e7-e23f-4608-9c9c-237ee9ac0482 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '.version_select at 0x7f5ca24f4700>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:11.235856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:11.252128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f64f69e7-e23f-4608-9c9c-237ee9ac0482 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-741600832" status: 202 len: 0 microversion: 2.1 time: 0.026177 Oct 31 16:02:11.252761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3101/6332] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Oct 31 16:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-741600832 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:02:11.295069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0a6f56a-5d32-461c-b2cb-a5013fc67691 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: .version_select at 0x7f5ca20e2e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-182780570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGGWN5DPpd2VRcib2UH3WC4My1uO/30mcaTFN8bRXZe3BsGJuP/cWj/IQHzLpBfkAmHj29YmpdjHF+7iVhXtnGglaI6uLWgodKx9KHwW/fnn+ApltXHJDSC0k2GR1AOQ=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:11.311135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b0a6f56a-5d32-461c-b2cb-a5013fc67691 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:02:11.316348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b0a6f56a-5d32-461c-b2cb-a5013fc67691 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:02:11.339758 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0a6f56a-5d32-461c-b2cb-a5013fc67691 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.048765 Oct 31 16:02:11.340364 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3232/6333] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:02:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:02:12.104650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:12.105315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:12.114394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:12.115541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:12.115541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:12.116237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:12.116770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:12.117441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:12.315968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:12.328147 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c33b3e3-5c29-4fec-ad85-304d17a35c87 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.227902 Oct 31 16:02:12.328970 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3102/6334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:12 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:13.355027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:13.355631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:13.362348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:13.362852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:13.363291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:13.364054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:13.365164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:13.365737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:13.584886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:13.592644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bb7c42e-40b8-43ca-8354-6b7da9c42534 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.242851 Oct 31 16:02:13.593258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3233/6335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:13 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:14.617889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:14.619828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:14.626543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:14.627118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:14.627635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:14.628468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:14.629109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:14.629640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:14.867540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:14.880966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6163f5b3-7e21-489b-a8a9-60d57d02311b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.266232 Oct 31 16:02:14.882580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3103/6336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:14 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:15.909870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:15.910592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:15.925738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:15.929231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:15.929848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:15.931358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:15.932708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:15.933795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:16.235924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:16.250354 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9becbb82-fd46-4ec1-8862-b04233a454f6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.345761 Oct 31 16:02:16.268125 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3234/6337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:15 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:17.276511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:17.277207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:17.285660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:17.286234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:17.287372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:17.288134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:17.288862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:17.289332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:17.444287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:17.455107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea8f8bf8-c40e-4b4a-9f67-d100b8a19dfc tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.183161 Oct 31 16:02:17.456587 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3104/6338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:17 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:18.115114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1661539900", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "28844dc5-ca25-49ef-b48e-7e6e33fc3907"}], "key_name": "tempest-TestNetworkAdvancedServerOps-182780570", "security_groups": [{"name": "tempest-secgroup-smoke-1590929923"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:18.240746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] validate_networks() for [('28844dc5-ca25-49ef-b48e-7e6e33fc3907', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:02:18.483729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:18.484994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:18.493186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.493814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.495417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.496284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.497041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.497721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.520823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:18.712850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:18.714961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:02:18.715650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:02:18.716127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:02:18.716755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:02:18.717184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:02:18.722382 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d5a040c9-4af4-40e0-8e88-698d4142a4c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.242699 Oct 31 16:02:18.728781 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3105/6339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:18 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:18.728957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.728957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.728957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.729256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.729672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.730121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.748720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:02:18.754349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:02:18.767521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:02:18.769860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:02:18.817229 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7fa68c7-46b0-4eeb-b71f-dea663e4985b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706165 Oct 31 16:02:18.825137 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3235/6340] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:02:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:02:18.831128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e00575d-d064-49fe-8050-d5e712321e76 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:18.832072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e00575d-d064-49fe-8050-d5e712321e76 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:18.887769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e00575d-d064-49fe-8050-d5e712321e76 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:18.909234 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e00575d-d064-49fe-8050-d5e712321e76 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1266 microversion: 2.1 time: 0.082401 Oct 31 16:02:18.910262 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3106/6341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:18 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:18.935728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-acd59d10-baf2-4772-b2ed-5ed686e60411 req-6203f59d-763c-48ef-8f13-3ac534df8b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69992a37-972a-4166-9c78-808b04f2e1e7", "name": "network-vif-plugged", "status": "completed", "tag": "d482b833-3c55-4c61-9e4c-db9339f99ea6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:18.946172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-acd59d10-baf2-4772-b2ed-5ed686e60411 req-6203f59d-763c-48ef-8f13-3ac534df8b07 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.946955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-acd59d10-baf2-4772-b2ed-5ed686e60411 req-6203f59d-763c-48ef-8f13-3ac534df8b07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.947465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-acd59d10-baf2-4772-b2ed-5ed686e60411 req-6203f59d-763c-48ef-8f13-3ac534df8b07 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.960017 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-acd59d10-baf2-4772-b2ed-5ed686e60411 req-6203f59d-763c-48ef-8f13-3ac534df8b07 service nova] Creating event network-vif-plugged:d482b833-3c55-4c61-9e4c-db9339f99ea6 for instance 69992a37-972a-4166-9c78-808b04f2e1e7 on n-h1-858383-17 Oct 31 16:02:18.965648 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-acd59d10-baf2-4772-b2ed-5ed686e60411 req-6203f59d-763c-48ef-8f13-3ac534df8b07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033894 Oct 31 16:02:18.966788 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3236/6342] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:02:19.747705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:19.748523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:19.756940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.757451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.757902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.758653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.759133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.759571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.901487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:19.915631 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5024473d-85dd-4852-a1e2-1ff69494f685 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1266 microversion: 2.1 time: 0.172643 Oct 31 16:02:19.919403 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3107/6343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:19 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:19.932170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:19.933708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:19.940730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.942226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.943901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.944982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.945686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.946353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.970504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:20.034879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:20.044390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-faf341f0-bbc9-4001-913c-6e4ed2727599 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1326 microversion: 2.1 time: 0.115004 Oct 31 16:02:20.046452 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3237/6344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:19 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:20.943640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:20.944964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:20.955779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:20.957811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:20.958853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:20.959616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:20.960263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:20.960725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.072125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:21.078382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:21.087367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.087938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.088567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.089795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.090519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.091188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.232418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:21.240932 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a38517b-b278-4e79-95a0-51cdeca4ca91 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1453 microversion: 2.1 time: 0.301485 Oct 31 16:02:21.259914 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3108/6345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:20 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1453 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:21.266804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:21.267630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:21.273984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.274593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.275131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.275911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.276437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.276923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.335980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:21.343770 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92b3a638-5f49-4577-ad99-076635024225 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.275986 Oct 31 16:02:21.344355 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3238/6346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:21 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:21.493583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:21.501560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49602474-aa23-4abb-82c6-e4cea84cd411 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1453 microversion: 2.1 time: 0.239802 Oct 31 16:02:21.502164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3109/6347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:21 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:21.742863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-19fa8e69-e86f-4e0a-898f-960b348896aa req-81674bd0-ccb0-4a2c-b0f3-03f4e54df6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:21.754169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-19fa8e69-e86f-4e0a-898f-960b348896aa req-81674bd0-ccb0-4a2c-b0f3-03f4e54df6b0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.755051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-19fa8e69-e86f-4e0a-898f-960b348896aa req-81674bd0-ccb0-4a2c-b0f3-03f4e54df6b0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.756305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-19fa8e69-e86f-4e0a-898f-960b348896aa req-81674bd0-ccb0-4a2c-b0f3-03f4e54df6b0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.773082 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-19fa8e69-e86f-4e0a-898f-960b348896aa req-81674bd0-ccb0-4a2c-b0f3-03f4e54df6b0 service nova] Creating event network-changed:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h2-858383-17 Oct 31 16:02:21.778953 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-19fa8e69-e86f-4e0a-898f-960b348896aa req-81674bd0-ccb0-4a2c-b0f3-03f4e54df6b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041774 Oct 31 16:02:21.779650 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3239/6348] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:22.369071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:22.369696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:22.372442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:22.378654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:22.379275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:22.379966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:22.381505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:22.382059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:22.382517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:22.518563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:22.526675 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bd35c95-8869-4da6-9b4c-e2f28dd8e66b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.162105 Oct 31 16:02:22.527341 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3110/6349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:22 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:23.137326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8a93c9b0-427d-4094-a191-9620938053d0 req-448705b5-a981-44bb-97a0-9552e97dc6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69992a37-972a-4166-9c78-808b04f2e1e7", "tag": "d482b833-3c55-4c61-9e4c-db9339f99ea6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:23.142788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:23.149859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8a93c9b0-427d-4094-a191-9620938053d0 req-448705b5-a981-44bb-97a0-9552e97dc6d4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:23.150446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8a93c9b0-427d-4094-a191-9620938053d0 req-448705b5-a981-44bb-97a0-9552e97dc6d4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:23.150959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8a93c9b0-427d-4094-a191-9620938053d0 req-448705b5-a981-44bb-97a0-9552e97dc6d4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:23.174818 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8a93c9b0-427d-4094-a191-9620938053d0 req-448705b5-a981-44bb-97a0-9552e97dc6d4 service nova] Creating event network-changed:d482b833-3c55-4c61-9e4c-db9339f99ea6 for instance 69992a37-972a-4166-9c78-808b04f2e1e7 on n-h1-858383-17 Oct 31 16:02:23.180466 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8a93c9b0-427d-4094-a191-9620938053d0 req-448705b5-a981-44bb-97a0-9552e97dc6d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048199 Oct 31 16:02:23.181304 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3240/6350] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:23.549389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:23.550177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:23.557682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:23.558477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:23.558982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:23.559778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:23.560405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:23.560942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:23.702625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:23.710723 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49ff171a-0c47-43de-adaa-779493882b8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.165367 Oct 31 16:02:23.711308 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3111/6351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:23 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:24.734626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:24.735333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:24.741571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:24.742060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:24.742502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:24.743200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:24.743664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:24.744129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:24.872904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:24.880589 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16d98642-b941-4e48-95d6-be5d243f0094 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.151050 Oct 31 16:02:24.881196 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3241/6352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:24 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:25.903351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:25.904566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:25.912266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:25.913008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:25.913508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:25.914236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:25.914718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:25.915168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:26.056637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:26.065092 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-47abb040-c99d-43a4-9582-9e88e7100581 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.165616 Oct 31 16:02:26.065698 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3112/6353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:25 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:27.087700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:27.088315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:27.095195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:27.095681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:27.096119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:27.096839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:27.097298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:27.097723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:27.229121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:27.236711 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae8815a6-afaa-4fa6-ab8f-43b8b30fd07f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.153157 Oct 31 16:02:27.237280 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3242/6354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:27 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:27.994272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8a6c374e-34f0-4803-abe3-6a99b1f0993c req-17c1ed4a-0b22-40cb-ad85-fff9ece9ece7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:28.006722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8a6c374e-34f0-4803-abe3-6a99b1f0993c req-17c1ed4a-0b22-40cb-ad85-fff9ece9ece7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:28.007303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8a6c374e-34f0-4803-abe3-6a99b1f0993c req-17c1ed4a-0b22-40cb-ad85-fff9ece9ece7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:28.007747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8a6c374e-34f0-4803-abe3-6a99b1f0993c req-17c1ed4a-0b22-40cb-ad85-fff9ece9ece7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:28.019490 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8a6c374e-34f0-4803-abe3-6a99b1f0993c req-17c1ed4a-0b22-40cb-ad85-fff9ece9ece7 service nova] Creating event network-vif-plugged:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h2-858383-17 Oct 31 16:02:28.025123 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8a6c374e-34f0-4803-abe3-6a99b1f0993c req-17c1ed4a-0b22-40cb-ad85-fff9ece9ece7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Oct 31 16:02:28.026087 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3113/6355] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:02:28.261209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:28.261827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:28.268800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:28.269288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:28.269726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:28.270423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:28.270967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:28.271989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:28.404037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:28.412305 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf0970b2-f6e2-4455-95de-8caa56d9c39a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1392 microversion: 2.1 time: 0.155431 Oct 31 16:02:28.412895 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3243/6356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:28 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:29.436011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:29.436745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:29.438735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:29.445707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:29.446203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:29.446654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:29.447357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:29.447827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:29.448270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:29.579772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:29.587913 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc392eae-130d-4fba-9757-22a0207d45d7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1564 microversion: 2.1 time: 0.156294 Oct 31 16:02:29.588496 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3114/6357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:29 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:29.610568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:29.611182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:29.613162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:29.613838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:29.621007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:29.621495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:29.621938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:29.622638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:29.623102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:29.623537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:29.759303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:29.767023 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e122cb7-034c-4d65-986d-f72dd40723a5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1564 microversion: 2.1 time: 0.160274 Oct 31 16:02:29.767589 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3244/6358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:29 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:31.726038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:31.727775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:31.730298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2ecc7918-7dcb-4fef-a012-e1e335784f11 req-beb09f1c-c2bc-4bde-ab9a-ea662233a52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:31.736652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:31.737609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:31.738097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:31.738862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:31.739518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:31.740016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:31.742632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2ecc7918-7dcb-4fef-a012-e1e335784f11 req-beb09f1c-c2bc-4bde-ab9a-ea662233a52d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:31.743118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2ecc7918-7dcb-4fef-a012-e1e335784f11 req-beb09f1c-c2bc-4bde-ab9a-ea662233a52d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:31.743554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2ecc7918-7dcb-4fef-a012-e1e335784f11 req-beb09f1c-c2bc-4bde-ab9a-ea662233a52d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:31.758878 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2ecc7918-7dcb-4fef-a012-e1e335784f11 req-beb09f1c-c2bc-4bde-ab9a-ea662233a52d service nova] Creating event network-changed:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h2-858383-17 Oct 31 16:02:31.764275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2ecc7918-7dcb-4fef-a012-e1e335784f11 req-beb09f1c-c2bc-4bde-ab9a-ea662233a52d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038650 Oct 31 16:02:31.764924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3245/6359] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:31.981513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:31.989325 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-328296ae-6452-475c-b85f-2bd8998aecd7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1564 microversion: 2.1 time: 0.268551 Oct 31 16:02:31.990717 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3115/6360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:31 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:53.354490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=11 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:53.355338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=38 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:53.359900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:53.362199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:53.369192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:53.369680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:53.370119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:53.370815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:53.371275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:53.371702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:53.421422 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-edaf0c5d-0a37-4640-aca0-831bd132bc96 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action" status: 200 len: 24571 microversion: 2.1 time: 0.069668 Oct 31 16:02:53.422397 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3246/6361] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:02:53 2022] POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:03:04.347736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:04.348358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:04.350455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=11 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:04.351210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=52 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:04.357285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.357794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.358252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.359012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.359520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.359971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.501613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:04.509516 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e5c01b69-d313-403e-b052-9ecafa15c5b7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1683 microversion: 2.1 time: 0.166058 Oct 31 16:03:04.510092 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3116/6362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:04 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:04.609121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:04.611422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:04.614419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:04.615162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:04.623152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.623637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.624087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.624822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.625290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.625725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.678291 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1dfe260e-1377-4e35-b71f-0f8456c0abbc tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action" status: 200 len: 32646 microversion: 2.1 time: 0.072902 Oct 31 16:03:04.679434 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3247/6363] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:03:04 2022] POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action => generated 32646 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:03:04.955299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:04.955926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:04.962050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.962545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.963088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.964016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.964488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.964949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:05.097219 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c6077d3-d452-42a8-9dbf-54c244a01e76 tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1836 microversion: 2.1 time: 0.276609 Oct 31 16:03:05.097842 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3117/6364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:04 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1836 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:05.128724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:05.131672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:05.139362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:05.140080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:05.140571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:05.141384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:05.141842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:05.142270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:05.169378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lazy-loading 'flavor' on Instance uuid 1394757a-13ab-4679-adb2-50463f805c92 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:03:05.183937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Going to try to live migrate instance to another host {{(pid=120625) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 16:03:06.555661 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75954fab-1abe-47ce-98ef-fd15d909dd9f tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action" status: 202 len: 0 microversion: 2.1 time: 1.430855 Oct 31 16:03:06.556575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3248/6365] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:03:05 2022] POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action => generated 0 bytes in 1433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:03:06.565752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:06.566402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:06.573575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:06.574078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:06.574530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:06.575457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:06.575933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:06.576577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:06.717265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:06.726301 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c12d4c7-8226-4043-a74a-66756f5b1919 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.164323 Oct 31 16:03:06.727112 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3118/6366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:06 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:07.647156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-06b45fe1-aa4c-4c5e-81d3-7727ab2b2035 req-5b9722af-4b03-4ff4-b2f6-55d514c78f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "name": "network-vif-unplugged", "status": "completed", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:07.658463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-06b45fe1-aa4c-4c5e-81d3-7727ab2b2035 req-5b9722af-4b03-4ff4-b2f6-55d514c78f85 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:07.658949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-06b45fe1-aa4c-4c5e-81d3-7727ab2b2035 req-5b9722af-4b03-4ff4-b2f6-55d514c78f85 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:07.659383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-06b45fe1-aa4c-4c5e-81d3-7727ab2b2035 req-5b9722af-4b03-4ff4-b2f6-55d514c78f85 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:07.670887 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-06b45fe1-aa4c-4c5e-81d3-7727ab2b2035 req-5b9722af-4b03-4ff4-b2f6-55d514c78f85 service nova] Creating event network-vif-unplugged:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h2-858383-17 Oct 31 16:03:07.675741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-06b45fe1-aa4c-4c5e-81d3-7727ab2b2035 req-5b9722af-4b03-4ff4-b2f6-55d514c78f85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032550 Oct 31 16:03:07.676343 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3249/6367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:07.753416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:07.754132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:07.761401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:07.762228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:07.763049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:07.763771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:07.764248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:07.764688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:07.968514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:07.976946 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a24b24ee-95fc-4e69-aa86-22f69cc4dd46 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.227814 Oct 31 16:03:07.977531 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3119/6368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:07 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:09.002467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:09.003203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:09.009442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:09.009938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:09.010376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:09.011071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:09.011534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:09.011966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:09.142727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:09.150425 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9061e77-b65a-40a4-a963-a8f1784671c9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.153003 Oct 31 16:03:09.150995 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3250/6369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:08 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:09.694076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4cdd6474-0580-475a-98d5-c1956345add0 req-5fd8d379-a78b-473f-9864-122b7f46d2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:09.704377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4cdd6474-0580-475a-98d5-c1956345add0 req-5fd8d379-a78b-473f-9864-122b7f46d2d0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:09.704895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4cdd6474-0580-475a-98d5-c1956345add0 req-5fd8d379-a78b-473f-9864-122b7f46d2d0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:09.705343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4cdd6474-0580-475a-98d5-c1956345add0 req-5fd8d379-a78b-473f-9864-122b7f46d2d0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:09.719331 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4cdd6474-0580-475a-98d5-c1956345add0 req-5fd8d379-a78b-473f-9864-122b7f46d2d0 service nova] Creating event network-changed:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h2-858383-17 Oct 31 16:03:09.724349 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4cdd6474-0580-475a-98d5-c1956345add0 req-5fd8d379-a78b-473f-9864-122b7f46d2d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Oct 31 16:03:09.724983 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3120/6370] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:10.176289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:10.176958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:10.184049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:10.185229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:10.185669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:10.186563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:10.187027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:10.187455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:10.467029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:10.477147 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f1f3032f-e1a4-4655-9312-9644e39097a2 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.305586 Oct 31 16:03:10.489324 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3251/6371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:10 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:11.505059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:11.505729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:11.512222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:11.512891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:11.513344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:11.514041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:11.514530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:11.514950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:11.646129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:11.654543 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6b1144de-ebc3-4fd3-86cd-6a33763eca37 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.155246 Oct 31 16:03:11.655110 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3121/6372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:11 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:12.678175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:12.678788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:12.685670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:12.686151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:12.686585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:12.687277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:12.687734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:12.688163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:12.817433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:12.825361 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-613661ba-ec6d-4eb0-b4c5-66c9997c4522 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.151172 Oct 31 16:03:12.825937 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3252/6373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:12 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:13.848569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:13.849167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:13.856685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.857218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.857723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.858419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.858886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.859324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.997975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:14.005701 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0be7e5e-6c3e-4831-a6f7-cc6f44eedec7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.161182 Oct 31 16:03:14.006274 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3122/6374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:13 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:15.029336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:15.029956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:15.037702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:15.038193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:15.038639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:15.039340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:15.039806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:15.040238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:15.174589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:15.182560 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8236f7bb-625a-4123-8ece-01577dfff8f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.157676 Oct 31 16:03:15.183140 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3253/6375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:15 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:16.205436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:16.206076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:16.213178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:16.213683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:16.214140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:16.214855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:16.215333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:16.216585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:16.419846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:16.428463 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8106a3b0-31b3-4fbd-a68a-78ab64937f5b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.227073 Oct 31 16:03:16.429093 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3123/6376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:16 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:17.456013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:17.456581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:17.463463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:17.463957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:17.464408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:17.465135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:17.466249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:17.466738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:17.603200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:17.611234 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a6b6568-d330-4d2a-96eb-015275cb2455 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1693 microversion: 2.1 time: 0.159257 Oct 31 16:03:17.611835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3254/6377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:17 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:18.634527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:18.635267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:18.643442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.643946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.644400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.645156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.645633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.646079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.779849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:18.787588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-943a2038-39aa-4d08-8b3f-bf3c7ac2ec86 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1683 microversion: 2.1 time: 0.157036 Oct 31 16:03:18.788164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3124/6378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:18 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:18.810112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:18.810828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:18.817726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.818214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.818653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.819358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.819820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.820285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.946194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ac7f4fc-1139-4a1a-bdb9-1745cfb027cb tempest-TestNetworkAdvancedServerOps-2015788264 tempest-TestNetworkAdvancedServerOps-2015788264-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1836 microversion: 2.1 time: 0.140303 Oct 31 16:03:18.946777 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3255/6379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:18 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1836 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:18.970751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:18.971388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:18.977489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.978000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.978443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.979149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.979916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.980362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:19.115495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:19.123715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-18e6e31d-e320-41fb-8365-7f43751b5faa tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1683 microversion: 2.1 time: 0.156902 Oct 31 16:03:19.124297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3125/6380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:18 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:19.219151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:19.221431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:19.227503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:19.227988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:19.228428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:19.229154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:19.229885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:19.230313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:19.292407 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd7ccf1d-d510-4b20-a0a2-6e29eac13683 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action" status: 200 len: 38648 microversion: 2.1 time: 0.077759 Oct 31 16:03:19.293172 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3256/6381] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:03:19 2022] POST /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92/action => generated 38648 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:03:20.268635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:20.269484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:20.271329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9d977373-0bef-4303-a022-7e05688bddf1 req-b3f73eb7-c6e9-48b6-a0d3-e788035712b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:20.276888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.277544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.278266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.279199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.279914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.280463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.282586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9d977373-0bef-4303-a022-7e05688bddf1 req-b3f73eb7-c6e9-48b6-a0d3-e788035712b9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.283071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9d977373-0bef-4303-a022-7e05688bddf1 req-b3f73eb7-c6e9-48b6-a0d3-e788035712b9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.283694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9d977373-0bef-4303-a022-7e05688bddf1 req-b3f73eb7-c6e9-48b6-a0d3-e788035712b9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.295478 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9d977373-0bef-4303-a022-7e05688bddf1 req-b3f73eb7-c6e9-48b6-a0d3-e788035712b9 service nova] Creating event network-changed:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h1-858383-17 Oct 31 16:03:20.300651 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9d977373-0bef-4303-a022-7e05688bddf1 req-b3f73eb7-c6e9-48b6-a0d3-e788035712b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033627 Oct 31 16:03:20.301596 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3257/6382] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:20.308257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:03:20.411045 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50d961d9-b07f-437c-a8e0-3d39ff7a4dbd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 204 len: 0 microversion: 2.1 time: 0.146237 Oct 31 16:03:20.412163 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3126/6383] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:03:20 2022] DELETE /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:03:20.421452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:20.422425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:20.429628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.430504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.431011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.431810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.432401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.433095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.577416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:20.585279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4f541c1-f0d4-4a79-9609-20dc897b4a16 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1689 microversion: 2.1 time: 0.168665 Oct 31 16:03:20.585863 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3258/6384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:20 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:21.610077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:21.610808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:21.617746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:21.618258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:21.618717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:21.619448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:21.619927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:21.620424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:21.716274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:21.724391 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e4ea349-4e7f-43aa-909e-d585a32b2c06 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 200 len: 1502 microversion: 2.1 time: 0.118778 Oct 31 16:03:21.725012 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3127/6385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:21 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 1502 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:22.316351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5a9274a3-b0a7-48c8-9cb3-10a2fe8dbb33 req-916c632c-f13c-493a-89c1-fb8a2817f0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1394757a-13ab-4679-adb2-50463f805c92", "name": "network-vif-deleted", "tag": "d1a0c54d-148c-4c8b-9d1c-badf2f305348"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:22.327068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5a9274a3-b0a7-48c8-9cb3-10a2fe8dbb33 req-916c632c-f13c-493a-89c1-fb8a2817f0d4 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:22.327539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5a9274a3-b0a7-48c8-9cb3-10a2fe8dbb33 req-916c632c-f13c-493a-89c1-fb8a2817f0d4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:22.327971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5a9274a3-b0a7-48c8-9cb3-10a2fe8dbb33 req-916c632c-f13c-493a-89c1-fb8a2817f0d4 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:22.338887 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5a9274a3-b0a7-48c8-9cb3-10a2fe8dbb33 req-916c632c-f13c-493a-89c1-fb8a2817f0d4 service nova] Creating event network-vif-deleted:d1a0c54d-148c-4c8b-9d1c-badf2f305348 for instance 1394757a-13ab-4679-adb2-50463f805c92 on n-h1-858383-17 Oct 31 16:03:22.343562 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5a9274a3-b0a7-48c8-9cb3-10a2fe8dbb33 req-916c632c-f13c-493a-89c1-fb8a2817f0d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030958 Oct 31 16:03:22.344150 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3259/6386] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:22.748549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:22.749284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: 1394757a-13ab-4679-adb2-50463f805c92] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:22.756161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:22.756659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:22.757140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:22.757847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:22.758322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:22.758772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:22.772096 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] HTTP exception thrown: Instance 1394757a-13ab-4679-adb2-50463f805c92 could not be found. Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Request method failure captured: Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 HTTP/1.1 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_BrAEMsdDgTOS65WgvdA_K_U3aO3wZSHFW2yc9-QoRkT_5VdBKNY6Qd-eWIeDszi1h-SYlx40HBcKrxlPxcB7NZsfdtAJMKANGMg6pjW58_ZGQAtb4E50u5dW1TaY9ZfBsX10OtC9SFv6l9znfhq2UuMbLota6w60dO6FTpp-aAzTk Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a0b4bb114e7c4b06b2643c593868f3a2 Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 1394757a-13ab-4679-adb2-50463f805c92 could not be found. Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '1394757a-13ab-4679-adb2-50463f805c92'} Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1394757a-13ab-4679-adb2-50463f805c92 could not be found. Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1394757a-13ab-4679-adb2-50463f805c92 could not be found. Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.773764 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1394757a-13ab-4679-adb2-50463f805c92 could not be found. Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Returning 404 to user: Instance 1394757a-13ab-4679-adb2-50463f805c92 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ff2acde-38f5-4558-a60d-3f96519f57c7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92" status: 404 len: 111 microversion: 2.1 time: 0.031211 Oct 31 16:03:22.779320 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3128/6387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:22 2022] GET /compute/v2.1/servers/1394757a-13ab-4679-adb2-50463f805c92 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:03:26.600133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22ed0962-aeb6-439c-a199-467f9db739d9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '.version_select at 0x7f5ca1671670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:26.627279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22ed0962-aeb6-439c-a199-467f9db739d9 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-182780570" status: 202 len: 0 microversion: 2.1 time: 0.032268 Oct 31 16:03:26.627907 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3260/6388] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Oct 31 16:03:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-182780570 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:03:26.659308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76487f2a-5dde-41f7-8529-c7bfd929dedd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: .version_select at 0x7f5ca1130700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-254634638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs3h7SFND5bhg5clCVPqvn3ejIr7LJBpdw10gdvHvhXW4Ihn0wRLEassd40te8qpw60UAq13EEhpIDyiJdpDbhVgAdyinNvVnj4L7tPSYnj1/+qcbbgPiCzuDVAxk4wSg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:26.677417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-76487f2a-5dde-41f7-8529-c7bfd929dedd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:03:26.686209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-76487f2a-5dde-41f7-8529-c7bfd929dedd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:03:26.710273 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76487f2a-5dde-41f7-8529-c7bfd929dedd tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054871 Oct 31 16:03:26.710878 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3129/6389] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:03:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:32.363101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:32.368325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1652049058", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "31b8b854-06d0-4863-a728-ecd318594032"}], "key_name": "tempest-TestNetworkAdvancedServerOps-254634638", "security_groups": [{"name": "tempest-secgroup-smoke-214340599"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:32.487925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] validate_networks() for [('31b8b854-06d0-4863-a728-ecd318594032', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:03:32.916207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:03:32.916620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:03:32.917210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:03:32.917618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:03:32.918188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:03:32.930573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:32.931063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:32.931503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:32.932395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:32.933128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:32.933716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:32.957427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:03:32.964573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Getting quotas for user a0b4bb114e7c4b06b2643c593868f3a2 and project 95fa0ce942784bb994b4b056e81fa547. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:03:32.984782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:03:32.987824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:03:33.051612 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2b6bb4a-75c0-47ed-917f-8cf2b7f32975 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.690316 Oct 31 16:03:33.053038 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3261/6390] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:03:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:03:33.063439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:33.070419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2136b4db-e6de-4212-ac75-619e63dd559d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:33.071277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2136b4db-e6de-4212-ac75-619e63dd559d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:33.163324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2136b4db-e6de-4212-ac75-619e63dd559d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:33.178433 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2136b4db-e6de-4212-ac75-619e63dd559d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1266 microversion: 2.1 time: 0.117543 Oct 31 16:03:33.180109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3130/6391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:33 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:34.201726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:34.202406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:34.210669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:34.211615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:34.212356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:34.213418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:34.214208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:34.214787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:34.310077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:34.328625 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdede787-bb44-46fa-90b5-fc31081e61ea tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1318 microversion: 2.1 time: 0.131159 Oct 31 16:03:34.329873 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3262/6392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:34 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:35.355205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:35.356017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:35.359438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:35.370016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:35.370776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:35.371224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:35.372674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:35.373431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:35.374017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:35.635705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:35.645543 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3da9b2b0-8d5c-41cd-bbd7-723c68ecdc98 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.294364 Oct 31 16:03:35.662235 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3131/6393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:35 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:35.936982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a7db81f4-1148-498b-9476-0287dbdd2a02 req-242a5e26-94c9-4a89-8db3-d97c5aa57480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:35.945623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:35.955302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7db81f4-1148-498b-9476-0287dbdd2a02 req-242a5e26-94c9-4a89-8db3-d97c5aa57480 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:35.955790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7db81f4-1148-498b-9476-0287dbdd2a02 req-242a5e26-94c9-4a89-8db3-d97c5aa57480 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:35.956225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7db81f4-1148-498b-9476-0287dbdd2a02 req-242a5e26-94c9-4a89-8db3-d97c5aa57480 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:35.969912 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a7db81f4-1148-498b-9476-0287dbdd2a02 req-242a5e26-94c9-4a89-8db3-d97c5aa57480 service nova] Creating event network-changed:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:03:35.975465 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a7db81f4-1148-498b-9476-0287dbdd2a02 req-242a5e26-94c9-4a89-8db3-d97c5aa57480 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042987 Oct 31 16:03:35.976089 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3263/6394] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:36.669466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:36.670092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:36.677331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:36.677778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:36.678229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:36.678945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:36.679417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:36.679859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:36.813687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:36.821377 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-586f2c86-0fb8-4932-9ba8-165f64ccdc6f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.155882 Oct 31 16:03:36.821943 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3132/6395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:36 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:37.846116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:37.846849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:37.853647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:37.854136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:37.854597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:37.855304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:37.856024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:37.856449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:38.014210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:38.021790 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7436c689-2afc-4ab8-8469-1d724ef5c8b5 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.180486 Oct 31 16:03:38.022361 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3264/6396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:37 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:39.044934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:39.045574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:39.052481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:39.053015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:39.053469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:39.054177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:39.054652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:39.055098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:39.191401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:39.199209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2ed0e146-98e7-462e-a9dc-1ad53a459480 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.158460 Oct 31 16:03:39.199780 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3133/6397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:39 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:40.222912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:40.223468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:40.230504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:40.231373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:40.231705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:40.234134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:40.234618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:40.235059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:40.369018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:40.377233 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b85dde08-adaa-47dc-8e79-54017199055b tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.158368 Oct 31 16:03:40.377815 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3265/6398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:40 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:41.399943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:41.400574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:41.407501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:41.407998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:41.408450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:41.409182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:41.409657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:41.410095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:41.542414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:41.550550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea49dd97-a78a-4ef1-9b9e-ac6014191874 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.154508 Oct 31 16:03:41.551130 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3134/6399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:41 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:42.456098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-80b73365-bea0-4c4f-8cf3-65e91719fa1b req-ba59d1eb-5114-47ae-adfc-fb5589b6b332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "name": "network-vif-plugged", "status": "completed", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:42.465543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-80b73365-bea0-4c4f-8cf3-65e91719fa1b req-ba59d1eb-5114-47ae-adfc-fb5589b6b332 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:42.466747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-80b73365-bea0-4c4f-8cf3-65e91719fa1b req-ba59d1eb-5114-47ae-adfc-fb5589b6b332 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:42.467161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-80b73365-bea0-4c4f-8cf3-65e91719fa1b req-ba59d1eb-5114-47ae-adfc-fb5589b6b332 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:42.478613 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-80b73365-bea0-4c4f-8cf3-65e91719fa1b req-ba59d1eb-5114-47ae-adfc-fb5589b6b332 service nova] Creating event network-vif-plugged:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:03:42.484070 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-80b73365-bea0-4c4f-8cf3-65e91719fa1b req-ba59d1eb-5114-47ae-adfc-fb5589b6b332 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101348 Oct 31 16:03:42.484765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3266/6400] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:42.574034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:42.574582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:42.581608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:42.582108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:42.582563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:42.583279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:42.583750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:42.584191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:42.728994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:42.737650 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2aa3710-c8cf-4840-9519-613c88c0f89a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1391 microversion: 2.1 time: 0.167850 Oct 31 16:03:42.738235 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3135/6401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:42 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:43.758591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:43.759399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:43.766565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:43.768245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:43.775596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:43.776092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:43.776534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:43.777294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:43.777762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:43.778200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:43.922351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:43.930400 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a7d3cbb-169d-4839-9ef2-e928155883ce tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1563 microversion: 2.1 time: 0.172896 Oct 31 16:03:43.930984 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3267/6402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:43 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:43.953746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:43.954370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:43.956236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:43.962953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:43.963454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:43.963906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:43.964611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:43.965113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:43.965552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:44.098930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:44.106950 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f7adc78-b378-4f3a-805e-480069222827 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1563 microversion: 2.1 time: 0.157171 Oct 31 16:03:44.107521 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3136/6403] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:43 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:45.683499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:45.684732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:45.689307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a77cf40c-3a2f-4614-bbd8-67762df5bb0f req-2326dc8d-78a5-44a5-9992-057a2f283e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:45.692280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:45.692903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:45.693550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:45.694469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:45.694996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:45.695641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:45.699581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a77cf40c-3a2f-4614-bbd8-67762df5bb0f req-2326dc8d-78a5-44a5-9992-057a2f283e9c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:45.700275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a77cf40c-3a2f-4614-bbd8-67762df5bb0f req-2326dc8d-78a5-44a5-9992-057a2f283e9c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:45.700926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a77cf40c-3a2f-4614-bbd8-67762df5bb0f req-2326dc8d-78a5-44a5-9992-057a2f283e9c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:45.712562 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a77cf40c-3a2f-4614-bbd8-67762df5bb0f req-2326dc8d-78a5-44a5-9992-057a2f283e9c service nova] Creating event network-changed:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:03:45.718341 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a77cf40c-3a2f-4614-bbd8-67762df5bb0f req-2326dc8d-78a5-44a5-9992-057a2f283e9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Oct 31 16:03:45.719132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3137/6404] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:45.927379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:45.937001 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-68fe7afa-e30d-43bb-9a5d-d6230ca3727a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1563 microversion: 2.1 time: 0.257716 Oct 31 16:03:45.937634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3268/6405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:45 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:01.817956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=13 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:01.818720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=38 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:01.823026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-103467038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1128586012", "security_groups": [{"name": "tempest-secgroup-smoke-285117054"}], "block_device_mapping_v2": [{"uuid": "26dd30ba-b3a5-4941-8fd0-6642ef267bb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e2d2149-aa6d-44dd-84ea-fcda1a759b38"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:01.937317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] validate_networks() for [('2e2d2149-aa6d-44dd-84ea-fcda1a759b38', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:04:02.412368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:04:02.412890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:04:02.413503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:04:02.413935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:04:02.414362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:04:02.423309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:02.423806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:02.424261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:02.425031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:02.425505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:02.425944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:02.443914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:04:02.449271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Getting quotas for user bcb36dbc34ee495e81ca9bca40829e1c and project 26304870055d4a58a7add843ebe0ff63. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:04:02.507088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:04:02.509429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26dd30ba-b3a5-4941-8fd0-6642ef267bb3',volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:04:02.633291 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [225ac707-913e-491c-8ecc-f0309407a598] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:04:03.639698 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [225ac707-913e-491c-8ecc-f0309407a598] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46456. Oct 31 16:04:03.643967 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa1794f3-a280-4998-8425-48136667c804 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.827992 Oct 31 16:04:03.644628 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3138/6406] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:04:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:04:03.655930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ada3e7e5-9a0e-4a4f-addc-685e86d99aa4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:03.656545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ada3e7e5-9a0e-4a4f-addc-685e86d99aa4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:03.660791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=11 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:03.661654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=36 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:03.719955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ada3e7e5-9a0e-4a4f-addc-685e86d99aa4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:03.726968 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ada3e7e5-9a0e-4a4f-addc-685e86d99aa4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1094 microversion: 2.1 time: 0.075091 Oct 31 16:04:03.727545 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3269/6407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:03 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:04.752087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:04.752637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:04.759020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:04.759519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:04.759969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:04.760673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:04.761177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:04.761618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:04.836975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:04.845380 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d3541d8e-a51e-486c-ab7e-4f27bcb06dab tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1200 microversion: 2.1 time: 0.098670 Oct 31 16:04:04.853030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3139/6408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:04 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:05.868850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:05.869517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:05.877354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:05.877841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:05.878272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:05.878969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:05.879426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:05.879852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:06.109855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:06.117710 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-afa7dd47-87f1-4ab4-a557-f61ed510c428 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1277 microversion: 2.1 time: 0.252760 Oct 31 16:04:06.118461 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3270/6409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:05 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:06.307148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5857b4cb-ee42-4cfe-9e48-326b031c29fe req-b839d47c-2cb9-4678-8e96-f1d846a6ef90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff53225-26b7-4ef6-8b76-e6eb08d01ce8", "tag": "76342cf9-9960-4390-8f18-28d9ef6b8b3a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:06.318291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5857b4cb-ee42-4cfe-9e48-326b031c29fe req-b839d47c-2cb9-4678-8e96-f1d846a6ef90 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:06.318608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5857b4cb-ee42-4cfe-9e48-326b031c29fe req-b839d47c-2cb9-4678-8e96-f1d846a6ef90 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:06.319423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5857b4cb-ee42-4cfe-9e48-326b031c29fe req-b839d47c-2cb9-4678-8e96-f1d846a6ef90 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:06.332107 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5857b4cb-ee42-4cfe-9e48-326b031c29fe req-b839d47c-2cb9-4678-8e96-f1d846a6ef90 service nova] Creating event network-changed:76342cf9-9960-4390-8f18-28d9ef6b8b3a for instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 on n-h1-858383-17 Oct 31 16:04:06.337133 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5857b4cb-ee42-4cfe-9e48-326b031c29fe req-b839d47c-2cb9-4678-8e96-f1d846a6ef90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033764 Oct 31 16:04:06.337736 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3140/6410] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:07.143365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:07.144868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:07.151968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:07.152490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:07.153689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:07.154562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:07.155160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:07.156164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:07.390808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:07.400254 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b53604d0-985e-4e38-8167-19594b3ca455 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1277 microversion: 2.1 time: 0.261315 Oct 31 16:04:07.400985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3271/6411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:07 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:08.427543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:08.428222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:08.434599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:08.435143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:08.435560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:08.436266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:08.437329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:08.437777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:08.581091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:08.589249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a22faf96-f6e9-4752-8eb0-c9b882876bb5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1277 microversion: 2.1 time: 0.166922 Oct 31 16:04:08.589786 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3141/6412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:08 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:09.244167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:09.246424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:09.254309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:09.254807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:09.255278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:09.255946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:09.256406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:09.256872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:09.310332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da7b1e04-b6b4-413b-b19d-6f330954b723 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e/action" status: 200 len: 24556 microversion: 2.1 time: 0.070071 Oct 31 16:04:09.311010 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3272/6413] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:04:09 2022] POST /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e/action => generated 24556 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 16:04:09.615793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:09.616419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:09.623432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:09.623925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:09.624392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:09.625131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:09.625600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:09.626036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:09.767814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:09.775941 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2ca9e76e-3747-41c2-bd43-81c5e84cb4f1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1277 microversion: 2.1 time: 0.163942 Oct 31 16:04:09.776524 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3142/6414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:09 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:10.800819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:10.801522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:10.808891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:10.809386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:10.809824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:10.810518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:10.810978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:10.811410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:10.941569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:10.950121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-542aec61-c866-475d-a679-9e8e0c8588bd tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.154172 Oct 31 16:04:10.950695 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3273/6415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:10 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:11.973772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:11.974397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:11.981152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:11.981718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:11.982426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:11.983125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:11.984139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:11.984812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:12.121076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:12.128984 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa8b0af5-15ba-41c6-a1e3-c4e6fd08d4ae tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.159096 Oct 31 16:04:12.129550 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3143/6416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:11 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:13.152316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:13.152950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:13.163815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:13.164303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:13.164764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:13.170304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:13.170304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:13.170304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:13.296091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:13.303843 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61a67a53-0a8a-4997-9e36-0ec9dd1b542f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.155458 Oct 31 16:04:13.304430 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3274/6417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:13 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:14.327706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:14.328257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:14.330259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:14.331039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:14.337577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:14.338084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:14.338536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:14.339242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:14.339718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:14.340163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:14.477918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:14.487118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e972af5b-169f-44fd-b223-f6567d31f445 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.163507 Oct 31 16:04:14.487693 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3144/6418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:14 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:15.510337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:15.510959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:15.513436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:15.519542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.520030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.520492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.521210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.521679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.522101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.654035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:15.662589 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6391c17d-c5ed-4f3d-90ed-9b219911ed4b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.156142 Oct 31 16:04:15.663155 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3275/6419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:15 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:15.723965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:15.726669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:15.734699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.735201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.735649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.736356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.736869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.737305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.817196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:04:15.817634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:04:15.818131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:04:15.818553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:04:15.818986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:04:15.878384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:15.884239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.884822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.885206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.886111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.886384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.886821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.915079 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fe24b78-03ab-4a41-9cf8-ba0394737d15 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e/action" status: 202 len: 1138 microversion: 2.1 time: 0.195073 Oct 31 16:04:15.915735 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3145/6420] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:04:15 2022] POST /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e/action => generated 1138 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 31 16:04:15.935791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:15.936466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:15.942694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.943183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.943623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:15.944316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:15.944814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:15.945248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:16.090703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:16.099074 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5f2b13b-a873-4738-8335-c9a47bf94806 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.167571 Oct 31 16:04:16.099646 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3276/6421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:15 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:16.686373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:16.687628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:16.693686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:16.694177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:16.694624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:16.695318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:16.695784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:16.696220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:16.829728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:16.837511 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d342377b-53ac-4fcd-b10f-df963ac18309 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.155409 Oct 31 16:04:16.838082 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3146/6422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:16 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:17.124003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:17.124861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:17.131497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:17.131994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:17.132443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:17.133178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:17.133640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:17.134071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:17.272304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:17.280213 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b107111c-ce33-4337-b94f-0ebe02ad5d12 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.160991 Oct 31 16:04:17.281428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3277/6423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:17 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:17.861943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:17.862574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:17.869398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:17.869900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:17.870352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:17.871054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:17.871528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:17.871972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:18.005323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:18.012996 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8dd37b10-c0cc-4138-b1d0-e6104189a8a4 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.155927 Oct 31 16:04:18.013574 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3147/6424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:17 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:18.304996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:18.305621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:18.312968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:18.313462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:18.313907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:18.314615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:18.315085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:18.315520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:18.463013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:18.472859 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dfa05832-47ef-4052-b246-6ebd103a575f tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.171830 Oct 31 16:04:18.473440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3278/6425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:18 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:19.036198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:19.036855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:19.043844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:19.044347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:19.044827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:19.045541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:19.046016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:19.047017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:19.185688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:19.193892 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9b58a1f-ae97-4d18-962b-c40b4dc0e957 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.161647 Oct 31 16:04:19.194476 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3148/6426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:19 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:19.501012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:19.501634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:19.508557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:19.509085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:19.509534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:19.510232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:19.510695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:19.511130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:19.642627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:19.650301 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9667dd04-c438-4af4-ad01-5210d9344eb7 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.153396 Oct 31 16:04:19.650871 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3279/6427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:19 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:20.217730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:20.218420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:20.225696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:20.226199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:20.226673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:20.227386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:20.227858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:20.228296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:20.360060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:20.367724 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4747c7fe-68e3-4b64-b236-9c8fc50b3a2d tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.153976 Oct 31 16:04:20.368298 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3149/6428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:20 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:20.673296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:20.673906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:20.680688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:20.681196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:20.681630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:20.682311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:20.682766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:20.683190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:20.820554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:20.828624 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eba254ce-1919-4ea5-bc18-758cb345fd36 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.159243 Oct 31 16:04:20.829240 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3280/6429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:20 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:21.391688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:21.392438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:21.399518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:21.400035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:21.400494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:21.401254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:21.401732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:21.402184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:21.535417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:21.543223 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2abfbb1-393e-4259-a229-7f2248ddc56b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.155774 Oct 31 16:04:21.543804 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3150/6430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:21 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:21.851773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:21.852382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:21.860196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:21.860678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:21.861135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:21.861823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:21.862279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:21.862703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:21.995859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:22.003938 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-393c3e30-e096-427d-8e7d-1661e5c9e357 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.156122 Oct 31 16:04:22.004519 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3281/6431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:21 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:22.566703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:22.567248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:22.574125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:22.574616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:22.575064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:22.575762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:22.576232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:22.576667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:22.708221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:22.716031 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-790d6ee6-4389-4a6f-84a5-36aeb9780f09 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.153357 Oct 31 16:04:22.716602 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3151/6432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:22 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:22.978271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-784c0caf-bbbc-426e-93c1-efdd36455b4d req-8cbdd38f-e7ac-463f-87d8-3f246b1dcd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff53225-26b7-4ef6-8b76-e6eb08d01ce8", "name": "network-vif-plugged", "status": "completed", "tag": "76342cf9-9960-4390-8f18-28d9ef6b8b3a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:22.990460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-784c0caf-bbbc-426e-93c1-efdd36455b4d req-8cbdd38f-e7ac-463f-87d8-3f246b1dcd67 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:22.990951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-784c0caf-bbbc-426e-93c1-efdd36455b4d req-8cbdd38f-e7ac-463f-87d8-3f246b1dcd67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:22.991388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-784c0caf-bbbc-426e-93c1-efdd36455b4d req-8cbdd38f-e7ac-463f-87d8-3f246b1dcd67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.003508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-784c0caf-bbbc-426e-93c1-efdd36455b4d req-8cbdd38f-e7ac-463f-87d8-3f246b1dcd67 service nova] Creating event network-vif-plugged:76342cf9-9960-4390-8f18-28d9ef6b8b3a for instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 on n-h1-858383-17 Oct 31 16:04:23.008580 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-784c0caf-bbbc-426e-93c1-efdd36455b4d req-8cbdd38f-e7ac-463f-87d8-3f246b1dcd67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034090 Oct 31 16:04:23.009191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3282/6433] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:23.027405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:23.028032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:23.034174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:23.034676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:23.035411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.036117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:23.036586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:23.037047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.261266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:23.269516 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f6bc9bdd-afe7-4fd8-aac9-2a9d4f047d8a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.245988 Oct 31 16:04:23.270090 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3152/6434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:23 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:23.740933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:23.741647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:23.747829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:23.748311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:23.748769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.749485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:23.749940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:23.750447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.895608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:23.903300 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2591b47-ec1c-41af-b40b-fa181324ca2a tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1265 microversion: 2.1 time: 0.167110 Oct 31 16:04:23.903871 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3283/6435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:23 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:24.292942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:24.293688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:24.300890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.301387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.301841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:24.302547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.303010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.303445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:24.515025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:24.518679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:24.524443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce6fe235-4161-480b-b7e3-01d6136a0125 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.235436 Oct 31 16:04:24.525058 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3153/6436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:24 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:24.927384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:24.927995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:24.934766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.935250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.935688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:24.936384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.936911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.937379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:25.072826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:25.081334 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b1f625b-3f08-4549-b948-dc8e552232c8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1453 microversion: 2.1 time: 0.157928 Oct 31 16:04:25.081913 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3284/6437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:24 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:25.104725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:25.105417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:25.112404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:25.112944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:25.113382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:25.114091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:25.114561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:25.115001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:25.247365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:25.255987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9a28c30-00a1-45fd-983c-ddcce41e03d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1453 microversion: 2.1 time: 0.155877 Oct 31 16:04:25.256568 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3154/6438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:25 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:25.548031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:25.548654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:25.554861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:25.555353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:25.555794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:25.556497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:25.556988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:25.557420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:25.729949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:25.738814 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f39d1aae-de95-4d8a-897f-a74682f43f4a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.195151 Oct 31 16:04:25.739428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3285/6439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:25 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:26.762076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:26.763737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:26.772443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:26.773175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:26.774263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:26.775065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:26.775612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:26.776140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:26.984435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:26.996952 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-15cea063-032d-4668-89c5-a2ccbc8b138d tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.238739 Oct 31 16:04:26.997558 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3155/6440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:26 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:27.355619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ca3db83d-113e-4b4a-b19d-e2b97cd7ba2d req-27555a10-56b2-4034-bd19-94e740fe38cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff53225-26b7-4ef6-8b76-e6eb08d01ce8", "tag": "76342cf9-9960-4390-8f18-28d9ef6b8b3a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:27.366530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ca3db83d-113e-4b4a-b19d-e2b97cd7ba2d req-27555a10-56b2-4034-bd19-94e740fe38cf service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:27.367008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ca3db83d-113e-4b4a-b19d-e2b97cd7ba2d req-27555a10-56b2-4034-bd19-94e740fe38cf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:27.367432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ca3db83d-113e-4b4a-b19d-e2b97cd7ba2d req-27555a10-56b2-4034-bd19-94e740fe38cf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:27.379225 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ca3db83d-113e-4b4a-b19d-e2b97cd7ba2d req-27555a10-56b2-4034-bd19-94e740fe38cf service nova] Creating event network-changed:76342cf9-9960-4390-8f18-28d9ef6b8b3a for instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 on n-h1-858383-17 Oct 31 16:04:27.384965 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ca3db83d-113e-4b4a-b19d-e2b97cd7ba2d req-27555a10-56b2-4034-bd19-94e740fe38cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033014 Oct 31 16:04:27.385551 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3286/6441] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:28.022568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:28.023204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:28.030371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:28.031407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:28.031914 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:28.032648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:28.033144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:28.033583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:28.169078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:28.177139 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b61af63b-dfa9-4bee-addc-2942176913c8 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1691 microversion: 2.1 time: 0.158484 Oct 31 16:04:28.177731 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3156/6442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:28 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:29.201980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:29.203297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:29.210390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:29.210876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:29.211312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:29.212008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:29.212471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:29.212951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:29.346256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:29.353998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-488b8974-ff50-42c4-89d6-3b76cf9e656e tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1697 microversion: 2.1 time: 0.156250 Oct 31 16:04:29.354567 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3287/6443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:29 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:30.378973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:30.379532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:30.386434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:30.386940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:30.387395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:30.388121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:30.388576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:30.389047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:30.527421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:30.535591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ce7a794-eab1-413f-8e93-5fb2948b7200 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1697 microversion: 2.1 time: 0.161111 Oct 31 16:04:30.536163 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3157/6444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:30 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:31.558882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:31.559408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:31.566577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:31.567073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:31.567518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:31.568219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:31.568683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:31.569136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:31.573286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:31.707937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:31.715751 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44adce2f-911c-43f4-82fc-dae3f3b3ad30 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1682 microversion: 2.1 time: 0.160886 Oct 31 16:04:31.716339 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3288/6445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:31 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:32.738355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-332e0366-66af-4577-a3c9-f1cee9a51238 req-2fe87614-4845-4d26-a36a-f6d4248b03cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "name": "network-vif-unplugged", "status": "completed", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:32.744319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:32.753671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-332e0366-66af-4577-a3c9-f1cee9a51238 req-2fe87614-4845-4d26-a36a-f6d4248b03cb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:32.754164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-332e0366-66af-4577-a3c9-f1cee9a51238 req-2fe87614-4845-4d26-a36a-f6d4248b03cb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:32.754606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-332e0366-66af-4577-a3c9-f1cee9a51238 req-2fe87614-4845-4d26-a36a-f6d4248b03cb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:32.766115 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-332e0366-66af-4577-a3c9-f1cee9a51238 req-2fe87614-4845-4d26-a36a-f6d4248b03cb service nova] Creating event network-vif-unplugged:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:04:32.771645 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-332e0366-66af-4577-a3c9-f1cee9a51238 req-2fe87614-4845-4d26-a36a-f6d4248b03cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038133 Oct 31 16:04:32.772751 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3158/6446] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:34.800743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-931c89fc-21cf-4c8a-8833-e538b56cdb70 req-e28853cd-29c0-4d00-b180-c9e039814efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "name": "network-vif-plugged", "status": "completed", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:34.806466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=43 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:34.812558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-931c89fc-21cf-4c8a-8833-e538b56cdb70 req-e28853cd-29c0-4d00-b180-c9e039814efe service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:34.813438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-931c89fc-21cf-4c8a-8833-e538b56cdb70 req-e28853cd-29c0-4d00-b180-c9e039814efe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:34.813927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-931c89fc-21cf-4c8a-8833-e538b56cdb70 req-e28853cd-29c0-4d00-b180-c9e039814efe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:34.825250 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-931c89fc-21cf-4c8a-8833-e538b56cdb70 req-e28853cd-29c0-4d00-b180-c9e039814efe service nova] Creating event network-vif-plugged:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:04:34.830395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-931c89fc-21cf-4c8a-8833-e538b56cdb70 req-e28853cd-29c0-4d00-b180-c9e039814efe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034509 Oct 31 16:04:34.830988 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3289/6447] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:55.918362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:55.920724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:55.922892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=26 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:55.923532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:55.931180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:55.931731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:55.932361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:55.933093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:55.933563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:55.934000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:55.988663 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c497e0e-50bd-41bd-b590-6b7c8beea1d0 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "POST /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e/action" status: 200 len: 24564 microversion: 2.1 time: 0.075528 Oct 31 16:04:55.989343 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3159/6448] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:04:55 2022] POST /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e/action => generated 24564 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:05:03.208679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:03.209306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:03.210626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-87fc4c8d-f382-4637-a558-9de79e42348e req-df8c4bb5-227b-490e-8cd3-696412904258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:03.213625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:03.214450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:03.221044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:03.221548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:03.222003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:03.222720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:03.223153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-87fc4c8d-f382-4637-a558-9de79e42348e req-df8c4bb5-227b-490e-8cd3-696412904258 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:03.223276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:03.223604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:03.223716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-87fc4c8d-f382-4637-a558-9de79e42348e req-df8c4bb5-227b-490e-8cd3-696412904258 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:03.224079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-87fc4c8d-f382-4637-a558-9de79e42348e req-df8c4bb5-227b-490e-8cd3-696412904258 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:03.240121 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-87fc4c8d-f382-4637-a558-9de79e42348e req-df8c4bb5-227b-490e-8cd3-696412904258 service nova] Creating event network-changed:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:05:03.245558 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-87fc4c8d-f382-4637-a558-9de79e42348e req-df8c4bb5-227b-490e-8cd3-696412904258 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038739 Oct 31 16:05:03.246547 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3160/6449] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:03.253643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:05:03.339019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd017028-58d3-4ad6-bceb-3f3bb3d4f617 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 204 len: 0 microversion: 2.1 time: 0.134212 Oct 31 16:05:03.343536 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3290/6450] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:05:03 2022] DELETE /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:05:03.349556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:03.349927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:03.356979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:03.357477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:03.358117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:03.358829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:03.359302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:03.360002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:03.519315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:03.527436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-507dee80-b60d-4232-ab6f-f61f930dc820 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1688 microversion: 2.1 time: 0.182692 Oct 31 16:05:03.528052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3161/6451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:03 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:05:04.554506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:04.555858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:04.562644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:04.563138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:04.563709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:04.564597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:04.565824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:04.566261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:04.774812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:04.783472 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b0f31f1-ba96-466a-892c-0543e798dc00 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1688 microversion: 2.1 time: 0.234186 Oct 31 16:05:04.784061 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3291/6452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:04 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:05.419565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-074b02dc-d77b-4f84-9ed7-d0ef59a3b21b req-65b862a6-769e-41fa-8761-82bfe5f2accb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad432738-8506-4b60-8a12-30eb0f4d928e", "name": "network-vif-deleted", "tag": "a7871e54-5c92-4b56-929c-d671378c45de"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:05.433112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-074b02dc-d77b-4f84-9ed7-d0ef59a3b21b req-65b862a6-769e-41fa-8761-82bfe5f2accb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:05.433541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-074b02dc-d77b-4f84-9ed7-d0ef59a3b21b req-65b862a6-769e-41fa-8761-82bfe5f2accb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:05.433981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-074b02dc-d77b-4f84-9ed7-d0ef59a3b21b req-65b862a6-769e-41fa-8761-82bfe5f2accb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:05.447212 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-074b02dc-d77b-4f84-9ed7-d0ef59a3b21b req-65b862a6-769e-41fa-8761-82bfe5f2accb service nova] Creating event network-vif-deleted:a7871e54-5c92-4b56-929c-d671378c45de for instance ad432738-8506-4b60-8a12-30eb0f4d928e on n-h2-858383-17 Oct 31 16:05:05.454286 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-074b02dc-d77b-4f84-9ed7-d0ef59a3b21b req-65b862a6-769e-41fa-8761-82bfe5f2accb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038656 Oct 31 16:05:05.454887 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3162/6453] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:05.807611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:05.808455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:05.815181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:05.816172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:05.816762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:05.817772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:05.818308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:05.818812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:05.856080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:05.856572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:05.857048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:05.857578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lazy-loading 'fault' on Instance uuid ad432738-8506-4b60-8a12-30eb0f4d928e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:05:05.901350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0b4bb114e7c4b06b2643c593868f3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fa0ce942784bb994b4b056e81fa547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:05.910133 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7ad9207-e8ff-4070-aabe-bb15f384063a tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 200 len: 1356 microversion: 2.1 time: 0.106519 Oct 31 16:05:05.910976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3292/6454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:05 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:06.935926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:06.936640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] [instance: ad432738-8506-4b60-8a12-30eb0f4d928e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:06.944002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:06.944498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:06.944973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:06.945682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:06.946151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:06.946590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:06.960111 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] HTTP exception thrown: Instance ad432738-8506-4b60-8a12-30eb0f4d928e could not be found. Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Request method failure captured: Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e HTTP/1.1 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_BrAEMsdDgTOS65WgvdA_K_U3aO3wZSHFW2yc9-QoRkT_5VdBKNY6Qd-eWIeDszi1h-SYlx40HBcKrxlPxcB7NZsfdtAJMKANGMg6pjW58_ZGQAtb4E50u5dW1TaY9ZfBsX10OtC9SFv6l9znfhq2UuMbLota6w60dO6FTpp-aAzTk Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/95fa0ce942784bb994b4b056e81fa547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 95fa0ce942784bb994b4b056e81fa547 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1089074515 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a0b4bb114e7c4b06b2643c593868f3a2 Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1089074515-project Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance ad432738-8506-4b60-8a12-30eb0f4d928e could not be found. Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'ad432738-8506-4b60-8a12-30eb0f4d928e'} Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad432738-8506-4b60-8a12-30eb0f4d928e could not be found. Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad432738-8506-4b60-8a12-30eb0f4d928e could not be found. Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:05:06.961739 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad432738-8506-4b60-8a12-30eb0f4d928e could not be found. Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Returning 404 to user: Instance ad432738-8506-4b60-8a12-30eb0f4d928e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5aa01a9b-7248-485f-98c8-296c4b2f51f6 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e" status: 404 len: 111 microversion: 2.1 time: 0.032264 Oct 31 16:05:06.966736 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3163/6455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:06 2022] GET /compute/v2.1/servers/ad432738-8506-4b60-8a12-30eb0f4d928e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:05:10.401139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34f57b67-7bdb-4141-812b-245de302aa59 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] Calling method '.version_select at 0x7f5ca66b60d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:10.425378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34f57b67-7bdb-4141-812b-245de302aa59 tempest-TestNetworkAdvancedServerOps-1089074515 tempest-TestNetworkAdvancedServerOps-1089074515-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254634638" status: 202 len: 0 microversion: 2.1 time: 0.029358 Oct 31 16:05:10.426630 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3293/6456] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Oct 31 16:05:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-254634638 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:05:18.212942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:18.213702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=16 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:18.218523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3aa88426-7f19-41da-b88a-ec7ef9286538 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'create', calling method: .version_select at 0x7f5ca2424160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1553829183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYp+jC9hZbYkMhT7B5LGRx1KOVcW3rBBRrGXtbQ1b2xvBzFcYPdDbECwaa1OsdhsZlN21pL/OFHvZBuJNUj7WSgF7xywUE39DFQ5IcgVWxh3lDd6N1SNNnYM7XVTu+3dw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:18.235721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3aa88426-7f19-41da-b88a-ec7ef9286538 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for project 2ca6848469bd4791b69f249f7173651d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:05:18.240880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-3aa88426-7f19-41da-b88a-ec7ef9286538 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for user 14bb69a4e98643e39e2d49c0e345730b and project 2ca6848469bd4791b69f249f7173651d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:05:18.266490 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3aa88426-7f19-41da-b88a-ec7ef9286538 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055156 Oct 31 16:05:18.267125 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3164/6457] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:05:18 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:19.285156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-565630636", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "30a183eb-853e-4b8c-bf2c-e5393c30e4b4"}], "key_name": "tempest-TestNetworkBasicOps-1553829183", "security_groups": [{"name": "tempest-secgroup-smoke-493772036"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:19.296555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:19.397552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] validate_networks() for [('30a183eb-853e-4b8c-bf2c-e5393c30e4b4', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:05:19.877372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:05:19.877837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:05:19.878435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:05:19.878844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:05:19.879256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:05:19.890535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:19.891377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:19.891819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:19.892549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:19.893220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:19.894644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:19.916345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for project 2ca6848469bd4791b69f249f7173651d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:05:19.922780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for user 14bb69a4e98643e39e2d49c0e345730b and project 2ca6848469bd4791b69f249f7173651d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:05:19.940031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:05:19.942401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:05:20.001247 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33ca83f2-87d5-4eff-ae6e-934e530427df tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719693 Oct 31 16:05:20.002514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3294/6458] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:05:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:05:20.024832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-09fed74e-d503-43e6-9fbf-09aed526a336 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:20.025693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-09fed74e-d503-43e6-9fbf-09aed526a336 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:20.099200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-09fed74e-d503-43e6-9fbf-09aed526a336 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:20.108186 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-09fed74e-d503-43e6-9fbf-09aed526a336 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1248 microversion: 2.1 time: 0.097945 Oct 31 16:05:20.108833 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3165/6459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:20 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:21.139317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:21.141990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:21.153948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:21.154450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:21.155085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:21.155810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:21.156937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:21.157531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:21.230679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:21.239044 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0bc2972d-5a74-47c4-a1df-a4b17960e514 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1308 microversion: 2.1 time: 0.105627 Oct 31 16:05:21.239638 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3295/6460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:21 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:05:22.263363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:22.274290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:22.284554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:22.285204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:22.285654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:22.286375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:22.287683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:22.288151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:22.430603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:22.438695 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73f7848f-1624-4197-88eb-6ee818174d8e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.179981 Oct 31 16:05:22.439692 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3166/6461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:22 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:22.813877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4cb1980f-6809-4f7d-9d25-1800ce2bd417 req-05d4dd54-fa1e-4cd1-871d-60b44b986941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f813e13-1def-4b07-8edf-91acdb2c7e9d", "tag": "6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:22.825189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4cb1980f-6809-4f7d-9d25-1800ce2bd417 req-05d4dd54-fa1e-4cd1-871d-60b44b986941 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:22.825678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4cb1980f-6809-4f7d-9d25-1800ce2bd417 req-05d4dd54-fa1e-4cd1-871d-60b44b986941 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:22.826115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4cb1980f-6809-4f7d-9d25-1800ce2bd417 req-05d4dd54-fa1e-4cd1-871d-60b44b986941 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:22.838452 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4cb1980f-6809-4f7d-9d25-1800ce2bd417 req-05d4dd54-fa1e-4cd1-871d-60b44b986941 service nova] Creating event network-changed:6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6 for instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d on n-h2-858383-17 Oct 31 16:05:22.844129 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4cb1980f-6809-4f7d-9d25-1800ce2bd417 req-05d4dd54-fa1e-4cd1-871d-60b44b986941 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033988 Oct 31 16:05:22.844817 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3296/6462] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:23.461765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:23.462486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:23.469900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:23.470326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:23.470782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:23.471500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:23.472099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:23.472561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:23.671697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:23.679496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bedc7405-a480-411c-b27c-1c9c6a6ebe9e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.221592 Oct 31 16:05:23.680066 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3167/6463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:23 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:24.704662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:24.705333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:24.711600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:24.712087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:24.712528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:24.713253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:24.713718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:24.714149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:24.844957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:24.852622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5ce0165-74ab-4379-8e90-b7533680027c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.153743 Oct 31 16:05:24.853233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3297/6464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:24 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:25.875960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:25.876586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:25.883489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:25.883985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:25.884439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:25.885154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:25.885624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:25.886061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:26.018090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:26.025758 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-449fa7a8-4530-4a9c-b789-b5068309059a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.153860 Oct 31 16:05:26.026328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3168/6465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:25 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:27.048394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:27.049044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:27.056140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:27.056640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:27.057169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:27.057873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:27.058336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:27.058771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:27.192393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:27.201235 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cef37dc5-57ae-4d0a-b111-fd2dbe97eb68 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.156637 Oct 31 16:05:27.201918 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3298/6466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:27 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:28.223444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:28.224074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:28.230979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:28.231691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:28.232164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:28.232893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:28.233367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:28.233807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:28.370776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:28.378860 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-056ddb55-6929-4574-941d-cc79bce1d939 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.159304 Oct 31 16:05:28.379452 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3169/6467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:28 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:28.940621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d994aedc-f983-469f-9aaf-198c9417c172 req-46ffaa0e-f3a8-41f6-bc87-fee1260eea91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f813e13-1def-4b07-8edf-91acdb2c7e9d", "name": "network-vif-plugged", "status": "completed", "tag": "6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:28.951812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d994aedc-f983-469f-9aaf-198c9417c172 req-46ffaa0e-f3a8-41f6-bc87-fee1260eea91 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:28.952322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d994aedc-f983-469f-9aaf-198c9417c172 req-46ffaa0e-f3a8-41f6-bc87-fee1260eea91 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:28.952776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d994aedc-f983-469f-9aaf-198c9417c172 req-46ffaa0e-f3a8-41f6-bc87-fee1260eea91 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:28.963923 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d994aedc-f983-469f-9aaf-198c9417c172 req-46ffaa0e-f3a8-41f6-bc87-fee1260eea91 service nova] Creating event network-vif-plugged:6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6 for instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d on n-h2-858383-17 Oct 31 16:05:28.969511 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d994aedc-f983-469f-9aaf-198c9417c172 req-46ffaa0e-f3a8-41f6-bc87-fee1260eea91 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032603 Oct 31 16:05:28.970116 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3299/6468] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:29.402452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:29.403075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:29.410573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:29.411068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:29.411517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:29.412221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:29.412686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:29.413178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:29.546025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:29.553750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3bc69b19-b7b0-44d6-8f2b-9f5b52a700dc tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1373 microversion: 2.1 time: 0.155212 Oct 31 16:05:29.554322 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3170/6469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:29 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:30.573944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:30.574724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:30.579883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:30.580594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:30.587714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:30.588208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:30.588654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:30.589381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:30.589848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:30.590282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:30.720092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:30.727780 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-edb6f563-96d0-4e13-a803-24ea425b2d7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1544 microversion: 2.1 time: 0.154835 Oct 31 16:05:30.728349 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3300/6470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:30 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1544 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:30.750844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:30.751472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:30.753411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:30.759653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:30.760154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:30.760607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:30.761342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:30.761823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:30.762266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:30.896031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:30.903833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-db8e9c2d-806a-443e-ad7f-3a68f8ff77c6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1544 microversion: 2.1 time: 0.157489 Oct 31 16:05:30.904412 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3171/6471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:30 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:32.471340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-56a22335-6f61-4e8b-ba46-ac1a16b09c38 req-81cc887e-a3d0-4470-807b-40f0f4621811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f813e13-1def-4b07-8edf-91acdb2c7e9d", "tag": "6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:32.483744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56a22335-6f61-4e8b-ba46-ac1a16b09c38 req-81cc887e-a3d0-4470-807b-40f0f4621811 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:32.484585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56a22335-6f61-4e8b-ba46-ac1a16b09c38 req-81cc887e-a3d0-4470-807b-40f0f4621811 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:32.485422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-56a22335-6f61-4e8b-ba46-ac1a16b09c38 req-81cc887e-a3d0-4470-807b-40f0f4621811 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:32.498350 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-56a22335-6f61-4e8b-ba46-ac1a16b09c38 req-81cc887e-a3d0-4470-807b-40f0f4621811 service nova] Creating event network-changed:6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6 for instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d on n-h2-858383-17 Oct 31 16:05:32.505679 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-56a22335-6f61-4e8b-ba46-ac1a16b09c38 req-81cc887e-a3d0-4470-807b-40f0f4621811 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038222 Oct 31 16:05:32.506855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3301/6472] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:53.702284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:53.704598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:53.707558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:53.708380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=36 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:53.714827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:53.715354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:53.715807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:53.716522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:53.717026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:53.717472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:53.767754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-acc15523-3ecc-4bf6-8a19-00c62b95aeef tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d/action" status: 200 len: 24560 microversion: 2.1 time: 0.069292 Oct 31 16:05:53.768387 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3172/6473] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:05:53 2022] POST /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d/action => generated 24560 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:05:56.070502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:56.071395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:56.072728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0c9164ba-cd57-4b88-b62a-d956243d099a req-696e8c86-1c0c-4e70-b6e0-5daacd6e943c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff53225-26b7-4ef6-8b76-e6eb08d01ce8", "tag": "76342cf9-9960-4390-8f18-28d9ef6b8b3a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:56.075094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:56.075919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:56.079783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.080347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.080843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:56.081695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.082158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.082583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:56.086040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c9164ba-cd57-4b88-b62a-d956243d099a req-696e8c86-1c0c-4e70-b6e0-5daacd6e943c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.086685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c9164ba-cd57-4b88-b62a-d956243d099a req-696e8c86-1c0c-4e70-b6e0-5daacd6e943c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.087138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c9164ba-cd57-4b88-b62a-d956243d099a req-696e8c86-1c0c-4e70-b6e0-5daacd6e943c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:56.100443 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0c9164ba-cd57-4b88-b62a-d956243d099a req-696e8c86-1c0c-4e70-b6e0-5daacd6e943c service nova] Creating event network-changed:76342cf9-9960-4390-8f18-28d9ef6b8b3a for instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 on n-h1-858383-17 Oct 31 16:05:56.105612 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0c9164ba-cd57-4b88-b62a-d956243d099a req-696e8c86-1c0c-4e70-b6e0-5daacd6e943c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037274 Oct 31 16:05:56.106802 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3173/6474] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:05:56.119021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:05:56.206328 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45c8edd7-18bc-48ec-aeab-366fcb58e83f tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 204 len: 0 microversion: 2.1 time: 0.139935 Oct 31 16:05:56.207804 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3302/6475] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:05:56 2022] DELETE /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:05:56.217864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:56.218591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:56.225284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.225786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.226241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:56.226962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.227442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.227888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:56.496635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:56.505168 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fa110ff5-a37a-4227-88a6-ca7a3e121174 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1577 microversion: 2.1 time: 0.292789 Oct 31 16:05:56.505740 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3174/6476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:56 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1577 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:57.529749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:57.530455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:57.537522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:57.538014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:57.538457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:57.539170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:57.539630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:57.540086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:57.744991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:57.752722 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-29957a02-7ed8-4d39-a92b-52ef45ab88c6 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1577 microversion: 2.1 time: 0.227296 Oct 31 16:05:57.753296 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3303/6477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:57 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:58.473235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a145caa4-f823-49f3-ac3d-4f9bd6faf8c8 req-d1612a39-932e-47e4-a11d-8c49d66fe106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff53225-26b7-4ef6-8b76-e6eb08d01ce8", "name": "network-vif-deleted", "tag": "76342cf9-9960-4390-8f18-28d9ef6b8b3a"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:58.485019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a145caa4-f823-49f3-ac3d-4f9bd6faf8c8 req-d1612a39-932e-47e4-a11d-8c49d66fe106 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:58.485515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a145caa4-f823-49f3-ac3d-4f9bd6faf8c8 req-d1612a39-932e-47e4-a11d-8c49d66fe106 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:58.485963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a145caa4-f823-49f3-ac3d-4f9bd6faf8c8 req-d1612a39-932e-47e4-a11d-8c49d66fe106 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:58.498254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a145caa4-f823-49f3-ac3d-4f9bd6faf8c8 req-d1612a39-932e-47e4-a11d-8c49d66fe106 service nova] Creating event network-vif-deleted:76342cf9-9960-4390-8f18-28d9ef6b8b3a for instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 on n-h1-858383-17 Oct 31 16:05:58.504470 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a145caa4-f823-49f3-ac3d-4f9bd6faf8c8 req-d1612a39-932e-47e4-a11d-8c49d66fe106 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034451 Oct 31 16:05:58.505115 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3175/6478] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:58.777173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:58.777995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:58.785355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:58.785938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:58.786379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:58.787095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:58.787552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:58.788361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:58.859875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:58.869882 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-665247bf-d06b-4af1-a368-5006bdd58472 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1225 microversion: 2.1 time: 0.096671 Oct 31 16:05:58.870614 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3304/6479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:58 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:59.896381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:59.897130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:59.903450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:59.903952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:59.904407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:59.905143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:59.905621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:59.906063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:59.975590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:59.983467 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7969568-6cb1-4ca3-8b81-fc712e5a63b8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1225 microversion: 2.1 time: 0.092865 Oct 31 16:05:59.984062 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3176/6480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:59 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:01.006689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:01.007305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:01.014290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:01.014776 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:01.015213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:01.015909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:01.016366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:01.016826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:01.078686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:01.086838 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b09e80a3-8fd0-43d0-b0f6-07c813d9406b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1225 microversion: 2.1 time: 0.084091 Oct 31 16:06:01.087428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3305/6481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:01 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:02.111266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:02.112156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:02.119714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:02.120229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:02.120672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:02.121406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:02.121881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:02.122327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:02.186470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:02.195440 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d9f6883-4d61-4754-bb20-d9bd724ce31b tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 200 len: 1225 microversion: 2.1 time: 0.088061 Oct 31 16:06:02.196027 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3177/6482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:02 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:03.219656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:03.220406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:03.227775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:03.228301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:03.228773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:03.229507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:03.230006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:03.230475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:03.244619 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 could not be found. Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 HTTP/1.1 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 could not be found. Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '9ff53225-26b7-4ef6-8b76-e6eb08d01ce8'} Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 could not be found. Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 could not be found. Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:03.246378 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 could not be found. Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb913b30-d24c-4374-bda1-21a41c6c1dd3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8" status: 404 len: 111 microversion: 2.1 time: 0.032163 Oct 31 16:06:03.250782 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3306/6483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:03 2022] GET /compute/v2.1/servers/9ff53225-26b7-4ef6-8b76-e6eb08d01ce8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:08.136081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79b6dc81-e8d2-4185-90d4-eb0cbc3eb415 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'create', calling method: .version_select at 0x7f5ca2424820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1977838749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvxoXFxmSFVA8c2KMM86GUtsV1+24pPCLrg3vNFs5IvrZtId3DEY55dQ9IezZnDMc3cFatkmPGMhPyB4kYSD8ynIpJRnToGFJzTh+msRL46CNKYrJBMmhZKU4adCNrTkw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:08.153136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-79b6dc81-e8d2-4185-90d4-eb0cbc3eb415 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for project 2ca6848469bd4791b69f249f7173651d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:06:08.158440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-79b6dc81-e8d2-4185-90d4-eb0cbc3eb415 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for user 14bb69a4e98643e39e2d49c0e345730b and project 2ca6848469bd4791b69f249f7173651d. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:06:08.184680 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79b6dc81-e8d2-4185-90d4-eb0cbc3eb415 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.052725 Oct 31 16:06:08.185403 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3178/6484] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:06:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:06:09.333318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1797474535", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "f03acd16-865b-49e4-b8ff-b957e07e5adf"}], "key_name": "tempest-TestNetworkBasicOps-1977838749", "security_groups": [{"name": "tempest-secgroup-smoke-1692310860"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:09.445601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] validate_networks() for [('f03acd16-865b-49e4-b8ff-b957e07e5adf', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:06:09.643219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:09.643739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:09.658542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.659062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.659524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.661006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.661604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.662059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.711449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:06:09.832775 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6997d579-df23-4d6f-bc01-fd287e1a80f5 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 204 len: 0 microversion: 2.1 time: 0.192944 Oct 31 16:06:09.836579 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3179/6485] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:09 2022] DELETE /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:06:09.843116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-1b120ec9-7b1d-484d-81a4-233d13f13ab1 req-9910657a-8c2f-4603-9da1-e3219676b363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69992a37-972a-4166-9c78-808b04f2e1e7", "tag": "d482b833-3c55-4c61-9e4c-db9339f99ea6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:09.854073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1b120ec9-7b1d-484d-81a4-233d13f13ab1 req-9910657a-8c2f-4603-9da1-e3219676b363 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.854798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1b120ec9-7b1d-484d-81a4-233d13f13ab1 req-9910657a-8c2f-4603-9da1-e3219676b363 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.855397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-1b120ec9-7b1d-484d-81a4-233d13f13ab1 req-9910657a-8c2f-4603-9da1-e3219676b363 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.868422 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-1b120ec9-7b1d-484d-81a4-233d13f13ab1 req-9910657a-8c2f-4603-9da1-e3219676b363 service nova] Creating event network-changed:d482b833-3c55-4c61-9e4c-db9339f99ea6 for instance 69992a37-972a-4166-9c78-808b04f2e1e7 on n-h1-858383-17 Oct 31 16:06:09.875043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-1b120ec9-7b1d-484d-81a4-233d13f13ab1 req-9910657a-8c2f-4603-9da1-e3219676b363 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Oct 31 16:06:09.875989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3180/6486] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:09.882949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:09.883898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:09.893445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.894884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.895410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.896149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.896625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.897109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.905626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:06:09.906225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:06:09.906862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:06:09.907414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:06:09.907983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:06:09.919058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.919804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.920550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.921501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.922124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.922706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.947292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for project 2ca6848469bd4791b69f249f7173651d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:06:09.955351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for user 14bb69a4e98643e39e2d49c0e345730b and project 2ca6848469bd4791b69f249f7173651d. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:06:09.971443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:06:09.974553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:06:10.040201 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f876165b-8349-452e-a2eb-2c554fd39e69 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711264 Oct 31 16:06:10.041348 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3307/6487] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:06:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:06:10.052595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2a10ba6-12fe-4ace-878f-20ec842f82fe tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:10.055044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2a10ba6-12fe-4ace-878f-20ec842f82fe tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:10.055457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:10.064405 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-be725f8b-83c1-4a9a-b724-eee8b5eec004 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1578 microversion: 2.1 time: 0.186728 Oct 31 16:06:10.067296 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3181/6488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:09 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:10.116532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2a10ba6-12fe-4ace-878f-20ec842f82fe tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:10.123972 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2a10ba6-12fe-4ace-878f-20ec842f82fe tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1249 microversion: 2.1 time: 0.075555 Oct 31 16:06:10.124800 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3308/6489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:10 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:11.093247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:11.094018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:11.102293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.102888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.103424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.104192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.104777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.105223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.148524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ce2cb65-5a12-41cc-b583-6e1c10533dab tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:11.149778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ce2cb65-5a12-41cc-b583-6e1c10533dab tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:11.242184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ce2cb65-5a12-41cc-b583-6e1c10533dab tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:11.249790 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ce2cb65-5a12-41cc-b583-6e1c10533dab tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1249 microversion: 2.1 time: 0.106263 Oct 31 16:06:11.250835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3309/6490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:11 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:06:11.351199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:11.360224 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-75308caa-bd58-4603-b198-61c1049f7d33 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1578 microversion: 2.1 time: 0.271158 Oct 31 16:06:11.360979 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3182/6491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:11 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1578 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:12.148258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-cfafa40f-04c8-44bb-8003-258696dd264a req-640f539c-191d-44f0-914a-e8fc205f14ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69992a37-972a-4166-9c78-808b04f2e1e7", "name": "network-vif-deleted", "tag": "d482b833-3c55-4c61-9e4c-db9339f99ea6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:12.159458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cfafa40f-04c8-44bb-8003-258696dd264a req-640f539c-191d-44f0-914a-e8fc205f14ea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.160179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cfafa40f-04c8-44bb-8003-258696dd264a req-640f539c-191d-44f0-914a-e8fc205f14ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.160643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cfafa40f-04c8-44bb-8003-258696dd264a req-640f539c-191d-44f0-914a-e8fc205f14ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:12.175872 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-cfafa40f-04c8-44bb-8003-258696dd264a req-640f539c-191d-44f0-914a-e8fc205f14ea service nova] Creating event network-vif-deleted:d482b833-3c55-4c61-9e4c-db9339f99ea6 for instance 69992a37-972a-4166-9c78-808b04f2e1e7 on n-h1-858383-17 Oct 31 16:06:12.182836 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-cfafa40f-04c8-44bb-8003-258696dd264a req-640f539c-191d-44f0-914a-e8fc205f14ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038769 Oct 31 16:06:12.183546 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3310/6492] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:12.276095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:12.278152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:12.288472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.289075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.289531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:12.291535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.292219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.292855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:12.385559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:12.387184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:12.388046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:12.395692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.396773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.397370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:12.398387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.398759 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5295737-b9ff-4fb2-ab15-b769a239d00d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1319 microversion: 2.1 time: 0.130109 Oct 31 16:06:12.399359 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3183/6493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:12 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1319 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:12.401748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.402196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:12.563874 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:12.573980 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-448ff3f9-c382-489e-af2a-e606328aff28 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1226 microversion: 2.1 time: 0.191338 Oct 31 16:06:12.574765 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3311/6494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:12 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1226 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:06:13.423104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:13.423730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:13.434232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:13.434772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:13.435459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:13.437058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:13.438049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:13.438783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:13.603718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:13.605110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:13.614996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:13.615750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:13.616571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:13.617604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:13.618217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:13.618798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:13.692380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:13.700546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ec08a4c-131e-4112-bbf8-85a785b5a5f0 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.281654 Oct 31 16:06:13.701487 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3184/6495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:13 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:13.729284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:13.741864 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdd86340-4a96-4dc9-b471-1978e022b53e tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1226 microversion: 2.1 time: 0.142832 Oct 31 16:06:13.742816 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3312/6496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:13 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:14.198232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4484cb67-4b4b-47c9-89a3-0b80e7557e25 req-5960c6fe-5435-43ff-99f1-638dbd46cba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83b9519-b5bf-41c8-9c19-c0a96d2a7951", "tag": "3d863eaa-8091-4dde-a914-842e3dd83e95"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:14.209062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4484cb67-4b4b-47c9-89a3-0b80e7557e25 req-5960c6fe-5435-43ff-99f1-638dbd46cba5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.209704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4484cb67-4b4b-47c9-89a3-0b80e7557e25 req-5960c6fe-5435-43ff-99f1-638dbd46cba5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.210262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4484cb67-4b4b-47c9-89a3-0b80e7557e25 req-5960c6fe-5435-43ff-99f1-638dbd46cba5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.221563 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4484cb67-4b4b-47c9-89a3-0b80e7557e25 req-5960c6fe-5435-43ff-99f1-638dbd46cba5 service nova] Creating event network-changed:3d863eaa-8091-4dde-a914-842e3dd83e95 for instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 on n-h1-858383-17 Oct 31 16:06:14.227936 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4484cb67-4b4b-47c9-89a3-0b80e7557e25 req-5960c6fe-5435-43ff-99f1-638dbd46cba5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033290 Oct 31 16:06:14.228635 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3185/6497] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:14.724200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:14.725017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:14.732301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.732817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.733261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.733970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.734434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.734875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.767567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:14.768671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:14.775779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.776292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.776779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.777511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.777991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.778509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.861582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:14.873131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6a8900e9-a3eb-4d02-86e7-b0911df747f8 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1226 microversion: 2.1 time: 0.110354 Oct 31 16:06:14.874427 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3186/6498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:14 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:06:14.895868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:14.905165 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-993a4aae-83ad-44f0-a6fe-0010e7ce8ea2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.184803 Oct 31 16:06:14.905874 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3313/6499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:14 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:15.898853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:15.899974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:15.907320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:15.907959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:15.908535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:15.909446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:15.910719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:15.911272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:15.928400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:15.929048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:15.936589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:15.937306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:15.937896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:15.938895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:15.939511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:15.940184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:16.000742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:16.012855 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1c9d9b15-5154-4f7d-be57-e019900cf1d2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1226 microversion: 2.1 time: 0.118058 Oct 31 16:06:16.014067 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3187/6500] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:15 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:16.111030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:16.119773 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cff441d3-deee-45f1-bbec-fad9753588bb tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.195920 Oct 31 16:06:16.120854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3314/6501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:15 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:17.037205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:17.037830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:17.045138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.045866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.046471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.047335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.047816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.048258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.084392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.084931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.085385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.085851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lazy-loading 'fault' on Instance uuid 69992a37-972a-4166-9c78-808b04f2e1e7 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:06:17.142477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb36dbc34ee495e81ca9bca40829e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26304870055d4a58a7add843ebe0ff63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:17.143445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:17.144064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:17.150591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2301cc8a-1a3c-4826-a576-25ddecefffa3 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 200 len: 1185 microversion: 2.1 time: 0.117804 Oct 31 16:06:17.151361 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3188/6502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:17 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 1185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:17.151470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.151953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.152399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.153139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.153602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.154029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.373695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:17.381955 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67b2b848-47ef-444c-a446-413855c9c069 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.242771 Oct 31 16:06:17.382528 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3315/6503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:17 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:18.174963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:18.175597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: 69992a37-972a-4166-9c78-808b04f2e1e7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:18.178725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:18.184009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.184510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.184988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.185692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.186164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.186608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.200727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance 69992a37-972a-4166-9c78-808b04f2e1e7 could not be found. Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 HTTP/1.1 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 69992a37-972a-4166-9c78-808b04f2e1e7 could not be found. Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '69992a37-972a-4166-9c78-808b04f2e1e7'} Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69992a37-972a-4166-9c78-808b04f2e1e7 could not be found. Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69992a37-972a-4166-9c78-808b04f2e1e7 could not be found. Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.202405 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69992a37-972a-4166-9c78-808b04f2e1e7 could not be found. Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance 69992a37-972a-4166-9c78-808b04f2e1e7 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d383806-b070-4460-94d8-bc25bd2ea209 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7" status: 404 len: 111 microversion: 2.1 time: 0.032859 Oct 31 16:06:18.206346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3189/6504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:18 2022] GET /compute/v2.1/servers/69992a37-972a-4166-9c78-808b04f2e1e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:18.405075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:18.405718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:18.413059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.413549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.413990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.414694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.415155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.415589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.610599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:18.618713 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6398f9e8-9e03-4b0d-9deb-e4832568a96a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.217806 Oct 31 16:06:18.619288 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3316/6505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:18 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:18.725040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:18.725491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:18.731496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.731999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.732453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.733193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.733667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.734109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.747550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 HTTP/1.1 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a96d8a61-4beb-4908-92e4-e64d23879837'} Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:18.749114 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73670e33-f36b-4bbf-85a3-04598963ffc2 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 404 len: 111 microversion: 2.1 time: 0.030213 Oct 31 16:06:18.752999 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3190/6506] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:18 2022] DELETE /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:18.759758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:18.760402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] [instance: a96d8a61-4beb-4908-92e4-e64d23879837] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:18.766361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.766844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.767277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.767959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.768411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.768862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.785814 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] HTTP exception thrown: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Request method failure captured: Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 HTTP/1.1 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX--4JQ7Aqr_lAxveynjY1LmO2YTEi18NyzbGUt5Bgy7qZs-kqSkzyXmK69CC2Mwy15yTGrztwNuternsMzGUUAI6sntcSW8mW9sdsHKEttypgSczVc7h59FVEZMcKBwKVh23VgoHSHLe45ArYtokn06Z2eMITLBtny8jD1Bf7po9CGg Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26304870055d4a58a7add843ebe0ff63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26304870055d4a58a7add843ebe0ff63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 26304870055d4a58a7add843ebe0ff63 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-2146862419 Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: bcb36dbc34ee495e81ca9bca40829e1c Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-2146862419-project Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a96d8a61-4beb-4908-92e4-e64d23879837'} Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.787529 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Returning 404 to user: Instance a96d8a61-4beb-4908-92e4-e64d23879837 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e5ca55e0-b11d-43dc-957c-36d54a8dc923 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837" status: 404 len: 111 microversion: 2.1 time: 0.032992 Oct 31 16:06:18.791739 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3317/6507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:18 2022] GET /compute/v2.1/servers/a96d8a61-4beb-4908-92e4-e64d23879837 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:06:19.641064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:19.641711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:19.650467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:19.651211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:19.651680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:19.652421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:19.652945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:19.653395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:19.801276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:19.805283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:19.810307 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-68b65862-4186-45b3-804e-5244af5174c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.173388 Oct 31 16:06:19.810899 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3191/6508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:19 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:20.834017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:20.834635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:20.837711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:20.844108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:20.844605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:20.845086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:20.845813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:20.846291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:20.846720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:21.009509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:21.019265 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e24a3fe-593f-48bd-a1e9-3a5189f16411 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.188814 Oct 31 16:06:21.020380 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3318/6509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:20 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:21.650908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-463e67a8-4f98-4823-b45d-663913b5c0a7 req-347338c4-5c51-4026-9e00-6279dca076e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83b9519-b5bf-41c8-9c19-c0a96d2a7951", "name": "network-vif-plugged", "status": "completed", "tag": "3d863eaa-8091-4dde-a914-842e3dd83e95"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:21.667627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-463e67a8-4f98-4823-b45d-663913b5c0a7 req-347338c4-5c51-4026-9e00-6279dca076e6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:21.669742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-463e67a8-4f98-4823-b45d-663913b5c0a7 req-347338c4-5c51-4026-9e00-6279dca076e6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:21.670418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-463e67a8-4f98-4823-b45d-663913b5c0a7 req-347338c4-5c51-4026-9e00-6279dca076e6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:21.684347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-463e67a8-4f98-4823-b45d-663913b5c0a7 req-347338c4-5c51-4026-9e00-6279dca076e6 service nova] Creating event network-vif-plugged:3d863eaa-8091-4dde-a914-842e3dd83e95 for instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 on n-h1-858383-17 Oct 31 16:06:21.690700 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-463e67a8-4f98-4823-b45d-663913b5c0a7 req-347338c4-5c51-4026-9e00-6279dca076e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043896 Oct 31 16:06:21.692918 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3192/6510] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:22.042993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:22.043607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:22.045489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:22.052722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:22.053225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:22.053660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:22.054361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:22.054961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:22.055328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:22.198751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:22.208740 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97be8e8a-7d0a-4b69-b151-149166ae405b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.169657 Oct 31 16:06:22.209328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3319/6511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:22 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:22.235024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c4c94537-1280-481c-904d-7064234e07d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] Calling method '.version_select at 0x7f5ca107fe50>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:22.261845 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c4c94537-1280-481c-904d-7064234e07d1 tempest-TestVolumeBootPattern-2146862419 tempest-TestVolumeBootPattern-2146862419-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1128586012" status: 202 len: 0 microversion: 2.1 time: 0.031245 Oct 31 16:06:22.262805 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3193/6512] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Oct 31 16:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1128586012 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:06:23.231911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:23.232463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:23.240210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:23.240628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:23.241134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:23.242050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:23.242481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:23.242938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:23.482446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:23.490816 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c4fa123f-a8d6-4359-b21a-d5017a79448e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1375 microversion: 2.1 time: 0.263020 Oct 31 16:06:23.491485 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3320/6513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:23 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:06:24.514796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:24.516317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:24.521839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:24.526688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:24.527216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:24.527676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:24.528381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:24.528875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:24.529369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:24.748827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:24.758343 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f81837d-95c0-4560-a53d-8e897b40d76d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1548 microversion: 2.1 time: 0.247957 Oct 31 16:06:24.758939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3194/6514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:24 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:24.781381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:24.782031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:24.789293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:24.789791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:24.790236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:24.790950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:24.791416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:24.791848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:24.812353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:24.933056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:24.941269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0d35d2e-c87c-4cbc-95bf-19dc4fcf2bc2 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1548 microversion: 2.1 time: 0.163734 Oct 31 16:06:24.942634 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3321/6515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:24 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:59.981311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:59.982416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:59.985989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:59.986869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=8 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:59.992415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:59.993000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:59.993451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:59.994168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:59.994638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:59.995073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:00.026315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:07:00.113199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da731bf2-badd-4d6c-a752-e1ff23d5a723 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 204 len: 0 microversion: 2.1 time: 0.135580 Oct 31 16:07:00.116821 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3195/6516] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:59 2022] DELETE /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:07:00.123266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:00.123958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:00.126580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:00.127274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:00.135345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:00.135847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:00.136289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:00.137045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:00.137805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:00.138242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:00.299408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:00.307528 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0bdf999a-e120-4d23-8177-7ef29acd00cf tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1554 microversion: 2.1 time: 0.188823 Oct 31 16:07:00.308448 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3322/6517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:00 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:07:01.331242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:01.331872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:01.339090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:01.339593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:01.340051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:01.340789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:01.341270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:01.341716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:01.479716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:01.491592 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9b45aef-77dc-4099-bed7-ba509ee759a5 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1554 microversion: 2.1 time: 0.164637 Oct 31 16:07:01.492320 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3196/6518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:01 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:02.306326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-cdcbfc55-4244-42a3-9d13-35e09205b705 req-74cdaaec-4e17-4390-bd20-1145c69efff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83b9519-b5bf-41c8-9c19-c0a96d2a7951", "name": "network-vif-deleted", "tag": "3d863eaa-8091-4dde-a914-842e3dd83e95"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:02.315959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cdcbfc55-4244-42a3-9d13-35e09205b705 req-74cdaaec-4e17-4390-bd20-1145c69efff7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:02.316443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cdcbfc55-4244-42a3-9d13-35e09205b705 req-74cdaaec-4e17-4390-bd20-1145c69efff7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:02.317484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-cdcbfc55-4244-42a3-9d13-35e09205b705 req-74cdaaec-4e17-4390-bd20-1145c69efff7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:02.329375 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-cdcbfc55-4244-42a3-9d13-35e09205b705 req-74cdaaec-4e17-4390-bd20-1145c69efff7 service nova] Creating event network-vif-deleted:3d863eaa-8091-4dde-a914-842e3dd83e95 for instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 on n-h1-858383-17 Oct 31 16:07:02.334833 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-cdcbfc55-4244-42a3-9d13-35e09205b705 req-74cdaaec-4e17-4390-bd20-1145c69efff7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164128 Oct 31 16:07:02.335887 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3323/6519] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:07:02.515085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:02.515708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:02.523651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:02.524149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:02.524596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:02.525347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:02.525813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:02.526259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:02.559603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:02.560103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:02.560555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:02.561171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lazy-loading 'fault' on Instance uuid f83b9519-b5bf-41c8-9c19-c0a96d2a7951 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:07:02.605972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:02.615635 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-52b4077d-2af2-404f-b1ee-2843e8c430b6 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 200 len: 1339 microversion: 2.1 time: 0.104290 Oct 31 16:07:02.616339 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3197/6520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:02 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:03.641808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:03.642514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: f83b9519-b5bf-41c8-9c19-c0a96d2a7951] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:03.649319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:03.649809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:03.650251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:03.650946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:03.651409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:03.651840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:03.665670 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] HTTP exception thrown: Instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 could not be found. Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Request method failure captured: Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 HTTP/1.1 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_I4z90OoqvEYdQktz71bB-OXxA_dl_V9LwiQatc8yNJjPFp_QqdMTioWlgVhabNXal8wEgO6YBujtR971hp5hUXldyIOHROvIwuxdUtJXJc7XrFl2OTOWce74sLOHPR2rNY1qu8EtRfM1zY5hho08Nx8ygIUKDU8F2jtxwg5uQEO7A Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 2ca6848469bd4791b69f249f7173651d Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ca6848469bd4791b69f249f7173651d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 2ca6848469bd4791b69f249f7173651d Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkBasicOps-1853387066-project Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 14bb69a4e98643e39e2d49c0e345730b Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkBasicOps-1853387066-project Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 could not be found. Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f83b9519-b5bf-41c8-9c19-c0a96d2a7951'} Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 could not be found. Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 could not be found. Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:07:03.667296 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 could not be found. Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Returning 404 to user: Instance f83b9519-b5bf-41c8-9c19-c0a96d2a7951 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58fc56ac-3029-484a-8bbc-d734189d70ff tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951" status: 404 len: 111 microversion: 2.1 time: 0.032062 Oct 31 16:07:03.671794 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3324/6521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:03 2022] GET /compute/v2.1/servers/f83b9519-b5bf-41c8-9c19-c0a96d2a7951 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:07:03.830213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98cd90d5-9480-4f02-942d-38e40554062b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '.version_select at 0x7f5ca101c430>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:03.851025 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98cd90d5-9480-4f02-942d-38e40554062b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1977838749" status: 202 len: 0 microversion: 2.1 time: 0.024534 Oct 31 16:07:03.854837 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3198/6522] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 16:07:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1977838749 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:07:05.865555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:05.866184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:05.879762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:05.880642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:05.881210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:05.882030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:05.882618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:05.883276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:05.914094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:07:05.941843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2a9f5acd-55e8-4bda-ba15-a2c8a8bc3d15 req-b7ec7d7a-9abb-4455-8f01-73e02842d3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f813e13-1def-4b07-8edf-91acdb2c7e9d", "tag": "6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:05.952318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a9f5acd-55e8-4bda-ba15-a2c8a8bc3d15 req-b7ec7d7a-9abb-4455-8f01-73e02842d3a6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:05.953428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a9f5acd-55e8-4bda-ba15-a2c8a8bc3d15 req-b7ec7d7a-9abb-4455-8f01-73e02842d3a6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:05.953920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a9f5acd-55e8-4bda-ba15-a2c8a8bc3d15 req-b7ec7d7a-9abb-4455-8f01-73e02842d3a6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:05.966933 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2a9f5acd-55e8-4bda-ba15-a2c8a8bc3d15 req-b7ec7d7a-9abb-4455-8f01-73e02842d3a6 service nova] Creating event network-changed:6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6 for instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d on n-h2-858383-17 Oct 31 16:07:05.972464 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2a9f5acd-55e8-4bda-ba15-a2c8a8bc3d15 req-b7ec7d7a-9abb-4455-8f01-73e02842d3a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108571 Oct 31 16:07:05.974110 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3199/6523] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:07:06.002425 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a07fb415-3166-4782-84db-ad6d32dd08ad tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 204 len: 0 microversion: 2.1 time: 0.141508 Oct 31 16:07:06.003801 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3325/6524] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:07:05 2022] DELETE /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:07:06.013486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:06.014386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:06.021015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:06.021525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:06.021981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:06.022892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:06.023375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:06.023823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:06.161208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:06.171208 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d76a4bc3-0d7b-490a-9ecf-518c5206e040 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1668 microversion: 2.1 time: 0.162391 Oct 31 16:07:06.171793 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3200/6525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:06 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:07.195419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:07.196125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:07.202615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.203105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.203544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.204238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.204719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.205152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.368294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:07.377551 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb70750d-cb59-48d1-8857-2d5d41f459be tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 200 len: 1668 microversion: 2.1 time: 0.186695 Oct 31 16:07:07.378132 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3326/6526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:07 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:07.790118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-dda80d10-209f-4806-b1f2-af9eb5845f52 req-5af5c70d-9601-4859-91aa-4d41679fa391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f813e13-1def-4b07-8edf-91acdb2c7e9d", "name": "network-vif-deleted", "tag": "6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:07.800684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dda80d10-209f-4806-b1f2-af9eb5845f52 req-5af5c70d-9601-4859-91aa-4d41679fa391 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.801288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dda80d10-209f-4806-b1f2-af9eb5845f52 req-5af5c70d-9601-4859-91aa-4d41679fa391 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.801932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-dda80d10-209f-4806-b1f2-af9eb5845f52 req-5af5c70d-9601-4859-91aa-4d41679fa391 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.813958 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-dda80d10-209f-4806-b1f2-af9eb5845f52 req-5af5c70d-9601-4859-91aa-4d41679fa391 service nova] Creating event network-vif-deleted:6f1b9e5d-6269-4ac0-aa7a-634c0dd553f6 for instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d on n-h2-858383-17 Oct 31 16:07:07.819276 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-dda80d10-209f-4806-b1f2-af9eb5845f52 req-5af5c70d-9601-4859-91aa-4d41679fa391 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Oct 31 16:07:07.819930 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3201/6527] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:07:08.402226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:08.402844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9f813e13-1def-4b07-8edf-91acdb2c7e9d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:08.409747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:08.410237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:08.410679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:08.411380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:08.411848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:08.412280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:08.425651 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] HTTP exception thrown: Instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d could not be found. Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Request method failure captured: Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d HTTP/1.1 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_I4z90OoqvEYdQktz71bB-OXxA_dl_V9LwiQatc8yNJjPFp_QqdMTioWlgVhabNXal8wEgO6YBujtR971hp5hUXldyIOHROvIwuxdUtJXJc7XrFl2OTOWce74sLOHPR2rNY1qu8EtRfM1zY5hho08Nx8ygIUKDU8F2jtxwg5uQEO7A Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 2ca6848469bd4791b69f249f7173651d Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ca6848469bd4791b69f249f7173651d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 2ca6848469bd4791b69f249f7173651d Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkBasicOps-1853387066-project Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 14bb69a4e98643e39e2d49c0e345730b Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkBasicOps-1853387066-project Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d could not be found. Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '9f813e13-1def-4b07-8edf-91acdb2c7e9d'} Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d could not be found. Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d could not be found. Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:07:08.427295 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d could not be found. Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Returning 404 to user: Instance 9f813e13-1def-4b07-8edf-91acdb2c7e9d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b0c31ba-9d55-4744-8103-6b2caf0f112e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d" status: 404 len: 111 microversion: 2.1 time: 0.030370 Oct 31 16:07:08.431968 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3327/6528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:08 2022] GET /compute/v2.1/servers/9f813e13-1def-4b07-8edf-91acdb2c7e9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:07:08.589773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-23dc9968-2913-4dcf-bd94-461114c8ca19 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '.version_select at 0x7f5ca1dbca60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:08.610442 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-23dc9968-2913-4dcf-bd94-461114c8ca19 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1553829183" status: 202 len: 0 microversion: 2.1 time: 0.024758 Oct 31 16:07:08.614981 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3202/6529] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 16:07:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1553829183 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:07:16.981371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbce8a98-454a-4b56-8b0d-7784a216dc3d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'create', calling method: .version_select at 0x7f5ca136caf0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-691555434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrD1NLJZYiddHcR5GaAO8EDN9M9S+iGfAlx37Hd+4VNETuMEQByqlmlGSPX8HJSanMS92onztpNy+uVFFQQFJkvRdUDEWyOxzUOpM/kbuek80nSoj823MeZmfHw1aUN9w=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:17.008419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fbce8a98-454a-4b56-8b0d-7784a216dc3d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for project 2ca6848469bd4791b69f249f7173651d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:07:17.018722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-fbce8a98-454a-4b56-8b0d-7784a216dc3d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for user 14bb69a4e98643e39e2d49c0e345730b and project 2ca6848469bd4791b69f249f7173651d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:07:17.048190 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fbce8a98-454a-4b56-8b0d-7784a216dc3d tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.072527 Oct 31 16:07:17.048827 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3328/6530] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:07:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:07:18.202722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-123661882", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "5ecabcf0-da72-4e91-9f2a-14c0f51915af"}], "key_name": "tempest-TestNetworkBasicOps-691555434", "security_groups": [{"name": "tempest-secgroup-smoke-1479149149"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:18.224283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:18.315558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] validate_networks() for [('5ecabcf0-da72-4e91-9f2a-14c0f51915af', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:07:18.766662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:07:18.767128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:07:18.767620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:07:18.768048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:07:18.768508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:07:18.778822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:18.779327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:18.779786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:18.780523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:18.781020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:18.781483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:18.799277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for project 2ca6848469bd4791b69f249f7173651d. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:07:18.805234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Getting quotas for user 14bb69a4e98643e39e2d49c0e345730b and project 2ca6848469bd4791b69f249f7173651d. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:07:18.819460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:07:18.821990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:07:18.873859 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e532b900-ee1d-4c21-bcae-76642f0f4e7f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675236 Oct 31 16:07:18.875122 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3203/6531] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:07:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:07:18.886648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0368cd8f-4fa2-4336-bd81-729b7ea0b565 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:18.887271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0368cd8f-4fa2-4336-bd81-729b7ea0b565 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:18.889947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:18.966573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0368cd8f-4fa2-4336-bd81-729b7ea0b565 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:18.974277 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0368cd8f-4fa2-4336-bd81-729b7ea0b565 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1247 microversion: 2.1 time: 0.091532 Oct 31 16:07:18.975101 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3329/6532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:18 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:19.998797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:19.999342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:20.007715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:20.008225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:20.008786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:20.009507 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:20.009983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:20.010427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:20.083149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:20.091368 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-195de487-b19f-4b30-906a-455173386f71 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1307 microversion: 2.1 time: 0.096670 Oct 31 16:07:20.091955 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3204/6533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:19 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:21.117673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:21.118307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:21.125791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:21.126471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:21.127094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:21.127814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:21.128433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:21.129069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:21.340565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:21.350863 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab9d7193-4f19-476a-94c4-6519fcb45fe3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.238397 Oct 31 16:07:21.351744 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3330/6534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:21 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:21.974521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b6de2edd-0db0-4da1-ba39-b22e8017ae60 req-557143c4-66bf-48ce-9863-0a4d9cd7a8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac077e6-66d9-4dca-914b-994b48d6ddde", "tag": "1c980dc9-694a-4c87-8dd7-70f0ce82543e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:21.986971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b6de2edd-0db0-4da1-ba39-b22e8017ae60 req-557143c4-66bf-48ce-9863-0a4d9cd7a8e8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:21.987466 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b6de2edd-0db0-4da1-ba39-b22e8017ae60 req-557143c4-66bf-48ce-9863-0a4d9cd7a8e8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:21.988164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b6de2edd-0db0-4da1-ba39-b22e8017ae60 req-557143c4-66bf-48ce-9863-0a4d9cd7a8e8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:22.004723 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b6de2edd-0db0-4da1-ba39-b22e8017ae60 req-557143c4-66bf-48ce-9863-0a4d9cd7a8e8 service nova] Creating event network-changed:1c980dc9-694a-4c87-8dd7-70f0ce82543e for instance 9ac077e6-66d9-4dca-914b-994b48d6ddde on n-h1-858383-17 Oct 31 16:07:22.012726 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b6de2edd-0db0-4da1-ba39-b22e8017ae60 req-557143c4-66bf-48ce-9863-0a4d9cd7a8e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043341 Oct 31 16:07:22.013534 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3205/6535] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:07:22.377708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:22.379155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:22.387396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:22.388110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:22.388547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:22.389470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:22.390148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:22.390794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:22.529736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:22.538502 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8e2ccdf-6c54-4f40-a57f-586d8027824e tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.165121 Oct 31 16:07:22.539091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3331/6536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:22 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:23.562912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:23.563684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:23.570992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:23.571495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:23.571951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:23.572662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:23.573168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:23.573615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:23.710796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:23.718390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-da147329-b81e-43b4-bfd4-078dc882af47 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.160195 Oct 31 16:07:23.718961 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3206/6537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:23 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:24.741400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:24.741950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:24.749046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:24.749545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:24.749994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:24.750709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:24.751168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:24.751604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:24.955266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:24.963514 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdefa4ab-3881-471e-837a-22247e8599a7 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.227132 Oct 31 16:07:24.964112 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3332/6538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:24 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:25.987578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:25.987578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:25.995653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:25.996164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:25.996622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:25.997388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:25.998047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:25.998497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:26.131153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:26.138903 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5d554f4f-c125-4b1a-8900-1ab6d2262164 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.156016 Oct 31 16:07:26.139477 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3207/6539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:25 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:27.161532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:27.162183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:27.169298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:27.169793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:27.170255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:27.170941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:27.171406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:27.171834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:27.309377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:27.317219 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c60d73de-f253-4fea-829e-1a27fd4d22c4 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.159605 Oct 31 16:07:27.317901 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3333/6540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:27 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:28.058737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-689cdf16-bcab-45c5-ad6d-7d3019eb1fd9 req-3a9b6751-7c4e-497c-9697-566297cf2dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac077e6-66d9-4dca-914b-994b48d6ddde", "name": "network-vif-plugged", "status": "completed", "tag": "1c980dc9-694a-4c87-8dd7-70f0ce82543e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:28.069842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-689cdf16-bcab-45c5-ad6d-7d3019eb1fd9 req-3a9b6751-7c4e-497c-9697-566297cf2dd0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:28.070337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-689cdf16-bcab-45c5-ad6d-7d3019eb1fd9 req-3a9b6751-7c4e-497c-9697-566297cf2dd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:28.070781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-689cdf16-bcab-45c5-ad6d-7d3019eb1fd9 req-3a9b6751-7c4e-497c-9697-566297cf2dd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:28.081816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-689cdf16-bcab-45c5-ad6d-7d3019eb1fd9 req-3a9b6751-7c4e-497c-9697-566297cf2dd0 service nova] Creating event network-vif-plugged:1c980dc9-694a-4c87-8dd7-70f0ce82543e for instance 9ac077e6-66d9-4dca-914b-994b48d6ddde on n-h1-858383-17 Oct 31 16:07:28.087498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-689cdf16-bcab-45c5-ad6d-7d3019eb1fd9 req-3a9b6751-7c4e-497c-9697-566297cf2dd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032552 Oct 31 16:07:28.088369 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3208/6541] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:07:28.339550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:28.340174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:28.347069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:28.347561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:28.348007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:28.348824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:28.349296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:28.349726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:28.479160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:28.486900 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-377e3781-26f1-43a5-8027-456a9ed09d0a tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.151301 Oct 31 16:07:28.487481 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3334/6542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:28 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:29.508290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:29.509118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:29.513984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:29.514704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:29.521817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:29.522316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:29.522768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:29.523471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:29.523946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:29.524386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:29.669765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:29.677988 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6b88363-83df-4bbd-831c-5fd8e6267a05 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1373 microversion: 2.1 time: 0.170478 Oct 31 16:07:29.678586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3209/6543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:29 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:30.702491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:30.703108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:30.705010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:30.706487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:30.713395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:30.713884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:30.714325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:30.715018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:30.715479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:30.715908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:30.844766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:30.853013 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50ee04ed-1380-4662-a2a8-e8962335789f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1545 microversion: 2.1 time: 0.154551 Oct 31 16:07:30.853585 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3335/6544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:30 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:30.875781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:30.876414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:30.879188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:30.885485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:30.886040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:30.886543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:30.887262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:30.887758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:30.888230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:31.028444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:31.037959 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3046730e-18af-453c-ab80-d39a2ff8d700 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1545 microversion: 2.1 time: 0.165977 Oct 31 16:07:31.038587 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3210/6545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:30 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1545 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:33.047343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-21c83e06-4fde-4123-b668-d0bb469e1c5a req-7ad4c199-4eee-4819-8ea7-b3214f9d8e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac077e6-66d9-4dca-914b-994b48d6ddde", "tag": "1c980dc9-694a-4c87-8dd7-70f0ce82543e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:33.057773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-21c83e06-4fde-4123-b668-d0bb469e1c5a req-7ad4c199-4eee-4819-8ea7-b3214f9d8e59 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:33.058396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-21c83e06-4fde-4123-b668-d0bb469e1c5a req-7ad4c199-4eee-4819-8ea7-b3214f9d8e59 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:33.058832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-21c83e06-4fde-4123-b668-d0bb469e1c5a req-7ad4c199-4eee-4819-8ea7-b3214f9d8e59 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:33.070860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-21c83e06-4fde-4123-b668-d0bb469e1c5a req-7ad4c199-4eee-4819-8ea7-b3214f9d8e59 service nova] Creating event network-changed:1c980dc9-694a-4c87-8dd7-70f0ce82543e for instance 9ac077e6-66d9-4dca-914b-994b48d6ddde on n-h1-858383-17 Oct 31 16:07:33.076056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-21c83e06-4fde-4123-b668-d0bb469e1c5a req-7ad4c199-4eee-4819-8ea7-b3214f9d8e59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 Oct 31 16:07:33.076658 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3336/6546] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:08:04.318738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:04.321150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:04.323602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:04.324450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=36 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:04.330004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:04.330509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:04.330982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:04.331676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:04.332153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:04.332598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:04.400331 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f5e9c7da-f40d-43f8-9c30-aaa6b470648b tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde/action" status: 200 len: 24563 microversion: 2.1 time: 0.085380 Oct 31 16:08:04.401041 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3211/6547] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:08:04 2022] POST /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde/action => generated 24563 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:08:34.891694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:34.892424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=38 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:34.897002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:34.899961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:34.906960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:34.907455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:34.907994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:34.908906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:34.909380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:34.909816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:34.977528 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dc7dfe3d-3277-4488-9718-0af3eb567dfd tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "POST /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde/action" status: 200 len: 32632 microversion: 2.1 time: 0.087685 Oct 31 16:08:34.978191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3337/6548] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:08:34 2022] POST /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde/action => generated 32632 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:08:36.286033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:36.286639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:36.294362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a7679930-5383-4690-8d52-e12e9d586ce5 req-eac61a5a-8398-4b20-b42d-b9f8be058651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac077e6-66d9-4dca-914b-994b48d6ddde", "tag": "1c980dc9-694a-4c87-8dd7-70f0ce82543e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:36.299857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:36.300945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:36.307184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:36.307692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:36.307810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7679930-5383-4690-8d52-e12e9d586ce5 req-eac61a5a-8398-4b20-b42d-b9f8be058651 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:36.308148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:36.308263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7679930-5383-4690-8d52-e12e9d586ce5 req-eac61a5a-8398-4b20-b42d-b9f8be058651 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:36.308599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a7679930-5383-4690-8d52-e12e9d586ce5 req-eac61a5a-8398-4b20-b42d-b9f8be058651 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:36.308905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:36.309421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:36.309859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:36.320097 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a7679930-5383-4690-8d52-e12e9d586ce5 req-eac61a5a-8398-4b20-b42d-b9f8be058651 service nova] Creating event network-changed:1c980dc9-694a-4c87-8dd7-70f0ce82543e for instance 9ac077e6-66d9-4dca-914b-994b48d6ddde on n-h1-858383-17 Oct 31 16:08:36.325957 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a7679930-5383-4690-8d52-e12e9d586ce5 req-eac61a5a-8398-4b20-b42d-b9f8be058651 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035507 Oct 31 16:08:36.326889 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3338/6549] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:08:36.339261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:08:36.420179 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6791ee1c-40c4-43aa-9594-a17bdcadb94f tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 204 len: 0 microversion: 2.1 time: 0.138328 Oct 31 16:08:36.421088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3212/6550] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:08:36 2022] DELETE /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:08:36.430870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:36.431991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:36.438259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:36.438966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:36.439415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:36.440115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:36.440771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:36.441380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:36.584417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:08:36.592798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9189c502-b04b-4726-905d-4cd66b7738f3 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1670 microversion: 2.1 time: 0.167285 Oct 31 16:08:36.593330 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3339/6551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:36 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:08:37.619327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:37.620054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:37.627798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:37.628303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:37.628782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:37.629500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:37.629980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:37.630432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:37.843903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:08:37.852998 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c0a5180-adb3-4404-8f08-5ab537192c26 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1670 microversion: 2.1 time: 0.239100 Oct 31 16:08:37.853593 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3213/6552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:37 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1670 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:08:38.702653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fe19eec2-8cf3-4667-8a93-a9d73d6a566f req-0d6088bd-dca9-4ced-b573-985b2421cedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac077e6-66d9-4dca-914b-994b48d6ddde", "name": "network-vif-deleted", "tag": "1c980dc9-694a-4c87-8dd7-70f0ce82543e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:38.713896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fe19eec2-8cf3-4667-8a93-a9d73d6a566f req-0d6088bd-dca9-4ced-b573-985b2421cedb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:38.714301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fe19eec2-8cf3-4667-8a93-a9d73d6a566f req-0d6088bd-dca9-4ced-b573-985b2421cedb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:38.714729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fe19eec2-8cf3-4667-8a93-a9d73d6a566f req-0d6088bd-dca9-4ced-b573-985b2421cedb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:38.726864 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fe19eec2-8cf3-4667-8a93-a9d73d6a566f req-0d6088bd-dca9-4ced-b573-985b2421cedb service nova] Creating event network-vif-deleted:1c980dc9-694a-4c87-8dd7-70f0ce82543e for instance 9ac077e6-66d9-4dca-914b-994b48d6ddde on n-h1-858383-17 Oct 31 16:08:38.732886 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fe19eec2-8cf3-4667-8a93-a9d73d6a566f req-0d6088bd-dca9-4ced-b573-985b2421cedb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033853 Oct 31 16:08:38.733492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3340/6553] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:08:38.876929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:38.877571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:38.885041 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:38.885551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:38.886010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:38.886733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:38.887219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:38.887664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:38.920044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:38.920550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:38.921037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:38.921503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lazy-loading 'fault' on Instance uuid 9ac077e6-66d9-4dca-914b-994b48d6ddde {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:08:38.962490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bb69a4e98643e39e2d49c0e345730b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca6848469bd4791b69f249f7173651d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:08:38.970451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d6fa05d-55a1-4e78-929b-6f772b4209c8 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 200 len: 1337 microversion: 2.1 time: 0.097465 Oct 31 16:08:38.971130 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3214/6554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:38 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:08:39.995892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:39.996600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] [instance: 9ac077e6-66d9-4dca-914b-994b48d6ddde] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:40.002793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:40.003281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:40.003723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:40.004416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:40.004938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:40.005372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:40.019186 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] HTTP exception thrown: Instance 9ac077e6-66d9-4dca-914b-994b48d6ddde could not be found. Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Request method failure captured: Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde HTTP/1.1 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_I4z90OoqvEYdQktz71bB-OXxA_dl_V9LwiQatc8yNJjPFp_QqdMTioWlgVhabNXal8wEgO6YBujtR971hp5hUXldyIOHROvIwuxdUtJXJc7XrFl2OTOWce74sLOHPR2rNY1qu8EtRfM1zY5hho08Nx8ygIUKDU8F2jtxwg5uQEO7A Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 2ca6848469bd4791b69f249f7173651d Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ca6848469bd4791b69f249f7173651d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ca6848469bd4791b69f249f7173651d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 2ca6848469bd4791b69f249f7173651d Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkBasicOps-1853387066 Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkBasicOps-1853387066-project Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 14bb69a4e98643e39e2d49c0e345730b Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkBasicOps-1853387066-project Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 9ac077e6-66d9-4dca-914b-994b48d6ddde could not be found. Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '9ac077e6-66d9-4dca-914b-994b48d6ddde'} Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac077e6-66d9-4dca-914b-994b48d6ddde could not be found. Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac077e6-66d9-4dca-914b-994b48d6ddde could not be found. Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:08:40.020816 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac077e6-66d9-4dca-914b-994b48d6ddde could not be found. Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Returning 404 to user: Instance 9ac077e6-66d9-4dca-914b-994b48d6ddde could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e35f0aa6-92f3-4563-af20-a9e7d7bacd5c tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde" status: 404 len: 111 microversion: 2.1 time: 0.032029 Oct 31 16:08:40.026133 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3341/6555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:39 2022] GET /compute/v2.1/servers/9ac077e6-66d9-4dca-914b-994b48d6ddde => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:08:40.181256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e53060a6-d8cd-4c26-91d0-b1c95483aa18 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] Calling method '.version_select at 0x7f5ca25ffc10>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:40.206267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e53060a6-d8cd-4c26-91d0-b1c95483aa18 tempest-TestNetworkBasicOps-1853387066 tempest-TestNetworkBasicOps-1853387066-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-691555434" status: 202 len: 0 microversion: 2.1 time: 0.029528 Oct 31 16:08:40.211311 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3215/6556] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Oct 31 16:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-691555434 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:08:54.519633 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:08:54.519633 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:08:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.48) !!! Oct 31 16:08:54.521599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:54.522655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:54.707333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a823f770-9189-4e01-a0c3-797eb7ff3bc5 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Action: 'create', calling method: .version_select at 0x7f5ca20e2e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-181159535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWiNOOelMAhmOu5D0bV5ZY4btOTViHwenc4agDG0INAlVRNikTj9nC54G8ksaCOCeYfwTglKRRE3HjPNPClgA9sn251I2Uq26CRUoLBxOMa7Qgu8LFr/cKSwOBHLjZcVg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:54.726077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a823f770-9189-4e01-a0c3-797eb7ff3bc5 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Getting quotas for project 50b26d29635345c6b0b1c6c024e26db1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:08:54.733071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a823f770-9189-4e01-a0c3-797eb7ff3bc5 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Getting quotas for user 84be6e15cad1412095b55b4249ba1715 and project 50b26d29635345c6b0b1c6c024e26db1. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:08:54.763087 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a823f770-9189-4e01-a0c3-797eb7ff3bc5 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.249805 Oct 31 16:08:54.763971 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3342/6557] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:08:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:08:55.756396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:55.757431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:08:55.762307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2059638072", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-181159535", "security_groups": [{"name": "tempest-secgroup-smoke-1728020959"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4a25a3f3-277d-4d1f-aa9a-9b6253f89579"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:55.873358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] validate_networks() for [('4a25a3f3-277d-4d1f-aa9a-9b6253f89579', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:08:56.262730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Getting quotas for project 50b26d29635345c6b0b1c6c024e26db1. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:08:56.267904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Getting quotas for user 84be6e15cad1412095b55b4249ba1715 and project 50b26d29635345c6b0b1c6c024e26db1. Resources: dict_keys(['metadata_items']) {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:08:56.281460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:08:56.281897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:08:56.282387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:08:56.282814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:08:56.283245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:08:56.291509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:56.292014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:56.292472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:56.293252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:56.293730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:56.294178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:56.311475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Getting quotas for project 50b26d29635345c6b0b1c6c024e26db1. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:08:56.316926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Getting quotas for user 84be6e15cad1412095b55b4249ba1715 and project 50b26d29635345c6b0b1c6c024e26db1. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:08:56.330451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:08:56.332884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:08:56.379833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-620ef568-304f-4679-a38b-f46fa424de5e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.625248 Oct 31 16:08:56.389234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3216/6558] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:08:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:08:56.400187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9713192-bc31-41d1-a359-33a35781838f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:56.400842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9713192-bc31-41d1-a359-33a35781838f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:56.474704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a9713192-bc31-41d1-a359-33a35781838f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:08:56.483049 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9713192-bc31-41d1-a359-33a35781838f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1302 microversion: 2.1 time: 0.091647 Oct 31 16:08:56.483998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3343/6559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:56 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:08:57.508342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:57.509864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:57.517772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:57.518493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:57.519212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:57.520089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:57.520803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:57.521477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:57.595902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:08:57.606910 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d1ccee8-c588-40da-b9da-588ba79822f7 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1362 microversion: 2.1 time: 0.103651 Oct 31 16:08:57.607490 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3217/6560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:57 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1362 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:08:58.632510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:58.633652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:58.641784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:58.642271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:58.642702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:58.643407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:58.643863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:58.644291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:58.891866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:08:58.899946 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56f7e9d6-f12c-4ea4-ba6c-192bfe448e3e tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.272264 Oct 31 16:08:58.900625 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3344/6561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:58 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:08:59.087508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-d678c404-b0ca-4552-ad3c-e252e918aebb req-722a34b8-dc43-4ca5-afe4-bda425f56f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa521d7-84b1-4f60-8a63-39206e165de0", "tag": "a03d4c24-900c-4d1c-8b11-315a50e8f96d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:08:59.102238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d678c404-b0ca-4552-ad3c-e252e918aebb req-722a34b8-dc43-4ca5-afe4-bda425f56f81 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:59.102883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d678c404-b0ca-4552-ad3c-e252e918aebb req-722a34b8-dc43-4ca5-afe4-bda425f56f81 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:59.103589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-d678c404-b0ca-4552-ad3c-e252e918aebb req-722a34b8-dc43-4ca5-afe4-bda425f56f81 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:59.116023 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-d678c404-b0ca-4552-ad3c-e252e918aebb req-722a34b8-dc43-4ca5-afe4-bda425f56f81 service nova] Creating event network-changed:a03d4c24-900c-4d1c-8b11-315a50e8f96d for instance 3fa521d7-84b1-4f60-8a63-39206e165de0 on n-h1-858383-17 Oct 31 16:08:59.122073 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-d678c404-b0ca-4552-ad3c-e252e918aebb req-722a34b8-dc43-4ca5-afe4-bda425f56f81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039970 Oct 31 16:08:59.123216 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3218/6562] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:08:59.923043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:08:59.923805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:08:59.931023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:59.931508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:59.931973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:08:59.932879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:08:59.933338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:08:59.933766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:00.076562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:00.085084 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec1d0cbe-a644-4a29-a91f-209e85a3ac83 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.165839 Oct 31 16:09:00.085767 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3345/6563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:08:59 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:01.109250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:01.109977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:01.116293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:01.116820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:01.118300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:01.119108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:01.119593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:01.120037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:01.255008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:01.262723 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-079c6849-2a44-42f3-9b99-4863131ee96d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.158681 Oct 31 16:09:01.263302 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3219/6564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:01 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:02.286571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:02.287334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:02.294221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:02.294708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:02.295145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:02.295971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:02.296565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:02.297020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:02.429890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:02.437741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-423dec27-9faf-49f4-9887-86fce9c0f85a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.155481 Oct 31 16:09:02.438314 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3346/6565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:02 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:03.461629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:03.462249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:03.469612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:03.470108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:03.470556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:03.471259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:03.471725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:03.472162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:03.607754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:03.615528 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-69c15414-0d04-41ad-ad8c-68fcd3e8872a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.158369 Oct 31 16:09:03.616107 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3220/6566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:03 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:09:04.639375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:04.639995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:04.647006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:04.647492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:04.647932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:04.648767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:04.649229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:04.649662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:04.781483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:04.790122 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf0210cc-bd80-4696-8ac4-0361a1beb652 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.154752 Oct 31 16:09:04.790705 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3347/6567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:04 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:05.812472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:05.813144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:05.819726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:05.821131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:05.821654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:05.822394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:05.822875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:05.823323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:05.957932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:05.965633 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-257d601d-87c1-44f1-be94-2b84072ff963 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.157249 Oct 31 16:09:05.966195 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3221/6568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:05 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:06.446818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-7c4c80fd-7312-415c-a76c-9507e8c7db2a req-7ba36276-52df-421f-ad05-a922e511b808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa521d7-84b1-4f60-8a63-39206e165de0", "name": "network-vif-plugged", "status": "completed", "tag": "a03d4c24-900c-4d1c-8b11-315a50e8f96d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:06.456329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7c4c80fd-7312-415c-a76c-9507e8c7db2a req-7ba36276-52df-421f-ad05-a922e511b808 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:06.456837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7c4c80fd-7312-415c-a76c-9507e8c7db2a req-7ba36276-52df-421f-ad05-a922e511b808 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:06.457277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-7c4c80fd-7312-415c-a76c-9507e8c7db2a req-7ba36276-52df-421f-ad05-a922e511b808 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:06.471666 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-7c4c80fd-7312-415c-a76c-9507e8c7db2a req-7ba36276-52df-421f-ad05-a922e511b808 service nova] Creating event network-vif-plugged:a03d4c24-900c-4d1c-8b11-315a50e8f96d for instance 3fa521d7-84b1-4f60-8a63-39206e165de0 on n-h1-858383-17 Oct 31 16:09:06.477120 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-7c4c80fd-7312-415c-a76c-9507e8c7db2a req-7ba36276-52df-421f-ad05-a922e511b808 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101283 Oct 31 16:09:06.477714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3348/6569] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:09:06.989055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:06.989682 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:06.991657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:06.993024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:07.000083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:07.000576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:07.001066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:07.001767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:07.002232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:07.002671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:07.135006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:07.142627 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-abdda6b9-ab52-4f4f-bedf-27cd4421307d tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.157428 Oct 31 16:09:07.143211 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3222/6570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:06 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:08.162865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:08.168765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:08.169517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:08.176201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:08.176713 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:08.177157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:08.177860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:08.178326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:08.178758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:08.316974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:08.325509 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2053473-1462-4ed0-9e53-472195fa6ec1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1428 microversion: 2.1 time: 0.163530 Oct 31 16:09:08.326097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3349/6571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:08 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:09.348907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:09.349523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:09.357062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.357559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.358005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.358702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.359170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.359606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.490453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:09.498516 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e657e44-f957-4335-8b3c-f3b8cd2d0485 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1607 microversion: 2.1 time: 0.153547 Oct 31 16:09:09.499083 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3223/6572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:09 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1607 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:09.521289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:09.521901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:09.529365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.529852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.530290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.530985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.531477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.531907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.666173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:09.673878 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-880d3c7d-ca35-4e5b-8554-eff34e688822 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1607 microversion: 2.1 time: 0.156460 Oct 31 16:09:09.674444 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3350/6573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:09 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1607 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:09.696670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:09.697263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:09.703208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.703703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.704151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.704882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.705352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.705787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.839177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:09.846915 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0fa65cee-efdb-47e7-a2bb-7327954e2a3f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1607 microversion: 2.1 time: 0.154855 Oct 31 16:09:09.847487 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3224/6574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:09 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1607 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:11.511943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ecbf604d-c5db-429f-a62e-3b49adc7637c req-7f6a1c81-b028-4ba4-b6f4-53b57ff256c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa521d7-84b1-4f60-8a63-39206e165de0", "tag": "a03d4c24-900c-4d1c-8b11-315a50e8f96d"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:11.525066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ecbf604d-c5db-429f-a62e-3b49adc7637c req-7f6a1c81-b028-4ba4-b6f4-53b57ff256c9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:11.525552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ecbf604d-c5db-429f-a62e-3b49adc7637c req-7f6a1c81-b028-4ba4-b6f4-53b57ff256c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:11.525988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ecbf604d-c5db-429f-a62e-3b49adc7637c req-7f6a1c81-b028-4ba4-b6f4-53b57ff256c9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:11.537328 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ecbf604d-c5db-429f-a62e-3b49adc7637c req-7f6a1c81-b028-4ba4-b6f4-53b57ff256c9 service nova] Creating event network-changed:a03d4c24-900c-4d1c-8b11-315a50e8f96d for instance 3fa521d7-84b1-4f60-8a63-39206e165de0 on n-h1-858383-17 Oct 31 16:09:11.542700 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ecbf604d-c5db-429f-a62e-3b49adc7637c req-7f6a1c81-b028-4ba4-b6f4-53b57ff256c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036079 Oct 31 16:09:11.543463 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3351/6575] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:10:18.389451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:10:18.390836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=46 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:10:18.395097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:10:18.395609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:10:18.403578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:10:18.404072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:10:18.404523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:10:18.405251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:10:18.405726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:10:18.406167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:10:18.430828 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4481f0c2-6bff-450f-873d-82f7d420d103 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043286 Oct 31 16:10:18.431422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3225/6576] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Oct 31 16:10:18 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:21.905340 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:14:21.906152 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:14:21.907344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:21.908109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=40 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:21.909259 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:14:21.909398 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 (ip 10.222.0.48) !!! Oct 31 16:14:21.911667 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:14:21.911801 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 (ip 10.222.0.48) !!! Oct 31 16:14:21.913579 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:14:21.913689 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 (ip 10.222.0.48) !!! Oct 31 16:14:22.084352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:22.085001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:22.094841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:22.095331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:22.095769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:22.096466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:22.096952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:22.097383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:22.125306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:14:22.205299 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-950c268b-53cd-4ce8-8bf8-fd188c66a62a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 204 len: 0 microversion: 2.1 time: 0.301649 Oct 31 16:14:22.205915 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3352/6577] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:14:21 2022] DELETE /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:14:22.212264 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:14:22.213255 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:14:22.216876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:22.218145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:22.220513 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:14:22.220656 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 (ip 10.222.0.48) !!! Oct 31 16:14:22.222059 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:14:22.222177 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 (ip 10.222.0.48) !!! Oct 31 16:14:22.223396 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:14:22.223505 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 (ip 10.222.0.48) !!! Oct 31 16:14:22.224404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:22.225100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:22.244023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:22.244528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:22.245016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:22.245724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:22.246193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:22.246632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:22.498048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:22.506727 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ce72c0a-6390-499b-950b-b29cacb79140 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1732 microversion: 2.1 time: 0.296191 Oct 31 16:14:22.507297 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3226/6578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:22 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1732 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:23.531710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:23.532471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:23.541524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:23.542011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:23.542471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:23.543167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:23.543620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:23.544041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:23.553106 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47646. Oct 31 16:14:23.562827 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47644. Oct 31 16:14:23.836603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84be6e15cad1412095b55b4249ba1715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50b26d29635345c6b0b1c6c024e26db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:23.845413 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9be8af1-ba98-42e2-91d3-4b05f906aaf0 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 200 len: 1732 microversion: 2.1 time: 0.318789 Oct 31 16:14:23.845994 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3353/6579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:23 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:24.156185 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47658. Oct 31 16:14:24.160893 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47660. Oct 31 16:14:24.222266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4c4a224a-9679-4ce5-878d-890fa69012d3 req-b1a17cc7-45a2-4117-a8f1-ae539044b737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa521d7-84b1-4f60-8a63-39206e165de0", "name": "network-vif-deleted", "tag": "a03d4c24-900c-4d1c-8b11-315a50e8f96d"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:24.236171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4c4a224a-9679-4ce5-878d-890fa69012d3 req-b1a17cc7-45a2-4117-a8f1-ae539044b737 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:24.236977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4c4a224a-9679-4ce5-878d-890fa69012d3 req-b1a17cc7-45a2-4117-a8f1-ae539044b737 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:24.237608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4c4a224a-9679-4ce5-878d-890fa69012d3 req-b1a17cc7-45a2-4117-a8f1-ae539044b737 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:24.250209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4c4a224a-9679-4ce5-878d-890fa69012d3 req-b1a17cc7-45a2-4117-a8f1-ae539044b737 service nova] Creating event network-vif-deleted:a03d4c24-900c-4d1c-8b11-315a50e8f96d for instance 3fa521d7-84b1-4f60-8a63-39206e165de0 on n-h1-858383-17 Oct 31 16:14:24.258738 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4c4a224a-9679-4ce5-878d-890fa69012d3 req-b1a17cc7-45a2-4117-a8f1-ae539044b737 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118993 Oct 31 16:14:24.259830 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3227/6580] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:24.868871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:24.869499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:24.877819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:24.878310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:24.878806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:24.879448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:24.879911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:24.880342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:24.895077 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] HTTP exception thrown: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Request method failure captured: Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 HTTP/1.1 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_MR97BSdn6J4ywfERsL3gmatcv0fKkJuG_RCHEjYzlvRSHIWMCCoIY8noqpkcVJyDE0DgBaVVUP8znh_GdyQPJo7q_KJZAthuA4OO8ataHGiTQSJvYTMf6REXZJprcJsqHEn9nAXr6L1rHSnJu43NvzijNo05xHPlhS735w2-DgCjo Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 50b26d29635345c6b0b1c6c024e26db1 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 50b26d29635345c6b0b1c6c024e26db1 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestServerBasicOps-1545181982-project Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 84be6e15cad1412095b55b4249ba1715 Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestServerBasicOps-1545181982-project Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3fa521d7-84b1-4f60-8a63-39206e165de0'} Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:24.896783 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Returning 404 to user: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e673a30-22c2-438c-91a5-993b500fbd8f tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 404 len: 111 microversion: 2.1 time: 0.033394 Oct 31 16:14:24.902151 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3354/6581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:24 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:14:25.347258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:25.347839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:25.354006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:25.354510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:25.354966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:25.355688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:25.356144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:25.356585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:25.370438 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] HTTP exception thrown: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Request method failure captured: Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 HTTP/1.1 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_MR97BSdn6J4ywfERsL3gmatcv0fKkJuG_RCHEjYzlvRSHIWMCCoIY8noqpkcVJyDE0DgBaVVUP8znh_GdyQPJo7q_KJZAthuA4OO8ataHGiTQSJvYTMf6REXZJprcJsqHEn9nAXr6L1rHSnJu43NvzijNo05xHPlhS735w2-DgCjo Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 50b26d29635345c6b0b1c6c024e26db1 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 50b26d29635345c6b0b1c6c024e26db1 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestServerBasicOps-1545181982-project Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 84be6e15cad1412095b55b4249ba1715 Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestServerBasicOps-1545181982-project Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '3fa521d7-84b1-4f60-8a63-39206e165de0'} Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:25.372072 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Returning 404 to user: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c32b02f-862b-4371-b2f6-e9faa2257ba1 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 404 len: 111 microversion: 2.1 time: 0.031887 Oct 31 16:14:25.377696 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3228/6582] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:14:25 2022] DELETE /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:14:25.383299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:25.383957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] [instance: 3fa521d7-84b1-4f60-8a63-39206e165de0] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:25.390023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:25.390506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:25.390947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:25.391636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:25.392097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:25.392525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:25.409092 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] HTTP exception thrown: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Request method failure captured: Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 HTTP/1.1 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_MR97BSdn6J4ywfERsL3gmatcv0fKkJuG_RCHEjYzlvRSHIWMCCoIY8noqpkcVJyDE0DgBaVVUP8znh_GdyQPJo7q_KJZAthuA4OO8ataHGiTQSJvYTMf6REXZJprcJsqHEn9nAXr6L1rHSnJu43NvzijNo05xHPlhS735w2-DgCjo Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 50b26d29635345c6b0b1c6c024e26db1 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50b26d29635345c6b0b1c6c024e26db1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 50b26d29635345c6b0b1c6c024e26db1 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestServerBasicOps-1545181982 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestServerBasicOps-1545181982-project Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 84be6e15cad1412095b55b4249ba1715 Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestServerBasicOps-1545181982-project Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3fa521d7-84b1-4f60-8a63-39206e165de0'} Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:25.410639 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Returning 404 to user: Instance 3fa521d7-84b1-4f60-8a63-39206e165de0 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1973cb0f-9e7a-4057-a102-4b3d8e5d160a tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0" status: 404 len: 111 microversion: 2.1 time: 0.032751 Oct 31 16:14:25.415664 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3355/6583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:25 2022] GET /compute/v2.1/servers/3fa521d7-84b1-4f60-8a63-39206e165de0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:14:25.573303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3ebc9ed-cff6-434d-b33b-79bb34194409 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] Calling method '.version_select at 0x7f5ca1018f70>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:25.597853 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3ebc9ed-cff6-434d-b33b-79bb34194409 tempest-TestServerBasicOps-1545181982 tempest-TestServerBasicOps-1545181982-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-181159535" status: 202 len: 0 microversion: 2.1 time: 0.028416 Oct 31 16:14:25.601637 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3229/6584] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Oct 31 16:14:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-181159535 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:14:43.648703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:43.649386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:43.758528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1537062280", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:43.812906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:14:44.086401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:14:44.086823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:14:44.087325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:14:44.087729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:14:44.088142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:14:44.099487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:44.099970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:44.100407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:44.101162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:44.101627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:44.102052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:44.120974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Getting quotas for project 5ff4367740f7476e8107e154928e6751. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:14:44.127273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Getting quotas for user 6472532d61b04e0280cfd51f48fa7883 and project 5ff4367740f7476e8107e154928e6751. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:14:44.139693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:14:44.143278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:14:44.189674 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-389021fd-825e-4f93-b942-0a4f902784c1 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546443 Oct 31 16:14:44.190324 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3356/6585] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:14:44.200567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=10 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:44.201457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:44.205842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2578cc23-3323-45d3-9d8d-bdc211ba8c61 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:44.206484 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2578cc23-3323-45d3-9d8d-bdc211ba8c61 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:44.268266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2578cc23-3323-45d3-9d8d-bdc211ba8c61 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:44.277929 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2578cc23-3323-45d3-9d8d-bdc211ba8c61 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1222 microversion: 2.1 time: 0.079151 Oct 31 16:14:44.278532 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3230/6586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:44 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:45.300353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:45.300989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:45.307905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:45.308387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:45.308856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:45.309557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:45.310013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:45.310435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:45.388424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:45.397591 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b701e771-63c9-4c05-a4c7-28eddd8aa147 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1274 microversion: 2.1 time: 0.100904 Oct 31 16:14:45.398101 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3357/6587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:45 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:46.422840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:46.423518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:46.430540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:46.431043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:46.431490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:46.432402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:46.432910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:46.433527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:46.655534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:46.663979 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d75a14de-c155-49dd-bcca-78e6223bd989 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1322 microversion: 2.1 time: 0.246112 Oct 31 16:14:46.664556 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3231/6588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:46 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:46.976929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-9e713e78-599f-4f95-9c2c-35e9212fa50a req-dc40448f-5c48-415d-835b-890bc7943b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01dbefc2-e215-49aa-ad60-b089e28e8447", "tag": "435ac01b-6d90-4b24-bba6-544682d4b48c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:46.990252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9e713e78-599f-4f95-9c2c-35e9212fa50a req-dc40448f-5c48-415d-835b-890bc7943b18 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:46.990781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9e713e78-599f-4f95-9c2c-35e9212fa50a req-dc40448f-5c48-415d-835b-890bc7943b18 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:46.991292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-9e713e78-599f-4f95-9c2c-35e9212fa50a req-dc40448f-5c48-415d-835b-890bc7943b18 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.003418 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-9e713e78-599f-4f95-9c2c-35e9212fa50a req-dc40448f-5c48-415d-835b-890bc7943b18 service nova] Creating event network-changed:435ac01b-6d90-4b24-bba6-544682d4b48c for instance 01dbefc2-e215-49aa-ad60-b089e28e8447 on n-h1-858383-17 Oct 31 16:14:47.009574 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-9e713e78-599f-4f95-9c2c-35e9212fa50a req-dc40448f-5c48-415d-835b-890bc7943b18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037406 Oct 31 16:14:47.010608 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3358/6589] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:47.687814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:47.688445 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:47.695296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:47.695795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:47.696264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.697006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:47.697481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:47.697925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.827057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:47.834936 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-68298b9b-d331-43ee-89ae-5ce89f4b0ae0 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1322 microversion: 2.1 time: 0.151084 Oct 31 16:14:47.835516 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3232/6590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:47 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:48.859941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:48.860647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:48.866959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:48.867446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:48.868595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:48.869336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:48.869800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:48.870231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:48.996228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:49.004215 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f78a2fd9-1bdd-4e6d-b02d-6980c77e989e tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1322 microversion: 2.1 time: 0.149420 Oct 31 16:14:49.004819 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3359/6591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:48 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:50.028026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:50.028726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:50.036614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:50.037151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:50.037617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:50.038343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:50.038826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:50.039290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:50.175103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:50.183795 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8f2ccfe1-e1ad-4550-bbcd-2ffda9a9f06d tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1322 microversion: 2.1 time: 0.160150 Oct 31 16:14:50.184364 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3233/6592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:50 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:51.206697 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:51.207318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:51.214708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.215196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.215634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.216329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.216815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.217242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.344934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:51.353184 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e94b50c-51fb-478b-861e-722e92bb1a04 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1322 microversion: 2.1 time: 0.150462 Oct 31 16:14:51.353758 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3360/6593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:51 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:52.116121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8abdfac0-2e6b-4d2e-a747-e72a938d83e9 req-7785a85c-f21c-4393-a7d0-e405734959a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01dbefc2-e215-49aa-ad60-b089e28e8447", "name": "network-vif-plugged", "status": "completed", "tag": "435ac01b-6d90-4b24-bba6-544682d4b48c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:52.126911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8abdfac0-2e6b-4d2e-a747-e72a938d83e9 req-7785a85c-f21c-4393-a7d0-e405734959a3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:52.127402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8abdfac0-2e6b-4d2e-a747-e72a938d83e9 req-7785a85c-f21c-4393-a7d0-e405734959a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:52.127849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8abdfac0-2e6b-4d2e-a747-e72a938d83e9 req-7785a85c-f21c-4393-a7d0-e405734959a3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:52.139530 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8abdfac0-2e6b-4d2e-a747-e72a938d83e9 req-7785a85c-f21c-4393-a7d0-e405734959a3 service nova] Creating event network-vif-plugged:435ac01b-6d90-4b24-bba6-544682d4b48c for instance 01dbefc2-e215-49aa-ad60-b089e28e8447 on n-h1-858383-17 Oct 31 16:14:52.144535 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8abdfac0-2e6b-4d2e-a747-e72a938d83e9 req-7785a85c-f21c-4393-a7d0-e405734959a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087348 Oct 31 16:14:52.145149 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3234/6594] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:52.375826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:52.376380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:52.383012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:52.383506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:52.383941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:52.384639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:52.385124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:52.385555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:52.803815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:52.812052 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d40585f7-158e-4455-aa44-3989e9de4894 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1322 microversion: 2.1 time: 0.440556 Oct 31 16:14:52.812625 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3361/6595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:52 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:53.835563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:53.836229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:53.843730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:53.844238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:53.844723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:53.845443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:53.845921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:53.846370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:53.977726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:53.985725 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3c373cc1-438d-4d81-9181-783172177bd3 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1472 microversion: 2.1 time: 0.154539 Oct 31 16:14:53.986308 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3235/6596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:53 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:54.056237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae9580c9-a26c-4b46-a701-6c310e4bd686 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Calling method '.version_select at 0x7f5ca12c5160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.112781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:54.121192 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae9580c9-a26c-4b46-a701-6c310e4bd686 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/c719ce824ab3414fa735d4ea083ba335" status: 200 len: 371 microversion: 2.1 time: 0.114186 Oct 31 16:14:54.121784 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3362/6597] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 16:14:54 2022] GET /compute/v2.1/os-quota-sets/c719ce824ab3414fa735d4ea083ba335 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:54.134318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6563fd3-29bb-4899-b597-904b7fee916d tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-88504067", "id": 554858410, "os-flavor-access:is_public": "True"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:54.153220 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6563fd3-29bb-4899-b597-904b7fee916d tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022739 Oct 31 16:14:54.153827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3236/6598] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:14:54 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:54.166558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "554858410"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:54.168906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:54.176207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.176721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.177174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.177875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.178364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.178792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.406195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '770e9c51e32341d5b03ff13c376d084e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719ce824ab3414fa735d4ea083ba335', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:54.412600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-88504067 {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:14:54.419745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.420227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.420655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.421394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.421972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.422339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.444460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Getting quotas for project 5ff4367740f7476e8107e154928e6751. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:14:54.450436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Getting quotas for user 6472532d61b04e0280cfd51f48fa7883 and project 5ff4367740f7476e8107e154928e6751. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:14:54.462381 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.compute.api [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] ram quota exceeded for c719ce824ab3414fa735d4ea083ba335, tried to resize instance. Oct 31 16:14:54.462915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Request method failure captured: Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447/action HTTP/1.1 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 38 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_RzKN6yLQNjzUlKnJBxxJwy1FIblEYswe816nGA6bqPHrlgaQ2gP9Bf_fTc-sFy52NL00FDOZITBlFMWMYqqcPDsLkH15Xcktu3hH6yl380_RPVAetnwjWk6iW0Rge39z2s28ISQQqdBp-XvUVdzCTbMrVRmKuF2JaB9wn-hSOOuvs Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c719ce824ab3414fa735d4ea083ba335 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-554734755 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,admin,reader Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,admin,reader Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersAdminNegativeTestJSON-554734755 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c719ce824ab3414fa735d4ea083ba335 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-554734755 Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersAdminNegativeTestJSON-554734755-project-admin Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 770e9c51e32341d5b03ff13c376d084e Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersAdminNegativeTestJSON-554734755-project-admin Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: {"resize": {"flavorRef": "554858410"}} Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '01dbefc2-e215-49aa-ad60-b089e28e8447', 'body': {'resize': {'flavorRef': '554858410'}}} Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:14:54.465055 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-047cf59e-3cb3-47e6-8a4c-34194a8e8f50 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447/action" status: 403 len: 118 microversion: 2.1 time: 0.304501 Oct 31 16:14:54.469187 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3363/6599] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:14:54 2022] POST /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447/action => generated 118 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:14:54.475279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-512a39d8-c6a2-47ab-9a92-5693cfec5202 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.478261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:54.495744 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-512a39d8-c6a2-47ab-9a92-5693cfec5202 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/554858410" status: 202 len: 0 microversion: 2.1 time: 0.023748 Oct 31 16:14:54.496459 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3237/6600] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Oct 31 16:14:54 2022] DELETE /compute/v2.1/flavors/554858410 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:14:54.504567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b854f56c-78b3-4c37-a005-aaf30d19e213 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.525364 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b854f56c-78b3-4c37-a005-aaf30d19e213 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024663 Oct 31 16:14:54.525924 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3364/6601] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 16:14:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:54.546788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-893aa511-3eaa-436f-9b2d-4424796b1c69 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Calling method '.version_select at 0x7f5ca0f63d30>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.614254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-893aa511-3eaa-436f-9b2d-4424796b1c69 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/c719ce824ab3414fa735d4ea083ba335" status: 200 len: 371 microversion: 2.1 time: 0.071124 Oct 31 16:14:54.614827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3238/6602] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Oct 31 16:14:54 2022] GET /compute/v2.1/os-quota-sets/c719ce824ab3414fa735d4ea083ba335 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:54.627408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02562032-c5ca-41df-a74b-8cb621b397f6 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1975029245", "id": 1608195695, "os-flavor-access:is_public": "True"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:54.645090 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02562032-c5ca-41df-a74b-8cb621b397f6 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021713 Oct 31 16:14:54.645665 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3365/6603] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:14:54 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:54.657595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1608195695"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:54.659876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:54.666457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.666949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.667399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.668602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.668602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.669054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.829000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '770e9c51e32341d5b03ff13c376d084e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c719ce824ab3414fa735d4ea083ba335', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:54.835284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1975029245 {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:14:54.841973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.842516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.842968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.843713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.844188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.844633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.870081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Getting quotas for project 5ff4367740f7476e8107e154928e6751. Resources: {'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:14:54.875226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Getting quotas for user 6472532d61b04e0280cfd51f48fa7883 and project 5ff4367740f7476e8107e154928e6751. Resources: {'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:14:54.893275 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] cores quota exceeded for c719ce824ab3414fa735d4ea083ba335, tried to resize instance. Oct 31 16:14:54.893829 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Request method failure captured: Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447/action HTTP/1.1 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 39 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_RzKN6yLQNjzUlKnJBxxJwy1FIblEYswe816nGA6bqPHrlgaQ2gP9Bf_fTc-sFy52NL00FDOZITBlFMWMYqqcPDsLkH15Xcktu3hH6yl380_RPVAetnwjWk6iW0Rge39z2s28ISQQqdBp-XvUVdzCTbMrVRmKuF2JaB9wn-hSOOuvs Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c719ce824ab3414fa735d4ea083ba335 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-554734755 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,admin,reader Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,admin,reader Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c719ce824ab3414fa735d4ea083ba335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-554734755 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c719ce824ab3414fa735d4ea083ba335 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-554734755 Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-554734755-project-admin Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 770e9c51e32341d5b03ff13c376d084e Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-554734755-project-admin Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: {"resize": {"flavorRef": "1608195695"}} Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '01dbefc2-e215-49aa-ad60-b089e28e8447', 'body': {'resize': {'flavorRef': '1608195695'}}} Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:14:54.895956 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9592223-d346-4a27-a39c-7e17c650f329 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447/action" status: 403 len: 113 microversion: 2.1 time: 0.243698 Oct 31 16:14:54.901179 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3239/6604] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:14:54 2022] POST /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447/action => generated 113 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:14:54.906707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9707001-3233-4d9e-b821-36ce1e87e758 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.924011 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9707001-3233-4d9e-b821-36ce1e87e758 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1608195695" status: 202 len: 0 microversion: 2.1 time: 0.021004 Oct 31 16:14:54.924617 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3366/6605] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Oct 31 16:14:54 2022] DELETE /compute/v2.1/flavors/1608195695 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:14:54.932673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27d642a8-fc39-48c1-9b8b-4455b39b17a8 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.952679 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27d642a8-fc39-48c1-9b8b-4455b39b17a8 tempest-ServersAdminNegativeTestJSON-554734755 tempest-ServersAdminNegativeTestJSON-554734755-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024017 Oct 31 16:14:54.953249 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3240/6606] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Oct 31 16:14:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:54.973649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:54.974146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:54.980104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.980592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.981061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:54.981794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:54.982247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:54.982668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:55.007810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:14:55.082208 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8dd0c812-dded-4f4b-98cb-60f7fa388393 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 204 len: 0 microversion: 2.1 time: 0.112194 Oct 31 16:14:55.082960 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3367/6607] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:14:54 2022] DELETE /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:14:55.091763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:55.092391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:55.098801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:55.099304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:55.099759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:55.100469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:55.100974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:55.101424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:55.239593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:55.247880 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-36b3cab5-af37-4631-be78-a9a141117733 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1478 microversion: 2.1 time: 0.160143 Oct 31 16:14:55.248455 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3241/6608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:55 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:56.271665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:56.272377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:56.279213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:56.279704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:56.280145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:56.280872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:56.281337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:56.281764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:56.408766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:56.416825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e47797be-e97a-4ce5-a460-608e14dd20cd tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1478 microversion: 2.1 time: 0.149412 Oct 31 16:14:56.417409 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3368/6609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:56 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1478 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:57.099480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-06eaf9a9-4b84-41ac-a74b-644713742b39 req-e7b3002e-3aef-4ae4-baaa-faa555ae20fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01dbefc2-e215-49aa-ad60-b089e28e8447", "name": "network-vif-deleted", "tag": "435ac01b-6d90-4b24-bba6-544682d4b48c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:57.111039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-06eaf9a9-4b84-41ac-a74b-644713742b39 req-e7b3002e-3aef-4ae4-baaa-faa555ae20fb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:57.111687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-06eaf9a9-4b84-41ac-a74b-644713742b39 req-e7b3002e-3aef-4ae4-baaa-faa555ae20fb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:57.112235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-06eaf9a9-4b84-41ac-a74b-644713742b39 req-e7b3002e-3aef-4ae4-baaa-faa555ae20fb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:57.126011 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-06eaf9a9-4b84-41ac-a74b-644713742b39 req-e7b3002e-3aef-4ae4-baaa-faa555ae20fb service nova] Creating event network-vif-deleted:435ac01b-6d90-4b24-bba6-544682d4b48c for instance 01dbefc2-e215-49aa-ad60-b089e28e8447 on n-h1-858383-17 Oct 31 16:14:57.134054 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-06eaf9a9-4b84-41ac-a74b-644713742b39 req-e7b3002e-3aef-4ae4-baaa-faa555ae20fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038724 Oct 31 16:14:57.134726 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3242/6610] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:57.440371 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:57.441051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:57.448856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:57.449347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:57.449784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:57.450481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:57.450937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:57.451374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:57.482322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:57.482803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:57.483249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:57.483695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lazy-loading 'fault' on Instance uuid 01dbefc2-e215-49aa-ad60-b089e28e8447 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:14:57.524617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472532d61b04e0280cfd51f48fa7883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ff4367740f7476e8107e154928e6751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:57.532931 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-06fa5573-e3f9-4b4c-af0e-41a58aab15ab tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 200 len: 1312 microversion: 2.1 time: 0.096339 Oct 31 16:14:57.533451 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3369/6611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:57 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:58.557538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:58.558172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] [instance: 01dbefc2-e215-49aa-ad60-b089e28e8447] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:58.565204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:58.565706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:58.566159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:58.566860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:58.567333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:58.567774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:58.581715 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] HTTP exception thrown: Instance 01dbefc2-e215-49aa-ad60-b089e28e8447 could not be found. Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Request method failure captured: Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 HTTP/1.1 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_RyM-mJw-SF4SglFulK9I5Gs5ZG0AtaIQkDvysCcKsMrFD_KNxICYfgHJIqoUCOF5K-jcUvfokJynZs2krUBLIYgjsBz7rD2mWlTUEs3PwrH6ieMsIWuYt0b5qmDsj-sq5D2jWB0lCg7FB7UoaImdXcL8ZJt-ZksQaapRT1Vju0Qno Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 5ff4367740f7476e8107e154928e6751 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-569457661 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ff4367740f7476e8107e154928e6751"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ff4367740f7476e8107e154928e6751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ff4367740f7476e8107e154928e6751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ff4367740f7476e8107e154928e6751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersAdminNegativeTestJSON-569457661 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 5ff4367740f7476e8107e154928e6751 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-569457661 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersAdminNegativeTestJSON-569457661-project Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 6472532d61b04e0280cfd51f48fa7883 Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersAdminNegativeTestJSON-569457661-project Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 01dbefc2-e215-49aa-ad60-b089e28e8447 could not be found. Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '01dbefc2-e215-49aa-ad60-b089e28e8447'} Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01dbefc2-e215-49aa-ad60-b089e28e8447 could not be found. Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01dbefc2-e215-49aa-ad60-b089e28e8447 could not be found. Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:58.583382 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01dbefc2-e215-49aa-ad60-b089e28e8447 could not be found. Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] Returning 404 to user: Instance 01dbefc2-e215-49aa-ad60-b089e28e8447 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93bff712-5f17-48c6-ad6e-7f4480effbf5 tempest-ServersAdminNegativeTestJSON-569457661 tempest-ServersAdminNegativeTestJSON-569457661-project] 10.222.0.48 "GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447" status: 404 len: 111 microversion: 2.1 time: 0.031988 Oct 31 16:14:58.589135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3243/6612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:58 2022] GET /compute/v2.1/servers/01dbefc2-e215-49aa-ad60-b089e28e8447 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:15:04.690303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:04.691952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:04.817291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-382166125", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "d9f3a899-38a4-403b-8758-7216d24e65e6"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:04.879068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] validate_networks() for [('d9f3a899-38a4-403b-8758-7216d24e65e6', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:15:05.274702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:15:05.275470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:15:05.275964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:15:05.276381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:15:05.276834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:15:05.285820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:05.286308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:05.286747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:05.287477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:05.287974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:05.288411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:05.305959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Getting quotas for project f4ae0322dc294380be20eeb5e38e96cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:15:05.311845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Getting quotas for user 17bf1b056e2f4b47a2fac5f61a00b33c and project f4ae0322dc294380be20eeb5e38e96cb. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:15:05.325623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:15:05.327958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:15:05.376576 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3efe6f68-a114-4cf9-ba68-4b6023756ef8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692181 Oct 31 16:15:05.377282 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3370/6613] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:15:05.388614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b304a58d-e4ae-4d91-9b71-a69ca1c24a52 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:05.389281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b304a58d-e4ae-4d91-9b71-a69ca1c24a52 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:05.392191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:05.392931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:05.451614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b304a58d-e4ae-4d91-9b71-a69ca1c24a52 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:05.458954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b304a58d-e4ae-4d91-9b71-a69ca1c24a52 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1214 microversion: 2.1 time: 0.074409 Oct 31 16:15:05.459536 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3244/6614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:05 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:06.483841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:06.484453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:06.491325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:06.491823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:06.492235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:06.492950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:06.493431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:06.493912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:06.571033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:06.589475 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af326e77-0310-4574-889c-51ea329b6f8e tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1266 microversion: 2.1 time: 0.110419 Oct 31 16:15:06.592818 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3371/6615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:06 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:07.616319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:07.616967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:07.627149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:07.627893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:07.628508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:07.629259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:07.629843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:07.630265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:07.852584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:07.861200 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc74525b-aa5e-44b9-b0f9-0dc44ffcb083 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.250128 Oct 31 16:15:07.861807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3245/6616] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:07 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:08.199293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c9413d8c-e344-4c2c-b09e-a1d57d2ee937 req-0ee68b1c-78db-4ca9-80a2-311fa9ae1ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c88e1d-8ac2-4d87-ac52-709cc59e35f9", "tag": "2ea2acf2-edf9-4114-ae0e-d7b1f45281b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:08.215889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c9413d8c-e344-4c2c-b09e-a1d57d2ee937 req-0ee68b1c-78db-4ca9-80a2-311fa9ae1ea6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:08.216468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c9413d8c-e344-4c2c-b09e-a1d57d2ee937 req-0ee68b1c-78db-4ca9-80a2-311fa9ae1ea6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:08.217031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c9413d8c-e344-4c2c-b09e-a1d57d2ee937 req-0ee68b1c-78db-4ca9-80a2-311fa9ae1ea6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:08.230416 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c9413d8c-e344-4c2c-b09e-a1d57d2ee937 req-0ee68b1c-78db-4ca9-80a2-311fa9ae1ea6 service nova] Creating event network-changed:2ea2acf2-edf9-4114-ae0e-d7b1f45281b3 for instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 on n-h1-858383-17 Oct 31 16:15:08.248559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c9413d8c-e344-4c2c-b09e-a1d57d2ee937 req-0ee68b1c-78db-4ca9-80a2-311fa9ae1ea6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053368 Oct 31 16:15:08.250913 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3372/6617] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:08.886355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:08.886984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:08.893959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:08.894394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:08.894842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:08.895543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:08.896011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:08.896450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:09.030005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:09.037660 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-093e3a65-2863-4a00-8f49-674ef575c923 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.155957 Oct 31 16:15:09.038228 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3246/6618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:08 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:10.062654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:10.063395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:10.069725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:10.070212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:10.070653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:10.071348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:10.072515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:10.072978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:10.202985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:10.210753 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b7baa7f3-0f22-4396-9b30-3d603f0d4492 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.153248 Oct 31 16:15:10.211322 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3373/6619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:10 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:11.234212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:11.234844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:11.241758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:11.242257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:11.242711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:11.243417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:11.243913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:11.244351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:11.372175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:11.380095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fbe16c08-1d7b-4c51-bdd8-3a9e78920740 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.149852 Oct 31 16:15:11.380667 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3247/6620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:11 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.403523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:12.404150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.411094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.411582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.412023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.412755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.413221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.413653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.548077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:12.556469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f5555e2c-14d0-4652-a143-3247a9e91a18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.156224 Oct 31 16:15:12.557088 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3374/6621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:12 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:13.579721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:13.580370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:13.587903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:13.588488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:13.588964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:13.589672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:13.590148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:13.590593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:13.721270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:13.728967 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2c01af89-c8a7-4c90-bee4-00ef4f124baf tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.153607 Oct 31 16:15:13.729552 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3248/6622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:13 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:14.137444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0a7cd063-4352-4526-8255-fc034f875217 req-9865a973-a475-4b54-8473-a92912f29137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c88e1d-8ac2-4d87-ac52-709cc59e35f9", "name": "network-vif-plugged", "status": "completed", "tag": "2ea2acf2-edf9-4114-ae0e-d7b1f45281b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:14.143794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:14.151096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0a7cd063-4352-4526-8255-fc034f875217 req-9865a973-a475-4b54-8473-a92912f29137 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:14.151561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0a7cd063-4352-4526-8255-fc034f875217 req-9865a973-a475-4b54-8473-a92912f29137 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:14.151990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0a7cd063-4352-4526-8255-fc034f875217 req-9865a973-a475-4b54-8473-a92912f29137 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:14.157218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:14.166330 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0a7cd063-4352-4526-8255-fc034f875217 req-9865a973-a475-4b54-8473-a92912f29137 service nova] Creating event network-vif-plugged:2ea2acf2-edf9-4114-ae0e-d7b1f45281b3 for instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 on n-h1-858383-17 Oct 31 16:15:14.172234 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0a7cd063-4352-4526-8255-fc034f875217 req-9865a973-a475-4b54-8473-a92912f29137 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038456 Oct 31 16:15:14.172869 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3375/6623] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:15:14.751829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:14.752447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:14.755123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:14.761888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:14.762422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:14.762874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:14.763617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:14.764142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:14.764585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:14.767791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=74 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:14.896662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:14.905327 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b2f5dc3-3e86-4b4d-b63d-eca9871b3f1c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1314 microversion: 2.1 time: 0.157634 Oct 31 16:15:14.905909 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3249/6624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:14 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:15.931785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:15.932491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:15.935247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:15.936038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:15.944273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:15.944788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:15.945227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:15.945932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:15.947021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:15.947743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.085668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:16.094491 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55a32e9c-1229-4b65-adba-11ec677b61d0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1501 microversion: 2.1 time: 0.168722 Oct 31 16:15:16.095096 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3376/6625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:15 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:16.117441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:16.120350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:16.122301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:16.128653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:16.129183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:16.129634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.130339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:16.130810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:16.131251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.159631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:16.166125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:15:16.172921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:15:16.173648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:15:16.173911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:15:16.174289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:15:16.174716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:15:16.239550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-977af6a4-6bfa-44b0-b252-7c9d43b1e183 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "POST /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9/action" status: 202 len: 0 microversion: 2.1 time: 0.125958 Oct 31 16:15:16.240161 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3250/6626] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:15:16 2022] POST /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:15:16.248484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:16.249312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:16.256015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:16.256537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:16.257000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.257699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:16.258159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:16.258586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.429561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:16.437570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-760c2d1d-7da8-4cbe-9e54-7bf9f562d371 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1510 microversion: 2.1 time: 0.193071 Oct 31 16:15:16.438247 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3377/6627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:16 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:17.462170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:17.462830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:17.470248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:17.470751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:17.471202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:17.471908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:17.472382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:17.472860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:17.605790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:17.614001 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5820c1a3-c110-48f3-8071-7d90dea89d39 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1510 microversion: 2.1 time: 0.156512 Oct 31 16:15:17.614588 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3251/6628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:17 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:18.636748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:18.637365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:18.644165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:18.644649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:18.645115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:18.645801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:18.646256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:18.646677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:18.776812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:18.784548 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d464c290-18a4-453a-a217-5cb10599bcc4 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.151777 Oct 31 16:15:18.785151 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3378/6629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:18 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:19.807784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:19.808511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:19.816090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:19.816443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:19.816960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:19.817680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:19.818197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:19.818646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:19.950635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:19.958210 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b2e41423-2fbd-401a-abe6-aa92649fbae0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.154439 Oct 31 16:15:19.958791 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3252/6630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:19 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:20.982213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:20.982832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:20.989846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:20.990332 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:20.990770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:20.991454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:20.991909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:20.992329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:21.120500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:21.128496 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4502de8a-67ed-4ea0-baf1-d3fbbdc63022 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.150913 Oct 31 16:15:21.129109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3379/6631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:20 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:22.151081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:22.151711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:22.158541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:22.159033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:22.159481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:22.160179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:22.160649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:22.161114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:22.291935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:22.299741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d7b5541-227e-4208-a83a-025c8ff0f242 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.152576 Oct 31 16:15:22.300599 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3253/6632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:22 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:23.322595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:23.323833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:23.330712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:23.331193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:23.331621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:23.332302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:23.332771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:23.333192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:23.463175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:23.471322 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c78bf0f8-213d-4234-bf50-62db504cf578 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.152663 Oct 31 16:15:23.471888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3380/6633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:23 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:24.496007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:24.496767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:24.502965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:24.503467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:24.503921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:24.504634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:24.505136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:24.505580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:24.641511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:24.649249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-90c3358e-6eba-4f6f-8309-d0da1188deb7 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.158365 Oct 31 16:15:24.649837 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3254/6634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:24 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:25.673215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:25.673826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:25.680130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:25.680609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:25.681071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:25.681753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:25.682271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:25.682726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:25.813534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:25.821291 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-adf76f80-5cdc-4afd-bd9b-c78f9742f35c tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.151913 Oct 31 16:15:25.822134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3381/6635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:25 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:26.844751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:26.845347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:26.852929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:26.853435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:26.854492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:26.855218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:26.855701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:26.856144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:26.987052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:26.995327 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4eedc153-495f-41a4-a03f-95203a8bde4d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.153931 Oct 31 16:15:26.995898 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3255/6636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:26 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:28.019146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:28.019761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:28.027258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:28.027744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:28.028176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:28.028908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:28.029368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:28.029799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:28.162106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:28.170459 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4db14146-7cc1-423a-a2a3-507b48d96be8 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.155172 Oct 31 16:15:28.171228 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3382/6637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:28 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:29.194544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:29.195165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:29.201993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:29.202481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:29.202925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:29.203614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:29.204082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:29.204517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:29.350478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:29.358362 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a6ea4f8-0f2d-402b-9611-8b25df81b55a tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.167743 Oct 31 16:15:29.358942 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3256/6638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:29 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:30.386428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:30.387040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:30.393957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:30.394442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:30.394881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:30.395579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:30.396040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:30.396468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:30.527012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:30.534702 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b70ab6dd-1055-4f34-987b-249b3330ce18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.152886 Oct 31 16:15:30.535273 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3383/6639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:30 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:31.558175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:31.558733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:31.565628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:31.566131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:31.566619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:31.567336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:31.567809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:31.568257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:31.701341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:31.709218 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ade50ca-33fb-48fe-b022-355f0a5d17aa tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.155547 Oct 31 16:15:31.709804 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3257/6640] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:31 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:32.733533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:32.734142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:32.740858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:32.741334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:32.741766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:32.742450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:32.742898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:32.743319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:32.871510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:32.879437 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44e3638d-27ef-43b6-9f8c-8990cafa9236 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.150438 Oct 31 16:15:32.880013 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3384/6641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:32 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:33.902727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:33.903367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:33.910285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:33.910790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:33.911247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:33.911965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:33.912443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:33.912936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:34.044856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:34.052546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-405a9bf4-83e0-4028-8929-94baef2590b0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.153912 Oct 31 16:15:34.053150 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3258/6642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:33 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:35.076062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:35.076646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:35.083596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:35.084081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:35.084523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:35.085254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:35.085752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:35.086183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:35.218931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:35.226616 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38e8d177-ca62-4de7-8de4-55489e2689fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.154660 Oct 31 16:15:35.227189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3385/6643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:35 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:36.250664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:36.251593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:36.258526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:36.259031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:36.259485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:36.260812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:36.261290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:36.261738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:36.388677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:36.396386 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27138a90-3237-4755-a2f0-cefab55747dc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.149637 Oct 31 16:15:36.397001 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3259/6644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:36 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:37.419934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:37.420576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:37.427338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:37.427818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:37.428249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:37.428962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:37.429414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:37.429832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:37.562436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:37.570190 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a0f48d6f-9d25-45fc-a923-11f94807e2fc tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.154290 Oct 31 16:15:37.570763 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3386/6645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:37 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:38.594040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:38.594699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:38.601633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:38.602176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:38.602608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:38.603301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:38.603810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:38.604414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:38.735347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:38.743056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f67b4b75-5782-440e-8ec9-ae84fb620ac3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.152886 Oct 31 16:15:38.743640 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3260/6646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:38 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:39.766735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:39.767403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:39.774494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:39.774980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:39.775417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:39.776749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:39.777217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:39.777646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:39.909877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:39.917632 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a90249dc-b360-43be-aa9b-780335a5d013 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.154789 Oct 31 16:15:39.918199 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3387/6647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:39 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:40.940866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:40.941511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:40.948920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:40.949415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:40.949860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:40.950556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:40.951022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:40.951460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:41.078964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:41.086553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b47513ea-e4ec-4414-aa68-b1ccba9007fd tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.149575 Oct 31 16:15:41.087159 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3261/6648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:40 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:42.109732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:42.110334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:42.117090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:42.117566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:42.117994 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:42.118678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:42.119132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:42.120091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:42.248063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:42.256005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95f1c27a-8897-409b-ae08-5d7c9ade128b tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.150075 Oct 31 16:15:42.256584 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3388/6649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:42 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:43.279467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:43.280097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:43.287402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:43.287897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:43.288346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:43.289077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:43.289553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:43.289992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:43.422249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:43.430009 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-49cdca09-62e7-4d1d-9a6f-9341ffb58afb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.154474 Oct 31 16:15:43.430530 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3262/6650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:43 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:44.453438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:44.453958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:44.460815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:44.461303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:44.461775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:44.462467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:44.462969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:44.463464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:44.598462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:44.606016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6334c82c-1790-4c3d-953c-04034086e746 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1515 microversion: 2.1 time: 0.156523 Oct 31 16:15:44.606600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3389/6651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:44 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:45.629765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:45.630519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:45.633494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=32 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:45.639176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.639690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.640449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.641200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.641672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.642109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.645465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:45.670998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c88e1d-8ac2-4d87-ac52-709cc59e35f9", "name": "network-vif-unplugged", "status": "completed", "tag": "2ea2acf2-edf9-4114-ae0e-d7b1f45281b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:45.682257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.682978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.684148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.696933 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] Creating event network-vif-unplugged:2ea2acf2-edf9-4114-ae0e-d7b1f45281b3 for instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 on n-h2-858383-17 Oct 31 16:15:45.703070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:15:45.714271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-00a568e9-5fb6-4620-9159-d11076f1e54f req-764691d7-c7d6-4267-95f9-7e68b0fa6622 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048487 Oct 31 16:15:45.714891 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3390/6652] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:15:45.880514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:45.888528 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-32a5be87-e80d-4dd8-a45f-7ef3bab6396d tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1514 microversion: 2.1 time: 0.262990 Oct 31 16:15:45.889137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3263/6653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:45 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:15:46.912948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:46.913654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:46.915635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:46.921594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:46.922084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:46.922521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:46.923214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:46.923677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:46.924102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:46.926871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=90 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:47.059034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:47.066832 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e511d5d8-26d0-4df6-9348-0110f88a28eb tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1512 microversion: 2.1 time: 0.159128 Oct 31 16:15:47.067415 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3391/6654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:46 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:47.730000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c88e1d-8ac2-4d87-ac52-709cc59e35f9", "tag": "2ea2acf2-edf9-4114-ae0e-d7b1f45281b3"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:47.740257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:47.740848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:47.741298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:47.753131 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] Creating event network-changed:2ea2acf2-edf9-4114-ae0e-d7b1f45281b3 for instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 on n-h2-858383-17 Oct 31 16:15:47.758365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:15:47.769452 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c7f5b960-ef6a-4816-b047-bf8d30b37c97 req-9fd472f4-bafa-4d4f-b681-3c20840fa9fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043145 Oct 31 16:15:47.770047 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3264/6655] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:48.090742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:48.091364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:48.098254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.098747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.099184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.099977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.100340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.100808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.413321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:48.421637 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc0b4073-821d-4d23-b192-b8081786ace0 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1509 microversion: 2.1 time: 0.335431 Oct 31 16:15:48.422210 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3392/6656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:48 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:48.446638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:48.447252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:48.453722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.454224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.454680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.455419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.456074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.456520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.482781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:15:48.534072 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.compute.api [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Found an unconfirmed migration during delete, id: 16, status: finished Oct 31 16:15:50.131693 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-967a6db7-20a9-4cbe-9fc4-4616aaa54470 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 204 len: 0 microversion: 2.1 time: 1.689625 Oct 31 16:15:50.132558 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3265/6657] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:15:48 2022] DELETE /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 0 bytes in 1692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:15:50.141179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:50.141790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:50.150864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:50.151352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:50.152420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:50.153223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:50.153597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:50.154018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:50.283652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:50.291429 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7ae16f1-2131-4cc3-97c9-3fcc98d0ea18 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1501 microversion: 2.1 time: 0.154232 Oct 31 16:15:50.292002 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3393/6658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:50 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:15:51.315558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:51.316306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:51.327037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.327538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.327985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.328690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.329181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.329616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.485473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-513d0b15-da5b-40ae-a75d-e9ae20e34de6 req-630cdb2a-9035-40ae-ad32-6782b48946e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c88e1d-8ac2-4d87-ac52-709cc59e35f9", "name": "network-vif-plugged", "status": "completed", "tag": "2ea2acf2-edf9-4114-ae0e-d7b1f45281b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:51.496675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-513d0b15-da5b-40ae-a75d-e9ae20e34de6 req-630cdb2a-9035-40ae-ad32-6782b48946e9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.497418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-513d0b15-da5b-40ae-a75d-e9ae20e34de6 req-630cdb2a-9035-40ae-ad32-6782b48946e9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.498182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-513d0b15-da5b-40ae-a75d-e9ae20e34de6 req-630cdb2a-9035-40ae-ad32-6782b48946e9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.510413 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-513d0b15-da5b-40ae-a75d-e9ae20e34de6 req-630cdb2a-9035-40ae-ad32-6782b48946e9 service nova] Creating event network-vif-plugged:2ea2acf2-edf9-4114-ae0e-d7b1f45281b3 for instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 on n-h2-858383-17 Oct 31 16:15:51.515758 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-513d0b15-da5b-40ae-a75d-e9ae20e34de6 req-630cdb2a-9035-40ae-ad32-6782b48946e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 Oct 31 16:15:51.516360 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3394/6659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:15:51.538976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bf1b056e2f4b47a2fac5f61a00b33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ae0322dc294380be20eeb5e38e96cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:51.547645 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b120dfad-eb2b-4dd8-8da3-7b67f1b13870 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 200 len: 1501 microversion: 2.1 time: 0.236331 Oct 31 16:15:51.548228 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3266/6660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:51 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 1501 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:51.892755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d626d7b0-acae-4714-9474-03695ea1d298 req-2fa242b3-0289-4281-9d8d-ee8c40f75379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c88e1d-8ac2-4d87-ac52-709cc59e35f9", "name": "network-vif-deleted", "tag": "2ea2acf2-edf9-4114-ae0e-d7b1f45281b3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:51.906096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626d7b0-acae-4714-9474-03695ea1d298 req-2fa242b3-0289-4281-9d8d-ee8c40f75379 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.906574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626d7b0-acae-4714-9474-03695ea1d298 req-2fa242b3-0289-4281-9d8d-ee8c40f75379 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.907021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626d7b0-acae-4714-9474-03695ea1d298 req-2fa242b3-0289-4281-9d8d-ee8c40f75379 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.924680 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d626d7b0-acae-4714-9474-03695ea1d298 req-2fa242b3-0289-4281-9d8d-ee8c40f75379 service nova] Creating event network-vif-deleted:2ea2acf2-edf9-4114-ae0e-d7b1f45281b3 for instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 on n-h2-858383-17 Oct 31 16:15:51.929686 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d626d7b0-acae-4714-9474-03695ea1d298 req-2fa242b3-0289-4281-9d8d-ee8c40f75379 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041206 Oct 31 16:15:51.930294 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3395/6661] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:52.571662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:52.572250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:52.580080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.580585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.581092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.581801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.582280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.582728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.596378 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] HTTP exception thrown: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Request method failure captured: Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 HTTP/1.1 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_SITlZM7d3dlA6-kpYOrPGkVezOsjWZ48jwZexvyRY_rU60FqpnKzvYGFOIMmPLvm9IHYyGKekWJkNlHpfVOZMb2i3rWBiHU6CkTIQdwM7UhYYJasCZJqE_WZlAZVtJ-W290PpdfZDEyzXCLsTEDqIL_XNsgc3Jsnm_8senMyWMQ1k Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: f4ae0322dc294380be20eeb5e38e96cb Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: f4ae0322dc294380be20eeb5e38e96cb Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1182977029-project Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 17bf1b056e2f4b47a2fac5f61a00b33c Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1182977029-project Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '20c88e1d-8ac2-4d87-ac52-709cc59e35f9'} Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:15:52.598089 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Returning 404 to user: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4224e1bc-9738-4a0b-8401-a4c1f8c46b00 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 404 len: 111 microversion: 2.1 time: 0.031904 Oct 31 16:15:52.602261 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3267/6662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:52 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:15:52.618261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:52.618850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:52.625692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.626417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.626863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.627550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.628009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.628434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.643814 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] HTTP exception thrown: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Request method failure captured: Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 HTTP/1.1 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_SITlZM7d3dlA6-kpYOrPGkVezOsjWZ48jwZexvyRY_rU60FqpnKzvYGFOIMmPLvm9IHYyGKekWJkNlHpfVOZMb2i3rWBiHU6CkTIQdwM7UhYYJasCZJqE_WZlAZVtJ-W290PpdfZDEyzXCLsTEDqIL_XNsgc3Jsnm_8senMyWMQ1k Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: f4ae0322dc294380be20eeb5e38e96cb Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: f4ae0322dc294380be20eeb5e38e96cb Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-1182977029-project Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 17bf1b056e2f4b47a2fac5f61a00b33c Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-1182977029-project Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '20c88e1d-8ac2-4d87-ac52-709cc59e35f9'} Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:15:52.645478 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Returning 404 to user: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-feb2778a-99a9-481c-89ba-a5207eb1c063 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 404 len: 111 microversion: 2.1 time: 0.033741 Oct 31 16:15:52.649819 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3396/6663] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:15:52 2022] DELETE /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:15:52.655530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:52.656166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] [instance: 20c88e1d-8ac2-4d87-ac52-709cc59e35f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:52.662143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.662643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.663098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.663809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.664291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.664764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.678034 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] HTTP exception thrown: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Request method failure captured: Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 HTTP/1.1 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_SITlZM7d3dlA6-kpYOrPGkVezOsjWZ48jwZexvyRY_rU60FqpnKzvYGFOIMmPLvm9IHYyGKekWJkNlHpfVOZMb2i3rWBiHU6CkTIQdwM7UhYYJasCZJqE_WZlAZVtJ-W290PpdfZDEyzXCLsTEDqIL_XNsgc3Jsnm_8senMyWMQ1k Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: f4ae0322dc294380be20eeb5e38e96cb Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f4ae0322dc294380be20eeb5e38e96cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: f4ae0322dc294380be20eeb5e38e96cb Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182977029 Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-DeleteServersTestJSON-1182977029-project Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 17bf1b056e2f4b47a2fac5f61a00b33c Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-DeleteServersTestJSON-1182977029-project Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '20c88e1d-8ac2-4d87-ac52-709cc59e35f9'} Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:15:52.679592 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] Returning 404 to user: Instance 20c88e1d-8ac2-4d87-ac52-709cc59e35f9 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b0bbc77-12c4-4207-864b-c66700014aa3 tempest-DeleteServersTestJSON-1182977029 tempest-DeleteServersTestJSON-1182977029-project] 10.222.0.48 "GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9" status: 404 len: 111 microversion: 2.1 time: 0.029583 Oct 31 16:15:52.684052 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3268/6664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:52 2022] GET /compute/v2.1/servers/20c88e1d-8ac2-4d87-ac52-709cc59e35f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:16:01.616400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1554307912", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "1c6ae3b3-79ce-4859-b1fc-51f8a478c9be"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:01.672878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] validate_networks() for [('1c6ae3b3-79ce-4859-b1fc-51f8a478c9be', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:16:02.074772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:16:02.075228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:16:02.075709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:16:02.076123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:16:02.076537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:16:02.086021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:02.086515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:02.086956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:02.087715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:02.088196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:02.088625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:02.110795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Getting quotas for project d5adf91d66c64bc987bbe820738e60ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:16:02.116605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Getting quotas for user 756f94b9a7a14c59821f0ba298609d83 and project d5adf91d66c64bc987bbe820738e60ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:16:02.130126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:16:02.132442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:16:02.184959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-835f6755-f1ca-4127-b069-eca84d111521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712975 Oct 31 16:16:02.185719 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3397/6665] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:16:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:16:02.197082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c6eb9c34-cf45-44ca-83d2-66767da92332 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:02.197729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c6eb9c34-cf45-44ca-83d2-66767da92332 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:02.269094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c6eb9c34-cf45-44ca-83d2-66767da92332 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:02.276560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c6eb9c34-cf45-44ca-83d2-66767da92332 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1218 microversion: 2.1 time: 0.083247 Oct 31 16:16:02.277420 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3269/6666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:02 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:03.300793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:03.301645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:03.308386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:03.308993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:03.309436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:03.310170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:03.310809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:03.311243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:03.388049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:03.398455 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e61d41e7-afd5-4725-8bde-d519529a878f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1270 microversion: 2.1 time: 0.102918 Oct 31 16:16:03.400052 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3398/6667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:03 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:04.423649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:04.425481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:04.427884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:04.445813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:04.446747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:04.447379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:04.448903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:04.449582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:04.450192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:04.728734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:04.737883 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-269c6a5e-7334-4e0d-8d2a-e0b9508e8c7b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1318 microversion: 2.1 time: 0.318554 Oct 31 16:16:04.756333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3270/6668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:04 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:04.852394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b5080201-f81a-40b4-b84e-11973520f5f4 req-e500fe77-0e82-4f7e-b55a-664bdbf686b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f965820b-4ca8-4486-a355-a24af93ea45e", "tag": "56a8cc5f-0438-47de-a94e-3f4be31e2d54"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:04.880685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b5080201-f81a-40b4-b84e-11973520f5f4 req-e500fe77-0e82-4f7e-b55a-664bdbf686b1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:04.881187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b5080201-f81a-40b4-b84e-11973520f5f4 req-e500fe77-0e82-4f7e-b55a-664bdbf686b1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:04.881867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b5080201-f81a-40b4-b84e-11973520f5f4 req-e500fe77-0e82-4f7e-b55a-664bdbf686b1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:04.894932 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b5080201-f81a-40b4-b84e-11973520f5f4 req-e500fe77-0e82-4f7e-b55a-664bdbf686b1 service nova] Creating event network-changed:56a8cc5f-0438-47de-a94e-3f4be31e2d54 for instance f965820b-4ca8-4486-a355-a24af93ea45e on n-h2-858383-17 Oct 31 16:16:04.906345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b5080201-f81a-40b4-b84e-11973520f5f4 req-e500fe77-0e82-4f7e-b55a-664bdbf686b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057308 Oct 31 16:16:04.907149 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3399/6669] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:05.763749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:05.764276 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:05.771115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:05.771608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:05.772056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:05.772788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:05.773256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:05.773692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:05.900910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:05.908734 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a96453b6-53ce-41c9-a9d9-05d94adcfc53 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1318 microversion: 2.1 time: 0.149064 Oct 31 16:16:05.909392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3271/6670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:05 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:06.934004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:06.934716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:06.940998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:06.941487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:06.941926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:06.942619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:06.943080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:06.943511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:07.078476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:07.086363 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed0055f3-134e-4e50-bff8-fff4ad358e5d tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1318 microversion: 2.1 time: 0.157709 Oct 31 16:16:07.087055 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3400/6671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:06 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:08.110034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:08.110670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:08.117539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:08.118503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:08.118956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:08.119662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:08.120344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:08.120823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:08.248136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:08.256113 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e1dfd427-b9f7-4df0-ace4-de167c35c4a1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1318 microversion: 2.1 time: 0.149921 Oct 31 16:16:08.256630 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3272/6672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:08 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:09.279248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:09.279868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:09.286897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:09.287380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:09.287811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:09.288495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:09.288976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:09.289397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:09.419694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:09.427637 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d4a600f-e42b-4244-a7aa-2a3d954d03d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1318 microversion: 2.1 time: 0.152852 Oct 31 16:16:09.428517 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3401/6673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:09 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:09.542775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c21034ae-e7a3-426b-9cb2-432249cec64f req-7844f175-60d5-4188-8094-b195698a0a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965820b-4ca8-4486-a355-a24af93ea45e", "name": "network-vif-plugged", "status": "completed", "tag": "56a8cc5f-0438-47de-a94e-3f4be31e2d54"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:09.553237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c21034ae-e7a3-426b-9cb2-432249cec64f req-7844f175-60d5-4188-8094-b195698a0a1a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:09.553728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c21034ae-e7a3-426b-9cb2-432249cec64f req-7844f175-60d5-4188-8094-b195698a0a1a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:09.554241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c21034ae-e7a3-426b-9cb2-432249cec64f req-7844f175-60d5-4188-8094-b195698a0a1a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:09.566643 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c21034ae-e7a3-426b-9cb2-432249cec64f req-7844f175-60d5-4188-8094-b195698a0a1a service nova] Creating event network-vif-plugged:56a8cc5f-0438-47de-a94e-3f4be31e2d54 for instance f965820b-4ca8-4486-a355-a24af93ea45e on n-h2-858383-17 Oct 31 16:16:09.571617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c21034ae-e7a3-426b-9cb2-432249cec64f req-7844f175-60d5-4188-8094-b195698a0a1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Oct 31 16:16:09.572372 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3273/6674] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:10.453067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:10.453622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:10.460342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:10.460866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:10.461297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:10.461982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:10.462868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:10.464643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:10.593544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:10.601151 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5d0b37ec-61f7-4170-92d6-d6837bcc9985 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1318 microversion: 2.1 time: 0.152217 Oct 31 16:16:10.601730 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3402/6675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:10 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:11.626073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:11.627060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:11.633219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:11.633718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:11.634170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:11.634871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:11.635346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:11.635785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:11.771277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:11.779749 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f7160b89-ef1c-4d88-b957-333c9ada9239 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1509 microversion: 2.1 time: 0.158916 Oct 31 16:16:11.780329 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3274/6676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:11 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:11.801944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:11.802554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:11.809590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:11.810072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:11.810500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:11.811182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:11.811637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:11.812058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:11.937346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:11.945040 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c442a660-2b1b-48ca-b774-0a36309badcc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1509 microversion: 2.1 time: 0.146955 Oct 31 16:16:11.945618 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3403/6677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:11 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:11.968374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:11.970882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:11.976907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:11.977401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:11.977841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:11.978533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:11.978997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:11.979429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.041955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57c65a7c-7aac-46ed-8567-1bd04b87b2c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "PUT /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1081 microversion: 2.1 time: 0.077954 Oct 31 16:16:12.042502 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3275/6678] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Oct 31 16:16:11 2022] PUT /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1081 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:12.061758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:12.062375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:12.068307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.068828 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.069271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.069965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.070422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.070849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.096618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:12.123818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:12.206364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:12.214393 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30b4da69-c9cb-418e-9b5a-1acfe39cb521 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1507 microversion: 2.1 time: 0.157130 Oct 31 16:16:12.215264 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3404/6679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:12 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:12.236179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:12.236840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:12.242904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.243399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.243851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.244553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.245049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.245492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.275985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:12.376015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:12.384012 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8ca5abc4-eeb5-41a7-8c8d-52ef913c6bab tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1507 microversion: 2.1 time: 0.151669 Oct 31 16:16:12.384586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3276/6680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:12 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:12.406606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:12.409147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:12.415076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.415558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.415995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.416682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.417167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.417630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.491044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:12.497024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:16:12.503698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:16:12.504123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:16:12.504595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:16:12.505031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:16:12.505444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:16:12.614114 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-705de69e-63ba-48e8-983a-92ef94d15d66 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e/action" status: 202 len: 0 microversion: 2.1 time: 0.211634 Oct 31 16:16:12.615007 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3405/6681] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:16:12 2022] POST /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:16:12.624465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:12.625177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:12.632285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.632865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.633247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.633961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.634428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.634864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.787496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:12.797534 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-481033af-d77b-4f88-b005-aed8dd0858d2 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1518 microversion: 2.1 time: 0.177553 Oct 31 16:16:12.798406 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3277/6682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:12 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:13.822045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:13.822564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:13.830160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:13.830709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:13.831146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:13.831844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:13.832301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:13.832750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:14.359075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:14.368380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ac60b27-1a8d-4e30-809f-93ba1e666500 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1518 microversion: 2.1 time: 0.551094 Oct 31 16:16:14.369141 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3406/6683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:13 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1518 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:15.393130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:15.393754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:15.401040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:15.401547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:15.402073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:15.403125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:15.403610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:15.404053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:15.542335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:15.551305 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c113d40a-a37a-4877-a727-b784261f2836 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.162084 Oct 31 16:16:15.551880 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3278/6684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:15 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:16.575279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:16.575898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:16.582727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:16.583210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:16.583645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:16.584338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:16.584820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:16.585249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:16.717838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:16.725627 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8404c0a9-f2d4-4bf8-9951-e2f1a82be7a5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.155001 Oct 31 16:16:16.726191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3407/6685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:16 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:17.749568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:17.750205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:17.753245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:17.758659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:17.759156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:17.759609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:17.760323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:17.760825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:17.761270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:17.893843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:17.901532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0aa82dd-7f70-46b4-8797-8f6337730d18 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.156567 Oct 31 16:16:17.902103 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3279/6686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:17 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:18.924602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:18.925170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:18.927794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:18.933001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:18.933995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:18.934515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:18.935210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:18.935668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:18.936094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:18.939525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:19.065688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:19.073294 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51ec4eec-333d-4e0a-a1ed-4e82d75ffb3e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.152774 Oct 31 16:16:19.074469 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3408/6687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:18 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:20.098533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:20.099163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:20.106190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:20.106694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:20.107149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:20.107863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:20.108341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:20.108821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:20.244404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:20.253005 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8214aed0-0a41-4348-a189-21876b770205 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.158319 Oct 31 16:16:20.253591 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3280/6688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:20 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:21.276113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:21.276744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:21.284140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:21.284615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:21.285073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:21.285758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:21.286216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:21.286638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:21.414196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:21.423047 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42342bee-a070-4ae4-ae2d-027febfa31dd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.150739 Oct 31 16:16:21.423731 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3409/6689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:21 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:22.446138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:22.446659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:22.453666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:22.454162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:22.454611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:22.455309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:22.455779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:22.456217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:22.584005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:22.592224 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03d8c035-8cc1-4b89-8b4d-a051f03ea58a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.150161 Oct 31 16:16:22.592835 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3281/6690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:22 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:23.615493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:23.616139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:23.623169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:23.623651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:23.624090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:23.624812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:23.625276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:23.625701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:23.760581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:23.768954 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4069a32-e330-44a9-bbc2-9d1c7b042d61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.157484 Oct 31 16:16:23.769522 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3410/6691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:23 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:24.794086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:24.794650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:24.800677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:24.801210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:24.801667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:24.802402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:24.802878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:24.803344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:24.931337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:24.938980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3bd281d2-d350-4302-af70-0d97ee6c6046 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.150124 Oct 31 16:16:24.939559 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3282/6692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:24 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:25.961825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:25.962487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:25.969399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:25.969889 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:25.970329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:25.971026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:25.971486 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:25.971917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:26.106397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:26.114185 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-728dadae-fd37-47c6-8991-68d5a38438c6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.156279 Oct 31 16:16:26.114773 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3411/6693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:25 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:27.137620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:27.138249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:27.145120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:27.145553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:27.145996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:27.146717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:27.147188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:27.147622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:27.276674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:27.285042 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-caf2f4ac-6a2d-4851-aac7-7b6d113afda8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.151329 Oct 31 16:16:27.285622 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3283/6694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:27 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:28.308974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:28.309571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:28.316630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:28.317141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:28.317573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:28.318258 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:28.318714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:28.319135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:28.445434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:28.453826 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4a99ebe-ba3d-4b67-ba06-063436f0021e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.148973 Oct 31 16:16:28.454396 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3412/6695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:28 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:29.478145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:29.478684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:29.486728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:29.487234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:29.487688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:29.488404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:29.488910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:29.489355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:29.644511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:29.653270 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc2ac014-fd27-4b1e-90fd-2e371ac55ec6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.179009 Oct 31 16:16:29.654022 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3284/6696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:29 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:30.677622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:30.678239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:30.686650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:30.687139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:30.687572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:30.688262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:30.688745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:30.689177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:30.819692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:30.827726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08728d89-d753-40a8-909d-a9deec64157c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.154023 Oct 31 16:16:30.828309 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3413/6697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:30 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:31.851746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:31.852367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:31.859888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:31.860383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:31.861016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:31.861718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:31.862183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:31.862622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:31.995427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:32.004000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-af198ed4-263e-4d50-90f4-84a5d4ae9bbf tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.156121 Oct 31 16:16:32.004582 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3285/6698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:31 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:33.027860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:33.028391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:33.035237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:33.035725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:33.036166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:33.036893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:33.037356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:33.037786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:33.166065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:33.174112 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5914ffd-5af8-43e2-a353-df251b8d7c61 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.150438 Oct 31 16:16:33.174689 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3414/6699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:33 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:34.198295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:34.199091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:34.206002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.206496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.206943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.207645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.208119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.208560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.228128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:34.345110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:34.352789 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22d89c07-8504-4d63-a898-79963bcbd973 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.158464 Oct 31 16:16:34.353360 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3286/6700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:34 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:35.376983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:35.377639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:35.384679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:35.385188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:35.385619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:35.386988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:35.387462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:35.388002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:35.514902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:35.522526 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08a5695d-d5e1-49fc-8361-314e23cf3f29 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.149714 Oct 31 16:16:35.523124 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3415/6701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:35 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:36.547270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:36.547910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:36.554890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:36.555482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:36.555929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:36.556630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:36.557140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:36.557563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:36.691457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:36.699287 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f2deea6d-225f-490f-a914-6276352f3034 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.157207 Oct 31 16:16:36.699865 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3287/6702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:36 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:37.722121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:37.722728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:37.729680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:37.730846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:37.731447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:37.732146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:37.732613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:37.733112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:37.867228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:37.874991 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26f5c1da-9841-4044-a1f5-f349e42f2bc6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.156785 Oct 31 16:16:37.875569 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3416/6703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:37 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:38.899119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:38.899748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:38.906644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:38.907134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:38.907582 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:38.908305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:38.908819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:38.909243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:39.039845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:39.048584 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fca26de5-429a-4ede-b645-838afb47f952 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.153427 Oct 31 16:16:39.049612 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3288/6704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:38 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:40.071558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:40.072174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:40.079827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:40.080312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:40.080781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:40.081477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:40.081937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:40.082364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:40.216625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:40.224477 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a1b0b20d-49a8-41b2-bb7c-d1120962c743 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.156806 Oct 31 16:16:40.225089 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3417/6705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:40 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:41.248459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:41.249116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:41.256285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:41.256816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:41.257274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:41.257980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:41.258450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:41.258929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:41.387026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:41.395436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-70a6cdce-0f59-461b-9eaa-0ba5f6c78b47 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.151462 Oct 31 16:16:41.396304 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3289/6706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:41 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:42.418730 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:42.419368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:42.426261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:42.426695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:42.427133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:42.427829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:42.428292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:42.428747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:42.557940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:42.565830 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65e4042a-6fab-4256-b663-1bf1e437facb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.151124 Oct 31 16:16:42.566408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3418/6707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:42 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:43.589359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:43.589885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:43.597236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:43.597730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:43.598179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:43.598879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:43.599347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:43.599781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:43.733186 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:43.740837 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-096fba0a-d5b9-4015-9c95-afd8c0f8d6f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.155446 Oct 31 16:16:43.741417 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3290/6708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:43 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:44.763990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:44.764532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:44.771360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:44.771844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:44.772268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:44.772976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:44.773428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:44.773845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:44.904930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:44.912610 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6148ff06-e64d-48b7-8c84-675f4ceda2f0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.153144 Oct 31 16:16:44.913226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3419/6709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:44 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:45.935379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:45.936006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:45.942944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:45.943440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:45.943890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:45.944595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:45.945102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:45.945548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:46.078566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:46.086283 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f6834ec-1826-4298-9487-94479b1dbf0e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1523 microversion: 2.1 time: 0.155363 Oct 31 16:16:46.086854 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3291/6710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:45 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:47.110013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:47.110668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:47.117538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:47.118013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:47.118437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:47.119115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:47.119565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:47.119981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:47.318967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:47.327734 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d821bb2f-b824-407a-af4a-e4a075de101c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1522 microversion: 2.1 time: 0.222079 Oct 31 16:16:47.328328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3420/6711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:47 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:47.331293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965820b-4ca8-4486-a355-a24af93ea45e", "name": "network-vif-unplugged", "status": "completed", "tag": "56a8cc5f-0438-47de-a94e-3f4be31e2d54"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:47.344911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:47.345480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:47.345925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:47.359555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] Creating event network-vif-unplugged:56a8cc5f-0438-47de-a94e-3f4be31e2d54 for instance f965820b-4ca8-4486-a355-a24af93ea45e on n-h1-858383-17 Oct 31 16:16:47.364947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] Instance f965820b-4ca8-4486-a355-a24af93ea45e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:16:47.376330 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-668fd55c-7b67-4b44-97eb-97f4746cfc5e req-3b0b528a-967e-424d-865c-be2f6e1d10ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050577 Oct 31 16:16:47.377236 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3292/6712] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:16:48.352725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:48.353264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:48.360078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:48.360555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:48.361020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:48.361703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:48.362155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:48.362576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:48.493045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:48.501048 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62aaa12c-9d8f-4147-a0d8-c1771d173358 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1520 microversion: 2.1 time: 0.152379 Oct 31 16:16:48.501622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3421/6713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:48 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:49.395266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f965820b-4ca8-4486-a355-a24af93ea45e", "tag": "56a8cc5f-0438-47de-a94e-3f4be31e2d54"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:49.400051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=28 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:49.406765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:49.407236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:49.407674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:49.419056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] Creating event network-changed:56a8cc5f-0438-47de-a94e-3f4be31e2d54 for instance f965820b-4ca8-4486-a355-a24af93ea45e on n-h1-858383-17 Oct 31 16:16:49.424304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] Instance f965820b-4ca8-4486-a355-a24af93ea45e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:16:49.434669 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-86cc8dc6-ae1f-46d1-a8f7-9663deba142f req-05b5dac9-80ca-4887-b746-346fef0a4b41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044294 Oct 31 16:16:49.435237 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3293/6714] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:49.524864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:49.525512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:49.528534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:49.534312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:49.535435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:49.535888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:49.536602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:49.537094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:49.537527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:49.540270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=84 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:49.765672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:49.773319 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-587b5292-f319-406f-83c4-04a360ef1bf6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1520 microversion: 2.1 time: 0.252406 Oct 31 16:16:49.773898 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3422/6715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:49 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:50.798680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:50.800385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:50.806514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:50.807023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:50.807493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:50.808198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:50.808675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:50.809221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:50.988615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:50.997201 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-93a29b8e-588f-4490-84a1-92cf09d576b1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1520 microversion: 2.1 time: 0.203501 Oct 31 16:16:50.998180 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3294/6716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:50 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:52.022353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:52.022990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:52.030479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.030958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.031386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.032072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.032524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.032975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.166484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:52.175961 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6dcb91c-233f-4a17-a067-d93ce6628489 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1517 microversion: 2.1 time: 0.157428 Oct 31 16:16:52.176552 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3423/6717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:52 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:52.199668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:52.200287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:52.207293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.207798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.208251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.208988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.209464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.210094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.271998 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-012a6df5-969c-4d9c-9b17-a74fbd52889a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e/action" status: 204 len: 0 microversion: 2.1 time: 0.075799 Oct 31 16:16:52.272737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3295/6718] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:16:52 2022] POST /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:16:52.288725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:52.289434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:52.296236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.296841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.297407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.298110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.298563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.298983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.507554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:52.515338 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3121a77-eca4-4e8c-b881-180b9dbe1f08 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1517 microversion: 2.1 time: 0.238375 Oct 31 16:16:52.515915 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3424/6719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:52 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1517 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:53.088683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965820b-4ca8-4486-a355-a24af93ea45e", "name": "network-vif-plugged", "status": "completed", "tag": "56a8cc5f-0438-47de-a94e-3f4be31e2d54"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:53.100056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.111381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.111876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.126068 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] Creating event network-vif-plugged:56a8cc5f-0438-47de-a94e-3f4be31e2d54 for instance f965820b-4ca8-4486-a355-a24af93ea45e on n-h1-858383-17 Oct 31 16:16:53.132399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] Instance f965820b-4ca8-4486-a355-a24af93ea45e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:16:53.145138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f25b0736-257e-4305-b192-f9b9b78f4d64 req-735f49d0-db32-4e64-b681-14ae03e19b6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061006 Oct 31 16:16:53.146109 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3296/6720] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:16:53.538635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:53.539248 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:53.547364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.548133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.548601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.549865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.550467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.551045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.690362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:53.698417 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-573ba908-617e-4417-b99d-b813bbb7299f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1509 microversion: 2.1 time: 0.163552 Oct 31 16:16:53.699111 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3425/6721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:53 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:53.722716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:53.723441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:53.729779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.730278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.731314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.732053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.732517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.732974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.860371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:53.868080 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-004ffa3a-0aa7-4f18-a67f-78be5987ff5f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1509 microversion: 2.1 time: 0.150541 Oct 31 16:16:53.868660 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3297/6722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:53 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:53.894056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71666f47-04f6-429c-95b5-acb0ef541c12 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'create', calling method: .version_select at 0x7f5ca14a0040>, body: {"keypair": {"name": "tempest-keypair-1378072070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9GLFL6fX6epyKYrTDkBNAP0Q6uxzNEbg11pyi2CAnWUeYgQoLt4IByYAMHvQfgHpPh788qoJOHK3ibnNWBRvdKgPoG2NrClArgMY/JMsgUnl8dR6beTiffbM3K7xhfPA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:53.909039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-71666f47-04f6-429c-95b5-acb0ef541c12 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Getting quotas for project d5adf91d66c64bc987bbe820738e60ef. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:16:53.914188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-71666f47-04f6-429c-95b5-acb0ef541c12 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Getting quotas for user 756f94b9a7a14c59821f0ba298609d83 and project d5adf91d66c64bc987bbe820738e60ef. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:16:53.941929 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71666f47-04f6-429c-95b5-acb0ef541c12 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051652 Oct 31 16:16:53.942542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3426/6723] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:16:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:55.100262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:55.100927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:55.107373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:55.107875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:55.108354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:55.109092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:55.109566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:55.110019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:55.541925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:55.550855 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76576fc4-ebc3-4058-894a-f676ecc76d56 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 200 len: 1509 microversion: 2.1 time: 0.454488 Oct 31 16:16:55.551450 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3298/6724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:55 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:55.573536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:55.574028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:55.845428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:55.845837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:55.846264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:55.846972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:55.847422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:55.847840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:55.873432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:16:55.945931 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fd0ddcf-755c-427f-a01c-0cc8b4084d25 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 204 len: 0 microversion: 2.1 time: 0.376811 Oct 31 16:16:55.946548 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3427/6725] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:16:55 2022] DELETE /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:16:56.005406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1302072075", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "1c6ae3b3-79ce-4859-b1fc-51f8a478c9be"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:56.059072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] validate_networks() for [('1c6ae3b3-79ce-4859-b1fc-51f8a478c9be', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:16:56.430950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:16:56.431530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:16:56.431902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:16:56.432330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:16:56.432795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:16:56.442632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:56.443130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:56.443586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:56.444327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:56.444929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:56.445375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:56.462852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Getting quotas for project d5adf91d66c64bc987bbe820738e60ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:16:56.468200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Getting quotas for user 756f94b9a7a14c59821f0ba298609d83 and project d5adf91d66c64bc987bbe820738e60ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:16:56.480463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:16:56.482836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:16:56.531195 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d8e72ff5-f551-48a4-a8a7-335bf1088e59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529938 Oct 31 16:16:56.531857 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3299/6726] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:16:56.543792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d36e5a4f-4ac1-4f77-ac24-bb6dc3e3e01c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:56.544658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d36e5a4f-4ac1-4f77-ac24-bb6dc3e3e01c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:56.598526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d36e5a4f-4ac1-4f77-ac24-bb6dc3e3e01c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:56.607358 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d36e5a4f-4ac1-4f77-ac24-bb6dc3e3e01c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1218 microversion: 2.1 time: 0.067602 Oct 31 16:16:56.607935 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3428/6727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:56 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:57.631591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:57.632342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:57.640279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:57.640714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:57.641162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:57.641871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:57.642338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:57.642776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:57.713134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:57.721816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-996412a8-2d6d-439d-a8ce-e719d3c099fb tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1270 microversion: 2.1 time: 0.095340 Oct 31 16:16:57.732775 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3300/6728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:57 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:58.017512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-96132840-45ef-425c-82d4-42d4323b2cb1 req-31924765-fb7e-4e27-bf86-1d4f8f2f8ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f965820b-4ca8-4486-a355-a24af93ea45e", "name": "network-vif-deleted", "tag": "56a8cc5f-0438-47de-a94e-3f4be31e2d54"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:58.028603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-96132840-45ef-425c-82d4-42d4323b2cb1 req-31924765-fb7e-4e27-bf86-1d4f8f2f8ca3 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:58.029104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-96132840-45ef-425c-82d4-42d4323b2cb1 req-31924765-fb7e-4e27-bf86-1d4f8f2f8ca3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:58.029533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-96132840-45ef-425c-82d4-42d4323b2cb1 req-31924765-fb7e-4e27-bf86-1d4f8f2f8ca3 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:58.040924 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-96132840-45ef-425c-82d4-42d4323b2cb1 req-31924765-fb7e-4e27-bf86-1d4f8f2f8ca3 service nova] Creating event network-vif-deleted:56a8cc5f-0438-47de-a94e-3f4be31e2d54 for instance f965820b-4ca8-4486-a355-a24af93ea45e on n-h1-858383-17 Oct 31 16:16:58.046497 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-96132840-45ef-425c-82d4-42d4323b2cb1 req-31924765-fb7e-4e27-bf86-1d4f8f2f8ca3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Oct 31 16:16:58.047091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3429/6729] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:58.745760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:58.747872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:58.755804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:58.756321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:58.756797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:58.757765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:58.758244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:58.758688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:59.018138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:59.026251 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-97643919-970f-4db5-8042-6be7eab859d6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.284347 Oct 31 16:16:59.026759 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3301/6730] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:58 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:00.049348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:00.050078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:00.057345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:00.057841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:00.058278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:00.059810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:00.060438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:00.060905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-77c93d66-4bb5-485b-b63a-581d8ef92c70 req-f1a3a2d0-3e57-40a2-ad39-452668a54916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58005c7c-2d80-48d6-97d4-62c7af2eace7", "tag": "e02a2cc6-cc5f-4a0d-939a-a48e828730f9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:00.061339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:00.071208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-77c93d66-4bb5-485b-b63a-581d8ef92c70 req-f1a3a2d0-3e57-40a2-ad39-452668a54916 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:00.071703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-77c93d66-4bb5-485b-b63a-581d8ef92c70 req-f1a3a2d0-3e57-40a2-ad39-452668a54916 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:00.072155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-77c93d66-4bb5-485b-b63a-581d8ef92c70 req-f1a3a2d0-3e57-40a2-ad39-452668a54916 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:00.083898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-77c93d66-4bb5-485b-b63a-581d8ef92c70 req-f1a3a2d0-3e57-40a2-ad39-452668a54916 service nova] Creating event network-changed:e02a2cc6-cc5f-4a0d-939a-a48e828730f9 for instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 on n-h1-858383-17 Oct 31 16:17:00.089063 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-77c93d66-4bb5-485b-b63a-581d8ef92c70 req-f1a3a2d0-3e57-40a2-ad39-452668a54916 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032407 Oct 31 16:17:00.089598 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3302/6731] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:17:00.197640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:00.206002 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b81b67ff-4399-45e0-8a4d-2d0dfaf3e675 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.160948 Oct 31 16:17:00.206565 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3430/6732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:00 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:01.231335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:01.231974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:01.238113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:01.238605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:01.239053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:01.239745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:01.240211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:01.240641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:01.368406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:01.376553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d458ff4d-6fb2-4521-bf41-9cc16dd3bdf8 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.150933 Oct 31 16:17:01.377416 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3303/6733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:01 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:02.399650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:02.400292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:02.407587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:02.408074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:02.408513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:02.409249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:02.409714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:02.410145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:02.538986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:02.547647 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48696a09-d888-497d-9054-ef94b2bc41f6 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.151906 Oct 31 16:17:02.548222 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3431/6734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:02 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:03.570388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:03.571040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:03.578620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:03.579115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:03.579567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:03.580274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:03.580765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:03.581209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:03.596669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:03.719341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:03.726973 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-76d09472-6bf9-4ee8-8f94-5fe10d50e016 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.160527 Oct 31 16:17:03.727547 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3304/6735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:03 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:04.750369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:04.750988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:04.758175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:04.758660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:04.759096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:04.759788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:04.760246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:04.760673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:04.889675 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:04.897326 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77d6e2c7-b993-4c8e-999d-c92a985eb07f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.150954 Oct 31 16:17:04.897898 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3432/6736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:04 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:05.118663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-71efc0d0-680a-4d7c-874a-75f4c63379fb req-9b3a6dac-e4cd-4d38-98ff-dcd19e3a7fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58005c7c-2d80-48d6-97d4-62c7af2eace7", "name": "network-vif-plugged", "status": "completed", "tag": "e02a2cc6-cc5f-4a0d-939a-a48e828730f9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:05.131803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-71efc0d0-680a-4d7c-874a-75f4c63379fb req-9b3a6dac-e4cd-4d38-98ff-dcd19e3a7fcd service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:05.132299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-71efc0d0-680a-4d7c-874a-75f4c63379fb req-9b3a6dac-e4cd-4d38-98ff-dcd19e3a7fcd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:05.132760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-71efc0d0-680a-4d7c-874a-75f4c63379fb req-9b3a6dac-e4cd-4d38-98ff-dcd19e3a7fcd service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:05.144376 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-71efc0d0-680a-4d7c-874a-75f4c63379fb req-9b3a6dac-e4cd-4d38-98ff-dcd19e3a7fcd service nova] Creating event network-vif-plugged:e02a2cc6-cc5f-4a0d-939a-a48e828730f9 for instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 on n-h1-858383-17 Oct 31 16:17:05.149583 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-71efc0d0-680a-4d7c-874a-75f4c63379fb req-9b3a6dac-e4cd-4d38-98ff-dcd19e3a7fcd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034704 Oct 31 16:17:05.150187 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3305/6737] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:05.919703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:05.920425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:05.927239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:05.927719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:05.928161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:05.928873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:05.929334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:05.929759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:06.059664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:06.067288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-968b838d-7806-4af0-ac78-58ed13684bea tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1318 microversion: 2.1 time: 0.151639 Oct 31 16:17:06.067865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3433/6738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:05 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:07.091743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:07.092490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:07.095286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:07.095967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:07.102255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.102753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.103207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.103916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.104388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.104869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.236646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:07.244329 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6ab8ca5-1934-4d72-b886-06381201dc98 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1508 microversion: 2.1 time: 0.157648 Oct 31 16:17:07.244941 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3306/6739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:07 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:07.267795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:07.268407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:07.270394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:07.276304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.276811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.277246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.277932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.278503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.278948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.408445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:07.416125 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1896fc1e-5a98-4f61-b2a0-7910b0e3d3d9 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1508 microversion: 2.1 time: 0.152216 Oct 31 16:17:07.416685 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3434/6740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:07 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:07.438777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:07.440988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:07.446893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.447386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.447831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.448527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.449017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.449453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.477552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:07.483661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Old instance type m1.heat2, new instance type m1.heat {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:17:07.490107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:17:07.490537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:17:07.491018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:17:07.491435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:17:07.491850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:17:07.554922 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ba51a76a-db02-4fbd-b6fe-b446f9633666 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7/action" status: 202 len: 0 microversion: 2.1 time: 0.120585 Oct 31 16:17:07.555832 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3307/6741] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:17:07 2022] POST /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:17:07.563660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:07.564271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:07.570219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.570700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.571133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.571849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:07.572308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:07.572753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:07.730944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:07.739547 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59b1ae83-8380-4e6f-95a0-bff3e7b647f4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1515 microversion: 2.1 time: 0.179682 Oct 31 16:17:07.740120 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3435/6742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:07 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:08.764103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:08.764816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:08.774340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:08.774841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:08.775295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:08.776005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:08.776481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:08.776954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:08.909359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:08.918170 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-99bdb83c-9e75-4f24-b53f-96bbfa592535 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1515 microversion: 2.1 time: 0.159411 Oct 31 16:17:08.918751 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3308/6743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:08 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:09.941591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:09.942203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:09.949023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:09.949504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:09.949937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:09.950621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:09.951225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:09.951649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:10.080199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:10.088198 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee943740-26ad-4195-b24c-eaf60ecfeaba tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.150592 Oct 31 16:17:10.088787 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3436/6744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:09 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:11.112564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:11.113235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:11.119997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:11.120517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:11.120997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:11.121699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:11.122316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:11.122834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:11.259361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:11.268133 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e452e916-c399-4960-98d6-6ebfcece07d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.159490 Oct 31 16:17:11.268719 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3309/6745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:11 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:12.291558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:12.292199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:12.299835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:12.300322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:12.300791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:12.301488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:12.301946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:12.302374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:12.431051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:12.438883 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57ff336d-8dbb-4ec1-828f-1408f557900c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.151280 Oct 31 16:17:12.439449 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3437/6746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:12 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:13.462927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:13.463459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:13.470864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:13.471350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:13.471796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:13.472500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:13.472995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:13.473435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:13.604416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:13.613265 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-50dcfb63-4ee8-4bd1-ad9d-ced1060efe14 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.154321 Oct 31 16:17:13.613858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3310/6747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:13 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:14.637225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:14.638894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:14.645759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:14.646254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:14.646699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:14.647400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:14.647866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:14.648296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:14.775089 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:14.783639 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b31accc5-0e90-4324-a269-a151a8349145 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.150335 Oct 31 16:17:14.784219 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3438/6748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:14 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:15.806958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:15.807514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:15.815047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:15.815546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:15.815999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:15.816717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:15.817193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:15.817637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:15.951580 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:15.959271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-57ca0edd-193a-4995-85aa-8eab391b8b0a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.156327 Oct 31 16:17:15.959841 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3311/6749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:15 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:16.982143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:16.982671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:16.989516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:16.989996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:16.990432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:16.991123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:16.991581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:16.992009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:17.123194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:17.125390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:17.132657 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-240294f9-9a21-4ed1-bb82-218fdb2355e5 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.154643 Oct 31 16:17:17.133247 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3439/6750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:16 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:18.156078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:18.156724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:18.163701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:18.164195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:18.164639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:18.165394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:18.165859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:18.166664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:18.299002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:18.307935 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e380979-c666-4747-a7a8-9461d7943467 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.155718 Oct 31 16:17:18.308745 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3312/6751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:18 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:19.332156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:19.332810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:19.341975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:19.342468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:19.342906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:19.343603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:19.344064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:19.344490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:19.477403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:19.485668 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c3cc2b4-da9f-4c11-948b-30460c3e53e1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.157439 Oct 31 16:17:19.486237 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3440/6752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:19 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:20.509145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:20.509683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:20.512403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:20.518433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:20.518924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:20.519372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:20.520067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:20.520531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:20.520993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:20.651553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:20.659557 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8851d8cd-10f9-4950-b34a-3be38087320a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.154452 Oct 31 16:17:20.660127 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3313/6753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:20 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:21.682736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:21.683299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:21.686726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:21.691925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:21.692382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:21.692847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:21.693536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:21.693992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:21.694412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:21.825426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:21.833076 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44c260fb-2341-40f2-bea2-279fcb44f321 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.154310 Oct 31 16:17:21.833647 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3441/6754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:21 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:22.856268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:22.856939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:22.863679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:22.864170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:22.864646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:22.865388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:22.865854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:22.866291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:22.996734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:23.004762 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e76f843-9ef1-413f-b257-bffb4281d9cd tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.152446 Oct 31 16:17:23.005333 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3314/6755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:22 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:24.028375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:24.028980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:24.035233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:24.035719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:24.036154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:24.036901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:24.037363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:24.037795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:24.164843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:24.173825 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37fa042c-0cf1-4077-a6cd-acc01a4471d4 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.149451 Oct 31 16:17:24.173938 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3442/6756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:24 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:25.195586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:25.196211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:25.202656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:25.203153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:25.203599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:25.204293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:25.204794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:25.205233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:25.335473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:25.343529 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-67bb7e68-8dba-4e02-beaa-8a37396c9f45 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.152002 Oct 31 16:17:25.344116 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3315/6757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:25 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:26.366945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:26.367588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:26.374627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:26.375110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:26.375554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:26.376241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:26.376729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:26.377146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:26.505151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:26.512895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71412523-13f5-4796-9157-5ffa97f1156f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.149978 Oct 31 16:17:26.513472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3443/6758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:26 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:27.536135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:27.536786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:27.543606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:27.544103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:27.544597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:27.545559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:27.546034 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:27.546498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:27.677893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:27.686526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7bf2272-d1df-4221-8e13-7ce32aba1d7e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.154159 Oct 31 16:17:27.687110 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3316/6759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:27 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:28.709690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:28.710301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:28.717325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:28.717818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:28.718254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:28.718947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:28.719403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:28.719834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:28.848242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:28.856056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33f06d99-6a02-4fc2-a1ea-1eb95c0a606a tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.150191 Oct 31 16:17:28.856627 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3444/6760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:28 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:29.880089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:29.880803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:29.889924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:29.890421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:29.890875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:29.892403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:29.893612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:29.894620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:30.030792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:30.038901 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-080d71f4-fc15-4911-82b4-785e339b0816 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.162998 Oct 31 16:17:30.039478 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3317/6761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:29 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:31.062614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:31.063168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:31.070310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:31.070819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:31.071256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:31.071951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:31.072408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:31.072861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:31.204735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:31.212808 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fca541dc-5eec-4623-8022-909a773afcdc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.154249 Oct 31 16:17:31.213381 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3445/6762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:31 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:32.236305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:32.236952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:32.244102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:32.244587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:32.245059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:32.245750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:32.246215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:32.246650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:32.376565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:32.384553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-687bc66c-9ac5-42f3-ab35-910f179b29dc tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.152537 Oct 31 16:17:32.385160 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3318/6763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:32 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:33.408676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:33.409331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:33.416532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:33.417046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:33.417490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:33.418190 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:33.418653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:33.419088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:33.557019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:33.565399 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7f7052a2-009b-4f59-8336-0c9d6db5842e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.160759 Oct 31 16:17:33.565981 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3446/6764] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:33 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:34.587729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:34.588396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:34.596083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:34.596589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:34.597066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:34.597798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:34.598270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:34.598712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:34.601704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:34.982485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:34.990209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ed717a35-2598-4829-91d5-ebde2e6dfbef tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.406461 Oct 31 16:17:34.990777 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3319/6765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:34 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:36.013727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:36.014347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:36.021186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:36.021678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:36.022117 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:36.022810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:36.023270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:36.023699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:36.154130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:36.162115 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c21297d-da07-48ca-8a41-7a87fc7a174c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1520 microversion: 2.1 time: 0.152419 Oct 31 16:17:36.162691 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3447/6766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:36 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:37.054115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58005c7c-2d80-48d6-97d4-62c7af2eace7", "name": "network-vif-unplugged", "status": "completed", "tag": "e02a2cc6-cc5f-4a0d-939a-a48e828730f9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:37.066048 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:37.066627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:37.067114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:37.080649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] Creating event network-vif-unplugged:e02a2cc6-cc5f-4a0d-939a-a48e828730f9 for instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 on n-h2-858383-17 Oct 31 16:17:37.086229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:17:37.099257 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-25df47e7-c2ad-4e6f-99af-4b4369cd59a3 req-75ec208d-91b3-4f1e-b3ea-8b60fb1bcaa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049178 Oct 31 16:17:37.099890 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3320/6767] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:37.185976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:37.186679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:37.193613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:37.194173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:37.194824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:37.195552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:37.196018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:37.196450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:37.391327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:37.399071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e2a4021c-b0f2-4f97-bb7c-0e64574afb3c tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1519 microversion: 2.1 time: 0.217100 Oct 31 16:17:37.399652 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3448/6768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:37 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:38.424927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:38.425553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:38.431802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:38.432310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:38.432796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:38.433513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:38.433988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:38.434436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:38.570068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:38.578769 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc0e8184-b18a-44b5-b089-035f5f3d699f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1517 microversion: 2.1 time: 0.159762 Oct 31 16:17:38.579362 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3321/6769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:38 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:39.114685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58005c7c-2d80-48d6-97d4-62c7af2eace7", "tag": "e02a2cc6-cc5f-4a0d-939a-a48e828730f9"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:39.125537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.126016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.126445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:39.138885 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] Creating event network-changed:e02a2cc6-cc5f-4a0d-939a-a48e828730f9 for instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 on n-h2-858383-17 Oct 31 16:17:39.144222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:17:39.154962 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-60f16839-55a1-45ae-82c7-7b4d90cde0d7 req-f7137bba-ba2d-4a98-abf3-88bf13c7a302 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044004 Oct 31 16:17:39.155546 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3449/6770] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:39.602690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:39.603501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:39.610676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.611179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.611703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:39.612539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.613129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.613569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:39.934073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:39.943399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f376774f-2989-4018-9db3-50bb445c6839 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1514 microversion: 2.1 time: 0.344522 Oct 31 16:17:39.944085 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3322/6771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:39 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:39.971941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:39.972958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:39.979340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.979949 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.980471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:39.981373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.981992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.982721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:40.046741 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf7cf366-718a-4b70-b0f2-c626a64f4283 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "POST /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7/action" status: 204 len: 0 microversion: 2.1 time: 0.079345 Oct 31 16:17:40.047533 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3450/6772] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:17:39 2022] POST /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 16:17:40.055918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:40.056608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:40.068802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:40.069643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:40.071010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:40.073177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:40.074567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:40.075256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:40.309858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:40.317596 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cef6e17e-b44c-40e9-8bd0-9425314c69af tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1514 microversion: 2.1 time: 0.265701 Oct 31 16:17:40.318175 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3323/6773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:40 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:41.344021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:41.344747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:41.350914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.351408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.351841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.352541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.353027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.353457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.489088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:41.497034 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3beba00a-0e02-4129-a6aa-08a19090acc1 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1506 microversion: 2.1 time: 0.158685 Oct 31 16:17:41.497714 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3451/6774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:41 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:41.519994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:41.520825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:41.529294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.529816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.530260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.530976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.531439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.531881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.666049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:41.673971 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2250681d-8da1-4d26-98f2-432219b6b67b tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1506 microversion: 2.1 time: 0.158080 Oct 31 16:17:41.674554 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3324/6775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:41 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:41.695638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:41.696249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:41.702699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.703202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.703674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.704402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.704890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.705315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.839662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:41.848167 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7177db99-bea5-4cb2-a1b4-9a434484b2e3 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1506 microversion: 2.1 time: 0.156369 Oct 31 16:17:41.849250 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3452/6776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:41 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:41.870656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:41.871101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:41.877383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.878179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.878614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.879336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.879814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.880250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.906988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:17:41.992323 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-624d2db2-7d35-42cf-b63a-5a0f83a1d864 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 204 len: 0 microversion: 2.1 time: 0.125113 Oct 31 16:17:41.995617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3325/6777] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:17:41 2022] DELETE /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:17:42.010641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:42.011507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:42.018790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.019291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.019765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.020455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.020944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.021649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.048107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:17:42.095572 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.compute.api [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Instance is already in deleting state, ignoring this request Oct 31 16:17:42.096404 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b829f3b9-3366-42bd-97f1-8c495799879e tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 204 len: 0 microversion: 2.1 time: 0.089745 Oct 31 16:17:42.097011 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3453/6778] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:17:42 2022] DELETE /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:17:42.105485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:42.106212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:42.112999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.113500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.113957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.114667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.115136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.115579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.137775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fcc635a2-e9aa-4814-8357-0cfdd56f4b50 req-4903e2bb-7b40-4412-bb91-e08a6f6f3943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58005c7c-2d80-48d6-97d4-62c7af2eace7", "name": "network-vif-plugged", "status": "completed", "tag": "e02a2cc6-cc5f-4a0d-939a-a48e828730f9"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:42.148306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fcc635a2-e9aa-4814-8357-0cfdd56f4b50 req-4903e2bb-7b40-4412-bb91-e08a6f6f3943 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.148823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fcc635a2-e9aa-4814-8357-0cfdd56f4b50 req-4903e2bb-7b40-4412-bb91-e08a6f6f3943 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.149280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fcc635a2-e9aa-4814-8357-0cfdd56f4b50 req-4903e2bb-7b40-4412-bb91-e08a6f6f3943 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.154222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:42.173600 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fcc635a2-e9aa-4814-8357-0cfdd56f4b50 req-4903e2bb-7b40-4412-bb91-e08a6f6f3943 service nova] Creating event network-vif-plugged:e02a2cc6-cc5f-4a0d-939a-a48e828730f9 for instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 on n-h2-858383-17 Oct 31 16:17:42.178996 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fcc635a2-e9aa-4814-8357-0cfdd56f4b50 req-4903e2bb-7b40-4412-bb91-e08a6f6f3943 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045245 Oct 31 16:17:42.179770 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3454/6779] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:17:42.251028 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:17:42.251273 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 (ip 10.222.0.48) !!! Oct 31 16:17:42.261305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:42.269502 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-220e9aae-faf6-412d-a0f3-0d45dd1c693f tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1512 microversion: 2.1 time: 0.168148 Oct 31 16:17:42.270076 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3326/6780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:42 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:43.295866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:43.296684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:43.303243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:43.303741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:43.304179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:43.304909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:43.305382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:43.305809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:43.545149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756f94b9a7a14c59821f0ba298609d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5adf91d66c64bc987bbe820738e60ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:43.553183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3298d59e-cb9d-4924-9fb0-2e3458ba2833 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 200 len: 1512 microversion: 2.1 time: 0.263789 Oct 31 16:17:43.553774 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3455/6781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:43 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:43.820151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-36f85d4f-dcb1-4364-a967-9dce88dc7ecb req-5be6603d-066b-416d-8a7b-b1c2fc9c6280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58005c7c-2d80-48d6-97d4-62c7af2eace7", "name": "network-vif-deleted", "tag": "e02a2cc6-cc5f-4a0d-939a-a48e828730f9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:43.832338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-36f85d4f-dcb1-4364-a967-9dce88dc7ecb req-5be6603d-066b-416d-8a7b-b1c2fc9c6280 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:43.833176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-36f85d4f-dcb1-4364-a967-9dce88dc7ecb req-5be6603d-066b-416d-8a7b-b1c2fc9c6280 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:43.833798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-36f85d4f-dcb1-4364-a967-9dce88dc7ecb req-5be6603d-066b-416d-8a7b-b1c2fc9c6280 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:43.846871 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-36f85d4f-dcb1-4364-a967-9dce88dc7ecb req-5be6603d-066b-416d-8a7b-b1c2fc9c6280 service nova] Creating event network-vif-deleted:e02a2cc6-cc5f-4a0d-939a-a48e828730f9 for instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 on n-h2-858383-17 Oct 31 16:17:43.852784 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-36f85d4f-dcb1-4364-a967-9dce88dc7ecb req-5be6603d-066b-416d-8a7b-b1c2fc9c6280 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Oct 31 16:17:43.853394 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3327/6782] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:44.576792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:44.577418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: 58005c7c-2d80-48d6-97d4-62c7af2eace7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:44.584352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:44.584875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:44.585317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:44.586013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:44.586476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:44.586905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:44.600096 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] HTTP exception thrown: Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 could not be found. Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Request method failure captured: Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 HTTP/1.1 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_TBS6QLBSD4rjTUe78zhC4VckDo88LEu09xsJHWToORnZmRJObg6o_YRin9lf0ch0CuOB04YDZZJi9ueEgjzH59ZvDVQ2IY_f1muSrgjUoe7J9KAt6I2DDto8osYi90o2ITgwRTfM4q_GVjDOcjFHKMVmraO_oQ5tP80tyV2m3RrtI Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d5adf91d66c64bc987bbe820738e60ef Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d5adf91d66c64bc987bbe820738e60ef Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiskConfigTestJSON-295517200-project Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 756f94b9a7a14c59821f0ba298609d83 Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiskConfigTestJSON-295517200-project Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 could not be found. Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '58005c7c-2d80-48d6-97d4-62c7af2eace7'} Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 could not be found. Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 could not be found. Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:44.601772 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 could not be found. Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Returning 404 to user: Instance 58005c7c-2d80-48d6-97d4-62c7af2eace7 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ac2889b-f384-461e-88d4-2aa50cdf4c59 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7" status: 404 len: 111 microversion: 2.1 time: 0.030716 Oct 31 16:17:44.607141 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3456/6783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:44 2022] GET /compute/v2.1/servers/58005c7c-2d80-48d6-97d4-62c7af2eace7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:17:44.613367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1884ac4b-3a67-4d6b-9cfe-a711a2bca6c0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '.version_select at 0x7f5ca669ddc0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:44.637138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1884ac4b-3a67-4d6b-9cfe-a711a2bca6c0 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378072070" status: 202 len: 0 microversion: 2.1 time: 0.027843 Oct 31 16:17:44.637733 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3328/6784] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 16:17:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378072070 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:17:45.237306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:45.237812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:45.243764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:45.244255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:45.244716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:45.245426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:45.245887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:45.246317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:45.259960 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] HTTP exception thrown: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Request method failure captured: Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e HTTP/1.1 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_TBS6QLBSD4rjTUe78zhC4VckDo88LEu09xsJHWToORnZmRJObg6o_YRin9lf0ch0CuOB04YDZZJi9ueEgjzH59ZvDVQ2IY_f1muSrgjUoe7J9KAt6I2DDto8osYi90o2ITgwRTfM4q_GVjDOcjFHKMVmraO_oQ5tP80tyV2m3RrtI Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: d5adf91d66c64bc987bbe820738e60ef Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: d5adf91d66c64bc987bbe820738e60ef Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerDiskConfigTestJSON-295517200-project Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 756f94b9a7a14c59821f0ba298609d83 Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerDiskConfigTestJSON-295517200-project Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f965820b-4ca8-4486-a355-a24af93ea45e'} Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:17:45.261574 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Returning 404 to user: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d2ede9c8-2c51-424a-bb58-03a1abe34a57 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 404 len: 111 microversion: 2.1 time: 0.029834 Oct 31 16:17:45.266013 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3457/6785] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:17:45 2022] DELETE /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:17:45.272400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:45.273213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] [instance: f965820b-4ca8-4486-a355-a24af93ea45e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:45.283093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:45.283625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:45.284081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:45.284814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:45.285292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:45.285739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:45.299528 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] HTTP exception thrown: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Request method failure captured: Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e HTTP/1.1 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_TBS6QLBSD4rjTUe78zhC4VckDo88LEu09xsJHWToORnZmRJObg6o_YRin9lf0ch0CuOB04YDZZJi9ueEgjzH59ZvDVQ2IY_f1muSrgjUoe7J9KAt6I2DDto8osYi90o2ITgwRTfM4q_GVjDOcjFHKMVmraO_oQ5tP80tyV2m3RrtI Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: d5adf91d66c64bc987bbe820738e60ef Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5adf91d66c64bc987bbe820738e60ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: d5adf91d66c64bc987bbe820738e60ef Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-295517200 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerDiskConfigTestJSON-295517200-project Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 756f94b9a7a14c59821f0ba298609d83 Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerDiskConfigTestJSON-295517200-project Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f965820b-4ca8-4486-a355-a24af93ea45e'} Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:45.301198 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] Returning 404 to user: Instance f965820b-4ca8-4486-a355-a24af93ea45e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-208f8462-39f2-46b3-9f1a-5969750cb278 tempest-ServerDiskConfigTestJSON-295517200 tempest-ServerDiskConfigTestJSON-295517200-project] 10.222.0.48 "GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e" status: 404 len: 111 microversion: 2.1 time: 0.034904 Oct 31 16:17:45.305149 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3329/6786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:45 2022] GET /compute/v2.1/servers/f965820b-4ca8-4486-a355-a24af93ea45e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:17:53.880179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ef6fcf6-af1c-4a52-9eac-031c92557ff4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'create', calling method: .version_select at 0x7f5ca12a24c0>, body: {"keypair": {"name": "tempest-keypair-1273366131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjVhJ0AN8Fn5x2nB9+noyJsM6zPucoSQe7XIh69gugwjPXt9/YjYUFIaTf5nPUi3rgAobStcI1+kymP0ct9WOvapgGqKhQ0llkqFg2qJYmm48afD5scoAef46ujwEmA9w=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:53.885734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=34 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:53.897460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-5ef6fcf6-af1c-4a52-9eac-031c92557ff4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:17:53.902644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-5ef6fcf6-af1c-4a52-9eac-031c92557ff4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:17:53.929664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ef6fcf6-af1c-4a52-9eac-031c92557ff4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168181 Oct 31 16:17:53.930258 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3458/6787] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:17:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:55.180224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1481264115", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c"}], "security_groups": [{"name": "tempest-securitygroup--1135105184"}], "key_name": "tempest-keypair-1273366131", "user_data": "}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:55.190888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:55.289144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] validate_networks() for [('89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:17:55.293353 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:55.678932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:17:55.679488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:17:55.679980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:17:55.680433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:17:55.680890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:17:55.691008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.691512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.691966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.692728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.693207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.693647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.711992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:17:55.717919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:17:55.731127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:17:55.733683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:17:55.785185 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f799f00-0454-4454-b090-4c2bf9a2a5ca tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.609238 Oct 31 16:17:55.786139 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3330/6788] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:17:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:17:55.798210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a52aa818-b625-4c69-8755-f8c1c1386efc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:55.798967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a52aa818-b625-4c69-8755-f8c1c1386efc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:55.802914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:55.869696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a52aa818-b625-4c69-8755-f8c1c1386efc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:55.879262 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a52aa818-b625-4c69-8755-f8c1c1386efc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1239 microversion: 2.1 time: 0.086148 Oct 31 16:17:55.879941 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3459/6789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:55 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:56.905785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:56.907131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:56.926339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:56.927112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:56.927758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:56.928566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:56.929140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:56.929651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:57.027311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:57.036627 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7b71ea1c-05e3-4a64-898e-f4d9d3a52124 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1299 microversion: 2.1 time: 0.138181 Oct 31 16:17:57.052958 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3331/6790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:56 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:58.062823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:58.063537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:58.070646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:58.071215 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:58.071719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:58.072524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:58.073068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:58.073565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:58.288963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:58.297785 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a03dd8b-576a-4b9c-a186-04d69fe69e6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1365 microversion: 2.1 time: 0.239465 Oct 31 16:17:58.298366 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3460/6791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:58 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:58.436571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c3f1840b-04ee-4c4c-b507-757729f4b81f req-4a308d23-7ba1-4cfb-854a-1cb2dee5ebb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:58.447386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c3f1840b-04ee-4c4c-b507-757729f4b81f req-4a308d23-7ba1-4cfb-854a-1cb2dee5ebb9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:58.447965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c3f1840b-04ee-4c4c-b507-757729f4b81f req-4a308d23-7ba1-4cfb-854a-1cb2dee5ebb9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:58.448476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c3f1840b-04ee-4c4c-b507-757729f4b81f req-4a308d23-7ba1-4cfb-854a-1cb2dee5ebb9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:58.459790 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c3f1840b-04ee-4c4c-b507-757729f4b81f req-4a308d23-7ba1-4cfb-854a-1cb2dee5ebb9 service nova] Creating event network-changed:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h2-858383-17 Oct 31 16:17:58.464954 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c3f1840b-04ee-4c4c-b507-757729f4b81f req-4a308d23-7ba1-4cfb-854a-1cb2dee5ebb9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034142 Oct 31 16:17:58.465551 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3332/6792] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:59.321897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:59.322533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:59.330077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.330553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.330988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.331671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.332125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.332547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.463334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:59.470986 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10737377-c941-4f4a-babe-0b3a5a9c97f4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1365 microversion: 2.1 time: 0.152984 Oct 31 16:17:59.471548 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3461/6793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:59 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:00.494516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:00.495242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:00.502177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:00.502686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:00.503396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:00.504112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:00.504588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:00.505059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:00.640885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:00.649023 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-95cb043f-2afd-499d-b531-2bd0774006a3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1365 microversion: 2.1 time: 0.159560 Oct 31 16:18:00.649619 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3333/6794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:00 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:01.671504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:01.672121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:01.679009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:01.679497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:01.679936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:01.680627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:01.681131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:01.681557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:01.815349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:01.823312 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fc04acf-82e2-4137-aa20-e17c2853b18b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1365 microversion: 2.1 time: 0.155795 Oct 31 16:18:01.823888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3462/6795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:01 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:02.199087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-03e3bf00-9a8a-4435-a6af-39fc6ac716fb req-0b7ad993-a3ed-4d60-8835-0f851fe69db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "name": "network-vif-plugged", "status": "completed", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:02.210666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-03e3bf00-9a8a-4435-a6af-39fc6ac716fb req-0b7ad993-a3ed-4d60-8835-0f851fe69db7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:02.211158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-03e3bf00-9a8a-4435-a6af-39fc6ac716fb req-0b7ad993-a3ed-4d60-8835-0f851fe69db7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:02.211599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-03e3bf00-9a8a-4435-a6af-39fc6ac716fb req-0b7ad993-a3ed-4d60-8835-0f851fe69db7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:02.222748 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-03e3bf00-9a8a-4435-a6af-39fc6ac716fb req-0b7ad993-a3ed-4d60-8835-0f851fe69db7 service nova] Creating event network-vif-plugged:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h2-858383-17 Oct 31 16:18:02.227573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-03e3bf00-9a8a-4435-a6af-39fc6ac716fb req-0b7ad993-a3ed-4d60-8835-0f851fe69db7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032314 Oct 31 16:18:02.228175 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3334/6796] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:02.846485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:02.847140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:02.854035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:02.854530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:02.854971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:02.855672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:02.856135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:02.857103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:02.989125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:02.996964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d5a87bce-313f-4afa-b805-a2b6186c6462 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1365 microversion: 2.1 time: 0.154423 Oct 31 16:18:02.997568 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3463/6797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:02 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:04.021358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:04.022100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:04.028208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:04.029336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:04.029794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:04.030485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:04.030953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:04.031409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:04.161851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:04.170098 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-12128d6a-15a7-488b-a17a-21cd3bf8e327 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1552 microversion: 2.1 time: 0.153727 Oct 31 16:18:04.170688 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3335/6798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:04 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:04.191893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:04.192382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:04.199308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:04.199786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:04.200217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:04.201466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:04.201915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:04.202336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:04.277869 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fc25cf0-8ad3-482c-a828-ea44d986bd88 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089785 Oct 31 16:18:04.279045 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3464/6799] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 16:18:04 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:05.510938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ecba1798-92a2-47a3-acc8-1e0f0c1b2300 req-8af7c915-b8a2-48a7-9885-aecbd146b1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:05.521841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecba1798-92a2-47a3-acc8-1e0f0c1b2300 req-8af7c915-b8a2-48a7-9885-aecbd146b1b7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:05.522326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecba1798-92a2-47a3-acc8-1e0f0c1b2300 req-8af7c915-b8a2-48a7-9885-aecbd146b1b7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:05.522767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ecba1798-92a2-47a3-acc8-1e0f0c1b2300 req-8af7c915-b8a2-48a7-9885-aecbd146b1b7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:05.534454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ecba1798-92a2-47a3-acc8-1e0f0c1b2300 req-8af7c915-b8a2-48a7-9885-aecbd146b1b7 service nova] Creating event network-changed:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h2-858383-17 Oct 31 16:18:05.539417 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ecba1798-92a2-47a3-acc8-1e0f0c1b2300 req-8af7c915-b8a2-48a7-9885-aecbd146b1b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 Oct 31 16:18:05.540210 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3336/6800] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:39.392810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.393718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.394405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.398501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:39.399116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:39.406829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.407318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.407759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.408460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.408950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.409384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.539732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:39.548091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b995632a-43dc-4303-abef-b73e36cabf83 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1671 microversion: 2.1 time: 0.157193 Oct 31 16:18:39.548645 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3465/6801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:39 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:18:39.572181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:39.572961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:39.575211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.575994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.576652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.577368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=26 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:39.584715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.585218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.585668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.586368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.586833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.587269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.721978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:39.729765 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b81f74de-6a43-45ab-8bc5-7bcd657fb4e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1671 microversion: 2.1 time: 0.161824 Oct 31 16:18:39.730353 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3337/6802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:39 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:39.753017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:39.753855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:39.759825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.760312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.760779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.761481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.762031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.762513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.890930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:39.899081 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b60811de-6aae-43f2-8740-0fdc22e0dc68 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1671 microversion: 2.1 time: 0.150084 Oct 31 16:18:39.899656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3466/6803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:39 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:39.922686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:39.924950 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:39.930857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.931355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.931808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.932506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:39.933015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:39.933457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:39.961197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:39.967322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Old instance type m1.heat2, new instance type m1.heat {{(pid=120626) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:18:39.973776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:18:39.974210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:18:39.974696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:18:39.975138 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:18:39.975543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:18:40.039156 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-95d36b1f-6178-49e3-8b05-f841c1424ec2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13/action" status: 202 len: 0 microversion: 2.1 time: 0.120943 Oct 31 16:18:40.039663 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3338/6804] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:18:39 2022] POST /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:18:40.047765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:40.048386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:40.054288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:40.054770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:40.055209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:40.055907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:40.056367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:40.056825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:40.215578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:40.223602 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a07de83c-eded-4d6d-927f-71bbfa882a84 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1680 microversion: 2.1 time: 0.179676 Oct 31 16:18:40.224172 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3467/6805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:40 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:41.247536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:41.248165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:41.255381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:41.255902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:41.256337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:41.257068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:41.257542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:41.257981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:41.392393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:41.400379 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7c12c27e-cc49-4be3-9f07-7bc80f7d98a0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1680 microversion: 2.1 time: 0.157936 Oct 31 16:18:41.400999 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3339/6806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:41 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:42.424412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:42.424995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:42.431895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:42.432386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:42.432860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:42.433556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:42.434020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:42.434444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:42.566680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:42.575027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4387d9e6-0a81-4766-98b0-ca6a925eb7f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.153942 Oct 31 16:18:42.575611 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3468/6807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:42 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:43.599100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:43.599665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:43.607446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:43.607944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:43.608398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:43.609144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:43.609625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:43.610068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:43.740140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:43.748048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e6aa0fbe-b3c2-4f81-ae6a-e6b3d05bec53 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.152959 Oct 31 16:18:43.748617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3340/6808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:43 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:44.771445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:44.772124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:44.779170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:44.779660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:44.780100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:44.780832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:44.781297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:44.781724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:44.917071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:44.925100 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-62f43460-37d8-4f24-b18f-3131313856ba tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.157528 Oct 31 16:18:44.925687 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3469/6809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:44 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:45.949797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:45.950643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:45.957548 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:45.958050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:45.958504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:45.959214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:45.959685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:45.960130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:46.088335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:46.096155 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9612327-b559-4594-b9f2-08561c425732 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.150951 Oct 31 16:18:46.096745 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3341/6810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:45 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:47.120021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:47.120642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:47.128003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:47.128777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:47.129222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:47.129913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:47.130375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:47.130803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:47.261270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:47.268983 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00f8b8e7-e87c-43fc-8925-e0d469b21e64 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.152889 Oct 31 16:18:47.269562 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3470/6811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:47 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:48.293634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:48.294364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:48.301283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:48.301787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:48.302244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:48.302953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:48.303430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:48.303875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:48.430541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:48.438932 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-798a11c9-44e9-48ee-9672-106264d1151a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.149860 Oct 31 16:18:48.439501 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3342/6812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:48 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:49.462425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:49.462954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:49.470128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:49.470620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:49.471083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:49.471790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:49.472249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:49.472676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:49.600295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:49.610345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-684695ad-49cf-4934-857e-cf17c568460b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.151958 Oct 31 16:18:49.610920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3471/6813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:49 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:50.634393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:50.634952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:50.642070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:50.642567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:50.643017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:50.643718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:50.644190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:50.644630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:50.780631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:50.788358 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a5540472-7f20-408b-86f0-3e95b3c3f32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.157951 Oct 31 16:18:50.788951 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3343/6814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:50 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:51.811548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:51.812099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:51.818662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:51.819143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:51.819581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:51.820281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:51.820750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:51.821177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:51.951803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:51.960275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8662dac-ee23-4954-8ac4-ce22da9f7a26 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.152727 Oct 31 16:18:51.960876 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3472/6815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:51 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:52.983405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:52.983972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:52.990856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:52.991357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:52.991811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:52.992517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:52.993022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:52.993471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:53.123630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:53.131591 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7ed7452b-6746-4696-8ffe-bcf30bd4e105 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1685 microversion: 2.1 time: 0.152183 Oct 31 16:18:53.132170 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3344/6816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:52 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:54.156495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:54.157157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:54.163487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.163985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.164425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.165162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.165625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.166292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.369272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:54.378125 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b53ec83-76df-4931-b3e1-20a2ff0e7338 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1684 microversion: 2.1 time: 0.226494 Oct 31 16:18:54.378976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3473/6817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:54 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1684 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:18:54.397245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "name": "network-vif-unplugged", "status": "completed", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:54.407493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.408001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.408494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.421178 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] Creating event network-vif-unplugged:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h1-858383-17 Oct 31 16:18:54.427248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:18:54.439482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c1727447-c6ff-434b-b4f3-a5896b073f4d req-b92799ae-241b-410e-bdd3-fd452f83ab39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046160 Oct 31 16:18:54.440105 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3345/6818] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:55.403504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:55.404106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:55.411100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:55.411588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:55.412025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:55.412751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:55.413209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:55.413630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:55.622408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:55.630374 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-695b2432-59c4-4179-ae24-325e4e0fce72 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1684 microversion: 2.1 time: 0.231539 Oct 31 16:18:55.630940 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3474/6819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:55 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1684 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:56.497209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:56.506829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:56.507311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:56.507751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:56.519550 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] Creating event network-changed:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h1-858383-17 Oct 31 16:18:56.524638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:18:56.535224 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-60bcb53d-8551-40da-ade1-fd8606dbf0d0 req-259affe2-b0f4-4a16-816c-6308cfe161ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043374 Oct 31 16:18:56.535818 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3346/6820] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:56.654134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:56.654871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:56.662007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:56.662584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:56.663030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:56.663767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:56.664283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:56.664733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:56.881751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:56.890508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a013a93-98a7-4a62-b68d-000bac8964cf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1682 microversion: 2.1 time: 0.240332 Oct 31 16:18:56.891226 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3475/6821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:56 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1682 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:57.919803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:57.920546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:57.926668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:57.927154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:57.927598 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:57.928286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:57.928779 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:57.929217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:58.063529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:58.071110 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-327af973-6729-40a8-a131-bde9c5d43ebd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1682 microversion: 2.1 time: 0.156546 Oct 31 16:18:58.071679 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3347/6822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:57 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:59.094219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:59.094859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:59.101916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.102400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.102835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.103641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.104189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.104616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.246277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:59.254257 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58648379-69cf-4d53-bbd9-8856490ae513 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1679 microversion: 2.1 time: 0.163933 Oct 31 16:18:59.254825 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3476/6823] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:59 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:59.277268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:59.277909 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:59.284710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.285211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.285657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.286351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.286816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.287251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.344816 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-910316ee-fff7-432f-b453-ce8478f9e1bb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13/action" status: 204 len: 0 microversion: 2.1 time: 0.071246 Oct 31 16:18:59.345451 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3348/6824] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:18:59 2022] POST /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:18:59.353738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:59.354426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:59.361302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.361789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.362286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.362985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.363549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.363982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.581568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:59.590498 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93f64454-6953-449b-a21a-5263b82c5cf9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1679 microversion: 2.1 time: 0.240064 Oct 31 16:18:59.591352 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3477/6825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:59 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:00.615989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:00.616988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:00.624686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:00.625206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:00.625666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:00.626380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:00.626852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:00.627318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:00.763506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:00.771271 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3fe4bf73-47ab-4c0b-b51b-7294b05b2769 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1671 microversion: 2.1 time: 0.161075 Oct 31 16:19:00.771845 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3349/6826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:00 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:00.793494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:00.794062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:00.800912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:00.801396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:00.801829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:00.802523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:00.802981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:00.803407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:00.937135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:00.944988 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9aac2d6b-52eb-4f67-9e14-3f8fe6626f48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1671 microversion: 2.1 time: 0.155434 Oct 31 16:19:00.945571 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3478/6827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:00 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:00.968013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:00.968636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:00.974590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:00.975081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:00.975530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:00.976224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:00.976708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:00.977151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.103388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:01.111708 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc9ac8f0-75f2-481a-b83a-77529931c207 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1671 microversion: 2.1 time: 0.147515 Oct 31 16:19:01.112283 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3350/6828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:00 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:01.135044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:01.135540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:01.141655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.142136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.142571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.143260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.143719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.144145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.169551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:19:01.220330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:01.248372 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42ea5cfe-04bd-46a2-9b79-2817bc35f85a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 204 len: 0 microversion: 2.1 time: 0.116862 Oct 31 16:19:01.249094 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3479/6829] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:19:01 2022] DELETE /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:19:01.257771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:01.258382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:01.264246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.264774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.265226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.265921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.266387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.266822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.399395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:01.401732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:01.409569 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc8791c6-2a00-4de7-bbd9-c6dabf1894af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1677 microversion: 2.1 time: 0.156091 Oct 31 16:19:01.410147 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3351/6830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:01 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:01.650323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4d874b4a-249c-4e92-8f36-c72d0f7683b5 req-a3a5ef90-cfaa-4bff-a065-cb0b44f54a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "name": "network-vif-plugged", "status": "completed", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:01.660661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4d874b4a-249c-4e92-8f36-c72d0f7683b5 req-a3a5ef90-cfaa-4bff-a065-cb0b44f54a27 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.661175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4d874b4a-249c-4e92-8f36-c72d0f7683b5 req-a3a5ef90-cfaa-4bff-a065-cb0b44f54a27 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.661600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4d874b4a-249c-4e92-8f36-c72d0f7683b5 req-a3a5ef90-cfaa-4bff-a065-cb0b44f54a27 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.673081 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4d874b4a-249c-4e92-8f36-c72d0f7683b5 req-a3a5ef90-cfaa-4bff-a065-cb0b44f54a27 service nova] Creating event network-vif-plugged:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h1-858383-17 Oct 31 16:19:01.677984 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4d874b4a-249c-4e92-8f36-c72d0f7683b5 req-a3a5ef90-cfaa-4bff-a065-cb0b44f54a27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Oct 31 16:19:01.678734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3480/6831] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:02.433573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:02.434117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:02.441848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.442345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.442790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.443492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.443958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.444411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.579311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:02.586972 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b5232933-dbbf-42c7-8d9c-5ccbc2be6bb1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1677 microversion: 2.1 time: 0.157751 Oct 31 16:19:02.587540 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3352/6832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:02 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:03.612101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:03.612834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:03.619992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:03.621222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:03.621686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:03.622374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:03.622829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:03.623395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:03.647802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-19094bc9-ed4b-4b16-be92-3d41fa7d519d req-8920327c-b8ae-439f-8f04-0a4963ab2aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba0b71-34a2-4023-9f15-1a4bf6d93b13", "name": "network-vif-deleted", "tag": "b09c6a07-810e-44b8-a79b-7a713de75bad"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:03.667264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-19094bc9-ed4b-4b16-be92-3d41fa7d519d req-8920327c-b8ae-439f-8f04-0a4963ab2aac service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:03.669585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-19094bc9-ed4b-4b16-be92-3d41fa7d519d req-8920327c-b8ae-439f-8f04-0a4963ab2aac service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:03.670207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-19094bc9-ed4b-4b16-be92-3d41fa7d519d req-8920327c-b8ae-439f-8f04-0a4963ab2aac service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:03.683767 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-19094bc9-ed4b-4b16-be92-3d41fa7d519d req-8920327c-b8ae-439f-8f04-0a4963ab2aac service nova] Creating event network-vif-deleted:b09c6a07-810e-44b8-a79b-7a713de75bad for instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 on n-h1-858383-17 Oct 31 16:19:03.689077 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-19094bc9-ed4b-4b16-be92-3d41fa7d519d req-8920327c-b8ae-439f-8f04-0a4963ab2aac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051113 Oct 31 16:19:03.690245 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3353/6833] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:03.725839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:03.736368 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf604f77-a536-4b9e-b182-0ffe010ffceb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 200 len: 1609 microversion: 2.1 time: 0.128474 Oct 31 16:19:03.737177 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3481/6834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:03 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 1609 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:04.763488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:04.764323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:04.770469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:04.770968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:04.771416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:04.772114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:04.772581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:04.773043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:04.786792 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 HTTP/1.1 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '3aba0b71-34a2-4023-9f15-1a4bf6d93b13'} Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:04.788404 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7cc71671-bc6c-49cb-b32d-e8a9348b0470 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 404 len: 111 microversion: 2.1 time: 0.032369 Oct 31 16:19:04.793179 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3354/6835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:04 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:19:04.802221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:04.802868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:04.809740 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:04.810228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:04.810665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:04.811368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:04.811823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:04.812252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:04.828597 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 HTTP/1.1 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3aba0b71-34a2-4023-9f15-1a4bf6d93b13'} Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:04.830335 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38a36d1c-038a-46d0-a90b-1ce2c9bfb72f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 404 len: 111 microversion: 2.1 time: 0.033451 Oct 31 16:19:04.834860 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3482/6836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:04 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:19:04.880590 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2046757696", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c"}], "security_groups": [{"name": "tempest-securitygroup--1135105184"}], "key_name": "tempest-keypair-1273366131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:04.984803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] validate_networks() for [('89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:19:05.353725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:19:05.354173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:19:05.354695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:19:05.355861 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:19:05.356291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:19:05.365327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.365830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.366284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.367029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.367500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.367943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.384946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:19:05.390338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:19:05.403249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:19:05.405634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:19:05.453347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-edbc32d3-3cdc-4e7a-9dcb-c6dc232468fa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.576868 Oct 31 16:19:05.454016 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3355/6837] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:19:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:19:05.466104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5fdfb7df-c29b-462f-b56b-a2623de2c940 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:05.466725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5fdfb7df-c29b-462f-b56b-a2623de2c940 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:05.519796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5fdfb7df-c29b-462f-b56b-a2623de2c940 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:05.527416 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5fdfb7df-c29b-462f-b56b-a2623de2c940 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1239 microversion: 2.1 time: 0.065369 Oct 31 16:19:05.528189 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3483/6838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:05 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:06.551544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:06.552413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:06.559973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:06.560558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:06.561073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:06.561867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:06.562377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:06.562819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:06.659935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:06.667826 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-64ad4049-3f33-4fe8-b5d0-629745d1c32e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1297 microversion: 2.1 time: 0.121193 Oct 31 16:19:06.668624 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3356/6839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:06 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:07.693045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:07.693768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:07.702435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:07.702928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:07.703366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:07.704075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:07.704557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:07.705017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:07.877493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6759c750-90a1-42ff-82aa-32392e71a6f5 req-e9798d3f-46c5-4413-a548-71912216a916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:07.889251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6759c750-90a1-42ff-82aa-32392e71a6f5 req-e9798d3f-46c5-4413-a548-71912216a916 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:07.889875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6759c750-90a1-42ff-82aa-32392e71a6f5 req-e9798d3f-46c5-4413-a548-71912216a916 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:07.890326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6759c750-90a1-42ff-82aa-32392e71a6f5 req-e9798d3f-46c5-4413-a548-71912216a916 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:07.902690 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6759c750-90a1-42ff-82aa-32392e71a6f5 req-e9798d3f-46c5-4413-a548-71912216a916 service nova] Creating event network-changed:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h2-858383-17 Oct 31 16:19:07.907628 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6759c750-90a1-42ff-82aa-32392e71a6f5 req-e9798d3f-46c5-4413-a548-71912216a916 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034120 Oct 31 16:19:07.908249 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3357/6840] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:19:07.931369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:07.939621 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cf0f74ae-6b4f-478e-a66e-422f4dae59a6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.250583 Oct 31 16:19:07.940191 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3484/6841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:07 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:08.963583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:08.964471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:08.971939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:08.972437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:08.972938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:08.973654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:08.974134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:08.974589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:09.175014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:09.182747 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9f07eabb-dd49-4939-9982-7750c97e003b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.223486 Oct 31 16:19:09.183933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3358/6842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:08 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:10.208131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:10.208767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:10.211620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:10.217410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:10.217896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:10.218330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:10.219020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:10.219479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:10.219901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:10.351454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:10.359609 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37200bb4-e542-49f0-86fd-23ccd46f955d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.156390 Oct 31 16:19:10.360176 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3485/6843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:10 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:11.383523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:11.384145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:11.387710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:11.393111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:11.393613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:11.394065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:11.394769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:11.395243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:11.395690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:11.525913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:11.533617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7d6a851a-a8cf-4665-a3dd-9d52d69c2dd0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.153999 Oct 31 16:19:11.534200 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3359/6844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:11 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:12.557054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:12.558063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:12.564999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:12.565482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:12.565915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:12.566613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:12.567076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:12.567520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:12.697607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:12.705932 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ec3b4abb-5bfd-4579-8d55-18dc5551563d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.152918 Oct 31 16:19:12.706499 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3486/6845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:12 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:19:13.729207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:13.729931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:13.736742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:13.737246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:13.737701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:13.738400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:13.738873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:13.739316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:14.135325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:14.143447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-539eb133-8ab2-4acf-a8d9-cd66e40b83f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.418097 Oct 31 16:19:14.144021 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3360/6846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:13 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:14.531631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-67999ec5-a405-461f-82cb-c6100eecec28 req-091aad8d-7879-45e5-b725-9baf426ededf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "name": "network-vif-plugged", "status": "completed", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:14.543213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-67999ec5-a405-461f-82cb-c6100eecec28 req-091aad8d-7879-45e5-b725-9baf426ededf service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:14.543213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-67999ec5-a405-461f-82cb-c6100eecec28 req-091aad8d-7879-45e5-b725-9baf426ededf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:14.543643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-67999ec5-a405-461f-82cb-c6100eecec28 req-091aad8d-7879-45e5-b725-9baf426ededf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:14.557559 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-67999ec5-a405-461f-82cb-c6100eecec28 req-091aad8d-7879-45e5-b725-9baf426ededf service nova] Creating event network-vif-plugged:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h2-858383-17 Oct 31 16:19:14.562877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-67999ec5-a405-461f-82cb-c6100eecec28 req-091aad8d-7879-45e5-b725-9baf426ededf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035899 Oct 31 16:19:14.563528 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3487/6847] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:15.167843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:15.168341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:15.175562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:15.176140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:15.176599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:15.177340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:15.177815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:15.178257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:15.311403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:15.319512 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e20d2802-94f0-4393-a8b5-f4404f2d3d56 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1365 microversion: 2.1 time: 0.155962 Oct 31 16:19:15.320174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3361/6848] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:15 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:16.341698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:16.346840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:16.347555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:16.354087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:16.355091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:16.355845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:16.356556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:16.357056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:16.357490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:16.488708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:16.496574 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e02f9e2-8486-4672-8036-50fd097a7660 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1551 microversion: 2.1 time: 0.155964 Oct 31 16:19:16.497246 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3488/6849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:16 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:16.519397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:16.519911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:16.521816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:16.522660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:16.529747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:16.530251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:16.530708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:16.531416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:16.531892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:16.532336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:16.609242 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d953b131-f861-4f74-9eb4-7af28cf55788 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093593 Oct 31 16:19:16.609871 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3362/6850] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 16:19:16 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:17.523895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-df777ade-7c6c-460f-b0f9-affe3ea5179f req-cf5fcd76-1045-4ade-880a-09bb6a49977a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:17.534070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-df777ade-7c6c-460f-b0f9-affe3ea5179f req-cf5fcd76-1045-4ade-880a-09bb6a49977a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:17.534550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-df777ade-7c6c-460f-b0f9-affe3ea5179f req-cf5fcd76-1045-4ade-880a-09bb6a49977a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:17.534995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-df777ade-7c6c-460f-b0f9-affe3ea5179f req-cf5fcd76-1045-4ade-880a-09bb6a49977a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:17.546490 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-df777ade-7c6c-460f-b0f9-affe3ea5179f req-cf5fcd76-1045-4ade-880a-09bb6a49977a service nova] Creating event network-changed:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h2-858383-17 Oct 31 16:19:17.551553 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-df777ade-7c6c-460f-b0f9-affe3ea5179f req-cf5fcd76-1045-4ade-880a-09bb6a49977a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031350 Oct 31 16:19:17.552584 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3489/6851] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:50.474618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:50.475657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=49 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:50.480008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-71ff68c6-0851-4166-a9a2-f98caf799b6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:50.489473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71ff68c6-0851-4166-a9a2-f98caf799b6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:50.489980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71ff68c6-0851-4166-a9a2-f98caf799b6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:50.490435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71ff68c6-0851-4166-a9a2-f98caf799b6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:50.513317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-71ff68c6-0851-4166-a9a2-f98caf799b6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Going to try to stop instance {{(pid=120626) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 16:19:50.555940 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-71ff68c6-0851-4166-a9a2-f98caf799b6e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action" status: 202 len: 0 microversion: 2.1 time: 0.083696 Oct 31 16:19:50.556549 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3363/6852] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:19:50 2022] POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:19:50.566769 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:19:50.567332 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef (ip 10.222.0.48) !!! Oct 31 16:19:50.569785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=9 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:50.571220 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=38 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:50.586625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:50.587343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:50.596173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:50.596662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:50.597144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:50.597845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:50.598310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:50.598743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:50.789893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:50.797720 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee9a5211-1359-4728-a1ab-bc7d25fd75d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.235137 Oct 31 16:19:50.798297 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3490/6853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:50 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:51.821710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:51.822920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:51.829179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:51.829681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:51.830136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:51.830845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:51.831321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:51.831764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:52.014524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:52.022282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cd62cd61-345a-4df3-a303-6ad62aceb3d8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.205839 Oct 31 16:19:52.022854 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3364/6854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:51 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:53.045322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:53.045879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:53.052918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:53.053403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:53.053837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:53.054524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:53.054984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:53.055409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:53.183620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:53.191644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e789ba4-1945-43e2-aa17-0602f2d96363 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.150363 Oct 31 16:19:53.192214 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3491/6855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:53 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:54.216832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:54.217469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:54.223866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:54.224363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:54.224840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:54.225544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:54.226014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:54.226472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:54.363387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:54.371712 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-92d846f0-b65a-4a34-ab35-aba343521534 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.159077 Oct 31 16:19:54.372280 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3365/6856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:54 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:55.395060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:55.395668 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:55.402498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:55.402976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:55.403405 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:55.404094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:55.404549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:55.405001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:55.532981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:55.540633 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b7071ee3-8b92-4195-aeb3-c4e30e53f127 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.149509 Oct 31 16:19:55.541308 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3492/6857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:55 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:56.564933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:56.565491 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:56.572313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:56.572934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:56.573395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:56.574137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:56.574604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:56.575049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:56.706349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:56.714639 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-477e1c88-16a6-4aa2-a27e-45780bccfe74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.153773 Oct 31 16:19:56.715212 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3366/6858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:56 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:57.737882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:57.738497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:57.745440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:57.745919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:57.746353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:57.747063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:57.747521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:57.747940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:57.875351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:57.883772 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-113c8252-d2ac-402b-9d1a-631cd9dd1db4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.149846 Oct 31 16:19:57.884351 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3493/6859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:57 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:58.906749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:58.907385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:58.914171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:58.914675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:58.915131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:58.916344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:58.916854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:58.917303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:59.045049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:59.052669 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9248de1b-7014-44e3-a6e4-a1f2f5e16feb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.149889 Oct 31 16:19:59.053270 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3367/6860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:58 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:00.077222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:00.077834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:00.084607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:00.085142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:00.085580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:00.086269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:00.086721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:00.087142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:00.219394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:00.227237 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db3ab5df-b1b8-404f-8a34-4bf69808cd2c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.153875 Oct 31 16:20:00.227816 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3494/6861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:00 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:20:01.250991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:01.251623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:01.258910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:01.259439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:01.259935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:01.260640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:01.261139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:01.261579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:01.389564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:01.397178 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f415ad5d-6faa-42e4-946b-028c871fb4f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.150104 Oct 31 16:20:01.397747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3368/6862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:01 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:02.421356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:02.421952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:02.429068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:02.429484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:02.429924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:02.430622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:02.431085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:02.431542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:02.564829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:02.573194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d09b1358-6144-4afb-8612-ee3258d006fb tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.155708 Oct 31 16:20:02.573758 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3495/6863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:02 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:03.597392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:03.597919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:03.605898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:03.606400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:03.606885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:03.607596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:03.608068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:03.608510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:03.737638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:03.745435 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-adb9f3f8-7a60-41f8-bb7b-12a9ee94d768 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.152097 Oct 31 16:20:03.746010 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3369/6864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:03 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:04.768742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:04.769361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:04.776821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:04.777302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:04.777735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:04.778422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:04.778877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:04.779309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:04.907821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:04.915591 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c740ffb-821f-4e0c-90a4-39b09c767084 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.150781 Oct 31 16:20:04.916447 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3496/6865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:04 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:05.939547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:05.940179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:05.947263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:05.947765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:05.948220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:05.949042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:05.949555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:05.950027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.080836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:06.090034 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f29cf57a-0972-4beb-99dc-eceaf09753d2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1657 microversion: 2.1 time: 0.154366 Oct 31 16:20:06.090949 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3370/6866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:05 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:06.113395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:06.115788 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:06.122834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:06.123321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:06.123764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.124464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:06.124954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:06.125385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.156217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:06.161705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Old instance type m1.heat2, new instance type m1.heat {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:20:06.169044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:20:06.169469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:20:06.169946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:20:06.170360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:20:06.170773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:20:06.235140 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a1824a0-e5b3-4f83-979b-3638e674253b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action" status: 202 len: 0 microversion: 2.1 time: 0.125855 Oct 31 16:20:06.235656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3497/6867] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:20:06 2022] POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:20:06.244594 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:06.245265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:06.251540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:06.251949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:06.252401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.253341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:06.253614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:06.254565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.414978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:06.423925 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b2b2fc9-7a2d-42aa-9115-e460e1257931 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.183883 Oct 31 16:20:06.424493 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3371/6868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:06 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:20:07.449387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:07.450010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:07.456886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:07.457373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:07.457816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:07.458510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:07.458971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:07.459400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:07.589770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:07.597775 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e407fdd-8e02-4623-9786-b2b779cff5aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1680 microversion: 2.1 time: 0.153868 Oct 31 16:20:07.598358 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3498/6869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:07 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:08.621136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:08.621768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:08.628569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:08.629364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:08.629815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:08.630519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:08.630992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:08.631434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:08.766881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:08.774585 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d7db6288-e316-4d6b-a9dd-344397b83e00 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1685 microversion: 2.1 time: 0.158157 Oct 31 16:20:08.775869 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3372/6870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:08 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:09.798186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:09.798839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:09.805711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:09.806800 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:09.807264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:09.807963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:09.808429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:09.808886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:09.982611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:09.991082 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3f0aab0-e807-4286-86bf-437f08a783c4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1685 microversion: 2.1 time: 0.196733 Oct 31 16:20:09.991854 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3499/6871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:09 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1685 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:10.737552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "name": "network-vif-unplugged", "status": "completed", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:10.748070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:10.748629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:10.749114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:10.761577 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] Creating event network-vif-unplugged:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h1-858383-17 Oct 31 16:20:10.767460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:20:10.779541 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-11e4dd51-70a9-4dcc-a624-f98bf30be7dd req-d61ae84a-7c0b-4660-8b88-68fa5ac24b9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108977 Oct 31 16:20:10.780165 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3373/6872] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:11.015957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:11.016718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:11.023534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:11.024026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:11.024468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:11.025810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:11.026274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:11.026707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:11.238617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:11.246752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83bfcadc-6526-4e98-b6cd-1de38f5117e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1684 microversion: 2.1 time: 0.234661 Oct 31 16:20:11.247427 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3500/6873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:11 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:12.272747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:12.273413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:12.280629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.281168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.281623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.282330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.282806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.283251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.417191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:12.425171 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4c05062c-4a3a-4ff7-acee-106edfa925f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1682 microversion: 2.1 time: 0.156742 Oct 31 16:20:12.425758 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3374/6874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:12 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:12.807581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:12.818460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.819098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.819527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.831527 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] Creating event network-changed:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h1-858383-17 Oct 31 16:20:12.836964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:20:12.848129 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-eda4ab7a-bbe4-4d86-9a73-2696a3500122 req-efdc76ba-e2be-4323-9887-9ff1de9bc917 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044377 Oct 31 16:20:12.848750 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3501/6875] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:13.448887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:13.449515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:13.456223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:13.456741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:13.457197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:13.457899 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:13.458365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:13.458807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:13.588690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:13.596347 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-01e4a5b3-1395-467b-8779-d5c447ccea3e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1682 microversion: 2.1 time: 0.151402 Oct 31 16:20:13.596960 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3375/6876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:13 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:14.623508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:14.624234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:14.630703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:14.631225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:14.631666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:14.632363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:14.632863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:14.633297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:14.867125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:14.878073 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43b4768e-e4dc-4e4a-985d-068c4e347b48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1682 microversion: 2.1 time: 0.260711 Oct 31 16:20:14.878670 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3502/6877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:14 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:15.902550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:15.903182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:15.910504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:15.911077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:15.911533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:15.912249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:15.912738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:15.913182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.053160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:16.063008 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-645637f5-f96d-44bb-b597-105b7b52347f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1678 microversion: 2.1 time: 0.164288 Oct 31 16:20:16.064027 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3376/6878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:15 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:16.087099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:16.088525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:16.097235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.097738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.098172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.099079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.099545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.099978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.167923 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-216f8c19-aa65-44fd-8fd5-9b7ffa71e770 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action" status: 204 len: 0 microversion: 2.1 time: 0.084744 Oct 31 16:20:16.168584 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3503/6879] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:20:16 2022] POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:20:16.176956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:16.177599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:16.183930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.184444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.184953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.185933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.186547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.186947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.402457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:16.410534 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0fab4263-40cb-4cb5-8ce2-aac7c04a1618 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1678 microversion: 2.1 time: 0.237709 Oct 31 16:20:16.411124 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3377/6880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:16 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:17.435508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:17.436222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:17.442578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.443066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.443505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.444202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.444662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.445127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.460760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:17.582517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:17.590362 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-59b6f9bc-f66f-470a-96f1-026c70d211f0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1657 microversion: 2.1 time: 0.160578 Oct 31 16:20:17.590933 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3504/6881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:17 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:17.612929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:17.613573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:17.621011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.621516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.621972 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.622687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.623192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.623639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.759035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:17.762576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:17.768764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5f859a19-fd42-489f-9836-802d67fac1a2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1657 microversion: 2.1 time: 0.159825 Oct 31 16:20:17.769365 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3378/6882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:17 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:17.791917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4bb83f73-a180-4b91-9847-a22fafe1d599 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:17.797991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bb83f73-a180-4b91-9847-a22fafe1d599 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.798467 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bb83f73-a180-4b91-9847-a22fafe1d599 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.798898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4bb83f73-a180-4b91-9847-a22fafe1d599 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.821429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4bb83f73-a180-4b91-9847-a22fafe1d599 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Going to try to start instance {{(pid=120625) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 16:20:17.863139 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4bb83f73-a180-4b91-9847-a22fafe1d599 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action" status: 202 len: 0 microversion: 2.1 time: 0.075559 Oct 31 16:20:17.863732 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3505/6883] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:20:17 2022] POST /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:20:17.873112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:17.874237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:17.882343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.882850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.883305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.884250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:17.884677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:17.885295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:18.058980 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:18.066932 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f364592a-2199-4ee2-9958-e39e1366c9c2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1666 microversion: 2.1 time: 0.198563 Oct 31 16:20:18.067722 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3379/6884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:17 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1666 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:18.150521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-937c75e2-17a8-4d70-89e1-beef784b0d1c req-9dca45e1-df97-4f41-81ec-3444406afda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "name": "network-vif-plugged", "status": "completed", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:18.161341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-937c75e2-17a8-4d70-89e1-beef784b0d1c req-9dca45e1-df97-4f41-81ec-3444406afda5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:18.161823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-937c75e2-17a8-4d70-89e1-beef784b0d1c req-9dca45e1-df97-4f41-81ec-3444406afda5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:18.162251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-937c75e2-17a8-4d70-89e1-beef784b0d1c req-9dca45e1-df97-4f41-81ec-3444406afda5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:18.174064 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-937c75e2-17a8-4d70-89e1-beef784b0d1c req-9dca45e1-df97-4f41-81ec-3444406afda5 service nova] Creating event network-vif-plugged:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h1-858383-17 Oct 31 16:20:18.178976 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-937c75e2-17a8-4d70-89e1-beef784b0d1c req-9dca45e1-df97-4f41-81ec-3444406afda5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110745 Oct 31 16:20:18.179575 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3506/6885] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:20:19.092211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:19.092783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:19.099757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.100254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.100726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.101429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.101900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.102340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.241325 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:19.250048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d34b2b4-efd6-45b0-adfc-10955285fc25 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1666 microversion: 2.1 time: 0.162157 Oct 31 16:20:19.250617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3380/6886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:19 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:20.275232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:20.275941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:20.282132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:20.282631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:20.283073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.283775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:20.284240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:20.284677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.416321 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:20.424155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1209b30f-8f4c-42c0-975a-4c76a670cc99 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1670 microversion: 2.1 time: 0.154073 Oct 31 16:20:20.424661 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3507/6887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:20 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:20.447701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:20.448240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:20.455009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:20.455508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:20.455958 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.456657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:20.457151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:20.457591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.482699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:20:20.543544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=39 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:20.559983 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-554f7d08-1ad6-4d4f-a6c3-f64730642b0c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 204 len: 0 microversion: 2.1 time: 0.116623 Oct 31 16:20:20.560586 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3381/6888] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:20:20 2022] DELETE /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:20:20.569257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:20.569879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:20.576070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:20.576557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:20.577032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.577731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:20.578192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:20.578624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.706553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:20.714327 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c85f9a5-c26a-479b-95d0-724df9fd55e7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1676 microversion: 2.1 time: 0.149029 Oct 31 16:20:20.714893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3508/6889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:20 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:20:21.738657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:21.739344 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:21.746227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:21.746733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:21.747191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:21.747907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:21.748388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:21.748873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:21.880154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:21.888056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6b4fb255-52e8-4d03-b231-d6cf2d8b3cda tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1676 microversion: 2.1 time: 0.153713 Oct 31 16:20:21.888635 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3382/6890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:21 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:22.806358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-10306f15-5de9-489c-8226-1150911f2387 req-a1473411-d753-4710-9b39-3c031674da98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c4f08f-7f76-461f-bc3c-985bd1891fef", "name": "network-vif-deleted", "tag": "bdd1c048-86e4-4f6c-ae0a-5779fdc33a51"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:22.815334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=43 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:22.821346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-10306f15-5de9-489c-8226-1150911f2387 req-a1473411-d753-4710-9b39-3c031674da98 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.822447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-10306f15-5de9-489c-8226-1150911f2387 req-a1473411-d753-4710-9b39-3c031674da98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.823264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-10306f15-5de9-489c-8226-1150911f2387 req-a1473411-d753-4710-9b39-3c031674da98 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.836588 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-10306f15-5de9-489c-8226-1150911f2387 req-a1473411-d753-4710-9b39-3c031674da98 service nova] Creating event network-vif-deleted:bdd1c048-86e4-4f6c-ae0a-5779fdc33a51 for instance 46c4f08f-7f76-461f-bc3c-985bd1891fef on n-h1-858383-17 Oct 31 16:20:22.844575 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-10306f15-5de9-489c-8226-1150911f2387 req-a1473411-d753-4710-9b39-3c031674da98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042502 Oct 31 16:20:22.845295 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3509/6891] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:22.911606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:22.912169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:22.919243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.919750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.920211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.920962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.921438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.921889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.954983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.955495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.955954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.956627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lazy-loading 'fault' on Instance uuid 46c4f08f-7f76-461f-bc3c-985bd1891fef {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:20:23.003649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:23.016264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3365ac72-15de-4344-aaf4-6df9a6407309 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 200 len: 1329 microversion: 2.1 time: 0.108554 Oct 31 16:20:23.017508 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3383/6892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:22 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:24.041964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:24.042621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:24.048953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.049434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.049870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.050552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.051010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.051436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.065103 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef HTTP/1.1 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '46c4f08f-7f76-461f-bc3c-985bd1891fef'} Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:24.066711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3071fcf4-0b60-4fa5-bc9e-1d59ec5b90fc tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 404 len: 111 microversion: 2.1 time: 0.030678 Oct 31 16:20:24.071792 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3510/6893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:24 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:20:24.084869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:24.085503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:24.092398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.092938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.093395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.094097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.094571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.095011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.108152 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef HTTP/1.1 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '46c4f08f-7f76-461f-bc3c-985bd1891fef'} Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:24.109837 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1efd4030-fcba-4299-b3be-9198e4b2f64b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 404 len: 111 microversion: 2.1 time: 0.030344 Oct 31 16:20:24.114482 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3384/6894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:24 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:20:24.160726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1961560407", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c"}], "security_groups": [{"name": "tempest-securitygroup--1135105184"}], "key_name": "tempest-keypair-1273366131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:24.268586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] validate_networks() for [('89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:20:24.675993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:20:24.676425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:20:24.676933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:20:24.677349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:20:24.677768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:20:24.687168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.687652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.688090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.688853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.689316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.689745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.707102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:20:24.712341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:20:24.724913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:20:24.727199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:20:24.773889 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b21aab9-82d8-4ddd-b0a3-38392ad7f3b7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.617153 Oct 31 16:20:24.774542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3511/6895] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:20:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:20:24.785915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1b1e35bb-68a5-45b3-b580-b3a3e492ac9d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:24.786553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1b1e35bb-68a5-45b3-b580-b3a3e492ac9d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:24.845099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1b1e35bb-68a5-45b3-b580-b3a3e492ac9d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:24.852295 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1b1e35bb-68a5-45b3-b580-b3a3e492ac9d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1239 microversion: 2.1 time: 0.070383 Oct 31 16:20:24.852916 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3385/6896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:24 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:25.877115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:25.877765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:25.886228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:25.886935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:25.887545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:25.888720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:25.889282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:25.889742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:25.976659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:25.984781 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9341da3-0342-4c63-91aa-eac4c8dedf81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1299 microversion: 2.1 time: 0.112456 Oct 31 16:20:25.985608 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3512/6897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:25 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:27.009370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:27.010133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:27.021659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:27.022162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:27.022615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:27.023326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:27.023802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:27.024273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:27.242885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:27.251152 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6999833b-f346-4d72-8ad0-39617e94848f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1365 microversion: 2.1 time: 0.245668 Oct 31 16:20:27.251747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3386/6898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:27 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:27.428428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-81ebb06c-0c0b-4c05-960f-ed0eb57b915d req-0cf75672-0779-4ece-9cf6-7c2b1a0ec129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:27.442413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-81ebb06c-0c0b-4c05-960f-ed0eb57b915d req-0cf75672-0779-4ece-9cf6-7c2b1a0ec129 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:27.442887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-81ebb06c-0c0b-4c05-960f-ed0eb57b915d req-0cf75672-0779-4ece-9cf6-7c2b1a0ec129 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:27.443314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-81ebb06c-0c0b-4c05-960f-ed0eb57b915d req-0cf75672-0779-4ece-9cf6-7c2b1a0ec129 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:27.455435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-81ebb06c-0c0b-4c05-960f-ed0eb57b915d req-0cf75672-0779-4ece-9cf6-7c2b1a0ec129 service nova] Creating event network-changed:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h1-858383-17 Oct 31 16:20:27.460193 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-81ebb06c-0c0b-4c05-960f-ed0eb57b915d req-0cf75672-0779-4ece-9cf6-7c2b1a0ec129 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036058 Oct 31 16:20:27.461580 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3513/6899] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:28.275105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:28.275741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:28.282687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:28.283190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:28.283645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:28.284357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:28.284936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:28.285387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:28.412352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:28.420843 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d6a4884-0a49-4113-b601-e7784d3e47e4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1365 microversion: 2.1 time: 0.149660 Oct 31 16:20:28.421418 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3387/6900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:28 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:29.445020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:29.445644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:29.451878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:29.452357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:29.452819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:29.453508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:29.453962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:29.454382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:29.919482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:29.927274 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a09f23f9-a164-4f32-bfdc-0287d86043b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1365 microversion: 2.1 time: 0.487439 Oct 31 16:20:29.940908 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3514/6901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:29 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:30.952723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:30.953396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:30.960248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:30.960774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:30.961227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:30.961929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:30.962401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:30.962842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:31.092681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:31.100351 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03813212-2e55-482e-a0af-5ef0c3f4951d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1365 microversion: 2.1 time: 0.152148 Oct 31 16:20:31.100956 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3388/6902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:30 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:32.079964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d9923b37-bdfe-432e-8fe1-925569daeee4 req-7cd717df-0e0a-4ebb-bf9f-b3ff08c007b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "name": "network-vif-plugged", "status": "completed", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:32.091539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d9923b37-bdfe-432e-8fe1-925569daeee4 req-7cd717df-0e0a-4ebb-bf9f-b3ff08c007b5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:32.092525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d9923b37-bdfe-432e-8fe1-925569daeee4 req-7cd717df-0e0a-4ebb-bf9f-b3ff08c007b5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:32.092525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d9923b37-bdfe-432e-8fe1-925569daeee4 req-7cd717df-0e0a-4ebb-bf9f-b3ff08c007b5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:32.106378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d9923b37-bdfe-432e-8fe1-925569daeee4 req-7cd717df-0e0a-4ebb-bf9f-b3ff08c007b5 service nova] Creating event network-vif-plugged:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h1-858383-17 Oct 31 16:20:32.112432 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d9923b37-bdfe-432e-8fe1-925569daeee4 req-7cd717df-0e0a-4ebb-bf9f-b3ff08c007b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036206 Oct 31 16:20:32.113098 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3515/6903] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:32.125452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:32.126398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:32.134044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:32.134794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:32.135510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:32.136717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:32.137288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:32.138069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:32.357615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:32.365449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-650319ef-a9f0-49ca-b549-3a86250c7bd2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1365 microversion: 2.1 time: 0.245969 Oct 31 16:20:32.366035 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3389/6904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:32 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:33.391072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:33.391780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:33.398048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:33.398538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:33.398978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:33.399673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:33.400138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:33.400573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:33.529875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:33.537570 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e758cc50-4550-4852-9c3e-c093f520d707 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1365 microversion: 2.1 time: 0.152252 Oct 31 16:20:33.538132 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3516/6905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:33 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:34.560407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:34.561279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:34.568085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:34.568912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:34.569407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:34.570134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:34.570612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:34.571062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:34.705210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:34.712892 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-46fa1931-f122-477c-940d-e072603d0f80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1552 microversion: 2.1 time: 0.156442 Oct 31 16:20:34.713469 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3390/6906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:34 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:34.736682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:34.737235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:34.740053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:34.740856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:34.747090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:34.747928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:34.748045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:34.748783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:34.749189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:34.749649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:34.827196 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-676e800c-a53b-40b4-ae4c-3604947389d0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094362 Oct 31 16:20:34.827801 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3517/6907] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 16:20:34 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:35.751678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-bcb16eaa-25b7-4076-bdf6-118c74fac692 req-18e1ad18-0e99-48f9-8499-c655523d3017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:35.756776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:35.764067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bcb16eaa-25b7-4076-bdf6-118c74fac692 req-18e1ad18-0e99-48f9-8499-c655523d3017 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:35.764569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bcb16eaa-25b7-4076-bdf6-118c74fac692 req-18e1ad18-0e99-48f9-8499-c655523d3017 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:35.765058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-bcb16eaa-25b7-4076-bdf6-118c74fac692 req-18e1ad18-0e99-48f9-8499-c655523d3017 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:35.775950 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-bcb16eaa-25b7-4076-bdf6-118c74fac692 req-18e1ad18-0e99-48f9-8499-c655523d3017 service nova] Creating event network-changed:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h1-858383-17 Oct 31 16:20:35.781309 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-bcb16eaa-25b7-4076-bdf6-118c74fac692 req-18e1ad18-0e99-48f9-8499-c655523d3017 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Oct 31 16:20:35.781923 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3391/6908] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:21:47.773490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:47.774360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:47.775616 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:21:47.775785 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/action (ip 10.222.0.48) !!! Oct 31 16:21:47.784947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:47.787236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:47.797037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:47.797530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:47.797962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:47.798660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:47.799124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:47.799552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:47.826972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:47.832866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Old instance type m1.heat2, new instance type m1.heat {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:21:47.839203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:21:47.839623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:21:47.840097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:21:47.840505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:21:47.840941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:21:47.906392 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae5e576a-38ac-40c4-ab08-e3992eee4ae1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/action" status: 202 len: 0 microversion: 2.1 time: 0.135074 Oct 31 16:21:47.907133 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3518/6909] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:21:47 2022] POST /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:21:47.914166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:47.914985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:47.916098 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:21:47.916246 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 (ip 10.222.0.48) !!! Oct 31 16:21:47.917294 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:21:47.917611 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 (ip 10.222.0.48) !!! Oct 31 16:21:47.923108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:47.923837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:47.935745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:47.936339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:47.936934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:47.937659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:47.938136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:47.938585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:48.107413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:48.115878 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-efd0631a-d150-433d-9d38-fe1fdf86e8da tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1680 microversion: 2.1 time: 0.204504 Oct 31 16:21:48.116476 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3392/6910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:47 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:49.141373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:49.142007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:49.148009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:49.148580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:49.149038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:49.149757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:49.150225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:49.150777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:49.372307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:49.380748 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-719193e7-707a-4c25-a729-d6bbedb886f2 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1680 microversion: 2.1 time: 0.244440 Oct 31 16:21:49.381333 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3519/6911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:49 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:50.404435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:50.405635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:50.412770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:50.413282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:50.413741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:50.414456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:50.414935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:50.415383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:50.542754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:50.550560 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a0aa6217-e300-402f-bc08-a1b5a05ec9c5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.150476 Oct 31 16:21:50.551142 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3393/6912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:50 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:51.575972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:51.576586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:51.583999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:51.584477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:51.584934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:51.585619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:51.586074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:51.586497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:51.719239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:51.727894 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8bb4313b-560b-4641-b346-d24f389be687 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.155783 Oct 31 16:21:51.728472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3520/6913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:51 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:52.751768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:52.752403 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:52.759560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:52.760062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:52.760513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:52.761248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:52.761721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:52.762171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:52.891662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:52.899393 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-040cadba-fa88-4677-96b5-e86487b1f188 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.152188 Oct 31 16:21:52.899976 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3394/6914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:52 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:53.921652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:53.922267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:53.928593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:53.929105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:53.929541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:53.930224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:53.930700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:53.931107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:54.057263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:54.065490 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-194f93eb-f5de-4b87-b786-be3197a8ae62 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.147820 Oct 31 16:21:54.066069 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3521/6915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:53 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:55.088868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:55.089526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:55.095755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:55.096255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:55.096729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:55.097464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:55.097945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:55.098387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:55.228971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:55.237482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ccb5e994-65e4-491b-ac22-b738a996fbfa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.152732 Oct 31 16:21:55.238062 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3395/6916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:55 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:56.261478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:56.262101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:56.269120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.269607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.270044 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.270739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.271205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.271638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.399920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:56.408294 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f79b26a-9683-4338-a56a-1eb61354d3f6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.150758 Oct 31 16:21:56.408905 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3522/6917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:56 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:57.432178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:57.432836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:57.439713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:57.440209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:57.440664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:57.441398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:57.441867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:57.442309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:57.575488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:57.583745 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-476413af-1d2f-4d4b-aa96-0cfba635417a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.155528 Oct 31 16:21:57.584312 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3396/6918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:57 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:58.607631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:58.609110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:58.616098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:58.616588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:58.617098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:58.617993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:58.618460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:58.618893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:58.746255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:58.754373 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a2d7cfb-20c5-4232-8fd9-3a94bb041e35 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.150701 Oct 31 16:21:58.755202 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3523/6919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:58 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:59.777936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:59.778567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:59.785688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:59.786188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:59.786645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:59.787352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:59.787826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:59.788274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:59.916381 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:59.924624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-af70bfdc-5c95-447a-b1b5-e315c9a0165e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.150698 Oct 31 16:21:59.925225 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3397/6920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:59 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:22:00.948584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:00.949237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:00.956105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:00.956602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:00.957051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:00.957742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:00.958200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:00.958626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:01.422141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:01.430042 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a231c9a8-3f2d-45a2-8e5d-8318092ee794 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1685 microversion: 2.1 time: 0.485254 Oct 31 16:22:01.430554 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3524/6921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:00 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1685 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:02.276032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "name": "network-vif-unplugged", "status": "completed", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:02.288004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:02.288511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:02.288994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:02.300994 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] Creating event network-vif-unplugged:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h2-858383-17 Oct 31 16:22:02.306481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:22:02.318093 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5885d7aa-0c89-4175-81ec-911356b8ad5b req-6cad4c93-e085-463c-ba17-e4b3ffdb15a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046266 Oct 31 16:22:02.318728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3398/6922] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:02.454546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:02.455200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:02.462120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:02.462618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:02.463062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:02.463773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:02.464239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:02.464673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:02.661566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:02.669319 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7994b724-a6d8-48d8-a3e5-9d34225893be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1684 microversion: 2.1 time: 0.218908 Oct 31 16:22:02.670100 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3525/6923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:02 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1684 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:03.694506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:03.695245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:03.701454 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:03.701959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:03.702954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:03.703642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:03.704116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:03.704566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:03.843387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:03.851040 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-65243c10-54f5-4436-a8bd-7f0447abb934 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1682 microversion: 2.1 time: 0.161737 Oct 31 16:22:03.851629 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3399/6924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:03 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:04.355834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:04.366535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:04.367182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:04.367616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:04.379587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] Creating event network-changed:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h2-858383-17 Oct 31 16:22:04.385133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:22:04.396162 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e53fb085-3ddc-406d-94b9-9a0a218e4fa2 req-b58fb902-c3b1-4800-ad2c-69f0c5387119 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044240 Oct 31 16:22:04.396780 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3526/6925] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:04.874813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:04.875725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:04.882942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:04.883453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:04.883915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:04.884647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:04.885154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:04.885611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.210777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:05.218637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1f01d94-2007-4d89-8e3f-70c3dd8fc04a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1679 microversion: 2.1 time: 0.348186 Oct 31 16:22:05.219223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3400/6926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:04 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:05.242288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:05.242913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:05.249183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.250446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.250879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.251572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.252029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.252456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.289310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.289799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.290240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.290983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.291436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.291856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.313234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:22:05.318747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:22:05.422605 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ce3719d-a6b4-4b68-8c33-928f45976491 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/action" status: 202 len: 0 microversion: 2.1 time: 0.184064 Oct 31 16:22:05.423318 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3527/6927] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:22:05 2022] POST /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:22:05.431621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:05.432328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:05.439094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.439607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.440073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.440935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.441429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.441927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.639154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:05.647469 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-036f6f4f-4e8a-4382-b5b3-e022f8a5f9a4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.219754 Oct 31 16:22:05.648059 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3401/6928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:05 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:22:06.673160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:06.673865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:06.681029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:06.681516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:06.681989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:06.682688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:06.683151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:06.683581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:06.816910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:06.824650 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d0b82fe-209b-4d4b-81e2-ae252bc303e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.157228 Oct 31 16:22:06.825252 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3528/6929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:06 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:07.848326 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:07.849562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:07.856322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:07.856884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:07.857338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:07.858051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:07.858525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:07.859740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:07.993021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:08.002442 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-07794f2f-e82d-4f2d-b378-60c54d99ee24 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.158340 Oct 31 16:22:08.003151 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3402/6930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:07 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:08.838398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:08.850756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:08.850962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:08.851392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:08.865951 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] Creating event network-changed:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h1-858383-17 Oct 31 16:22:08.871743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:22:08.883434 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ff358a05-1d8c-40f4-8389-ff2a9c16b810 req-737d9c01-764e-4db3-a975-9433620678b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049011 Oct 31 16:22:08.884470 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3529/6931] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:22:09.027666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:09.028299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:09.035957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:09.036470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:09.036947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:09.037666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:09.038149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:09.038621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:09.641087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:09.648943 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-34e4b197-3982-44d6-8a33-620336770e5d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.625154 Oct 31 16:22:09.649521 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3403/6932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:09 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:10.675320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:10.676025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:10.683030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:10.683517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:10.683951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:10.684642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:10.685126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:10.685555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:10.819177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:10.822786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:10.828614 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4795b085-91cc-463e-afae-388745ff8daf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.158357 Oct 31 16:22:10.829223 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3530/6933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:10 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:11.851875 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:11.852504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:11.859987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:11.860487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:11.860982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:11.861722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:11.862201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:11.862643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:11.991887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:12.000554 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-61a20bd8-3834-441a-98bd-e08dc9f2962f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.152586 Oct 31 16:22:12.001441 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3404/6934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:11 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:13.023815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:13.024463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:13.033485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:13.033983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:13.034433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:13.035135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:13.035602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:13.036033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:13.268629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:13.276709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10e6c30a-905f-4735-a48d-e5acb51e9208 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1678 microversion: 2.1 time: 0.256779 Oct 31 16:22:13.277408 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3531/6935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:13 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:14.301900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:14.302542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:14.309619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.310126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.310583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.311302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.312387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.312956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.443211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:14.451184 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-935b04a9-b422-4dde-8afc-2a7944f42196 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1671 microversion: 2.1 time: 0.153199 Oct 31 16:22:14.451796 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3405/6936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:14 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:14.474336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:14.474928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:14.481848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.482336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.482777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.483514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.483990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.484411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.624552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:14.634793 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60027688-b781-4b72-b033-f346ed865734 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1671 microversion: 2.1 time: 0.164289 Oct 31 16:22:14.635607 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3532/6937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:14 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:14.659412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:14.660170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:14.666197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.666796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.667354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.668127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.668669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.669208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.807117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:14.815285 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aebde4e4-2e00-4adc-a5ff-05f3e22fc32b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1671 microversion: 2.1 time: 0.160731 Oct 31 16:22:14.815860 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3406/6938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:14 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:14.837785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:14.838286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:14.844925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.845445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.845887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.846581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.847042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.847470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.872954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:22:14.956748 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cb5b60a-8d1e-4c87-9556-bd746a171a81 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 204 len: 0 microversion: 2.1 time: 0.122390 Oct 31 16:22:14.957959 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3533/6939] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:14 2022] DELETE /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:22:14.966010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:14.966749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:14.973853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.974361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.974821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.975538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.976017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.976554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:15.114955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:15.123484 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-87e32ebb-5ee9-40d1-b0c8-2f04eeb8aa0b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1677 microversion: 2.1 time: 0.161399 Oct 31 16:22:15.124947 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3407/6940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:14 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:16.149784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:16.150499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:16.152469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:16.159160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.159656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.160130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.160872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.161368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.161805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.297383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:16.305287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-154632cd-fdd8-4c6f-a369-fde73137cadf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1677 microversion: 2.1 time: 0.160250 Oct 31 16:22:16.306005 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3534/6941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:16 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:16.600927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3d315a06-371c-4e81-b463-f1301add70b4 req-6eaa91aa-f1fe-4e65-b84f-121e56262181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "name": "network-vif-plugged", "status": "completed", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:16.612775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d315a06-371c-4e81-b463-f1301add70b4 req-6eaa91aa-f1fe-4e65-b84f-121e56262181 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.613286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d315a06-371c-4e81-b463-f1301add70b4 req-6eaa91aa-f1fe-4e65-b84f-121e56262181 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.613737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3d315a06-371c-4e81-b463-f1301add70b4 req-6eaa91aa-f1fe-4e65-b84f-121e56262181 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.627836 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3d315a06-371c-4e81-b463-f1301add70b4 req-6eaa91aa-f1fe-4e65-b84f-121e56262181 service nova] Creating event network-vif-plugged:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h1-858383-17 Oct 31 16:22:16.633750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3d315a06-371c-4e81-b463-f1301add70b4 req-6eaa91aa-f1fe-4e65-b84f-121e56262181 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036613 Oct 31 16:22:16.634984 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3408/6942] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:17.330646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:17.331262 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:17.338875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:17.339387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:17.340008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:17.340743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:17.341209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:17.341967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:17.406991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-33d2eba6-7518-4ef2-8a18-338df6da085a req-3f2cc9a3-8052-4d5d-86b7-4bff7ab78d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af25822-42b7-4cb7-8d5c-974d4c448021", "name": "network-vif-deleted", "tag": "4189b20b-221c-4176-baf7-1e9778abf2d6"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:17.419307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-33d2eba6-7518-4ef2-8a18-338df6da085a req-3f2cc9a3-8052-4d5d-86b7-4bff7ab78d32 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:17.420020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-33d2eba6-7518-4ef2-8a18-338df6da085a req-3f2cc9a3-8052-4d5d-86b7-4bff7ab78d32 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:17.420609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-33d2eba6-7518-4ef2-8a18-338df6da085a req-3f2cc9a3-8052-4d5d-86b7-4bff7ab78d32 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:17.421698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:17.430261 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-340af2d5-a397-44fd-b888-a7a90ada0854 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 200 len: 1609 microversion: 2.1 time: 0.104125 Oct 31 16:22:17.432735 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3535/6943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:17 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 1609 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:17.448013 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-33d2eba6-7518-4ef2-8a18-338df6da085a req-3f2cc9a3-8052-4d5d-86b7-4bff7ab78d32 service nova] Creating event network-vif-deleted:4189b20b-221c-4176-baf7-1e9778abf2d6 for instance 4af25822-42b7-4cb7-8d5c-974d4c448021 on n-h1-858383-17 Oct 31 16:22:17.453059 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-33d2eba6-7518-4ef2-8a18-338df6da085a req-3f2cc9a3-8052-4d5d-86b7-4bff7ab78d32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050714 Oct 31 16:22:17.454820 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3409/6944] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:18.456572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:18.457247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:18.460019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:18.466132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.466663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.467111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.467837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.468297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.468753 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.483834 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 HTTP/1.1 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '4af25822-42b7-4cb7-8d5c-974d4c448021'} Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:18.485945 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-701d1dbf-979d-4eb4-a53e-70ab39772969 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 404 len: 111 microversion: 2.1 time: 0.035847 Oct 31 16:22:18.491083 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3536/6945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:18 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:18.502759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:18.503496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:18.505774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=37 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:18.512032 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.512532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.513566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.514277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.514750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.515196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.518585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=99 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:18.530014 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 HTTP/1.1 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4af25822-42b7-4cb7-8d5c-974d4c448021'} Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:18.532244 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5c75b286-3807-4732-8ddd-d4cf827d13a8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 404 len: 111 microversion: 2.1 time: 0.036596 Oct 31 16:22:18.537090 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3410/6946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:18 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:18.583374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-407455968", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c"}], "security_groups": [{"name": "tempest-securitygroup--1135105184"}], "key_name": "tempest-keypair-1273366131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:18.688566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] validate_networks() for [('89ce94e1-10a9-46ff-98fa-a6ccdf3a5d5c', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:22:19.050147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:22:19.050576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:22:19.051054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:22:19.051466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:22:19.051877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:22:19.060767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:19.061253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:19.061691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:19.062418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:19.063440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:19.063853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:19.081176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:22:19.086439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:22:19.098770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:22:19.101077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:22:19.148974 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0cb2ffac-b98a-4533-a45c-6952c150644d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.570129 Oct 31 16:22:19.149528 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3537/6947] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:22:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:22:19.165144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6f42d0b1-5032-48f0-96d0-2feb851e937f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:19.165144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6f42d0b1-5032-48f0-96d0-2feb851e937f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:19.219128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6f42d0b1-5032-48f0-96d0-2feb851e937f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:19.226051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6f42d0b1-5032-48f0-96d0-2feb851e937f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1238 microversion: 2.1 time: 0.069179 Oct 31 16:22:19.226618 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3411/6948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:19 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:20.254213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:20.254639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:20.263025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:20.263846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:20.265490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:20.266353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:20.267006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:20.267443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:20.348113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:20.355904 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f14b0673-eb8a-458c-90c8-eaaf2e6aee29 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1308 microversion: 2.1 time: 0.109518 Oct 31 16:22:20.356483 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3538/6949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:20 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:21.380632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:21.381398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:21.389378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:21.389880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:21.391569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:21.392298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:21.392809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:21.393242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:21.604439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:21.613176 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-66b53930-99d5-4e66-bc8a-96daf97de651 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.236885 Oct 31 16:22:21.613765 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3412/6950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:21 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:21.677289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-62487e8a-74de-4e66-ad19-b57b18af745f req-9a82229d-f232-462f-ab05-e419350edf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:21.688797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-62487e8a-74de-4e66-ad19-b57b18af745f req-9a82229d-f232-462f-ab05-e419350edf69 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:21.689609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-62487e8a-74de-4e66-ad19-b57b18af745f req-9a82229d-f232-462f-ab05-e419350edf69 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:21.690109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-62487e8a-74de-4e66-ad19-b57b18af745f req-9a82229d-f232-462f-ab05-e419350edf69 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:21.701528 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-62487e8a-74de-4e66-ad19-b57b18af745f req-9a82229d-f232-462f-ab05-e419350edf69 service nova] Creating event network-changed:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:22:21.707166 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-62487e8a-74de-4e66-ad19-b57b18af745f req-9a82229d-f232-462f-ab05-e419350edf69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 Oct 31 16:22:21.708115 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3539/6951] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:22.637554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:22.638235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:22.645934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:22.646433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:22.646921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:22.647624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:22.648095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:22.648537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:22.779514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:22.788782 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6b70507a-c52e-428a-a07b-c806cb151396 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.155138 Oct 31 16:22:22.789366 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3413/6952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:22 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:23.814611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:23.815352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:23.821856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:23.822348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:23.822838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:23.823537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:23.824000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:23.824429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:23.952245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:23.960468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09d6d85d-340d-4feb-a914-94370fb75f2d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.151189 Oct 31 16:22:23.961077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3540/6953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:23 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:24.984331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:24.985568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:24.991780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:24.992272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:24.992743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:24.993443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:24.993913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:24.994356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:25.123631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:25.131555 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4c315685-b030-424e-8d54-f5d9b47db1b5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.151307 Oct 31 16:22:25.132131 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3414/6954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:24 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:26.155882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:26.156669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:26.163709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:26.164200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:26.164643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:26.165374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:26.165835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:26.166297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:26.632476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:26.641535 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56f51340-36d5-4ed5-ab9d-772987523cf6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.489030 Oct 31 16:22:26.642116 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3541/6955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:26 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:27.666005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:27.666641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:27.674288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.674789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.675243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.675959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.676436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.676911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.804837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:27.812360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fcb0d4e-7ef3-44b9-8bfa-70ee93bdb16a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.150344 Oct 31 16:22:27.813042 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3415/6956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:27 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:28.658876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ff9e92b1-af67-4adb-b3fc-0648956139ee req-c1151e9b-6acc-412c-82c8-22fbc08defad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "name": "network-vif-plugged", "status": "completed", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:28.669197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff9e92b1-af67-4adb-b3fc-0648956139ee req-c1151e9b-6acc-412c-82c8-22fbc08defad service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.669684 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff9e92b1-af67-4adb-b3fc-0648956139ee req-c1151e9b-6acc-412c-82c8-22fbc08defad service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.670111 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ff9e92b1-af67-4adb-b3fc-0648956139ee req-c1151e9b-6acc-412c-82c8-22fbc08defad service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.681620 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ff9e92b1-af67-4adb-b3fc-0648956139ee req-c1151e9b-6acc-412c-82c8-22fbc08defad service nova] Creating event network-vif-plugged:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:22:28.686380 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ff9e92b1-af67-4adb-b3fc-0648956139ee req-c1151e9b-6acc-412c-82c8-22fbc08defad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 Oct 31 16:22:28.686977 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3542/6957] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:28.835680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:28.836309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:28.843084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.843589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.844688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.845506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.845985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.846430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.977416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:28.985222 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dafc7cd0-19af-43dd-9833-90c7935dc850 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.153327 Oct 31 16:22:28.985806 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3416/6958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:28 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:30.006582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:30.007351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:30.013035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:30.013735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:30.021578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:30.022061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:30.022497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:30.023175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:30.023629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:30.024050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:30.156533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:30.164340 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-955b5ace-ebc9-4298-93bc-c9ba13b9a816 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1364 microversion: 2.1 time: 0.159011 Oct 31 16:22:30.166094 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3543/6959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:30 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:31.189748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:31.190386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:31.192292 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:31.198530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:31.199062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:31.199512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:31.200221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:31.200716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:31.201163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:31.329402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:31.337200 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ec07678d-8ccf-4680-a296-8345f1103448 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1550 microversion: 2.1 time: 0.151716 Oct 31 16:22:31.337784 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3417/6960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:31 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:31.362539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:31.363122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:31.371720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:31.372214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:31.373014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:31.373734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:31.374237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:31.374670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:31.450738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49698032-9775-4765-b08c-4211c2f54974 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092447 Oct 31 16:22:31.451344 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3544/6961] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Oct 31 16:22:31 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:32.387384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5f67b403-4ec3-4547-a72a-3b93e4766494 req-58aede85-1f83-49fb-a672-aaac8876b939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:32.397849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5f67b403-4ec3-4547-a72a-3b93e4766494 req-58aede85-1f83-49fb-a672-aaac8876b939 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:32.398343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5f67b403-4ec3-4547-a72a-3b93e4766494 req-58aede85-1f83-49fb-a672-aaac8876b939 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:32.398794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5f67b403-4ec3-4547-a72a-3b93e4766494 req-58aede85-1f83-49fb-a672-aaac8876b939 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:32.411039 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5f67b403-4ec3-4547-a72a-3b93e4766494 req-58aede85-1f83-49fb-a672-aaac8876b939 service nova] Creating event network-changed:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:22:32.416427 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5f67b403-4ec3-4547-a72a-3b93e4766494 req-58aede85-1f83-49fb-a672-aaac8876b939 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032843 Oct 31 16:22:32.417123 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3418/6962] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:46.262708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:46.263373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:46.270289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:46.270899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:46.279249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:46.279736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:46.280862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:46.281732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:46.282187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:46.282617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:46.419047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:46.426818 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-345e916c-32ff-4319-9ce4-eda7a533791a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1669 microversion: 2.1 time: 0.167675 Oct 31 16:23:46.427383 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3545/6963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:46 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:46.447565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=19 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:46.448328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=39 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:46.454538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4468825-3582-40d6-8136-8cc701aa4eff"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:46.457116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:46.464073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:46.464578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:46.465073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:46.465788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:46.466265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:46.466711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:46.727919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb86830b-c3ca-4cb2-b1e4-a3fc1755da48 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281841 Oct 31 16:23:46.728551 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3419/6964] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 16:23:46 2022] POST /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:58.502899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:58.505201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:58.507555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:58.508206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:58.513961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:58.514447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:58.514883 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:58.515565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:58.516018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:58.516442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:58.547936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:58.553470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Old instance type m1.heat2, new instance type m1.heat {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:23:58.560478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:23:58.560974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:23:58.561562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:23:58.562002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:23:58.562411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:23:58.624722 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eff518b3-4074-4665-84ba-d18655efde37 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/action" status: 202 len: 0 microversion: 2.1 time: 0.125941 Oct 31 16:23:58.625341 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3546/6965] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:23:58 2022] POST /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:23:58.634831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:58.635563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:58.638106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:58.638866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:58.645204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:58.645695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:58.646343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:58.647161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:58.647692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:58.648204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:58.805384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:58.814659 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d1098f8-0fe1-459e-b4f0-ad8c415eb699 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1724 microversion: 2.1 time: 0.184703 Oct 31 16:23:58.815417 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3420/6966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:58 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:59.839846 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:59.840401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:59.848086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:59.848583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:59.849052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:59.849770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:59.850255 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:59.850691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:00.026627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:00.035689 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-354cbbe4-53c3-488a-b597-444fbf4eeea5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1724 microversion: 2.1 time: 0.200731 Oct 31 16:24:00.036270 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3547/6967] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:59 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:01.060051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:01.060688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:01.067612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:01.068114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:01.068570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:01.069317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:01.069796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:01.070242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:01.203678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:01.211920 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08ff2dc0-9b84-4839-8372-aa9d75050701 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.155868 Oct 31 16:24:01.212504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3421/6968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:01 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:02.235913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:02.236528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:02.243373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:02.243855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:02.244289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:02.245003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:02.245458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:02.245881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:02.374317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:02.383005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f68a1803-bd5f-4ea4-a11b-16e813998056 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.151578 Oct 31 16:24:02.383580 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3548/6969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:02 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:03.406436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:03.407071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:03.413920 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:03.414425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:03.414885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:03.415605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:03.416084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:03.416530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:03.547700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:03.555862 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c88c1832-4a6b-4966-b07a-516fc4923f32 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.153514 Oct 31 16:24:03.556436 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3422/6970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:03 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:04.579938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:04.580492 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:04.587338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:04.587822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:04.588256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:04.588982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:04.589440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:04.589872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:04.724812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:04.733364 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f01610f0-d812-42c8-b2a7-9801f5ea0960 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.157649 Oct 31 16:24:04.733959 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3549/6971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:04 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:05.757968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:05.758660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:05.766404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:05.766916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:05.767375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:05.768095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:05.768575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:05.769090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:05.899549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:05.908612 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-924c5339-e798-4d76-83b6-9d0fd1dc3f89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.154890 Oct 31 16:24:05.909227 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3423/6972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:05 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:06.932238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:06.932955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:06.940479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:06.941005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:06.941449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:06.942150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:06.942619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:06.943052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:07.073711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:07.082365 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5750d6c-607d-4e07-bac7-da593f1bd1aa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.153812 Oct 31 16:24:07.082686 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3550/6973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:06 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:08.106035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:08.106669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:08.114007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:08.114512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:08.114966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:08.115683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:08.116161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:08.116612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:08.245419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:08.254454 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7149ffbf-4a30-466d-8375-5a52dc3686d1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.152407 Oct 31 16:24:08.255025 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3424/6974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:08 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:09.280261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:09.280916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:09.288251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:09.288866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:09.289354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:09.290103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:09.290647 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:09.291206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:09.428977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:09.438049 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-769e9475-d80c-4752-a5df-a9b2dd102d8f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.163087 Oct 31 16:24:09.438632 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3551/6975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:09 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:10.462082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:10.462719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:10.470573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:10.471096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:10.471557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:10.472270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:10.472781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:10.473229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:10.599755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:10.608305 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de53b088-e004-41b8-a66c-f72b6dcfd8be tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.150170 Oct 31 16:24:10.609512 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3425/6976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:10 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:11.632199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:11.632835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:11.639606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:11.640725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:11.641207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:11.641895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:11.642352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:11.642777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:11.770860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:11.779085 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb1b5f0e-4a0e-4c1b-b1d2-72851e837ba3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.151071 Oct 31 16:24:11.779660 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3552/6977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:11 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:12.803482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:12.804118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:12.811018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:12.811520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:12.812064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:12.812921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:12.813401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:12.813848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:12.947896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:12.956231 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e70fc5a4-4754-4fe6-89a6-d33ead31624b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.156698 Oct 31 16:24:12.956839 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3426/6978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:12 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:13.979445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:13.980055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:13.987481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:13.987981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:13.988403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:13.989115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:13.989573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:13.990000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:14.117434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:14.126506 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c4bdcea5-9ab0-4be4-b614-c14038e6b0d6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.150934 Oct 31 16:24:14.127085 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3553/6979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:13 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:15.151140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:15.151677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:15.159393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:15.159893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:15.160342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:15.161098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:15.161574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:15.162015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:15.301703 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:15.310135 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-444010f1-506a-4f29-826f-84b96eafc5d3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.162994 Oct 31 16:24:15.310715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3427/6980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:15 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:24:16.334623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:16.335154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:16.341939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:16.342422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:16.342856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:16.344327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:16.344810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:16.345236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:16.473115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:16.481322 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bb067ae-62f7-4ac3-956b-c8b91501dff1 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.150737 Oct 31 16:24:16.481888 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3554/6981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:16 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:17.506189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:17.506758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:17.513637 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:17.514139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:17.514599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:17.515954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:17.516434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:17.516925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:17.651307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:17.659656 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73d3820f-773d-4e7b-8ac7-5237fb143d82 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.157833 Oct 31 16:24:17.660246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3428/6982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:17 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:18.683396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:18.684010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:18.690919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:18.691406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:18.691847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:18.692541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:18.693030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:18.693460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:18.824504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:18.832916 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58d03e52-9ee8-4d84-831c-a5d604800a4f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.153415 Oct 31 16:24:18.833490 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3555/6983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:18 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:19.856439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:19.857106 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:19.864585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:19.865126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:19.865587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:19.866313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:19.866793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:19.867239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:19.995874 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:20.004412 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-699396f3-a56c-427a-9ac2-38878c429e5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.151934 Oct 31 16:24:20.005016 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3429/6984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:19 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:21.028419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:21.029084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:21.036118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:21.036616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:21.037084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:21.037790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:21.038253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:21.038685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:21.171093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:21.180035 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdca60ae-5817-4731-9e33-fab77e017fe0 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.155626 Oct 31 16:24:21.180604 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3556/6985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:21 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:22.203093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:22.203731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:22.210665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:22.211167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:22.211623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:22.212331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:22.212829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:22.213275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:22.343125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:22.351650 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f61a9d97-2843-4ee9-9d9d-b53a9b29062a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.152988 Oct 31 16:24:22.352227 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3430/6986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:22 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:23.375706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:23.376322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:23.383725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:23.384221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:23.384660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:23.385397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:23.385858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:23.386292 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:23.523771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:23.532332 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5756a2a2-8e26-445d-9c16-1f98cae08449 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.161100 Oct 31 16:24:23.533187 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3557/6987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:23 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:24.556065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:24.556827 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:24.563400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:24.564346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:24.564474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:24.565148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:24.565614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:24.566061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:24.712860 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:24.722676 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-594b3431-d5bc-49d0-b91a-9ba96d8954e8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1729 microversion: 2.1 time: 0.171058 Oct 31 16:24:24.723543 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3431/6988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:24 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:25.160979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "name": "network-vif-unplugged", "status": "completed", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:25.176733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:25.177437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:25.178072 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:25.190951 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] Creating event network-vif-unplugged:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h2-858383-17 Oct 31 16:24:25.196466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] Instance 981efbcf-9cfd-4f2b-a127-c794102701dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:24:25.209343 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-dab8a567-7e9c-46f1-9172-e080c21a73fa req-29a54ac6-73fc-41a6-b39d-4104e2118369 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053742 Oct 31 16:24:25.210027 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3558/6989] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:25.750236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:25.750892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:25.758532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:25.759040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:25.759496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:25.760215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:25.760774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:25.761156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:25.947880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:25.956856 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0e8244ec-32d5-4d5d-b58d-914876c0706a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1728 microversion: 2.1 time: 0.211134 Oct 31 16:24:25.957444 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3432/6990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:25 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:26.982419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:26.983120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:26.989533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:26.990020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:26.990497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:26.991174 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:26.991629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:26.992054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:27.134019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:27.143247 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7dcc86a3-c70a-48e6-9917-005b13a3c630 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.165982 Oct 31 16:24:27.144051 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3559/6991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:26 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:27.247049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:27.258402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:27.258908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:27.259357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:27.272279 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] Creating event network-changed:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h2-858383-17 Oct 31 16:24:27.278273 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] Instance 981efbcf-9cfd-4f2b-a127-c794102701dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:24:27.290120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-41b7bbd2-d188-436c-b4cb-b80e4ad994d2 req-430cebee-facd-4bb4-9833-3ec0e99d9dee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046870 Oct 31 16:24:27.290736 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3433/6992] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:28.168401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:28.169761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:28.178112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:28.178610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:28.179050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:28.179761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:28.180226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:28.180856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:28.314801 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:28.323111 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3464c34-fedb-43bd-8cf9-a780950cc374 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.159487 Oct 31 16:24:28.323682 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3560/6993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:28 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:29.348411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:29.349161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:29.351120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=29 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:29.356625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:29.357157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:29.357614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:29.358390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:29.359139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:29.359785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:29.362731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=83 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:29.497374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:29.506601 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0a351bd7-4f06-45ff-85be-d775122a159f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.163172 Oct 31 16:24:29.507189 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3434/6994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:29 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:30.531860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:30.532531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:30.535417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=35 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:30.540147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:30.540634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:30.541103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:30.541810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:30.542274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:30.542708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:30.546172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:30.676780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:30.685227 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87b41698-0daa-4e84-82d4-52722b725a19 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.158162 Oct 31 16:24:30.685811 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3561/6995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:30 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:31.708089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:31.709338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:31.716253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:31.716788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:31.717242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:31.717942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:31.718959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:31.719573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:31.855559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:31.863940 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-41eac7f2-08c0-4378-81c8-d92603cc7ccf tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.159796 Oct 31 16:24:31.864535 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3435/6996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:31 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:32.887656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:32.888268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:32.896172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:32.896654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:32.897124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:32.897818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:32.898278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:32.898704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:33.026574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:33.035432 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7728f8f-2427-4683-ad2e-9342983c6005 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.151758 Oct 31 16:24:33.036003 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3562/6997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:32 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:34.059967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:34.060593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:34.067616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:34.068111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:34.068559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:34.069289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:34.069759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:34.070199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:34.205803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:34.214168 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2e918409-4061-4927-bc53-1817eaf9153f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.158149 Oct 31 16:24:34.214757 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3436/6998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:34 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:35.237671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:35.238297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:35.245205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:35.245691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:35.246126 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:35.246814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:35.247267 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:35.247692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:35.376941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:35.385448 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55e79f2e-34e8-4358-90f0-1ff4e0ca9f6f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.151973 Oct 31 16:24:35.386024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3563/6999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:35 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:36.410514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:36.411141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:36.417974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:36.418470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:36.418917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:36.419618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:36.420086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:36.420524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:36.548545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:36.556844 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad5649f0-b25e-4ecc-8d79-da11758c9ed8 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.150913 Oct 31 16:24:36.557428 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3437/7000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:36 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:37.581484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:37.582011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:37.588887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:37.589376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:37.589811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:37.590510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:37.590971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:37.591400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:37.728508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:37.737452 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6030bfc2-2a89-4b19-acc2-bb3d0a1f07b4 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1726 microversion: 2.1 time: 0.161119 Oct 31 16:24:37.738039 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3564/7001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:37 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:38.761742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:38.762496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:38.770870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.771307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.771772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.772498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.773006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.773458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.910175 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:38.918473 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80fe6aab-9195-4a62-aee5-2f18bf2cacbd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1723 microversion: 2.1 time: 0.160702 Oct 31 16:24:38.919056 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3438/7002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:38 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:38.941660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:38.942223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:38.949163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.949651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.950091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.950795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.951288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.951779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.990219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.990698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.991136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.991855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.992312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.992762 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:39.013271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for project 16f115f1bd214b728735f7225e91d268. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:24:39.019102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Getting quotas for user ede4b8852ab149a0b57f02585580d00c and project 16f115f1bd214b728735f7225e91d268. Resources: {'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:24:39.119161 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ff7b837b-749a-4e49-bd4f-7c62e2c39d1e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "POST /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/action" status: 202 len: 0 microversion: 2.1 time: 0.181625 Oct 31 16:24:39.119764 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3565/7003] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:24:38 2022] POST /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:24:39.128257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:39.129027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:39.135470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:39.136231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:39.137019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:39.137687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:39.138168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:39.138616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:39.340863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:39.349737 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f9bd674b-b906-480a-80b4-847d7068dd80 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.225618 Oct 31 16:24:39.350881 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3439/7004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:39 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:40.376034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:40.376808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:40.384242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:40.384878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:40.385339 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:40.386108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:40.386562 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:40.387019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:40.521448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:40.529706 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-be7e35ee-fe2b-488d-949d-77f662e17859 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.158901 Oct 31 16:24:40.530277 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3566/7005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:40 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:41.553090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:41.553728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:41.560949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:41.561453 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:41.562506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:41.563522 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:41.564105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:41.564555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:41.698907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:41.710276 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-522ddb30-a37e-48fa-aa8b-5f7382b915af tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.161144 Oct 31 16:24:41.710968 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3440/7006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:41 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:42.087500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "name": "network-vif-plugged", "status": "completed", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:42.103242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:42.103721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:42.104149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:42.117125 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] Creating event network-vif-plugged:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h2-858383-17 Oct 31 16:24:42.122628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] Instance 981efbcf-9cfd-4f2b-a127-c794102701dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:24:42.134970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6166af4e-2b8e-44f2-ad63-837e94ef10cc req-7894cb81-a969-4ed5-b636-aadf1919c9c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053671 Oct 31 16:24:42.135855 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3567/7007] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:42.735307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:42.735944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:42.742939 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:42.743440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:42.743896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:42.744614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:42.745118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:42.745569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:42.877829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:42.886561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e69e2a4b-ccfd-4eff-8b44-6c9e6658b739 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.155655 Oct 31 16:24:42.894564 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3441/7008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:42 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:43.913119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:43.913743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:43.919872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:43.920385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:43.920858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:43.921593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:43.922047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:43.922471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:44.060137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:44.069155 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-95da8ab6-0f92-4226-ba95-c84f8847615a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.161258 Oct 31 16:24:44.069737 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3568/7009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:43 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:24:44.504062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "name": "network-vif-unplugged", "status": "completed", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:44.514572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:44.515813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:44.516374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:44.531240 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] Creating event network-vif-unplugged:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:24:44.536645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] Instance 981efbcf-9cfd-4f2b-a127-c794102701dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:24:44.547708 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9cf10867-4025-458a-9af3-269e7d48facf req-112a2591-fa8e-4834-8a43-3a0375ab8b88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048208 Oct 31 16:24:44.548332 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3442/7010] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:45.094320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:45.094980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:45.101899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:45.102386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:45.102823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:45.103517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:45.103979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:45.104402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:45.293498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:45.302752 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-caed237b-8496-4024-8285-cd2d00610a5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.213559 Oct 31 16:24:45.303335 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3569/7011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:45 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:46.328475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:46.329233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:46.335496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:46.335999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:46.336460 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:46.337212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:46.337690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:46.338142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:46.474310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:46.482573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8d4d100b-fbb1-4b75-ba4b-25b815099801 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.159938 Oct 31 16:24:46.483148 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3443/7012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:46 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:46.585401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:46.596506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:46.597021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:46.597459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:46.613438 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] Creating event network-changed:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:24:46.618945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] Instance 981efbcf-9cfd-4f2b-a127-c794102701dc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:24:46.630288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ef347a05-2951-470b-8c76-140eb6d5d0ac req-58b56398-bd58-4a79-b052-e507ed626d78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048846 Oct 31 16:24:46.630912 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3570/7013] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:47.507208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:47.507869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:47.516416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:47.516960 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:47.517735 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:47.518151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:47.518635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:47.519086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:47.811430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:47.822695 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5219e392-1869-402f-826b-29c3b16b4dd7 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.319355 Oct 31 16:24:47.823392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3444/7014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:47 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:48.848078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:48.848680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:48.855167 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:48.855655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:48.856093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:48.856822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:48.857288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:48.857720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:48.992618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:49.001828 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eaeceb7f-72e3-4817-b7fb-84944e1db0a9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.158993 Oct 31 16:24:49.002404 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3571/7015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:48 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:50.026367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:50.027038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:50.035400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:50.035911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:50.036361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:50.037115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:50.037589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:50.038033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:50.179104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:50.188228 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fc9e51c9-5896-496d-ae0e-c5a4656c7b74 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.166075 Oct 31 16:24:50.188843 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3445/7016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:50 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:51.211455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:51.212069 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:51.214061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:51.220903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:51.221386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:51.221818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:51.222505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:51.222966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:51.223388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:51.430809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:51.438971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1906f663-3083-4a15-94c1-4f867855ad7a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.231415 Oct 31 16:24:51.439545 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3572/7017] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:51 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:52.463558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:52.464120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:52.471579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:52.472086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:52.472542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:52.473290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:52.473768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:52.474216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:52.646558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:52.654805 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b18594a1-e32f-4665-b64d-06b141ea2316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.195281 Oct 31 16:24:52.655933 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3446/7018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:52 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:53.679583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:53.680196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:53.687041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:53.687550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:53.687984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:53.688711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:53.689170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:53.689591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:53.824779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:53.833035 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4d604f0e-7737-458c-b36c-b0fff0fe38ad tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.157570 Oct 31 16:24:53.833610 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3573/7019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:53 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:54.856232 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:54.856887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:54.864000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:54.864494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:54.864979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:54.865677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:54.866146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:54.866583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:54.995893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:55.004761 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c267a117-bb20-4a8d-958e-78f26a8d6daa tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.152484 Oct 31 16:24:55.005340 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3447/7020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:54 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:56.029165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:56.029786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:56.037694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:56.038180 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:56.038628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:56.039319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:56.039781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:56.040211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:56.174700 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:56.183082 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-934c0c8e-cb3a-4f9e-a3b2-3862b6d33a18 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.157836 Oct 31 16:24:56.183666 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3574/7021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:56 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:57.207610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:57.208288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:57.215101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:57.215592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:57.216038 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:57.216763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:57.217238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:57.218250 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:57.348081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:57.356292 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6de3431c-fe39-4c10-a235-9375c9180b7d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.152584 Oct 31 16:24:57.356826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3448/7022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:57 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:58.379625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:58.380251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:58.387665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:58.388154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:58.388594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:58.389829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:58.390394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:58.390841 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:58.407501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:58.536706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:58.545069 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-938cdf12-38be-44ee-93d1-a370b656d2f9 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1722 microversion: 2.1 time: 0.169360 Oct 31 16:24:58.545703 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3575/7023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:58 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:59.567572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:59.568205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:59.571053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=30 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:59.576313 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:59.577369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:59.577931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:59.578647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:59.579124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:59.579570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:59.582399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=88 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:59.713390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:59.722342 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a01cde3b-1bd0-4cfc-a458-827a2d9b71ae tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1715 microversion: 2.1 time: 0.158764 Oct 31 16:24:59.722944 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3449/7024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:59 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:59.744606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:59.745247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:59.752221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:59.752743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:59.753172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:59.753862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:59.754325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:59.754750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:59.885797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:59.894911 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d5db74b-34f3-4ce5-83e5-4ad506ec2d7b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1715 microversion: 2.1 time: 0.154174 Oct 31 16:24:59.895486 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3576/7025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:59 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:59.973961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:59.974517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:59.980528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:59.981074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:59.981562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:59.982285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:59.982767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:59.983282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:00.118667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:00.127334 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc88bab8-fd57-434f-86d0-944943cd2cb3 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1715 microversion: 2.1 time: 0.157416 Oct 31 16:25:00.127908 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3450/7026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:59 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:00.149780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:00.150285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:00.156831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:00.157325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:00.157765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:00.158466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:00.158928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:00.159361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:00.188365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:25:00.266884 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bd049017-4cc8-448e-b060-0460351d736c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 204 len: 0 microversion: 2.1 time: 0.120574 Oct 31 16:25:00.267438 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3577/7027] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:00 2022] DELETE /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:25:00.275971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:00.276597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:00.282760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:00.283260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:00.283742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:00.284473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:00.284999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:00.285443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:00.415020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:00.423209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80620323-1fbf-4788-9b51-640c2b5bf83b tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1721 microversion: 2.1 time: 0.151096 Oct 31 16:25:00.423787 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3451/7028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:00 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:25:01.447122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:01.447823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:01.451569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:01.457973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:01.458499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:01.458937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:01.459643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:01.460100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:01.460528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:01.472258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0ccfa169-b750-4e00-9f5b-54e3f93ad97b req-4a5518ee-a0aa-4389-9275-bb508b795c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "name": "network-vif-plugged", "status": "completed", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:01.484059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0ccfa169-b750-4e00-9f5b-54e3f93ad97b req-4a5518ee-a0aa-4389-9275-bb508b795c6f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:01.484949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0ccfa169-b750-4e00-9f5b-54e3f93ad97b req-4a5518ee-a0aa-4389-9275-bb508b795c6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:01.485599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0ccfa169-b750-4e00-9f5b-54e3f93ad97b req-4a5518ee-a0aa-4389-9275-bb508b795c6f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:01.497374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0ccfa169-b750-4e00-9f5b-54e3f93ad97b req-4a5518ee-a0aa-4389-9275-bb508b795c6f service nova] Creating event network-vif-plugged:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:25:01.503359 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0ccfa169-b750-4e00-9f5b-54e3f93ad97b req-4a5518ee-a0aa-4389-9275-bb508b795c6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035345 Oct 31 16:25:01.504290 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3452/7029] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:01.602411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:01.610820 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab118b4c-2a3b-47f8-8735-0302281ce15d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1721 microversion: 2.1 time: 0.168069 Oct 31 16:25:01.611390 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3578/7030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:01 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:02.636392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:02.637151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:02.643905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:02.644409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:02.644893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:02.645608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:02.646089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:02.646537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:02.860051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:02.869336 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3dcff54-c2ed-48b1-8104-d4e636dee7e5 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1721 microversion: 2.1 time: 0.238265 Oct 31 16:25:02.870152 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3453/7031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:02 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:03.128420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-de34d024-2feb-47e3-9734-f47d81d2f959 req-13ad34ae-1a01-4608-bbe5-c612fb0ebe15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981efbcf-9cfd-4f2b-a127-c794102701dc", "name": "network-vif-deleted", "tag": "65f08bd8-88bd-439a-860a-da002fcc8933"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:03.142498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-de34d024-2feb-47e3-9734-f47d81d2f959 req-13ad34ae-1a01-4608-bbe5-c612fb0ebe15 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:03.142993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-de34d024-2feb-47e3-9734-f47d81d2f959 req-13ad34ae-1a01-4608-bbe5-c612fb0ebe15 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:03.143430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-de34d024-2feb-47e3-9734-f47d81d2f959 req-13ad34ae-1a01-4608-bbe5-c612fb0ebe15 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:03.157935 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-de34d024-2feb-47e3-9734-f47d81d2f959 req-13ad34ae-1a01-4608-bbe5-c612fb0ebe15 service nova] Creating event network-vif-deleted:65f08bd8-88bd-439a-860a-da002fcc8933 for instance 981efbcf-9cfd-4f2b-a127-c794102701dc on n-h1-858383-17 Oct 31 16:25:03.164352 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-de34d024-2feb-47e3-9734-f47d81d2f959 req-13ad34ae-1a01-4608-bbe5-c612fb0ebe15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041046 Oct 31 16:25:03.165005 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3579/7032] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:03.894704 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:03.895360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:03.906729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:03.907399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:03.907853 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:03.908583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:03.909097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:03.910193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:03.977202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:03.987015 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-61fc894f-083b-4834-983a-07fcfd6293e6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1369 microversion: 2.1 time: 0.096209 Oct 31 16:25:03.987628 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3454/7033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:03 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:05.011636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:05.012363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:05.019655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:05.020147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:05.020591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:05.021316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:05.021780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:05.022211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:05.084479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:05.093019 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c5dedb18-479f-4f55-bd52-17985713c316 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1369 microversion: 2.1 time: 0.085725 Oct 31 16:25:05.093591 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3580/7034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:05 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:06.116455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:06.117231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:06.124737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:06.125319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:06.125846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:06.126625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:06.127180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:06.127967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:06.191474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:06.201514 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb731463-32ba-450e-a971-c62f72b4061c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1369 microversion: 2.1 time: 0.088823 Oct 31 16:25:06.202380 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3455/7035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:06 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:07.224962 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:07.225593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:07.232747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:07.233481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:07.234004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:07.234718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:07.235187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:07.235628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:07.302781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede4b8852ab149a0b57f02585580d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f115f1bd214b728735f7225e91d268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:07.311323 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d78e8b45-a699-468e-9f8d-5eda7601cb5c tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 200 len: 1369 microversion: 2.1 time: 0.090312 Oct 31 16:25:07.312112 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3581/7036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:07 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:08.337154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:08.337781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:08.345252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:08.345746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:08.346196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:08.346932 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:08.347404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:08.347841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:08.361942 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc HTTP/1.1 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '981efbcf-9cfd-4f2b-a127-c794102701dc'} Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:08.363624 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-54a144b2-3889-4793-a2fb-ffeaafb6fb89 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 404 len: 111 microversion: 2.1 time: 0.031833 Oct 31 16:25:08.367944 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3456/7037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:08 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:25:08.426445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:08.428645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:08.435577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:08.436328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:08.436829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:08.437520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:08.437978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:08.438401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:08.450947 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-volume_attachments HTTP/1.1 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': '981efbcf-9cfd-4f2b-a127-c794102701dc'} Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:08.452750 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-04712c87-f59f-4a5c-9f1d-cf54d8d47d4e tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031764 Oct 31 16:25:08.457656 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3582/7038] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:08 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:11.795723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.796329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.803279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.803810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.804260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.804993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.805462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.805901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.822573 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc HTTP/1.1 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '981efbcf-9cfd-4f2b-a127-c794102701dc'} Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:11.824132 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-460bf89c-6a2b-44fd-8518-9791de53369a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 404 len: 111 microversion: 2.1 time: 0.034337 Oct 31 16:25:11.828745 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3457/7039] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:11 2022] DELETE /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:11.834291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.834938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 981efbcf-9cfd-4f2b-a127-c794102701dc] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.842040 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.842502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.842938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.843640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.844129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.844559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.858756 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc HTTP/1.1 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '981efbcf-9cfd-4f2b-a127-c794102701dc'} Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.860324 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 981efbcf-9cfd-4f2b-a127-c794102701dc could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e7e095a-27c5-45ff-b42b-0be02da9121f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc" status: 404 len: 111 microversion: 2.1 time: 0.031466 Oct 31 16:25:11.865076 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3583/7040] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:11 2022] GET /compute/v2.1/servers/981efbcf-9cfd-4f2b-a127-c794102701dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:25:11.870690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.871532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.878728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.879243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.879700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.880434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.880949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.881667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.896768 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 HTTP/1.1 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4af25822-42b7-4cb7-8d5c-974d4c448021'} Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:11.898560 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc2e1581-0568-412d-8e0b-3ef33225bfa6 tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 404 len: 111 microversion: 2.1 time: 0.033354 Oct 31 16:25:11.902924 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3458/7041] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:11 2022] DELETE /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:25:11.909059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.909680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 4af25822-42b7-4cb7-8d5c-974d4c448021] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.916006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.916502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.916961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.917670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.918124 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.918549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.933416 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 HTTP/1.1 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '4af25822-42b7-4cb7-8d5c-974d4c448021'} Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.935658 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 4af25822-42b7-4cb7-8d5c-974d4c448021 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bcbd1dc9-dc46-4256-aeb6-ef06a636401d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021" status: 404 len: 111 microversion: 2.1 time: 0.033404 Oct 31 16:25:11.940623 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3584/7042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:11 2022] GET /compute/v2.1/servers/4af25822-42b7-4cb7-8d5c-974d4c448021 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:11.946940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.947461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.953675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.954177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.954632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.955343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.955816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.956260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.971056 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef HTTP/1.1 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '46c4f08f-7f76-461f-bc3c-985bd1891fef'} Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:11.972640 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a5d3749-c829-4c06-b365-044b25cf7eef tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 404 len: 111 microversion: 2.1 time: 0.031126 Oct 31 16:25:11.977602 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3459/7043] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:11 2022] DELETE /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:25:11.983985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.984605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 46c4f08f-7f76-461f-bc3c-985bd1891fef] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.990658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.991148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.991585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.992284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.992772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.993203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.010525 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef HTTP/1.1 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '46c4f08f-7f76-461f-bc3c-985bd1891fef'} Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:12.012075 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 46c4f08f-7f76-461f-bc3c-985bd1891fef could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-880341c3-2ed8-43a8-a51f-76716489cd5a tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef" status: 404 len: 111 microversion: 2.1 time: 0.033537 Oct 31 16:25:12.020239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3585/7044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:11 2022] GET /compute/v2.1/servers/46c4f08f-7f76-461f-bc3c-985bd1891fef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:12.025266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:12.025897 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:12.032338 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:12.032952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:12.033478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.034245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:12.034804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:12.035310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.049264 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 HTTP/1.1 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '3aba0b71-34a2-4023-9f15-1a4bf6d93b13'} Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:12.050885 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5266f845-58a4-463f-afbe-0d30d182d38d tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 404 len: 111 microversion: 2.1 time: 0.032441 Oct 31 16:25:12.058267 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3460/7045] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:12 2022] DELETE /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:25:12.063555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:12.064291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [instance: 3aba0b71-34a2-4023-9f15-1a4bf6d93b13] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:12.070513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:12.071078 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:12.071610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.072393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:12.072880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:12.073314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.087852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] HTTP exception thrown: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Request method failure captured: Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 HTTP/1.1 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_Ux_M5ghvvvMOo4NVsEsd1_GdHNoGIHzn_mHP7VmMO0AFevFfYGnIWumIsQ5fFxp3hSSrqfeIKNi1rRUk-8Qw6IynOsm9XR5Ra1wWbnzaQCsUqIXkGm9WReYhEN5SF3hZxszWQEo3xbv6BP_3a-pN-VLeI-1YXjyAlH4b-ZbhwbfL0 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/16f115f1bd214b728735f7225e91d268"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_16f115f1bd214b728735f7225e91d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/16f115f1bd214b728735f7225e91d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 16f115f1bd214b728735f7225e91d268 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerActionsTestJSON-1367770775 Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ede4b8852ab149a0b57f02585580d00c Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServerActionsTestJSON-1367770775-project Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '3aba0b71-34a2-4023-9f15-1a4bf6d93b13'} Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:12.089428 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Returning 404 to user: Instance 3aba0b71-34a2-4023-9f15-1a4bf6d93b13 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7cf022e1-ee6f-4bce-a426-231a26518ecd tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13" status: 404 len: 111 microversion: 2.1 time: 0.032728 Oct 31 16:25:12.093654 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3586/7046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:12 2022] GET /compute/v2.1/servers/3aba0b71-34a2-4023-9f15-1a4bf6d93b13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:12.099560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f555ea71-a96c-4305-bfd4-126d3593822f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] Calling method '.version_select at 0x7f5ca12fd0d0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:12.103946 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f555ea71-a96c-4305-bfd4-126d3593822f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [e6149452-7858-4595-94fa-9010c8426312] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:25:13.112034 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [None req-f555ea71-a96c-4305-bfd4-126d3593822f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] [e6149452-7858-4595-94fa-9010c8426312] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 49482. Oct 31 16:25:13.133277 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f555ea71-a96c-4305-bfd4-126d3593822f tempest-ServerActionsTestJSON-1367770775 tempest-ServerActionsTestJSON-1367770775-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273366131" status: 202 len: 0 microversion: 2.1 time: 1.037426 Oct 31 16:25:13.133826 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3461/7047] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Oct 31 16:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273366131 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:25:22.068938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=17 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:22.078592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:22.085957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1555307900", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "391ca5e9-62d2-441b-9c7a-53bec52178e3"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:22.142945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] validate_networks() for [('391ca5e9-62d2-441b-9c7a-53bec52178e3', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:25:22.899937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:25:22.900555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:25:22.901316 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:25:22.903438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:25:22.903438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:25:22.913088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:22.913591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:22.914423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:22.914781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:22.915692 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:22.916143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:22.934774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Getting quotas for project 598319c2ce954506a91f20330f04baa2. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:25:22.941166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Getting quotas for user a832ee7233df4a409b448d3703c0a333 and project 598319c2ce954506a91f20330f04baa2. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:25:22.955591 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:25:22.958253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:25:23.008110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-456311f5-9e6e-4d52-92a1-46e3c04d1366 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043719 Oct 31 16:25:23.009459 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3587/7048] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:25:23.019193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=47 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:23.027113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f0c79a5-e8de-4f6d-923c-473a1db24b7b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:23.027763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f0c79a5-e8de-4f6d-923c-473a1db24b7b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:23.095385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f0c79a5-e8de-4f6d-923c-473a1db24b7b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:23.102778 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f0c79a5-e8de-4f6d-923c-473a1db24b7b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1217 microversion: 2.1 time: 0.085692 Oct 31 16:25:23.117389 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3462/7049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:23 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:24.127584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:24.128324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:24.137244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:24.137746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:24.138346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:24.139717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:24.140230 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:24.140679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:24.244464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:24.260863 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea48c948-a2c8-49de-8007-8c58375f9530 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1277 microversion: 2.1 time: 0.137984 Oct 31 16:25:24.262185 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3588/7050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:24 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:25.286766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:25.288155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:25.294558 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:25.295322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:25.296050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:25.296992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:25.297839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:25.298463 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:25.539661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:25.548098 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8e09a922-551c-49b4-bdfa-23ed8aedd997 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.265231 Oct 31 16:25:25.548925 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3463/7051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:25 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:25.883239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5db451f5-ebac-44ed-a1b0-cd219fdd0dd3 req-159965d8-7b48-4c12-9abf-3933fc70b7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ed1224-ee53-46d8-a2d3-baa7fdfd2692", "tag": "494e7a60-36c2-43b2-8828-904e4aa5213b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:25.896381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5db451f5-ebac-44ed-a1b0-cd219fdd0dd3 req-159965d8-7b48-4c12-9abf-3933fc70b7ff service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:25.897203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5db451f5-ebac-44ed-a1b0-cd219fdd0dd3 req-159965d8-7b48-4c12-9abf-3933fc70b7ff service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:25.897625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5db451f5-ebac-44ed-a1b0-cd219fdd0dd3 req-159965d8-7b48-4c12-9abf-3933fc70b7ff service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:25.909734 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5db451f5-ebac-44ed-a1b0-cd219fdd0dd3 req-159965d8-7b48-4c12-9abf-3933fc70b7ff service nova] Creating event network-changed:494e7a60-36c2-43b2-8828-904e4aa5213b for instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 on n-h1-858383-17 Oct 31 16:25:25.915377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5db451f5-ebac-44ed-a1b0-cd219fdd0dd3 req-159965d8-7b48-4c12-9abf-3933fc70b7ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098743 Oct 31 16:25:25.916003 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3589/7052] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:25:26.571350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:26.571902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:26.574882 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:25:26.575024 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:25:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 (ip 10.222.0.48) !!! Oct 31 16:25:26.582026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:26.582550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:26.583002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:26.583707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:26.584176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:26.584627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:26.720665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:26.728320 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d08aadd-62e1-4a8c-956c-6fbf6a7cbb2a tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.160965 Oct 31 16:25:26.728918 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3464/7053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:26 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:27.748834 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:25:27.749373 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:25:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 (ip 10.222.0.48) !!! Oct 31 16:25:27.756068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:27.757066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:27.765341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:27.765827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:27.766266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:27.766958 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:27.767416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:27.767852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:27.898352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:27.906636 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-baf68291-a541-44a6-af0c-4ef3614fae15 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.159335 Oct 31 16:25:27.907208 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3590/7054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:27 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:28.930185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:28.930823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:28.938499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:28.939009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:28.939468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:28.940187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:28.940668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:28.941157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:29.077775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:29.085696 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9aa2325d-52b4-4ddd-9f39-ef7bf4dc59fc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.159542 Oct 31 16:25:29.086276 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3465/7055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:28 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:30.108553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:30.109304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:30.116013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:30.116490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:30.116953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:30.117641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:30.118094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:30.118548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:30.249009 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:30.257005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6576976c-69a5-4fe7-80a7-46539c096632 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.152427 Oct 31 16:25:30.257585 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3591/7056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:30 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:31.280109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:31.280810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:31.283597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:31.289224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:31.289726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:31.290176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:31.290887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:31.291357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:31.291795 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:31.424513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:31.432475 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a70dcd29-732d-4a53-81ab-81892bc7d4cd tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.156884 Oct 31 16:25:31.433088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3466/7057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:31 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:32.456726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:32.457346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:32.464080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:32.464560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:32.465027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:32.465718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:32.466169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:32.466902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:32.601494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:32.610318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6b8e789-a8a0-4b7b-8122-8f57bde7f685 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.157617 Oct 31 16:25:32.610898 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3592/7058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:32 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:33.598967 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:33.634716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:33.635921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:33.638977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:33.639637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:33.645285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:33.646012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:33.646630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:33.647340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:33.647797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:33.648246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:33.660452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2087cab4-6250-471e-a8ad-cbc59c14c884 req-0cce1578-008f-4036-a440-a67e45d38483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed1224-ee53-46d8-a2d3-baa7fdfd2692", "name": "network-vif-plugged", "status": "completed", "tag": "494e7a60-36c2-43b2-8828-904e4aa5213b"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:33.671831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2087cab4-6250-471e-a8ad-cbc59c14c884 req-0cce1578-008f-4036-a440-a67e45d38483 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:33.672331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2087cab4-6250-471e-a8ad-cbc59c14c884 req-0cce1578-008f-4036-a440-a67e45d38483 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:33.672811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2087cab4-6250-471e-a8ad-cbc59c14c884 req-0cce1578-008f-4036-a440-a67e45d38483 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:33.684051 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2087cab4-6250-471e-a8ad-cbc59c14c884 req-0cce1578-008f-4036-a440-a67e45d38483 service nova] Creating event network-vif-plugged:494e7a60-36c2-43b2-8828-904e4aa5213b for instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 on n-h1-858383-17 Oct 31 16:25:33.689943 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2087cab4-6250-471e-a8ad-cbc59c14c884 req-0cce1578-008f-4036-a440-a67e45d38483 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096344 Oct 31 16:25:33.690680 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3467/7059] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:33.789699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:33.799875 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-077a75b2-2e59-4145-9e78-fc67f32d9da1 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.168766 Oct 31 16:25:33.800921 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3593/7060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:33 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:34.828931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:34.829662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:34.836016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:34.836518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:34.837000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:34.837715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:34.838185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:34.838625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:34.967840 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:34.975671 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-982a5bcd-7b57-474e-88a3-5f4e22946bbe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1317 microversion: 2.1 time: 0.152428 Oct 31 16:25:34.976293 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3468/7061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:34 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:35.999854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:36.000475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:36.007901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:36.008388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:36.008858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:36.009566 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:36.010022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:36.010447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:36.139567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:36.147293 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-30c3bda5-4f8c-4e61-8a75-f8557dfac3fe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.151758 Oct 31 16:25:36.147872 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3594/7062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:35 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:36.208723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737300164", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "391ca5e9-62d2-441b-9c7a-53bec52178e3"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:36.262883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] validate_networks() for [('391ca5e9-62d2-441b-9c7a-53bec52178e3', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:25:36.671763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:25:36.672211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:25:36.672731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:25:36.673220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:25:36.673652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:25:36.682847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:36.683351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:36.683807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:36.684553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:36.685117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:36.685814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:36.703689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Getting quotas for project 598319c2ce954506a91f20330f04baa2. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:25:36.708990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Getting quotas for user a832ee7233df4a409b448d3703c0a333 and project 598319c2ce954506a91f20330f04baa2. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:25:36.722253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:25:36.724574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:25:36.772545 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e18539df-893a-4741-a32e-843a9aeb4344 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567875 Oct 31 16:25:36.773241 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3469/7063] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:25:36.784942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef786bce-eb4f-48fa-9990-0280cff7d12d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:36.785565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef786bce-eb4f-48fa-9990-0280cff7d12d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:36.838854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef786bce-eb4f-48fa-9990-0280cff7d12d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:36.846378 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef786bce-eb4f-48fa-9990-0280cff7d12d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1217 microversion: 2.1 time: 0.065364 Oct 31 16:25:36.847199 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3595/7064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:36 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:37.869427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:37.870238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:37.878215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:37.878807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:37.879366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:37.880147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:37.880721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:37.881239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:37.977506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:37.985640 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79702f99-505f-4b7a-b48c-ae1dde8eb78c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1287 microversion: 2.1 time: 0.120207 Oct 31 16:25:37.986424 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3470/7065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:37 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:25:39.008471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:39.009136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:39.017660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:39.018085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:39.018534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:39.019244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:39.019717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:39.020151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:39.286043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:39.293709 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20360245-797f-49c2-bdc7-6f17e14344a0 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1317 microversion: 2.1 time: 0.289666 Oct 31 16:25:39.294514 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3596/7066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:39 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:39.643576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a7ad1242-cddc-465c-80f6-7410ca50dafd req-d41fee43-056c-415a-81d5-5511410c8c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad3ca21-0002-44dc-adf2-c552c31417f9", "tag": "abb7085c-8752-4b14-b525-e2b2de828d25"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:39.657257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a7ad1242-cddc-465c-80f6-7410ca50dafd req-d41fee43-056c-415a-81d5-5511410c8c85 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:39.657750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a7ad1242-cddc-465c-80f6-7410ca50dafd req-d41fee43-056c-415a-81d5-5511410c8c85 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:39.658192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a7ad1242-cddc-465c-80f6-7410ca50dafd req-d41fee43-056c-415a-81d5-5511410c8c85 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:39.670471 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a7ad1242-cddc-465c-80f6-7410ca50dafd req-d41fee43-056c-415a-81d5-5511410c8c85 service nova] Creating event network-changed:abb7085c-8752-4b14-b525-e2b2de828d25 for instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 on n-h2-858383-17 Oct 31 16:25:39.675397 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a7ad1242-cddc-465c-80f6-7410ca50dafd req-d41fee43-056c-415a-81d5-5511410c8c85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037108 Oct 31 16:25:39.675997 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3471/7067] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:40.317207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:40.317819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:40.324656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:40.325162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:40.325597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:40.326381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:40.326857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:40.327268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:40.453597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:40.461335 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-13f2cb96-073d-4eb6-ad9d-10e45e9eaac2 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1317 microversion: 2.1 time: 0.148112 Oct 31 16:25:40.461934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3597/7068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:40 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:41.486822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:41.487568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:41.494073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:41.494573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:41.495030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:41.495759 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:41.496238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:41.496688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:41.699685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:41.707614 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-11871aa6-6879-486b-9db7-a8b79b295ada tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1317 microversion: 2.1 time: 0.226784 Oct 31 16:25:41.708198 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3472/7069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:41 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:42.731768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:42.732507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:42.739475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:42.739969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:42.740415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:42.741149 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:42.741619 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:42.742055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:42.870975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:42.879259 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a500a99e-a9a5-4576-82dc-0b8dfd7fb37d tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1317 microversion: 2.1 time: 0.151654 Oct 31 16:25:42.879829 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3598/7070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:42 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:43.903297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:43.904247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:43.911266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:43.911780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:43.912239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:43.912991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:43.913472 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:43.913922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:44.049613 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:44.057205 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e00f691-b20a-4022-861d-6f24a9263e66 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1317 microversion: 2.1 time: 0.157880 Oct 31 16:25:44.057783 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3473/7071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:43 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:44.345349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3af3d5f4-b3b3-4876-8749-23a12666530e req-0455c889-3d11-4d94-ae70-8883c80e7c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad3ca21-0002-44dc-adf2-c552c31417f9", "name": "network-vif-plugged", "status": "completed", "tag": "abb7085c-8752-4b14-b525-e2b2de828d25"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:44.370270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3af3d5f4-b3b3-4876-8749-23a12666530e req-0455c889-3d11-4d94-ae70-8883c80e7c25 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:44.373004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3af3d5f4-b3b3-4876-8749-23a12666530e req-0455c889-3d11-4d94-ae70-8883c80e7c25 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:44.373574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3af3d5f4-b3b3-4876-8749-23a12666530e req-0455c889-3d11-4d94-ae70-8883c80e7c25 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:44.388550 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3af3d5f4-b3b3-4876-8749-23a12666530e req-0455c889-3d11-4d94-ae70-8883c80e7c25 service nova] Creating event network-vif-plugged:abb7085c-8752-4b14-b525-e2b2de828d25 for instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 on n-h2-858383-17 Oct 31 16:25:44.394043 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3af3d5f4-b3b3-4876-8749-23a12666530e req-0455c889-3d11-4d94-ae70-8883c80e7c25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055588 Oct 31 16:25:44.394953 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3599/7072] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:45.080401 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:45.081066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:45.088013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:45.088508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:45.088991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:45.089696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:45.090169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:45.090605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:45.226517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:45.234800 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8dc83635-75b7-421a-b020-26b21e5e3f37 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1317 microversion: 2.1 time: 0.159029 Oct 31 16:25:45.235387 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3474/7073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:45 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:46.259148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:46.259852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:46.266207 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:46.266696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:46.267134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:46.267821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:46.268281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:46.268733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:46.399971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:46.407721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49ee7292-67e2-475b-885b-61432cd67dc5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1507 microversion: 2.1 time: 0.154000 Oct 31 16:25:46.408338 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3600/7074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:46 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:46.430984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:46.431478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:46.439074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:46.439585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:46.440040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:46.440784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:46.441260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:46.441705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:46.467230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:25:46.540623 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2b49579f-e012-463e-938c-c228f64267a8 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 204 len: 0 microversion: 2.1 time: 0.113233 Oct 31 16:25:46.541279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3475/7075] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:46 2022] DELETE /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:25:46.550211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:46.550830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:46.556861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:46.557350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:46.557793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:46.558518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:46.558983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:46.559413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:46.686553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:46.694317 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e48e35b-002a-4867-9619-7fea15183d17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1513 microversion: 2.1 time: 0.148165 Oct 31 16:25:46.694899 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3601/7076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:46 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:25:47.720157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:47.720917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:47.722852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:47.723687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:47.731927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:47.732546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:47.733033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:47.733737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:47.734213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:47.734650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:47.932100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:47.940000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8c38a86-5859-4b0c-a481-a19aaadc0ffe tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 200 len: 1513 microversion: 2.1 time: 0.224909 Oct 31 16:25:47.940583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3476/7077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:47 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:48.300246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b063a174-057f-453c-a105-0a00f97b8afc req-e6072900-7337-45f1-a926-1bf11e6d2a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad3ca21-0002-44dc-adf2-c552c31417f9", "name": "network-vif-deleted", "tag": "abb7085c-8752-4b14-b525-e2b2de828d25"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:48.305611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:48.314355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b063a174-057f-453c-a105-0a00f97b8afc req-e6072900-7337-45f1-a926-1bf11e6d2a5a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:48.314744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b063a174-057f-453c-a105-0a00f97b8afc req-e6072900-7337-45f1-a926-1bf11e6d2a5a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:48.315172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b063a174-057f-453c-a105-0a00f97b8afc req-e6072900-7337-45f1-a926-1bf11e6d2a5a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:48.334018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b063a174-057f-453c-a105-0a00f97b8afc req-e6072900-7337-45f1-a926-1bf11e6d2a5a service nova] Creating event network-vif-deleted:abb7085c-8752-4b14-b525-e2b2de828d25 for instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 on n-h2-858383-17 Oct 31 16:25:48.339925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b063a174-057f-453c-a105-0a00f97b8afc req-e6072900-7337-45f1-a926-1bf11e6d2a5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043457 Oct 31 16:25:48.343100 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3602/7078] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:48.963608 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:48.964167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:48.971019 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:48.971518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:48.971969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:48.972670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:48.973165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:48.973611 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:48.987010 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] HTTP exception thrown: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 HTTP/1.1 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '8ad3ca21-0002-44dc-adf2-c552c31417f9'} Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:48.988741 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 404 to user: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d60dff72-2e85-4e30-a0b8-5f0f2828f340 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 404 len: 111 microversion: 2.1 time: 0.030705 Oct 31 16:25:48.993206 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3477/7079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:48 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:49.000424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:49.001159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.007616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.008100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.008538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.009256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.009717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.010148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.142015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:49.149928 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd116325-d98e-445c-a7a5-f6cf8efbe521 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.154356 Oct 31 16:25:49.150506 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3603/7080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:48 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:49.172991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ee3c85b-b21e-48ee-8130-9a8d408aaccc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:49.175319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4ee3c85b-b21e-48ee-8130-9a8d408aaccc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.180867 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-4ee3c85b-b21e-48ee-8130-9a8d408aaccc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] HTTP exception thrown: Instance 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16 could not be found. Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ee3c85b-b21e-48ee-8130-9a8d408aaccc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16/action HTTP/1.1 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 32 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: {"resize": {"flavorRef": "452"}} Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16 could not be found. Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16', 'body': {'resize': {'flavorRef': '452'}}} Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16 could not be found. Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:49.182423 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16 could not be found. Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16 could not be found. Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4ee3c85b-b21e-48ee-8130-9a8d408aaccc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 404 to user: Instance 66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4ee3c85b-b21e-48ee-8130-9a8d408aaccc tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "POST /compute/v2.1/servers/66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16/action" status: 404 len: 111 microversion: 2.1 time: 0.015480 Oct 31 16:25:49.188374 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3478/7081] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:25:49 2022] POST /compute/v2.1/servers/66aac0b7-ad48-4d03-9cb1-5c3b4c1fcd16/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:49.193202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:49.193823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.199709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.200197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.200633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.201422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.201876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.202299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.328777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:49.336582 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c0330a5-fbb7-4883-b7ef-95a6173dda86 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.147219 Oct 31 16:25:49.337210 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3604/7082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:49 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:49.360227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:49.360891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.367740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.368236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.368685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.369406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.369880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.370321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.501385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:49.509306 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3f780db9-7427-49fa-8d6a-3c75572a5a72 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.153507 Oct 31 16:25:49.509881 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3479/7083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:49 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:49.532079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1171b581-e0b8-4d73-95ac-7e8f1155be20"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:49.534352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.540344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.540886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.541336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.542035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.542498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.542931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.626930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:49.632576 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] HTTP exception thrown: Flavor 1171b581-e0b8-4d73-95ac-7e8f1155be20 could not be found. Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692/action HTTP/1.1 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 65 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: {"resize": {"flavorRef": "1171b581-e0b8-4d73-95ac-7e8f1155be20"}} Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: exception: Flavor 1171b581-e0b8-4d73-95ac-7e8f1155be20 could not be found. Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'c4ed1224-ee53-46d8-a2d3-baa7fdfd2692', 'body': {'resize': {'flavorRef': '1171b581-e0b8-4d73-95ac-7e8f1155be20'}}} Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4201, in resize Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:49.634558 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1171b581-e0b8-4d73-95ac-7e8f1155be20 could not be found. Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1171b581-e0b8-4d73-95ac-7e8f1155be20 could not be found. Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1171b581-e0b8-4d73-95ac-7e8f1155be20 could not be found. Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 400 to user: Flavor 1171b581-e0b8-4d73-95ac-7e8f1155be20 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6f5a04f-2ca3-4682-ac2e-cb354e14a296 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "POST /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692/action" status: 400 len: 107 microversion: 2.1 time: 0.108578 Oct 31 16:25:49.639327 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3605/7084] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:25:49 2022] POST /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692/action => generated 107 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 16:25:49.644781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:49.645426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.651429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.651936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.652392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.653134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.654309 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.654788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.781555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:49.789427 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad4c1ae9-4abf-4424-b0ae-9c15ce5e9b50 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.148517 Oct 31 16:25:49.789941 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3480/7085] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:49 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:49.813271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:49.813916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:49.819859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.820353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.820881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.821570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:49.822024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:49.822450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:49.957567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:49.965356 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4efe3446-2b80-4985-9533-3888790355d5 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.156504 Oct 31 16:25:49.965985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3606/7086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:49 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:49.988000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86096039-e837-412a-818c-62857aa4f6ab tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86096039-e837-412a-818c-62857aa4f6ab tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: request: POST /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692/action HTTP/1.1 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 29 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: {"resize": {"flavorRef": ""}} Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'c4ed1224-ee53-46d8-a2d3-baa7fdfd2692', 'body': {'resize': {'flavorRef': ''}}} Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise error Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi '' Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.991766 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-86096039-e837-412a-818c-62857aa4f6ab tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-86096039-e837-412a-818c-62857aa4f6ab tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "POST /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692/action" status: 400 len: 113 microversion: 2.1 time: 0.009281 Oct 31 16:25:49.996834 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3481/7087] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:25:49 2022] POST /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 16:25:50.002238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:50.002852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:50.009019 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.009508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.009941 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.010628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.011083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.011505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.030544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:50.139701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:50.147374 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a33bc8f6-a0ca-4943-83b9-341b8eec8c5c tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1507 microversion: 2.1 time: 0.149026 Oct 31 16:25:50.147954 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3607/7088] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:49 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:25:50.174780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:50.175327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:50.182538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.183047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.183504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.184209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.185304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.185753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.201353 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] HTTP exception thrown: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 HTTP/1.1 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '8ad3ca21-0002-44dc-adf2-c552c31417f9'} Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:50.202922 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 404 to user: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ec3db89e-6f74-462e-b1f0-126ebc35e015 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 404 len: 111 microversion: 2.1 time: 0.035263 Oct 31 16:25:50.207483 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3482/7089] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:50 2022] DELETE /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:50.212835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:50.213474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: 8ad3ca21-0002-44dc-adf2-c552c31417f9] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:50.220287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.220803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.221236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.221959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.222416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.222838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.236869 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] HTTP exception thrown: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 HTTP/1.1 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '8ad3ca21-0002-44dc-adf2-c552c31417f9'} Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:50.238382 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 404 to user: Instance 8ad3ca21-0002-44dc-adf2-c552c31417f9 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-048f51a7-fa5a-470f-9def-e637ac4bc18b tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9" status: 404 len: 111 microversion: 2.1 time: 0.030791 Oct 31 16:25:50.242711 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3608/7090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:50 2022] GET /compute/v2.1/servers/8ad3ca21-0002-44dc-adf2-c552c31417f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:50.248716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:50.249244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:50.255345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.255849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.256312 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.257307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.257782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.258229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.262314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:50.285423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:25:50.358833 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c03b3108-d97b-4b4f-96bb-5188fd65a880 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 204 len: 0 microversion: 2.1 time: 0.114178 Oct 31 16:25:50.359358 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3483/7091] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:50 2022] DELETE /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 16:25:50.367634 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:50.369453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:50.377202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.377686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.378119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.378814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.379270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.379693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.511349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:50.519110 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8e6f3b0-15a9-43d4-8622-f6b3147223ec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1513 microversion: 2.1 time: 0.155734 Oct 31 16:25:50.519679 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3609/7092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:50 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:51.543319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:51.544061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:51.551519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:51.552024 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:51.552478 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:51.553219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:51.553701 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:51.554146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:51.696393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:51.704387 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b458e955-d647-415f-a654-4ee85030ae17 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1513 microversion: 2.1 time: 0.165465 Oct 31 16:25:51.705009 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3484/7093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:51 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:52.588460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c5ea7160-c09a-47e2-87d2-546bceb15a2c req-dfa5e7c6-5256-43ca-92b2-2827d5409005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ed1224-ee53-46d8-a2d3-baa7fdfd2692", "name": "network-vif-deleted", "tag": "494e7a60-36c2-43b2-8828-904e4aa5213b"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:52.594957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:52.604384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5ea7160-c09a-47e2-87d2-546bceb15a2c req-dfa5e7c6-5256-43ca-92b2-2827d5409005 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:52.605115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5ea7160-c09a-47e2-87d2-546bceb15a2c req-dfa5e7c6-5256-43ca-92b2-2827d5409005 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:52.605657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c5ea7160-c09a-47e2-87d2-546bceb15a2c req-dfa5e7c6-5256-43ca-92b2-2827d5409005 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:52.619486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c5ea7160-c09a-47e2-87d2-546bceb15a2c req-dfa5e7c6-5256-43ca-92b2-2827d5409005 service nova] Creating event network-vif-deleted:494e7a60-36c2-43b2-8828-904e4aa5213b for instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 on n-h1-858383-17 Oct 31 16:25:52.625128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c5ea7160-c09a-47e2-87d2-546bceb15a2c req-dfa5e7c6-5256-43ca-92b2-2827d5409005 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041265 Oct 31 16:25:52.625802 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3610/7094] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:52.729930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:52.730519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:52.738219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:52.738717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:52.739196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:52.739904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:52.740373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:52.740842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:52.774537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:52.775028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:52.775479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:52.775936 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lazy-loading 'fault' on Instance uuid c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:25:52.823469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a832ee7233df4a409b448d3703c0a333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598319c2ce954506a91f20330f04baa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:52.832165 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2e82b7ee-ee35-43f4-bb1a-517b48b68fec tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 200 len: 1307 microversion: 2.1 time: 0.106860 Oct 31 16:25:52.832796 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3485/7095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:52 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:53.857341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:53.858048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] [instance: c4ed1224-ee53-46d8-a2d3-baa7fdfd2692] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:53.864966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:53.865455 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:53.865909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:53.866609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:53.867084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:53.867513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:53.881297 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] HTTP exception thrown: Instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 could not be found. Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Request method failure captured: Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 HTTP/1.1 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_bx5Wn6qZUsw1bp009f2iIdvsuSoj0sFyS9ZRcZXpo25ircnR8khhB6qwUTynL4KA1a7RfqaAtsorATpytcWnajQvRPot_lvWmfe-8D28PhEAUh-HPvjp_c31dh1DRdQIL1-7vW4qvjk7XD72l4MnYoA0RzM69o2oENulE6Z0wdPj4 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/598319c2ce954506a91f20330f04baa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_598319c2ce954506a91f20330f04baa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/598319c2ce954506a91f20330f04baa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 598319c2ce954506a91f20330f04baa2 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1399431334 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: a832ee7233df4a409b448d3703c0a333 Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-ServersNegativeTestJSON-1399431334-project Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 could not be found. Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'c4ed1224-ee53-46d8-a2d3-baa7fdfd2692'} Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 could not be found. Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 could not be found. Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:53.883237 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 could not be found. Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] Returning 404 to user: Instance c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9ffc3c0-f2a1-4042-98d4-6c0e86bec084 tempest-ServersNegativeTestJSON-1399431334 tempest-ServersNegativeTestJSON-1399431334-project] 10.222.0.48 "GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692" status: 404 len: 111 microversion: 2.1 time: 0.032645 Oct 31 16:25:53.887927 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3611/7096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:53 2022] GET /compute/v2.1/servers/c4ed1224-ee53-46d8-a2d3-baa7fdfd2692 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:26:27.323569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:27.325891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:27.545501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2e27b22-6740-4912-8c33-644f754eda17 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: .version_select at 0x7f5ca298fd30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1054888862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2J/UlRTLX+H1doGrR6FvXG1DjUHxDBxkNcZxwB/W+qyULXx8xbAwInZZn3oozby9ztYmXcYB0SEA3FPwqRyRrzMUrKARoogja7iafPLnlSlncbtMqDjISng3UjJ0/m5Q=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:27.570475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e2e27b22-6740-4912-8c33-644f754eda17 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for project c3d5148ed8314ad7a383c44740eda69a. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:26:27.576046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e2e27b22-6740-4912-8c33-644f754eda17 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for user 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 and project c3d5148ed8314ad7a383c44740eda69a. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:26:27.602198 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2e27b22-6740-4912-8c33-644f754eda17 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.284108 Oct 31 16:26:27.602827 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3486/7097] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:26:27 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:26:27.656775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1370638905", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1054888862", "networks": [{"uuid": "cdd59fdd-2d84-4cff-91de-d32ad91f8acd"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:27.666082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:27.666662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=14 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:27.716662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] validate_networks() for [('cdd59fdd-2d84-4cff-91de-d32ad91f8acd', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:26:28.097686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:26:28.098122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:26:28.098603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:26:28.099018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:26:28.099441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:26:28.109309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:28.109795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:28.110242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:28.110975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:28.111439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:28.111868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:28.128797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for project c3d5148ed8314ad7a383c44740eda69a. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:26:28.134280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for user 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 and project c3d5148ed8314ad7a383c44740eda69a. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:26:28.147082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:26:28.149407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:26:28.196587 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48e8027b-af7c-43fd-aae1-9cfe23404403 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544586 Oct 31 16:26:28.197274 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3612/7098] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:26:28.208245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-55b788fd-4fe1-437e-b3f1-310f897458eb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:28.208903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-55b788fd-4fe1-437e-b3f1-310f897458eb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:28.265150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-55b788fd-4fe1-437e-b3f1-310f897458eb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:28.272582 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-55b788fd-4fe1-437e-b3f1-310f897458eb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1263 microversion: 2.1 time: 0.068224 Oct 31 16:26:28.273194 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3487/7099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:28 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:29.297589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:29.298148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:29.305048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:29.305546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:29.305989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:29.306694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:29.307162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:29.307597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:29.371399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:29.381198 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75429a84-99be-4ff7-816a-55dd24c0db1b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1315 microversion: 2.1 time: 0.089231 Oct 31 16:26:29.382417 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3613/7100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:29 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1315 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:30.405965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:30.407182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:30.414387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:30.414913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:30.415566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:30.416331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:30.416839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:30.417282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:30.669441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:30.678955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e51f58bc-4f37-4e1c-a83e-334c736799c5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.278215 Oct 31 16:26:30.679646 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3488/7101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:30 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:31.048968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-acacae29-ed2c-4ff7-a519-a3587e5b2dc5 req-d41c9963-b737-493b-9d2a-d74e0ec4a299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f850bb2f-7da6-467a-a3e7-a09c9bae7829", "tag": "00e7acf8-9ddb-4be3-afaa-f184f4afa7b1"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:31.062829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-acacae29-ed2c-4ff7-a519-a3587e5b2dc5 req-d41c9963-b737-493b-9d2a-d74e0ec4a299 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:31.063314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-acacae29-ed2c-4ff7-a519-a3587e5b2dc5 req-d41c9963-b737-493b-9d2a-d74e0ec4a299 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:31.064242 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-acacae29-ed2c-4ff7-a519-a3587e5b2dc5 req-d41c9963-b737-493b-9d2a-d74e0ec4a299 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:31.076951 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-acacae29-ed2c-4ff7-a519-a3587e5b2dc5 req-d41c9963-b737-493b-9d2a-d74e0ec4a299 service nova] Creating event network-changed:00e7acf8-9ddb-4be3-afaa-f184f4afa7b1 for instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 on n-h1-858383-17 Oct 31 16:26:31.082608 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-acacae29-ed2c-4ff7-a519-a3587e5b2dc5 req-d41c9963-b737-493b-9d2a-d74e0ec4a299 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Oct 31 16:26:31.083779 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3614/7102] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:31.703424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:31.704056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:31.712004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:31.712512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:31.713006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:31.713718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:31.714198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:31.714646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:31.851579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:31.859984 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a88ca6de-4b04-4dbe-8cc3-7e760ccb2a68 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.161210 Oct 31 16:26:31.860564 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3489/7103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:31 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:32.884598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:32.885352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:32.892805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:32.893389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:32.893907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:32.894705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:32.895240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:32.895746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:33.036385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:33.044225 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4532c237-a852-424a-913d-4b4635b7e84a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.165275 Oct 31 16:26:33.044821 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3615/7104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:32 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:34.067523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:34.068150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:34.074986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:34.075487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:34.075938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:34.076638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:34.077269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:34.077696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:34.209486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:34.217086 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bad7aeec-f29c-4b35-a061-f271b16af74f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.153512 Oct 31 16:26:34.218188 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3490/7105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:34 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:35.240671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:35.241251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:35.248082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:35.248572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:35.249636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:35.250514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:35.250977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:35.251411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:35.385669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:35.393747 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b2e8dfd-ea21-4389-b36c-94864272d703 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.157062 Oct 31 16:26:35.394332 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3616/7106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:35 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:36.415810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:36.416438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:36.423555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:36.424057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:36.424506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:36.425236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:36.425707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:36.426143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:36.556771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:36.565407 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8905251-8358-426a-8474-ba69239ecba8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.153500 Oct 31 16:26:36.565991 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3491/7107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:36 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:37.589123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:37.589861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:37.598047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:37.598527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:37.598960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:37.599650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:37.600105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:37.600528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:37.733716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:37.741398 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-412b040d-f5ae-4e72-bac9-f2f9f8621c3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.156499 Oct 31 16:26:37.741983 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3617/7108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:37 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:37.978845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b264a3c2-5a13-40c5-b362-8b49d97b88ff req-9fc43249-d439-4d31-809e-1ee11b9fd523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f850bb2f-7da6-467a-a3e7-a09c9bae7829", "name": "network-vif-plugged", "status": "completed", "tag": "00e7acf8-9ddb-4be3-afaa-f184f4afa7b1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:37.989993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b264a3c2-5a13-40c5-b362-8b49d97b88ff req-9fc43249-d439-4d31-809e-1ee11b9fd523 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:37.990488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b264a3c2-5a13-40c5-b362-8b49d97b88ff req-9fc43249-d439-4d31-809e-1ee11b9fd523 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:37.990929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b264a3c2-5a13-40c5-b362-8b49d97b88ff req-9fc43249-d439-4d31-809e-1ee11b9fd523 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:38.002808 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b264a3c2-5a13-40c5-b362-8b49d97b88ff req-9fc43249-d439-4d31-809e-1ee11b9fd523 service nova] Creating event network-vif-plugged:00e7acf8-9ddb-4be3-afaa-f184f4afa7b1 for instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 on n-h1-858383-17 Oct 31 16:26:38.008764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b264a3c2-5a13-40c5-b362-8b49d97b88ff req-9fc43249-d439-4d31-809e-1ee11b9fd523 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Oct 31 16:26:38.009408 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3492/7109] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:38.765757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:38.766367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:38.768322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:38.769051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:38.775909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:38.776391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:38.776856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:38.777545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:38.777999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:38.778420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:38.908533 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:38.916290 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05f63a1e-5191-4951-a360-d514f4727c9e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1363 microversion: 2.1 time: 0.155182 Oct 31 16:26:38.916893 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3618/7110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:38 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:39.936769 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:39.942028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:39.942757 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:39.949361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:39.949862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:39.950317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:39.951023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:39.951497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:39.952471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:40.087026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:40.095000 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1e02ac0-4f9b-417a-a1bb-4fead0b5bab9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1555 microversion: 2.1 time: 0.159282 Oct 31 16:26:40.095766 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3493/7111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:39 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:40.117386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:40.118006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:40.125747 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:40.126491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:40.126934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:40.127641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:40.128098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:40.128532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:40.300160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:40.307987 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d37bd9d4-1434-445a-a920-9cc4a78ff19c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1555 microversion: 2.1 time: 0.194486 Oct 31 16:26:40.308569 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3619/7112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:40 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:41.967808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea17ac3e-0ab9-4796-a624-df74e72ff131"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:41.970202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:41.977219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:41.977711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:41.978158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:41.978880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:41.979528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:41.979962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:42.241330 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e59ee4fa-418f-4d5d-b59d-b96328c77950 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277355 Oct 31 16:26:42.242312 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3494/7113] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 16:26:41 2022] POST /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:52.954689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:52.955191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:52.958094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:52.958944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=40 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:52.965168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:52.965662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:52.966105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:52.966812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:52.967279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:52.967712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:53.049891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lazy-loading 'services' on Instance uuid f850bb2f-7da6-467a-a3e7-a09c9bae7829 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:26:53.121860 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c89fd589-6657-4644-8fd9-f4c80f48c1c6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments/ea17ac3e-0ab9-4796-a624-df74e72ff131" status: 202 len: 0 microversion: 2.1 time: 0.171552 Oct 31 16:26:53.122472 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3620/7114] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:26:52 2022] DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments/ea17ac3e-0ab9-4796-a624-df74e72ff131 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:26:53.131475 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:53.134261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:53.137269 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:53.138050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:53.147267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:53.147736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:53.148187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:53.148965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:53.149440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:53.149882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:53.185501 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6be7a35b-8413-446c-9401-a6581d9a0b6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058178 Oct 31 16:26:53.186169 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3495/7115] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:26:53 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:54.200200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:54.202667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:54.209185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:54.209670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:54.210140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:54.210844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:54.211334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:54.211761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:54.242729 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad1517fd-5bd9-4f89-99e9-139c7c80049d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048109 Oct 31 16:26:54.243298 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3621/7116] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:26:54 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:55.255817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:55.258392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:55.265540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:55.266051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:55.266510 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:55.267241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:55.267716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:55.268176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:55.301150 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7fd12c76-f6c0-4a88-b7e9-4f469d91f064 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049618 Oct 31 16:26:55.301888 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3496/7117] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:26:55 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:56.313450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:56.315772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:56.322903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:56.323442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:56.323947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:56.324643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:56.325131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:56.325564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:56.355546 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63626b0b-ee6a-4939-b97b-f8a3c27b47b0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046800 Oct 31 16:26:56.356114 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3622/7118] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:26:56 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:57.369012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:57.371220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:57.379018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:57.379534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:57.379996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:57.380736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:57.381219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:57.381669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:57.415781 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b7e8444c-3398-49e6-b5fe-fc0c9caf826c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050785 Oct 31 16:26:57.416358 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3497/7119] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:26:57 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:58.429221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:58.431318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:58.438814 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:58.439299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:58.439732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:58.440419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:58.440914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:58.441340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:58.472550 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08cdd834-a3ab-4189-9b53-058613dd2d2d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047567 Oct 31 16:26:58.473139 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3623/7120] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:26:58 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:26:58.483783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:58.484896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:58.491591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:58.492086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:58.492533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:58.493257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:58.493723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:58.494159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:58.570184 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] HTTP exception thrown: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 is not attached to volume ea17ac3e-0ab9-4796-a624-df74e72ff131 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Request method failure captured: Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: request: DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments/ea17ac3e-0ab9-4796-a624-df74e72ff131 HTTP/1.1 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_cu4Aw5ms2B2s4Su3QKXmAnxyF0j2I4fssPnYYTtglqeQAf_2kzD1XedqK8ZR5Y8rdsXNcdWym6s69sT_V0NRZuPywgzObAOf2oHs10hodSDG2WV-YufEmk_BjWzYg7HYeSAc8IEM6h-Ga83RshYRTZRpVLRhtXkur-a1sTUftycZM Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 is not attached to volume ea17ac3e-0ab9-4796-a624-df74e72ff131 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'server_id': 'f850bb2f-7da6-467a-a3e7-a09c9bae7829', 'id': 'ea17ac3e-0ab9-4796-a624-df74e72ff131'} Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea17ac3e-0ab9-4796-a624-df74e72ff131. Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 is not attached to volume ea17ac3e-0ab9-4796-a624-df74e72ff131 Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:26:58.575789 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 is not attached to volume ea17ac3e-0ab9-4796-a624-df74e72ff131 Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Returning 404 to user: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 is not attached to volume ea17ac3e-0ab9-4796-a624-df74e72ff131 {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3bfc19f7-1f8d-42d7-8351-5f8ae046ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments/ea17ac3e-0ab9-4796-a624-df74e72ff131" status: 404 len: 154 microversion: 2.1 time: 0.097614 Oct 31 16:26:58.581206 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3498/7121] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:26:58 2022] DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829/os-volume_attachments/ea17ac3e-0ab9-4796-a624-df74e72ff131 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:27:01.922131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:01.922779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:01.930022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:01.930512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:01.930946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:01.931654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:01.932109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:01.932534 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:01.960478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:27:02.039311 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c7761cb-3d7f-44fd-a91f-979de5ea4376 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 204 len: 0 microversion: 2.1 time: 0.121497 Oct 31 16:27:02.039930 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3624/7122] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:27:01 2022] DELETE /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 16:27:02.048363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:02.049026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:02.056778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:02.057228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:02.057690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:02.058406 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:02.058888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:02.059335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:02.202369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:02.211209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7cd1504c-bde9-48ef-8627-07784f616c8c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1561 microversion: 2.1 time: 0.166806 Oct 31 16:27:02.211789 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3499/7123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:02 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:03.235965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:03.236667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:03.243623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:03.244108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:03.244549 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:03.245282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:03.245743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:03.246173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:03.376595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:03.384563 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-79d30943-1147-4393-a8bb-de4eaebb999f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1561 microversion: 2.1 time: 0.153511 Oct 31 16:27:03.385167 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3625/7124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:03 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:04.229856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ab9d5419-14fa-45bc-8c9e-51c7563f0736 req-2bb5519d-4ed4-4292-afd9-190fe8837ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f850bb2f-7da6-467a-a3e7-a09c9bae7829", "name": "network-vif-deleted", "tag": "00e7acf8-9ddb-4be3-afaa-f184f4afa7b1"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:04.242782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ab9d5419-14fa-45bc-8c9e-51c7563f0736 req-2bb5519d-4ed4-4292-afd9-190fe8837ee9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:04.243282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ab9d5419-14fa-45bc-8c9e-51c7563f0736 req-2bb5519d-4ed4-4292-afd9-190fe8837ee9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:04.243730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ab9d5419-14fa-45bc-8c9e-51c7563f0736 req-2bb5519d-4ed4-4292-afd9-190fe8837ee9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:04.255953 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ab9d5419-14fa-45bc-8c9e-51c7563f0736 req-2bb5519d-4ed4-4292-afd9-190fe8837ee9 service nova] Creating event network-vif-deleted:00e7acf8-9ddb-4be3-afaa-f184f4afa7b1 for instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 on n-h1-858383-17 Oct 31 16:27:04.262390 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ab9d5419-14fa-45bc-8c9e-51c7563f0736 req-2bb5519d-4ed4-4292-afd9-190fe8837ee9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036427 Oct 31 16:27:04.263761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3500/7125] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:04.407545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:04.408163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:04.415319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:04.415810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:04.416245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:04.417187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:04.417650 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:04.418080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:04.451547 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:04.452032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:04.452530 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:04.453025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lazy-loading 'fault' on Instance uuid f850bb2f-7da6-467a-a3e7-a09c9bae7829 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:27:04.493436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:04.501971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14d529f9-369f-4733-a75e-0755c3dc23e9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 200 len: 1353 microversion: 2.1 time: 0.098373 Oct 31 16:27:04.502540 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3626/7126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:04 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:05.526328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:05.527061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: f850bb2f-7da6-467a-a3e7-a09c9bae7829] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:05.533540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:05.534045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:05.534500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:05.535216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:05.535695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:05.536144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:05.549498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] HTTP exception thrown: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 could not be found. Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Request method failure captured: Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 HTTP/1.1 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_cu4Aw5ms2B2s4Su3QKXmAnxyF0j2I4fssPnYYTtglqeQAf_2kzD1XedqK8ZR5Y8rdsXNcdWym6s69sT_V0NRZuPywgzObAOf2oHs10hodSDG2WV-YufEmk_BjWzYg7HYeSAc8IEM6h-Ga83RshYRTZRpVLRhtXkur-a1sTUftycZM Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 could not be found. Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f850bb2f-7da6-467a-a3e7-a09c9bae7829'} Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 could not be found. Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 could not be found. Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:27:05.551137 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 could not be found. Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Returning 404 to user: Instance f850bb2f-7da6-467a-a3e7-a09c9bae7829 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2fff55b0-4f84-46b2-a809-25114ddc2b67 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829" status: 404 len: 111 microversion: 2.1 time: 0.031527 Oct 31 16:27:05.556456 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3501/7127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:05 2022] GET /compute/v2.1/servers/f850bb2f-7da6-467a-a3e7-a09c9bae7829 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:27:05.561392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b72725e-eaec-47be-b35d-389b99f3beda tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '.version_select at 0x7f5ca136c820>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:05.585904 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b72725e-eaec-47be-b35d-389b99f3beda tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1054888862" status: 202 len: 0 microversion: 2.1 time: 0.028355 Oct 31 16:27:05.586482 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3627/7128] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Oct 31 16:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1054888862 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:27:05.603000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e955b42f-9637-47d2-a668-d41976c2e06f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: .version_select at 0x7f5ca1dbe280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1870427585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe0V9YCEpC/rtP4eXEMqVP0EVjOfa8t8NoIMT2ZZuH3g7VTIiFYmrjXaZJSicYurQgRqgGhvDNgtlTkhgpOGffMfGhKGGEUlZE3Ofu0kpsqFMXOyBJXmWju1MILyRlcww=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:05.618375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e955b42f-9637-47d2-a668-d41976c2e06f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for project c3d5148ed8314ad7a383c44740eda69a. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:27:05.623572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-e955b42f-9637-47d2-a668-d41976c2e06f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for user 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 and project c3d5148ed8314ad7a383c44740eda69a. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:27:05.649374 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e955b42f-9637-47d2-a668-d41976c2e06f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050251 Oct 31 16:27:05.649967 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3502/7129] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:27:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:27:05.699699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-186070430", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1870427585", "networks": [{"uuid": "cdd59fdd-2d84-4cff-91de-d32ad91f8acd"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:05.753454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] validate_networks() for [('cdd59fdd-2d84-4cff-91de-d32ad91f8acd', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:27:06.121338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:27:06.121765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:27:06.122241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:27:06.122644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:27:06.123053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:27:06.132737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:06.133218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:06.133651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:06.134365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:06.134821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:06.135243 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:06.152051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for project c3d5148ed8314ad7a383c44740eda69a. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:27:06.157347 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for user 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 and project c3d5148ed8314ad7a383c44740eda69a. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:27:06.169616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:27:06.172511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:27:06.219912 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-11158349-916a-44b2-b84a-87f5116c65b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524055 Oct 31 16:27:06.220763 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3628/7130] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:27:06.232062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6863f059-273c-4f49-b6a7-92b0e93890b2 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:06.232683 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6863f059-273c-4f49-b6a7-92b0e93890b2 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:06.287287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6863f059-273c-4f49-b6a7-92b0e93890b2 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:06.294104 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6863f059-273c-4f49-b6a7-92b0e93890b2 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1262 microversion: 2.1 time: 0.066187 Oct 31 16:27:06.294897 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3503/7131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:06 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1262 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:07.318034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:07.318795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:07.326593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:07.327516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:07.327966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:07.328720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:07.329199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:07.329631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:07.399793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:07.408162 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-086622a0-06aa-485f-965b-761ebffbc211 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1332 microversion: 2.1 time: 0.095653 Oct 31 16:27:07.408925 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3629/7132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:07 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:08.431633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:08.432306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:08.441468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:08.441976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:08.442438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:08.443162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:08.443644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:08.444103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:08.615327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:08.623339 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8b850a88-ebc8-489b-a32c-d0ac12e2400c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.195786 Oct 31 16:27:08.623925 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3504/7133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:08 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:09.020014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0ba630dc-dc1d-43c3-ac2a-5f8e1764afb6 req-32b0850a-bc68-41fd-a99f-a45e2d70c60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a802c92a-7d9a-4321-890c-4dacf393779a", "tag": "4ba35407-0ff1-4591-94b7-f819261164d0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:09.036085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0ba630dc-dc1d-43c3-ac2a-5f8e1764afb6 req-32b0850a-bc68-41fd-a99f-a45e2d70c60c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:09.036577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0ba630dc-dc1d-43c3-ac2a-5f8e1764afb6 req-32b0850a-bc68-41fd-a99f-a45e2d70c60c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:09.037031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0ba630dc-dc1d-43c3-ac2a-5f8e1764afb6 req-32b0850a-bc68-41fd-a99f-a45e2d70c60c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:09.047401 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0ba630dc-dc1d-43c3-ac2a-5f8e1764afb6 req-32b0850a-bc68-41fd-a99f-a45e2d70c60c service nova] Creating event network-changed:4ba35407-0ff1-4591-94b7-f819261164d0 for instance a802c92a-7d9a-4321-890c-4dacf393779a on n-h1-858383-17 Oct 31 16:27:09.052288 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0ba630dc-dc1d-43c3-ac2a-5f8e1764afb6 req-32b0850a-bc68-41fd-a99f-a45e2d70c60c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036119 Oct 31 16:27:09.053008 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3630/7134] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:09.648479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:09.649151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:09.656342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:09.656925 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:09.657447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:09.658110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:09.658647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:09.659103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:09.791587 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:09.800249 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a6b30a25-ff0b-43c2-a534-29825a652214 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.155713 Oct 31 16:27:09.800851 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3505/7135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:09 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:10.824873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:10.825582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:10.831763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:10.832252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:10.832707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:10.833415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:10.833875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:10.834306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:10.963632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:10.972152 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63088537-0cc0-4f9d-baec-9bb55cf12872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.152359 Oct 31 16:27:10.972747 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3631/7136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:10 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:11.995710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:11.996365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:12.004166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:12.004708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:12.005184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:12.005889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:12.006362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:12.006798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:12.137691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:12.145360 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9ab09e57-4d9e-4adc-8d66-40cccec3ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.153534 Oct 31 16:27:12.145985 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3506/7137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:11 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:13.169087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:13.169699 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:13.177418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:13.177907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:13.178340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:13.179037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:13.179491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:13.179914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:13.312309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:13.319964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c555f8e4-a65f-4b2f-91f9-9135a6664c90 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.154872 Oct 31 16:27:13.320533 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3632/7138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:13 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:14.342714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:14.343368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:14.357209 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:14.357736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:14.358234 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:14.359755 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:14.360236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:14.360681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:14.489574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:14.497287 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f808eb1a-1034-472c-959b-ae792014332e tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.158472 Oct 31 16:27:14.497858 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3507/7139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:14 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:15.522221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:15.522831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:15.529834 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:15.530392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:15.530817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:15.531504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:15.531960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:15.532381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:15.668569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:15.677597 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99871ae2-bb73-4303-ac98-ae886211cd13 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.158807 Oct 31 16:27:15.689998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3633/7140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:15 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:16.265314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2a8e3b6e-9340-4301-bbdf-f0caf54b9a38 req-6a15835d-aa67-40ca-9b43-f0bf6f46e22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a802c92a-7d9a-4321-890c-4dacf393779a", "name": "network-vif-plugged", "status": "completed", "tag": "4ba35407-0ff1-4591-94b7-f819261164d0"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:16.275659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a8e3b6e-9340-4301-bbdf-f0caf54b9a38 req-6a15835d-aa67-40ca-9b43-f0bf6f46e22c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:16.276230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a8e3b6e-9340-4301-bbdf-f0caf54b9a38 req-6a15835d-aa67-40ca-9b43-f0bf6f46e22c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:16.276688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a8e3b6e-9340-4301-bbdf-f0caf54b9a38 req-6a15835d-aa67-40ca-9b43-f0bf6f46e22c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:16.288861 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2a8e3b6e-9340-4301-bbdf-f0caf54b9a38 req-6a15835d-aa67-40ca-9b43-f0bf6f46e22c service nova] Creating event network-vif-plugged:4ba35407-0ff1-4591-94b7-f819261164d0 for instance a802c92a-7d9a-4321-890c-4dacf393779a on n-h1-858383-17 Oct 31 16:27:16.292302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:16.294186 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2a8e3b6e-9340-4301-bbdf-f0caf54b9a38 req-6a15835d-aa67-40ca-9b43-f0bf6f46e22c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032708 Oct 31 16:27:16.294783 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3508/7141] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:16.700929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:16.701551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:16.703571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:16.704257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:16.711276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:16.711766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:16.712208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:16.712932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:16.713396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:16.713837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:16.843361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:16.851163 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e67050f-2079-4eca-8f62-f48933cf0804 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.154274 Oct 31 16:27:16.851734 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3634/7142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:16 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:17.875964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:17.876690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:17.883699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:17.884204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:17.884664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:17.885468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:17.885947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:17.886426 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:18.026977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:18.035389 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5240afcb-c60a-4b73-9de0-92921993be88 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1362 microversion: 2.1 time: 0.164564 Oct 31 16:27:18.035964 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3509/7143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:17 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:19.058314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:19.058932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:19.066358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:19.066844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:19.067283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:19.067974 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:19.068436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:19.068899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:19.197444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:19.205973 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb8e3c9d-ad79-4091-8de1-5cba3567865c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1553 microversion: 2.1 time: 0.151544 Oct 31 16:27:19.206484 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3635/7144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:19 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:19.227948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:19.228573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:19.235563 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:19.236058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:19.236506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:19.237237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:19.237707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:19.238144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:19.370093 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:19.378436 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-edbc584c-daeb-4de5-afaa-297321f591cf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1553 microversion: 2.1 time: 0.154410 Oct 31 16:27:19.379006 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3510/7145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:19 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:20.863375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16be759b-18bf-4ddd-bad4-b0313e6377c9"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:20.865865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:20.872648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:20.873154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:20.873596 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:20.874610 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:20.875062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:20.875517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:20.879197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:21.133481 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb0c994a-5d5e-49cf-9a5e-e144ac1bb510 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273962 Oct 31 16:27:21.134135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3636/7146] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 16:27:20 2022] POST /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:31.850797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:31.851298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:31.853387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:31.854230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=72 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:31.860797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:31.861300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:31.861750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:31.862462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:31.862933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:31.863374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:31.943834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lazy-loading 'services' on Instance uuid a802c92a-7d9a-4321-890c-4dacf393779a {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:27:32.013392 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-347d18ca-c5ed-4e05-989f-09d3b5102113 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments/16be759b-18bf-4ddd-bad4-b0313e6377c9" status: 202 len: 0 microversion: 2.1 time: 0.166722 Oct 31 16:27:32.013988 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3511/7147] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:27:31 2022] DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments/16be759b-18bf-4ddd-bad4-b0313e6377c9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:27:32.020585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:32.021386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:32.025824 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:32.028184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:32.036537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:32.037059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:32.037493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:32.038218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:32.038676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:32.039108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:32.072246 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d764e16b-5490-406c-b724-caea32649c28 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053726 Oct 31 16:27:32.072842 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3637/7148] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:27:32 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:33.085931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:33.088314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:33.095672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:33.096179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:33.096633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:33.097374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:33.097846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:33.098291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:33.132386 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c34a72c6-c04b-4fb3-aba0-26cc9d7daf11 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050581 Oct 31 16:27:33.132984 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3512/7149] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:27:33 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:34.145435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:34.147631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:34.154879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:34.155384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:34.155956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:34.156685 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:34.157173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:34.157613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:34.191816 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b89631c8-a1db-4345-9e1b-6e3dfa43bd8d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050372 Oct 31 16:27:34.192633 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3638/7150] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:27:34 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:35.204621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:35.206921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:35.213786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:35.214298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:35.214812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:35.215481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:35.215961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:35.216411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:35.247505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-73f136e9-cd7c-40fb-9698-9894f94b72df tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047142 Oct 31 16:27:35.248088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3513/7151] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:27:35 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:36.261498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:36.263849 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:36.270987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:36.271485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:36.271928 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:36.272665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:36.273148 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:36.273576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:36.305363 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44aa35e5-9042-445c-bf12-30f0eece53a7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048337 Oct 31 16:27:36.305932 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3639/7152] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:27:36 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:37.319104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:37.321333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:37.328797 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:37.329300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:37.329772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:37.330462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:37.330934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:37.331379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:37.361075 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-10c59f39-cfe4-415e-a8fe-ce8e595f1fe7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046055 Oct 31 16:27:37.361641 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3514/7153] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:27:37 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:27:37.372363 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:37.372886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:37.380324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:37.380840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:37.381275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:37.381961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:37.382670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:37.383091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:37.457541 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] HTTP exception thrown: Instance a802c92a-7d9a-4321-890c-4dacf393779a is not attached to volume 16be759b-18bf-4ddd-bad4-b0313e6377c9 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Request method failure captured: Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments/16be759b-18bf-4ddd-bad4-b0313e6377c9 HTTP/1.1 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_cu4Aw5ms2B2s4Su3QKXmAnxyF0j2I4fssPnYYTtglqeQAf_2kzD1XedqK8ZR5Y8rdsXNcdWym6s69sT_V0NRZuPywgzObAOf2oHs10hodSDG2WV-YufEmk_BjWzYg7HYeSAc8IEM6h-Ga83RshYRTZRpVLRhtXkur-a1sTUftycZM Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a802c92a-7d9a-4321-890c-4dacf393779a is not attached to volume 16be759b-18bf-4ddd-bad4-b0313e6377c9 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': 'a802c92a-7d9a-4321-890c-4dacf393779a', 'id': '16be759b-18bf-4ddd-bad4-b0313e6377c9'} Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16be759b-18bf-4ddd-bad4-b0313e6377c9. Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a802c92a-7d9a-4321-890c-4dacf393779a is not attached to volume 16be759b-18bf-4ddd-bad4-b0313e6377c9 Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:27:37.459513 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a802c92a-7d9a-4321-890c-4dacf393779a is not attached to volume 16be759b-18bf-4ddd-bad4-b0313e6377c9 Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Returning 404 to user: Instance a802c92a-7d9a-4321-890c-4dacf393779a is not attached to volume 16be759b-18bf-4ddd-bad4-b0313e6377c9 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0edd9562-efe5-4915-a0a3-d91c3297e1de tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments/16be759b-18bf-4ddd-bad4-b0313e6377c9" status: 404 len: 154 microversion: 2.1 time: 0.092756 Oct 31 16:27:37.464835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3640/7154] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:27:37 2022] DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a/os-volume_attachments/16be759b-18bf-4ddd-bad4-b0313e6377c9 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:27:40.807515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:40.808108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:40.815601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:40.816101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:40.816554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:40.817288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:40.817756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:40.818213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:40.846156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:27:40.930071 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d2f963e-b210-44f8-aed4-df161060468f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 204 len: 0 microversion: 2.1 time: 0.126095 Oct 31 16:27:40.930814 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3515/7155] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:27:40 2022] DELETE /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:27:40.941066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:40.942560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:40.950333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:40.950899 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:40.951539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:40.953183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:40.953775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:40.954276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:41.087568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:41.096091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-631e22ba-29f9-4ca9-9a0f-4090ff22cee1 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1559 microversion: 2.1 time: 0.160568 Oct 31 16:27:41.096746 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3641/7156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:40 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:42.120585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:42.121365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:42.128458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:42.128992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:42.129449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:42.130164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:42.130638 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:42.131084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:42.260992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:42.269537 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ea95d41a-cb2f-42a5-a98d-9253396f7872 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1559 microversion: 2.1 time: 0.153215 Oct 31 16:27:42.270130 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3516/7157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:42 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:43.174508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1e2c04aa-accf-496e-8e11-c9b391a3880b req-6ca0b0cd-73f7-4844-ac81-99ebbcc4e3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a802c92a-7d9a-4321-890c-4dacf393779a", "name": "network-vif-deleted", "tag": "4ba35407-0ff1-4591-94b7-f819261164d0"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:43.186146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e2c04aa-accf-496e-8e11-c9b391a3880b req-6ca0b0cd-73f7-4844-ac81-99ebbcc4e3bb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:43.186655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e2c04aa-accf-496e-8e11-c9b391a3880b req-6ca0b0cd-73f7-4844-ac81-99ebbcc4e3bb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:43.187107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e2c04aa-accf-496e-8e11-c9b391a3880b req-6ca0b0cd-73f7-4844-ac81-99ebbcc4e3bb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:43.202181 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1e2c04aa-accf-496e-8e11-c9b391a3880b req-6ca0b0cd-73f7-4844-ac81-99ebbcc4e3bb service nova] Creating event network-vif-deleted:4ba35407-0ff1-4591-94b7-f819261164d0 for instance a802c92a-7d9a-4321-890c-4dacf393779a on n-h1-858383-17 Oct 31 16:27:43.207847 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1e2c04aa-accf-496e-8e11-c9b391a3880b req-6ca0b0cd-73f7-4844-ac81-99ebbcc4e3bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037649 Oct 31 16:27:43.208627 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3642/7158] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:43.292934 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:43.293584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:43.301208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:43.302025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:43.302656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:43.303379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:43.303977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:43.304425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:43.337865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:43.338321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:43.338832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:43.339305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lazy-loading 'fault' on Instance uuid a802c92a-7d9a-4321-890c-4dacf393779a {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:27:43.381801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:43.389686 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1da63fa-f029-4f12-a924-5f55fbccd283 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 200 len: 1352 microversion: 2.1 time: 0.100629 Oct 31 16:27:43.391020 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3517/7159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:43 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:44.415839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:44.416537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: a802c92a-7d9a-4321-890c-4dacf393779a] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:44.423623 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:44.424043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:44.424483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:44.425208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:44.425664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:44.426088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:44.439887 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] HTTP exception thrown: Instance a802c92a-7d9a-4321-890c-4dacf393779a could not be found. Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Request method failure captured: Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a HTTP/1.1 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_cu4Aw5ms2B2s4Su3QKXmAnxyF0j2I4fssPnYYTtglqeQAf_2kzD1XedqK8ZR5Y8rdsXNcdWym6s69sT_V0NRZuPywgzObAOf2oHs10hodSDG2WV-YufEmk_BjWzYg7HYeSAc8IEM6h-Ga83RshYRTZRpVLRhtXkur-a1sTUftycZM Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance a802c92a-7d9a-4321-890c-4dacf393779a could not be found. Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'a802c92a-7d9a-4321-890c-4dacf393779a'} Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a802c92a-7d9a-4321-890c-4dacf393779a could not be found. Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a802c92a-7d9a-4321-890c-4dacf393779a could not be found. Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:27:44.441609 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a802c92a-7d9a-4321-890c-4dacf393779a could not be found. Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Returning 404 to user: Instance a802c92a-7d9a-4321-890c-4dacf393779a could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2bce2543-4cd9-41d9-aed6-ea94df68dd66 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a" status: 404 len: 111 microversion: 2.1 time: 0.032264 Oct 31 16:27:44.446279 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3643/7160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:44 2022] GET /compute/v2.1/servers/a802c92a-7d9a-4321-890c-4dacf393779a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:27:44.451997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-afccc717-5f87-45ad-ab60-50b6235deb25 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '.version_select at 0x7f5ca230cca0>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:44.473345 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-afccc717-5f87-45ad-ab60-50b6235deb25 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1870427585" status: 202 len: 0 microversion: 2.1 time: 0.025280 Oct 31 16:27:44.474068 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3518/7161] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Oct 31 16:27:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1870427585 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:27:44.491163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a1b56f2b-d4d4-41ad-829d-a27a3bb2d9c9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: .version_select at 0x7f5ca21363a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1654773547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2Qbl7y87DUhUAASxYOFDR0TTN4SGY2MAg9L8E5TGxhjSOlwHMjK0+z4MkeI+ps0IcAMax40gB/4HBOgRgj1y723CIlg0/jPmAcIRNQ9PTAqo9QnHvHGPKOzW1sOtCymw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:44.506655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a1b56f2b-d4d4-41ad-829d-a27a3bb2d9c9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for project c3d5148ed8314ad7a383c44740eda69a. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:27:44.511971 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a1b56f2b-d4d4-41ad-829d-a27a3bb2d9c9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for user 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 and project c3d5148ed8314ad7a383c44740eda69a. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:27:44.535344 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a1b56f2b-d4d4-41ad-829d-a27a3bb2d9c9 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048063 Oct 31 16:27:44.535933 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3644/7162] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:27:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:44.585015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1655147931", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1654773547", "networks": [{"uuid": "cdd59fdd-2d84-4cff-91de-d32ad91f8acd"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:44.638397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] validate_networks() for [('cdd59fdd-2d84-4cff-91de-d32ad91f8acd', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:27:45.020822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:27:45.021267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:27:45.021763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:27:45.022208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:27:45.022670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:27:45.032305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:45.032857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:45.033310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:45.034056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:45.034530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:45.034973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:45.052318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for project c3d5148ed8314ad7a383c44740eda69a. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:27:45.057595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Getting quotas for user 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 and project c3d5148ed8314ad7a383c44740eda69a. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:27:45.069908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:27:45.072248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:27:45.118912 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bf2734b-be2f-42cc-a45b-12734369ccfb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537824 Oct 31 16:27:45.119561 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3519/7163] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:27:45.130979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-136ccb3f-52c8-4326-b022-f67c223073e7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:45.131600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-136ccb3f-52c8-4326-b022-f67c223073e7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:45.193288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-136ccb3f-52c8-4326-b022-f67c223073e7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:45.201603 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-136ccb3f-52c8-4326-b022-f67c223073e7 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1263 microversion: 2.1 time: 0.074604 Oct 31 16:27:45.202701 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3645/7164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:45 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:46.225144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:46.225886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:46.257009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:46.258145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:46.258684 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:46.259520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:46.260077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:46.260773 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:46.344754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:46.352482 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c5afa472-db47-4da3-991d-f69e580c1363 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1333 microversion: 2.1 time: 0.131209 Oct 31 16:27:46.353117 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3520/7165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:46 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1333 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:47.376561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:47.377210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:47.384283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:47.384799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:47.385246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:47.385957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:47.386415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:47.386845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:47.585705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:47.594256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98f1ebf8-08f4-437c-8a57-ab1778d80c0b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.221426 Oct 31 16:27:47.594835 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3646/7166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:47 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:27:47.613767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6c6f8516-00af-409e-9aa2-584b811e3281 req-af8d0005-7364-4b5e-8760-16d03409f994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29886d58-4dc8-423a-a416-b57c95b023be", "tag": "84eb2c39-e599-4fe7-9ab3-7898acd90686"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:47.624622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c6f8516-00af-409e-9aa2-584b811e3281 req-af8d0005-7364-4b5e-8760-16d03409f994 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:47.625197 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c6f8516-00af-409e-9aa2-584b811e3281 req-af8d0005-7364-4b5e-8760-16d03409f994 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:47.625663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6c6f8516-00af-409e-9aa2-584b811e3281 req-af8d0005-7364-4b5e-8760-16d03409f994 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:47.636827 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6c6f8516-00af-409e-9aa2-584b811e3281 req-af8d0005-7364-4b5e-8760-16d03409f994 service nova] Creating event network-changed:84eb2c39-e599-4fe7-9ab3-7898acd90686 for instance 29886d58-4dc8-423a-a416-b57c95b023be on n-h1-858383-17 Oct 31 16:27:47.642514 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6c6f8516-00af-409e-9aa2-584b811e3281 req-af8d0005-7364-4b5e-8760-16d03409f994 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032459 Oct 31 16:27:47.643289 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3521/7167] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:48.618250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:48.618870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:48.625888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:48.626370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:48.626803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:48.627491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:48.627945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:48.628367 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:48.755578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:48.763576 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a9e34ce-1574-412b-a683-c60bdb0441a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.149271 Oct 31 16:27:48.764144 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3647/7168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:48 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:49.788129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:49.788886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:49.795213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:49.795719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:49.796536 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:49.797322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:49.797808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:49.798261 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:49.933394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:49.941642 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-00f8232a-2018-48c2-bb00-7284c15b9aaf tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.158743 Oct 31 16:27:49.942230 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3522/7169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:49 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:50.965597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:50.966211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:50.973228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:50.973658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:50.974096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:50.974817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:50.975274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:50.975698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:51.103625 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:51.111496 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-088a4066-2328-46d4-b5c4-53c4c8ff4987 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.149824 Oct 31 16:27:51.112062 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3648/7170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:50 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:52.134235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:52.134865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:52.141883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:52.142382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:52.142835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:52.143538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:52.144015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:52.144457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:52.275761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:52.284654 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dd1d6d25-6267-4f1e-b38c-f0655e6cb367 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.154565 Oct 31 16:27:52.285284 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3523/7171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:52 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:53.308046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:53.308666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:53.316288 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:53.316808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:53.317250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:53.317945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:53.318406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:53.318833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:53.446356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:53.454183 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1e17f98-9029-473d-aa33-013662ea21b8 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.150038 Oct 31 16:27:53.454748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3649/7172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:53 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:54.435302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c07a924e-1dcd-43c5-a5fd-7865be84d0a2 req-998b8f85-bb69-4ee8-b502-e95493508238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29886d58-4dc8-423a-a416-b57c95b023be", "name": "network-vif-plugged", "status": "completed", "tag": "84eb2c39-e599-4fe7-9ab3-7898acd90686"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:54.446111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c07a924e-1dcd-43c5-a5fd-7865be84d0a2 req-998b8f85-bb69-4ee8-b502-e95493508238 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:54.446606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c07a924e-1dcd-43c5-a5fd-7865be84d0a2 req-998b8f85-bb69-4ee8-b502-e95493508238 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:54.447149 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c07a924e-1dcd-43c5-a5fd-7865be84d0a2 req-998b8f85-bb69-4ee8-b502-e95493508238 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:54.458513 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c07a924e-1dcd-43c5-a5fd-7865be84d0a2 req-998b8f85-bb69-4ee8-b502-e95493508238 service nova] Creating event network-vif-plugged:84eb2c39-e599-4fe7-9ab3-7898acd90686 for instance 29886d58-4dc8-423a-a416-b57c95b023be on n-h1-858383-17 Oct 31 16:27:54.463525 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c07a924e-1dcd-43c5-a5fd-7865be84d0a2 req-998b8f85-bb69-4ee8-b502-e95493508238 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Oct 31 16:27:54.464346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3524/7173] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:27:54.477622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:54.478283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:54.485424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:54.485920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:54.486369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:54.487073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:54.487543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:54.487973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:54.669915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:54.679707 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e73a1a4-a72a-45de-8607-f6aa897aeee5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.205800 Oct 31 16:27:54.680227 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3650/7174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:54 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:55.700585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:55.701430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:55.706631 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:55.707379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:55.714492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:55.714992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:55.715447 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:55.716151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:55.716626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:55.717095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:55.848222 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:55.855909 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-65abc36e-972a-4913-aaf0-f99d8626b19f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1363 microversion: 2.1 time: 0.156340 Oct 31 16:27:55.856474 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3525/7175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:55 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:56.879891 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:56.880508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:56.882835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:27:56.889338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:56.890033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:56.890482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:56.891176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:56.891784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:56.892269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:57.030702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:57.038525 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e213b851-bd54-4e43-863a-864e9abbf2fd tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1555 microversion: 2.1 time: 0.162665 Oct 31 16:27:57.039117 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3651/7176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:56 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:57.061879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:27:57.062462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:57.069369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:57.069876 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:57.070343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:57.071058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:57.071545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:57.071994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:57.202825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:27:57.210526 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e5d83644-c122-4d5d-88df-d2576ff60b09 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1555 microversion: 2.1 time: 0.153232 Oct 31 16:27:57.211120 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3526/7177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:27:57 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:27:58.695189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae0e9ef-5a2e-4908-9c08-f5a0d837f086"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:27:58.697554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:27:58.704615 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:58.705139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:58.705583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:58.706280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:27:58.706742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:27:58.707176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:27:58.961895 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c76c62f-207a-47a0-bb4b-c333cecd56a6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "POST /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270241 Oct 31 16:27:58.962464 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3652/7178] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 16:27:58 2022] POST /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:09.674007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:09.674559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:09.677372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:09.678046 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:09.683943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:09.684462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:09.684998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:09.685738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:09.686333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:09.686913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:09.773143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lazy-loading 'services' on Instance uuid 29886d58-4dc8-423a-a416-b57c95b023be {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:28:09.842074 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1ff47ca4-60d2-44c3-a11b-d5dc2a3836f0 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments/3ae0e9ef-5a2e-4908-9c08-f5a0d837f086" status: 202 len: 0 microversion: 2.1 time: 0.171765 Oct 31 16:28:09.843346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3527/7179] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:28:09 2022] DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments/3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:28:09.853452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:09.856410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:09.860779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:09.861478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:09.870520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:09.871454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:09.872004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:09.872741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:09.873214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:09.873683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:09.910751 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f77c5795-8630-4e77-8444-04d2d3a2dc3d tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062197 Oct 31 16:28:09.911265 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3653/7180] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:28:09 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:10.925685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:10.928089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:10.934499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:10.934995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:10.935473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:10.936207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:10.936818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:10.937262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:10.968004 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e1334f34-df39-41d5-8563-c4fdcde0846b tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Oct 31 16:28:10.968578 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3528/7181] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:28:10 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:11.980862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:11.983112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:11.990603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:11.991065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:11.991505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:11.992210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:11.992669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:11.993118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:12.026611 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c69cbe3-9a86-4a48-bd66-cfa836336acb tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049942 Oct 31 16:28:12.027208 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3654/7182] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:28:11 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:13.039595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:13.042080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:13.049430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:13.049938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:13.050397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:13.051118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:13.051601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:13.052071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:13.083712 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a283d7c-d2c8-419f-9376-0d071697e82c tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047973 Oct 31 16:28:13.084177 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3529/7183] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:28:13 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:14.096163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:14.098702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:14.105844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:14.106346 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:14.106792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:14.107516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:14.108503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:14.109013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:14.141075 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a4db0342-94d9-4b1a-9d83-7ef5e71bc6b5 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049206 Oct 31 16:28:14.141865 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3655/7184] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:28:14 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:15.153882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:15.156816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:15.163770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:15.164271 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:15.164746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:15.165470 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:15.165947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:15.166392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:15.196330 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33828f15-390e-4e81-b770-abb77032d433 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046722 Oct 31 16:28:15.196946 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3530/7185] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:28:15 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 16:28:15.209640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:15.210217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:15.217884 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:15.218577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:15.219088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:15.219859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:15.220454 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:15.220993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:15.297335 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] HTTP exception thrown: Instance 29886d58-4dc8-423a-a416-b57c95b023be is not attached to volume 3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Request method failure captured: Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments/3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 HTTP/1.1 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_cu4Aw5ms2B2s4Su3QKXmAnxyF0j2I4fssPnYYTtglqeQAf_2kzD1XedqK8ZR5Y8rdsXNcdWym6s69sT_V0NRZuPywgzObAOf2oHs10hodSDG2WV-YufEmk_BjWzYg7HYeSAc8IEM6h-Ga83RshYRTZRpVLRhtXkur-a1sTUftycZM Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 29886d58-4dc8-423a-a416-b57c95b023be is not attached to volume 3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': '29886d58-4dc8-423a-a416-b57c95b023be', 'id': '3ae0e9ef-5a2e-4908-9c08-f5a0d837f086'} Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3ae0e9ef-5a2e-4908-9c08-f5a0d837f086. Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29886d58-4dc8-423a-a416-b57c95b023be is not attached to volume 3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:28:15.299050 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29886d58-4dc8-423a-a416-b57c95b023be is not attached to volume 3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Returning 404 to user: Instance 29886d58-4dc8-423a-a416-b57c95b023be is not attached to volume 3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80474e3e-387b-484b-9bfe-6dfa4a4a688a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments/3ae0e9ef-5a2e-4908-9c08-f5a0d837f086" status: 404 len: 154 microversion: 2.1 time: 0.095365 Oct 31 16:28:15.303121 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3656/7186] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:28:15 2022] DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be/os-volume_attachments/3ae0e9ef-5a2e-4908-9c08-f5a0d837f086 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:28:18.650259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:18.650796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:18.658766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:18.659282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:18.659736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:18.660468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:18.660963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:18.661409 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:18.688439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:28:18.771590 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cb859e2b-d198-49fb-85e1-ef14725ec071 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 204 len: 0 microversion: 2.1 time: 0.124841 Oct 31 16:28:18.772239 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3531/7187] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:28:18 2022] DELETE /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:28:18.781542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:18.782060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:18.789754 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:18.790244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:18.790688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:18.791393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:18.791852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:18.792281 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:18.923940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:18.931799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e3cb64a-c196-4131-9f9c-88ae7902fe3f tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1561 microversion: 2.1 time: 0.155024 Oct 31 16:28:18.932376 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3657/7188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:18 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:19.956363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:19.957119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:19.964107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:19.964615 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:19.965109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:19.965823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:19.966302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:19.966750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:20.103872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:20.112318 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-be708cdc-dbf5-4eab-9ae4-70462bd7c6ef tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1561 microversion: 2.1 time: 0.160617 Oct 31 16:28:20.112947 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3532/7189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:19 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:21.140600 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:21.141940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:21.150987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:21.151496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:21.151943 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:21.152673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:21.153725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:21.153725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:21.197099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-498d68b3-895f-49a4-9fe4-85faff1cfeb0 req-aab5f9c8-ce37-402e-8f89-e2daa9de05ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29886d58-4dc8-423a-a416-b57c95b023be", "name": "network-vif-deleted", "tag": "84eb2c39-e599-4fe7-9ab3-7898acd90686"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:28:21.208871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-498d68b3-895f-49a4-9fe4-85faff1cfeb0 req-aab5f9c8-ce37-402e-8f89-e2daa9de05ec service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:21.209378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-498d68b3-895f-49a4-9fe4-85faff1cfeb0 req-aab5f9c8-ce37-402e-8f89-e2daa9de05ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:21.209839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-498d68b3-895f-49a4-9fe4-85faff1cfeb0 req-aab5f9c8-ce37-402e-8f89-e2daa9de05ec service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:21.223430 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-498d68b3-895f-49a4-9fe4-85faff1cfeb0 req-aab5f9c8-ce37-402e-8f89-e2daa9de05ec service nova] Creating event network-vif-deleted:84eb2c39-e599-4fe7-9ab3-7898acd90686 for instance 29886d58-4dc8-423a-a416-b57c95b023be on n-h1-858383-17 Oct 31 16:28:21.228869 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-498d68b3-895f-49a4-9fe4-85faff1cfeb0 req-aab5f9c8-ce37-402e-8f89-e2daa9de05ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037291 Oct 31 16:28:21.229515 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3533/7190] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:21.239946 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59eb62fe2fba45bfa9bc3ff6dbc4b2e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5148ed8314ad7a383c44740eda69a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:21.248282 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ddc3437-dc6b-4595-a905-6f4563c8ff6a tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 200 len: 1519 microversion: 2.1 time: 0.114160 Oct 31 16:28:21.248904 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3658/7191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:21 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 1519 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:22.274314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:22.275039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] [instance: 29886d58-4dc8-423a-a416-b57c95b023be] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:22.282115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:22.282612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:22.283069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:22.283778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:22.284253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:22.284714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:22.298786 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] HTTP exception thrown: Instance 29886d58-4dc8-423a-a416-b57c95b023be could not be found. Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Request method failure captured: Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be HTTP/1.1 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_cu4Aw5ms2B2s4Su3QKXmAnxyF0j2I4fssPnYYTtglqeQAf_2kzD1XedqK8ZR5Y8rdsXNcdWym6s69sT_V0NRZuPywgzObAOf2oHs10hodSDG2WV-YufEmk_BjWzYg7HYeSAc8IEM6h-Ga83RshYRTZRpVLRhtXkur-a1sTUftycZM Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d5148ed8314ad7a383c44740eda69a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: c3d5148ed8314ad7a383c44740eda69a Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-740652832 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 59eb62fe2fba45bfa9bc3ff6dbc4b2e8 Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestEncryptedCinderVolumes-740652832-project Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 29886d58-4dc8-423a-a416-b57c95b023be could not be found. Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '29886d58-4dc8-423a-a416-b57c95b023be'} Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29886d58-4dc8-423a-a416-b57c95b023be could not be found. Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29886d58-4dc8-423a-a416-b57c95b023be could not be found. Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:28:22.300415 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29886d58-4dc8-423a-a416-b57c95b023be could not be found. Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Returning 404 to user: Instance 29886d58-4dc8-423a-a416-b57c95b023be could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1cf23375-b7e6-4b99-877b-3ebf10e27fcc tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be" status: 404 len: 111 microversion: 2.1 time: 0.032731 Oct 31 16:28:22.305289 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3534/7192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:22 2022] GET /compute/v2.1/servers/29886d58-4dc8-423a-a416-b57c95b023be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:28:22.310654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eac1363a-29de-4a8e-b335-24eef83e3db6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] Calling method '.version_select at 0x7f5ca141b5e0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:22.330966 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eac1363a-29de-4a8e-b335-24eef83e3db6 tempest-TestEncryptedCinderVolumes-740652832 tempest-TestEncryptedCinderVolumes-740652832-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1654773547" status: 202 len: 0 microversion: 2.1 time: 0.024187 Oct 31 16:28:22.331537 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3659/7193] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Oct 31 16:28:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1654773547 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:28:49.482159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5b9e6929-b7b2-4d52-ade6-8c61fa51ce38 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'create', calling method: .version_select at 0x7f5ca1d060d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-37586040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdqqSnz1c0BzhNKB/hxC4WbYwDXRxrJPk4Y3x7K14kk45vARQGm1wKM1sAtvFKm+6Ij6W8h2JAFItLK9H1KIGE1h3FtaXAcr8t1q6Dkwz4f5ubJDb3Dub0R2ZQd36WUbA=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:28:49.488113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:49.488835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:49.504500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-5b9e6929-b7b2-4d52-ade6-8c61fa51ce38 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for project 29972189b0004124a5824449a6bb96c0. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:28:49.509933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-5b9e6929-b7b2-4d52-ade6-8c61fa51ce38 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for user ad19f3c6ede24eb5ad16410d4558847e and project 29972189b0004124a5824449a6bb96c0. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:28:49.533398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5b9e6929-b7b2-4d52-ade6-8c61fa51ce38 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.056074 Oct 31 16:28:49.534010 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3535/7194] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:28:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:49.580241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=36 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:49.581071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:49.585704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1706236102", "imageRef": "8caba0f8-faff-4791-938f-fe1a8c771a9c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-37586040", "networks": [{"uuid": "4525d959-d68e-41ae-b5a6-ab50d0974cce"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:28:49.639953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] validate_networks() for [('4525d959-d68e-41ae-b5a6-ab50d0974cce', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:28:50.010123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:28:50.010565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:28:50.011018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:28:50.011431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:28:50.011835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:28:50.021302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:50.021775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:50.022208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:50.022926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:50.023381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:50.023807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:50.041624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for project 29972189b0004124a5824449a6bb96c0. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:28:50.047341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for user ad19f3c6ede24eb5ad16410d4558847e and project 29972189b0004124a5824449a6bb96c0. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:28:50.059426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:28:50.062558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8caba0f8-faff-4791-938f-fe1a8c771a9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:28:50.108057 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7aa372d1-9249-4e75-b7e9-00579aa57cff tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529011 Oct 31 16:28:50.108720 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3660/7195] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:28:50.119665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5551f8e6-a428-40bb-8964-ed42d233e4a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:50.120425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5551f8e6-a428-40bb-8964-ed42d233e4a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:50.175722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5551f8e6-a428-40bb-8964-ed42d233e4a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:50.183936 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5551f8e6-a428-40bb-8964-ed42d233e4a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1257 microversion: 2.1 time: 0.068217 Oct 31 16:28:50.184506 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3536/7196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:50 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:51.206811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:51.207435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:51.217673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:51.218491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:51.219024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:51.219854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:51.220430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:51.221106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:51.303198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:51.312390 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-41974130-e07c-4ebc-a87a-bcc2f2c8197a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1317 microversion: 2.1 time: 0.109499 Oct 31 16:28:51.328421 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3661/7197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:51 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1317 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:52.335620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:52.336196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:52.343282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:52.343777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:52.344227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:52.345088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:52.345612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:52.346147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:52.505651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:52.515805 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ca6cde30-2b87-414f-94c0-26baeb39bc3c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.184126 Oct 31 16:28:52.516422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3537/7198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:52 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:53.540333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:53.541679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:53.549853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:53.550442 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:53.551337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:53.551919 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:53.552476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:53.552997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:53.696868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:53.705639 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6e1ce977-fe8e-4642-9752-e3649074dde5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.169883 Oct 31 16:28:53.706329 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3662/7199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:53 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:54.730768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:54.734054 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:54.742793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:54.743535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:54.744061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:54.745010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:54.745525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:54.745971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:54.910859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:54.918654 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8a0e1df5-4679-4aad-8a74-503fce7cb812 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.192725 Oct 31 16:28:54.919239 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3538/7200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:54 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:55.943601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:55.945641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:55.953863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:55.954452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:55.955123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:55.955917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:55.956450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:55.957022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:56.106427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:56.115623 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd8acaca-62d5-4823-9f9e-08b3a0efff22 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.177189 Oct 31 16:28:56.116220 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3663/7201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:55 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:57.141800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:57.142593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:57.150043 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:57.150549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:57.151204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:57.152218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:57.152970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:57.153498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:57.308614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:57.317209 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-603a5f28-c388-4901-aa42-c496e9bfb566 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.179816 Oct 31 16:28:57.317998 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3539/7202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:57 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:58.340582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:58.341228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:58.349341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:58.349833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:58.350266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:58.350972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:58.351482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:58.351906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:58.506092 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:58.515569 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e16d4cf-003f-4ef9-b2f3-16e3178a4c0e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.178807 Oct 31 16:28:58.516484 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3664/7203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:58 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:59.539202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:59.539845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:59.547531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:59.548035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:59.548497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:59.549244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:59.549727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:59.550185 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:59.682216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:59.690474 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3261e87-e9f3-4ed7-927b-8ef083569d34 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.155206 Oct 31 16:28:59.691059 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3540/7204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:59 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:00.714674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:00.715326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:00.718881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:00.719493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:00.725134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:00.725622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:00.726061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:00.726757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:00.727218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:00.727648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:00.859490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:00.867145 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0617a830-f578-449f-a357-b8fda87c992e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.156464 Oct 31 16:29:00.867728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3665/7205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:00 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:01.890263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:01.890894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:01.892845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:01.898854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:01.899345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:01.899793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:01.900493 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:01.900983 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:01.901423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:02.035022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:02.042697 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f032783e-f435-4689-a788-ed40058fe463 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.156344 Oct 31 16:29:02.043279 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3541/7206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:01 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:03.066169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:03.066813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:03.073681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:03.074159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:03.074589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:03.075276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:03.075773 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:03.076304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:03.214415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:03.222801 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd7a6308-b236-4661-a91c-83f50942dd79 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.160538 Oct 31 16:29:03.223600 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3666/7207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:03 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:03.958801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-b9e5e932-b055-4abd-a035-bc24902fcd0e req-f7c67ad6-e088-4728-a7c4-9b3f50ee359d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:03.970946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b9e5e932-b055-4abd-a035-bc24902fcd0e req-f7c67ad6-e088-4728-a7c4-9b3f50ee359d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:03.971437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b9e5e932-b055-4abd-a035-bc24902fcd0e req-f7c67ad6-e088-4728-a7c4-9b3f50ee359d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:03.971882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-b9e5e932-b055-4abd-a035-bc24902fcd0e req-f7c67ad6-e088-4728-a7c4-9b3f50ee359d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:03.983798 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-b9e5e932-b055-4abd-a035-bc24902fcd0e req-f7c67ad6-e088-4728-a7c4-9b3f50ee359d service nova] Creating event network-changed:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:29:03.988796 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-b9e5e932-b055-4abd-a035-bc24902fcd0e req-f7c67ad6-e088-4728-a7c4-9b3f50ee359d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Oct 31 16:29:03.989404 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3542/7208] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:29:04.247388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:04.248589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:04.255572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:04.256061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:04.256505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:04.257232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:04.257961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:04.258392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:04.457380 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:04.465369 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6c16afd-fef3-4ced-8737-40a801fb006b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.221910 Oct 31 16:29:04.465956 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3667/7209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:04 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:05.490570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:05.491317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:05.497509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:05.498006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:05.498451 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:05.499144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:05.499610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:05.500045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:05.633092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:05.641270 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d467fae6-9e5b-4a19-940b-c27a430ea9dc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.155828 Oct 31 16:29:05.641837 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3543/7210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:05 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:06.663477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:06.664132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:06.671633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:06.672133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:06.672579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:06.673315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:06.673783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:06.674232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:06.878263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:06.886565 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc63a2f7-63e8-4b0f-adde-af3cb64a2f26 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.226980 Oct 31 16:29:06.887246 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3668/7211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:06 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:07.909917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:07.910544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:07.917405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:07.917904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:07.918351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:07.919051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:07.919523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:07.920150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:08.052731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:08.060470 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b09b7095-1b1a-40b0-a3d7-683afff1e510 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.154411 Oct 31 16:29:08.061074 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3544/7212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:07 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:29:09.082687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:09.083233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:09.090198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:09.090682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:09.091119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:09.092464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:09.092956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:09.093387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:09.224652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:09.232798 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e9940be-5a2f-4216-ad30-6b590e1a892a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.154039 Oct 31 16:29:09.233379 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3669/7213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:09 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:10.255935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:10.256562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:10.263736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:10.264226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:10.264673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:10.265394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:10.265866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:10.266307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:10.394017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:10.401647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c273391b-6bea-4f2e-810b-720485ac690c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.149625 Oct 31 16:29:10.402228 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3545/7214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:10 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:10.710614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-32edc0dc-8a54-4587-a52e-43cf340ab6ea req-027fa97c-a5d0-4a19-b133-f5e99375e2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "name": "network-vif-plugged", "status": "completed", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:10.721519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-32edc0dc-8a54-4587-a52e-43cf340ab6ea req-027fa97c-a5d0-4a19-b133-f5e99375e2de service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:10.722011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-32edc0dc-8a54-4587-a52e-43cf340ab6ea req-027fa97c-a5d0-4a19-b133-f5e99375e2de service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:10.722443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-32edc0dc-8a54-4587-a52e-43cf340ab6ea req-027fa97c-a5d0-4a19-b133-f5e99375e2de service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:10.733862 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-32edc0dc-8a54-4587-a52e-43cf340ab6ea req-027fa97c-a5d0-4a19-b133-f5e99375e2de service nova] Creating event network-vif-plugged:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:29:10.738780 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-32edc0dc-8a54-4587-a52e-43cf340ab6ea req-027fa97c-a5d0-4a19-b133-f5e99375e2de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Oct 31 16:29:10.739576 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3670/7215] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:11.425525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:11.426077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:11.433014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:11.433516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:11.433966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:11.434673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:11.435780 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:11.436394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:11.565669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:11.573262 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ff1f5d0-2caa-4fa2-b270-831bcfe5b091 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1357 microversion: 2.1 time: 0.151792 Oct 31 16:29:11.573865 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3546/7216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:11 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:29:12.597736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:12.598374 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:12.605394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:12.606091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:12.606537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:12.607270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:12.607732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:12.608750 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:12.742268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:12.750708 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d97d0a44-1c7b-4ab1-b1c9-7889a021959c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1547 microversion: 2.1 time: 0.158298 Oct 31 16:29:12.751306 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3671/7217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:12 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:12.773524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:12.774161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:12.781181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:12.781689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:12.782140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:12.782851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:12.783324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:12.783771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:12.911752 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:12.919516 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ce1ec0a-ab02-4903-af98-0518c5c7dd04 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1547 microversion: 2.1 time: 0.149876 Oct 31 16:29:12.920094 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3547/7218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:12 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:12.941648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:12.946328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:12.947202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Searching by: {'deleted': False, 'project_id': '29972189b0004124a5824449a6bb96c0'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 16:29:12.952672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:12.953178 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:12.953637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:12.954351 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:12.954802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:12.955224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:12.978969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 16:29:13.006015 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39de12e3-059a-4278-91dd-cfd33ae00997 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068251 Oct 31 16:29:13.006593 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3672/7219] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 16:29:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:13.018568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:13.019198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:13.025152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:13.025651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:13.026099 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:13.026801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:13.027272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:13.027709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:13.158554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:13.166506 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3e69b7b8-f721-4f65-9bba-46bfc84596a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1547 microversion: 2.1 time: 0.151875 Oct 31 16:29:13.167100 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3548/7220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:13 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:14.891708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9717886c-7910-4dc4-aced-3cc6c98d4f0b"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:14.894106 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:14.901052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:14.901548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:14.901995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:14.902702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:14.903168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:14.903594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:15.179569 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a6487ea-6664-4ead-b34e-58f63b3ac8a5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292366 Oct 31 16:29:15.180266 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3673/7221] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 16:29:14 2022] POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:28.227681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:28.228311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:28.230881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:28.231729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=68 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:28.237708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:28.238207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:28.238659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:28.239372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:28.239845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:28.240287 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:28.372094 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:28.381045 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a191c63-b656-4ad1-bde2-211d64aa6bc3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1593 microversion: 2.1 time: 0.157234 Oct 31 16:29:28.381624 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3549/7222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:28 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:29.993387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:29.994151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:29.994873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:29.998933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-274daf28-419a-4d45-af56-b888f9856314 req-a7822d60-f114-4ae7-93cc-bc3c1f8c12b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:30.010401 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-274daf28-419a-4d45-af56-b888f9856314 req-a7822d60-f114-4ae7-93cc-bc3c1f8c12b7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:30.010878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-274daf28-419a-4d45-af56-b888f9856314 req-a7822d60-f114-4ae7-93cc-bc3c1f8c12b7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:30.011496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-274daf28-419a-4d45-af56-b888f9856314 req-a7822d60-f114-4ae7-93cc-bc3c1f8c12b7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:30.024726 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-274daf28-419a-4d45-af56-b888f9856314 req-a7822d60-f114-4ae7-93cc-bc3c1f8c12b7 service nova] Creating event network-changed:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:29:30.030138 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-274daf28-419a-4d45-af56-b888f9856314 req-a7822d60-f114-4ae7-93cc-bc3c1f8c12b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038515 Oct 31 16:29:30.030744 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3674/7223] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:31.133945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1936156982"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:31.134537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:31.143573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:31.144082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:31.144547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:31.145571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:31.145766 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:31.146207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:31.277685 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Adding security group 220ed3f5-f2de-459d-9333-b31b9dfcd6e3 to port a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 Oct 31 16:29:31.596655 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7bf6716e-ad29-47ff-a5cf-8bb89aab71d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action" status: 202 len: 0 microversion: 2.1 time: 0.467110 Oct 31 16:29:31.597328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3550/7224] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:29:31 2022] POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:29:31.607464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:31.608171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:31.615073 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:31.615564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:31.616023 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:31.616963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:31.617422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:31.618033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:31.768956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:31.777536 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d462b4c5-b2b7-4a7d-b148-15884923f00d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1759 microversion: 2.1 time: 0.175685 Oct 31 16:29:31.778209 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3675/7225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:31 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:32.045468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2a089cd1-6638-44d8-bee4-a3a7805b188e req-71cfaf6c-92e6-4c68-871d-ae4faaaeb96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:32.055361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a089cd1-6638-44d8-bee4-a3a7805b188e req-71cfaf6c-92e6-4c68-871d-ae4faaaeb96c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:32.055977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a089cd1-6638-44d8-bee4-a3a7805b188e req-71cfaf6c-92e6-4c68-871d-ae4faaaeb96c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:32.056432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2a089cd1-6638-44d8-bee4-a3a7805b188e req-71cfaf6c-92e6-4c68-871d-ae4faaaeb96c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:32.067899 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2a089cd1-6638-44d8-bee4-a3a7805b188e req-71cfaf6c-92e6-4c68-871d-ae4faaaeb96c service nova] Creating event network-changed:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:29:32.073273 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2a089cd1-6638-44d8-bee4-a3a7805b188e req-71cfaf6c-92e6-4c68-871d-ae4faaaeb96c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031442 Oct 31 16:29:32.075066 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3551/7226] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:44.252980 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:31:44.253898 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:31:44.254369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:44.255100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:44.256036 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:31:44.256195 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action (ip 10.222.0.48) !!! Oct 31 16:31:44.257432 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:31:44.257595 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action (ip 10.222.0.48) !!! Oct 31 16:31:44.262790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:44.265125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:44.274881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:44.275366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:44.275806 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:44.276496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:44.276990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:44.277417 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:44.351412 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2eae695b-0f7f-4bc5-8c7b-bda5ca7cbce9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action" status: 202 len: 0 microversion: 2.1 time: 0.101210 Oct 31 16:31:44.352060 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3676/7227] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:31:44 2022] POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:31:44.358824 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:31:44.360358 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:31:44.361233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:44.361977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:44.363394 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:31:44.363515 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c (ip 10.222.0.48) !!! Oct 31 16:31:44.364565 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:31:44.364716 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c (ip 10.222.0.48) !!! Oct 31 16:31:44.369995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:44.370664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:44.380836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:44.381335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:44.381791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:44.382517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:44.382991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:44.383753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:44.739318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:44.747728 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-35600ce0-ec2a-4a70-b392-a697c4950c89 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1761 microversion: 2.1 time: 0.391014 Oct 31 16:31:44.748310 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3552/7228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:44 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1761 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:45.774513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:45.775217 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:45.789928 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50822. Oct 31 16:31:45.792519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:45.793027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:45.793458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:45.794153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:45.794611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:45.795037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:45.795620 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50820. Oct 31 16:31:45.989963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:45.998154 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4db531d2-1c26-4ff1-a03b-f6e2737347c6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1766 microversion: 2.1 time: 0.227960 Oct 31 16:31:45.998727 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3677/7229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:45 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1766 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:47.021857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:47.022420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:47.031744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:47.032239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:47.032689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:47.033422 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:47.033889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:47.034334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:47.041182 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50830. Oct 31 16:31:47.041985 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50828. Oct 31 16:31:47.182202 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:47.191354 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bba3f88a-a957-4997-8d2f-b515bc3dc379 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1766 microversion: 2.1 time: 0.173559 Oct 31 16:31:47.191919 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3553/7230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:47 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1766 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:48.214579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:48.215201 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:48.222358 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:48.222847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:48.223284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:48.223976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:48.224432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:48.224888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:48.367100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:48.375586 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-54b3459e-a8dc-4792-8e6c-89d6f26efebb tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1766 microversion: 2.1 time: 0.165027 Oct 31 16:31:48.376263 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3678/7231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:48 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1766 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:49.399559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:49.400194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:49.407410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:49.407916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:49.408379 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:49.409184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:49.409660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:49.410105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:49.551556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:49.559798 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6ea2d9cc-5595-4b82-81d6-45ffea138f8b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1766 microversion: 2.1 time: 0.164198 Oct 31 16:31:49.560367 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3554/7232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:49 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1766 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:50.583287 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:50.583907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:50.590812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:50.591299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:50.591737 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:50.592428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:50.592926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:50.593984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:50.778506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:50.787746 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f258d09f-f256-46ba-be21-1dcd8d4de152 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1759 microversion: 2.1 time: 0.208457 Oct 31 16:31:50.788327 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3679/7233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:50 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1759 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:23.169717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:23.171069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=18 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:23.176058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1936156982"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:23.176622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:23.183916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:23.184423 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:23.185079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:23.185799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:23.186349 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:23.186801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:23.316786 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Removing security group 220ed3f5-f2de-459d-9333-b31b9dfcd6e3 from port a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 Oct 31 16:33:23.612145 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-36a71818-e9be-414d-be24-bdc101fd4676 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action" status: 202 len: 0 microversion: 2.1 time: 0.444278 Oct 31 16:33:23.613024 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3555/7234] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:33:23 2022] POST /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:33:23.619802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:23.623628 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:23.722185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e06a755c-8bd2-4824-a7e0-451967de253c req-5357e5c3-c9e8-4919-9fe4-6b2421bb8b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:23.732655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e06a755c-8bd2-4824-a7e0-451967de253c req-5357e5c3-c9e8-4919-9fe4-6b2421bb8b67 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:23.733168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e06a755c-8bd2-4824-a7e0-451967de253c req-5357e5c3-c9e8-4919-9fe4-6b2421bb8b67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:23.733604 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e06a755c-8bd2-4824-a7e0-451967de253c req-5357e5c3-c9e8-4919-9fe4-6b2421bb8b67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:23.745946 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e06a755c-8bd2-4824-a7e0-451967de253c req-5357e5c3-c9e8-4919-9fe4-6b2421bb8b67 service nova] Creating event network-changed:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:33:23.751468 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e06a755c-8bd2-4824-a7e0-451967de253c req-5357e5c3-c9e8-4919-9fe4-6b2421bb8b67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133299 Oct 31 16:33:23.752328 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3680/7235] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:24.736509 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:33:24.736509 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:33:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments/9717886c-7910-4dc4-aced-3cc6c98d4f0b (ip 10.222.0.48) !!! Oct 31 16:33:24.741659 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:24.741778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:24.749425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:24.749931 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:24.750383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:24.751647 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:24.752129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:24.752579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:24.825640 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-510ba497-ed46-4863-8379-aa9557071751 req-699e0f41-1d5f-406d-99d5-f98799a640a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:24.853274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-510ba497-ed46-4863-8379-aa9557071751 req-699e0f41-1d5f-406d-99d5-f98799a640a1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:24.854043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-510ba497-ed46-4863-8379-aa9557071751 req-699e0f41-1d5f-406d-99d5-f98799a640a1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:24.854471 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-510ba497-ed46-4863-8379-aa9557071751 req-699e0f41-1d5f-406d-99d5-f98799a640a1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:24.855036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lazy-loading 'services' on Instance uuid fef96a61-5ce2-477f-8d0f-ea05564d340c {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:33:24.865667 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-510ba497-ed46-4863-8379-aa9557071751 req-699e0f41-1d5f-406d-99d5-f98799a640a1 service nova] Creating event network-changed:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:33:24.871023 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-510ba497-ed46-4863-8379-aa9557071751 req-699e0f41-1d5f-406d-99d5-f98799a640a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108682 Oct 31 16:33:24.871974 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3681/7236] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:24.933512 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5109239b-5b49-4d73-b7f3-8767b643ded6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments/9717886c-7910-4dc4-aced-3cc6c98d4f0b" status: 202 len: 0 microversion: 2.1 time: 0.199464 Oct 31 16:33:24.936144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3556/7237] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:33:24 2022] DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments/9717886c-7910-4dc4-aced-3cc6c98d4f0b => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:33:24.947661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:24.952056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:24.963789 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:24.964540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:24.965480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:24.966421 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:24.967049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:24.967483 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:25.008810 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-396b17c0-5725-4f80-8b0e-8948fd022b53 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066416 Oct 31 16:33:25.009976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3682/7238] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:33:24 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:26.022628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:26.024949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:26.031911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:26.032415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:26.032902 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:26.033604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:26.034074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:26.034512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:26.065451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-220c0c84-0d58-44dd-be9c-28644654de27 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Oct 31 16:33:26.066019 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3557/7239] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:33:26 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:33:27.078162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:27.080475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:27.087426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:27.087914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:27.088352 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:27.089095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:27.089554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:27.089976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:27.127414 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4c61485a-d1f0-4fff-a0d6-584b1e351a52 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053008 Oct 31 16:33:27.128025 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3683/7240] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:33:27 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:28.140129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:28.142908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:28.151285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:28.151731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:28.152187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:28.152970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:28.153411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:28.153859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:28.184772 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-99751348-2070-4eda-b08e-df507db85ff5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048679 Oct 31 16:33:28.185532 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3558/7241] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:33:28 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:29.198115 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:29.200397 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:29.207972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:29.208464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:29.208938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:29.209648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:29.210119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:29.210552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:29.240397 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e6ef9c30-77b2-4d41-964e-14e3bc230891 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Oct 31 16:33:29.240998 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3684/7242] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:33:29 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:30.252801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:30.255039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:30.262141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:30.262645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:30.263100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:30.263808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:30.264286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:30.264764 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:30.294204 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c8f90bb2-8f73-4a4d-8677-c3c207b167c5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045443 Oct 31 16:33:30.294762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3559/7243] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:33:30 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:33:30.305531 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:30.306025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:30.312785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:30.313293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:30.313742 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:30.314433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:30.314890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:30.315322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:30.392487 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] HTTP exception thrown: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c is not attached to volume 9717886c-7910-4dc4-aced-3cc6c98d4f0b Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Request method failure captured: Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments/9717886c-7910-4dc4-aced-3cc6c98d4f0b HTTP/1.1 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_eyYK-dnr7e8zON6iI2hEw-PFM2DhEuj5SIGiIA7DfOUN7hdJAQg2YhNO8p03n33imyNM4xq5sYvqvFpo3-aaHAyt015T4f0OHGH5CRBeGPOhm2Z7ipiQO5hl7Nkl4C1SYVP5-vqNgJcBZtoDp95cE-jA9hxFLfYRqn7EG5ukdUNvc Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29972189b0004124a5824449a6bb96c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29972189b0004124a5824449a6bb96c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ad19f3c6ede24eb5ad16410d4558847e Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c is not attached to volume 9717886c-7910-4dc4-aced-3cc6c98d4f0b Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': 'fef96a61-5ce2-477f-8d0f-ea05564d340c', 'id': '9717886c-7910-4dc4-aced-3cc6c98d4f0b'} Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9717886c-7910-4dc4-aced-3cc6c98d4f0b. Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c is not attached to volume 9717886c-7910-4dc4-aced-3cc6c98d4f0b Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:33:30.394142 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c is not attached to volume 9717886c-7910-4dc4-aced-3cc6c98d4f0b Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Returning 404 to user: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c is not attached to volume 9717886c-7910-4dc4-aced-3cc6c98d4f0b {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a421870a-7671-43f7-873c-27e33d51d63a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments/9717886c-7910-4dc4-aced-3cc6c98d4f0b" status: 404 len: 154 microversion: 2.1 time: 0.094060 Oct 31 16:33:30.398725 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3685/7244] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:33:30 2022] DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c/os-volume_attachments/9717886c-7910-4dc4-aced-3cc6c98d4f0b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:33:33.645691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:33.646213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:33.653129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:33.653628 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:33.654080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:33.654788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:33.655260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:33.655692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:33.681750 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:33:33.761430 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b90d2a1e-a22e-40cb-acdc-fe952b9d0518 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 204 len: 0 microversion: 2.1 time: 0.119282 Oct 31 16:33:33.762397 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3560/7245] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:33:33 2022] DELETE /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:33:33.770764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:33.771349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:33.778517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:33.779013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:33.779448 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:33.780156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:33.780614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:33.781076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:33.921735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:33.930487 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8c05ac3-4a65-4e37-8e17-76a3df7c0316 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1553 microversion: 2.1 time: 0.163918 Oct 31 16:33:33.931162 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3686/7246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:33 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:33:34.955710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:34.956356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:34.964056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:34.964561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:34.965074 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:34.965788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:34.966265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:34.966727 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:35.095350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:35.106580 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-797a3381-b62d-4383-b423-cfb6199365ae tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1553 microversion: 2.1 time: 0.156091 Oct 31 16:33:35.107174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3561/7247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:34 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:36.130416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:36.131060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:36.138186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:36.138669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:36.139098 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:36.140247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:36.140738 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:36.141168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:36.381719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8f226251-bb6a-420f-a489-9865e30e64d5 req-80b3ba6b-49f2-43b4-9c5e-0637c9015aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef96a61-5ce2-477f-8d0f-ea05564d340c", "name": "network-vif-deleted", "tag": "a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:36.383768 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:36.393555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f226251-bb6a-420f-a489-9865e30e64d5 req-80b3ba6b-49f2-43b4-9c5e-0637c9015aa6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:36.393767 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7777694-8618-4f1d-820c-47d1bf0e032d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 200 len: 1553 microversion: 2.1 time: 0.267694 Oct 31 16:33:36.394116 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f226251-bb6a-420f-a489-9865e30e64d5 req-80b3ba6b-49f2-43b4-9c5e-0637c9015aa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:36.394441 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3687/7248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:36 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:36.409172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8f226251-bb6a-420f-a489-9865e30e64d5 req-80b3ba6b-49f2-43b4-9c5e-0637c9015aa6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:36.423048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8f226251-bb6a-420f-a489-9865e30e64d5 req-80b3ba6b-49f2-43b4-9c5e-0637c9015aa6 service nova] Creating event network-vif-deleted:a5c5b32f-6ca5-4fe7-ac5e-272bc81d9e88 for instance fef96a61-5ce2-477f-8d0f-ea05564d340c on n-h1-858383-17 Oct 31 16:33:36.428372 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8f226251-bb6a-420f-a489-9865e30e64d5 req-80b3ba6b-49f2-43b4-9c5e-0637c9015aa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051007 Oct 31 16:33:36.429018 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3562/7249] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:37.421802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:37.422330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: fef96a61-5ce2-477f-8d0f-ea05564d340c] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:37.430165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:37.430656 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:37.431099 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:37.431804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:37.432264 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:37.432705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:37.446084 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] HTTP exception thrown: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c could not be found. Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Request method failure captured: Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c HTTP/1.1 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_eyYK-dnr7e8zON6iI2hEw-PFM2DhEuj5SIGiIA7DfOUN7hdJAQg2YhNO8p03n33imyNM4xq5sYvqvFpo3-aaHAyt015T4f0OHGH5CRBeGPOhm2Z7ipiQO5hl7Nkl4C1SYVP5-vqNgJcBZtoDp95cE-jA9hxFLfYRqn7EG5ukdUNvc Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29972189b0004124a5824449a6bb96c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29972189b0004124a5824449a6bb96c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ad19f3c6ede24eb5ad16410d4558847e Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c could not be found. Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'fef96a61-5ce2-477f-8d0f-ea05564d340c'} Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c could not be found. Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c could not be found. Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:33:37.447616 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c could not be found. Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Returning 404 to user: Instance fef96a61-5ce2-477f-8d0f-ea05564d340c could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8730d7e-d164-4503-8796-984d81203cf4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c" status: 404 len: 111 microversion: 2.1 time: 0.031265 Oct 31 16:33:37.452565 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3688/7250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:37 2022] GET /compute/v2.1/servers/fef96a61-5ce2-477f-8d0f-ea05564d340c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:33:37.459088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-43c61cd9-f681-4b48-a68a-772f940227e8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '.version_select at 0x7f5ca669d280>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:37.483156 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-43c61cd9-f681-4b48-a68a-772f940227e8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-37586040" status: 202 len: 0 microversion: 2.1 time: 0.029128 Oct 31 16:33:37.483732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3563/7251] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Oct 31 16:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-37586040 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:33:46.846833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d021e8ef-f5f4-41bd-a737-ab99e197b6b3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'create', calling method: .version_select at 0x7f5ca23e6040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1772563385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOOZ57YxLqZ0kngmLWM8ViKlGHSxhmMqYlko886ho7fuKk2Z4h1rytPmLhyMvD887M9QUCCzzWfw5DVPFCpgHop4qE/OqXwq4ciYu4mwWLQDPeuDbjxKbjh5Kgl/IMstg=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:46.863721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d021e8ef-f5f4-41bd-a737-ab99e197b6b3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for project 29972189b0004124a5824449a6bb96c0. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:33:46.868937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-d021e8ef-f5f4-41bd-a737-ab99e197b6b3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for user ad19f3c6ede24eb5ad16410d4558847e and project 29972189b0004124a5824449a6bb96c0. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:33:46.896469 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d021e8ef-f5f4-41bd-a737-ab99e197b6b3 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.112237 Oct 31 16:33:46.897101 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3689/7252] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:33:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:46.954088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:46.959286 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-3621711", "imageRef": "333681de-1ae7-463e-9973-8954c4ba7763", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1772563385", "networks": [{"uuid": "4525d959-d68e-41ae-b5a6-ab50d0974cce"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:47.011725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] validate_networks() for [('4525d959-d68e-41ae-b5a6-ab50d0974cce', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:33:47.755872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:33:47.756428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:33:47.756963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:33:47.757389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:33:47.757816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:33:47.766777 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:47.767275 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:47.768323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:47.769100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:47.769572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:47.770012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:47.791042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for project 29972189b0004124a5824449a6bb96c0. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:33:47.796306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Getting quotas for user ad19f3c6ede24eb5ad16410d4558847e and project 29972189b0004124a5824449a6bb96c0. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:33:47.809056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:33:47.811385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='333681de-1ae7-463e-9973-8954c4ba7763',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:33:47.857705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dc362917-557a-4578-8698-387657a41d1c tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905380 Oct 31 16:33:47.858518 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3564/7253] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:33:47.866950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=42 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:47.872208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd4dd428-7939-4bd0-bdde-a861110a0a2a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:47.872859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd4dd428-7939-4bd0-bdde-a861110a0a2a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:47.930757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fd4dd428-7939-4bd0-bdde-a861110a0a2a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:47.937888 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd4dd428-7939-4bd0-bdde-a861110a0a2a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1256 microversion: 2.1 time: 0.071762 Oct 31 16:33:47.938532 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3690/7254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:47 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1256 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:48.963413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:48.964000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:48.972028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:48.972635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:48.973207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:48.973997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:48.974544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:48.975052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:49.060465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:49.068604 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d603e63f-6939-4e6c-9cbd-6232ce2d2082 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1316 microversion: 2.1 time: 0.110092 Oct 31 16:33:49.069223 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3565/7255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:48 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1316 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:50.093290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:50.094872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:50.105012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:50.105761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:50.106537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:50.107325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:50.107920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:50.108459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:50.258892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:50.267210 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61fc30c9-f0f5-4417-a4f0-d498a4bac01d tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.178987 Oct 31 16:33:50.267859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3691/7256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:50 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:51.291585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:51.293030 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:51.300410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:51.301017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:51.301487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:51.302208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:51.302686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:51.303134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:51.452487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:51.461592 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0cd9c11e-4c79-4309-82ef-2d0c0373072a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.174037 Oct 31 16:33:51.462527 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3566/7257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:51 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:52.485412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:52.487646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:52.495491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:52.496315 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:52.497011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:52.497940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:52.498644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:52.499567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:52.637717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:52.646411 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccdb8c70-3181-4290-bb3d-94fe33e59e58 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.165242 Oct 31 16:33:52.647310 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3692/7258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:52 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:53.670033 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:53.670672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:53.680721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:53.680721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:53.680721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:53.680721 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:53.681384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:53.681984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:53.682444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:53.830399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:53.839118 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c7428b31-e598-4287-b832-994bc595f437 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.172927 Oct 31 16:33:53.854184 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3567/7259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:53 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:54.865663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:54.867236 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:54.873710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:54.875570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:54.876063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:54.877112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:54.877843 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:54.878307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:54.878736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:55.025748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:55.045163 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-afa1d761-7b2f-42af-8562-3f13071ef450 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.185163 Oct 31 16:33:55.046004 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3693/7260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:54 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:56.069676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:56.071204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:56.082144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:56.082740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:56.083264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:56.084143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:56.084776 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:56.085315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:56.221739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:56.230519 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce65e274-10a4-4a2b-94ce-e5a08d44a240 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.165496 Oct 31 16:33:56.231293 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3568/7261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:56 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:57.254028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:57.254794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:57.261924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:57.262396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:57.262829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:57.263525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:57.263979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:57.264399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:57.530924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:57.539018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66b11766-bcaf-4312-bb8b-c2300e647dc5 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.289588 Oct 31 16:33:57.539598 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3694/7262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:57 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:57.918316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a7921309-aa5e-41d4-a213-0fe3d687c773 req-fe58c0c2-fa0b-444e-99e1-795979ccfdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:57.926237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:57.926963 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:57.933167 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a7921309-aa5e-41d4-a213-0fe3d687c773 req-fe58c0c2-fa0b-444e-99e1-795979ccfdca service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:57.933662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a7921309-aa5e-41d4-a213-0fe3d687c773 req-fe58c0c2-fa0b-444e-99e1-795979ccfdca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:57.934108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a7921309-aa5e-41d4-a213-0fe3d687c773 req-fe58c0c2-fa0b-444e-99e1-795979ccfdca service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:57.946539 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a7921309-aa5e-41d4-a213-0fe3d687c773 req-fe58c0c2-fa0b-444e-99e1-795979ccfdca service nova] Creating event network-changed:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:33:57.951887 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a7921309-aa5e-41d4-a213-0fe3d687c773 req-fe58c0c2-fa0b-444e-99e1-795979ccfdca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037339 Oct 31 16:33:57.952503 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3569/7263] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:58.562761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:58.563396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:58.565306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:58.572211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:58.572722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:58.573162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:58.573857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:58.574314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:58.574741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:58.703042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:58.710622 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7360492-cbed-4efb-910b-f52e574ca814 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.151929 Oct 31 16:33:58.711190 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3695/7264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:58 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:59.735784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:59.736462 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:59.743428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:59.743927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:59.744377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:59.745113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:59.745591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:59.746036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:59.880044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:59.888022 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-233b305e-8c51-4cbd-901a-3f00b747a7f8 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.157450 Oct 31 16:33:59.888600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3570/7265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:59 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:00.912189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:00.912838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:00.919654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:00.920147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:00.920590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:00.921325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:00.921786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:00.922225 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:01.053240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:01.061033 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db166a83-f562-439e-8331-cec4fdb0ae29 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.153510 Oct 31 16:34:01.061611 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3696/7266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:00 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:02.085370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:02.085999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:02.092869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:02.093370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:02.093820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:02.094525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:02.094992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:02.095433 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:02.226614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:02.234199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-94032167-d3c1-472c-961c-905fba5846bf tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.153383 Oct 31 16:34:02.234777 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3571/7267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:02 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:02.895424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-72669094-f97b-4adb-a397-8d55b0a4f9e1 req-ed11872c-6993-492c-9aba-5965574d0dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "name": "network-vif-plugged", "status": "completed", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:02.905077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-72669094-f97b-4adb-a397-8d55b0a4f9e1 req-ed11872c-6993-492c-9aba-5965574d0dce service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:02.905553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-72669094-f97b-4adb-a397-8d55b0a4f9e1 req-ed11872c-6993-492c-9aba-5965574d0dce service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:02.905982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-72669094-f97b-4adb-a397-8d55b0a4f9e1 req-ed11872c-6993-492c-9aba-5965574d0dce service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:02.917129 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-72669094-f97b-4adb-a397-8d55b0a4f9e1 req-ed11872c-6993-492c-9aba-5965574d0dce service nova] Creating event network-vif-plugged:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:34:02.922052 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-72669094-f97b-4adb-a397-8d55b0a4f9e1 req-ed11872c-6993-492c-9aba-5965574d0dce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085193 Oct 31 16:34:02.922640 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3697/7268] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:03.257190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:03.257816 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:03.264979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:03.265477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:03.265923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:03.266620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:03.267086 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:03.267521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:03.398929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:03.406498 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-07666f3a-ab9c-4018-baac-78c248e6bb1e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1356 microversion: 2.1 time: 0.153886 Oct 31 16:34:03.407071 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3572/7269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:03 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:04.430682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:04.431326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:04.437482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.437987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.438429 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.439118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.439569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.439993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.574011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:04.582318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db64c3e5-0c4c-4934-ab8d-044f955af269 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1545 microversion: 2.1 time: 0.156735 Oct 31 16:34:04.582883 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3698/7270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:04 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:04.605036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:04.605671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:04.612596 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.613131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.613586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.614294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.614768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.615211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.743350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:04.751655 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b68616d-b2ae-4d89-8327-d87eaa11a013 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1545 microversion: 2.1 time: 0.150586 Oct 31 16:34:04.752327 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3573/7271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:04 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1545 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:04.776033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:04.780982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:04.781741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Searching by: {'deleted': False, 'project_id': '29972189b0004124a5824449a6bb96c0'} {{(pid=120625) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 16:34:04.787065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.787543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.787973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.788689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.789163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.789587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.812343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.multi_cell_list [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120625) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 16:34:04.839243 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ff07654-ade7-43dd-87e1-68b8e0d30b66 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.067024 Oct 31 16:34:04.839814 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3699/7272] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Oct 31 16:34:04 2022] GET /compute/v2.1/servers => generated 340 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:04.851434 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:04.852064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:04.858076 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.858572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.859022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.859726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:04.860195 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:04.860636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.986848 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:04.994637 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c489f211-bada-4378-b918-e3d8091e8859 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1545 microversion: 2.1 time: 0.147084 Oct 31 16:34:04.995209 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3574/7273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:04 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1545 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:06.510877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beca48b2-485d-4f02-a1bb-41ae80cd68f1"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:06.513260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:06.520095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:06.520581 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:06.521049 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:06.521745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:06.522206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:06.522636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:06.760496 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1a6e4e27-502e-4cfd-bddf-82e44bdbd790 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253359 Oct 31 16:34:06.761185 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3700/7274] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Oct 31 16:34:06 2022] POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:17.533327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:17.534485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:17.536994 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=15 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:17.537664 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=58 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:17.543161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:17.543678 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:17.544127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:17.544851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:17.545321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:17.545758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:17.677929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:17.686048 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0503e0cd-54b7-4d47-8857-fca9435d60d1 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1591 microversion: 2.1 time: 0.156544 Oct 31 16:34:17.686612 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3575/7275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:17 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1591 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:34:19.234342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:19.235477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=15 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:19.236459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:19.242449 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4fd70236-8798-44d3-9b77-1cc34dfe5959 req-326b90dc-76dd-4712-bbf3-155a428ab97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:19.256016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4fd70236-8798-44d3-9b77-1cc34dfe5959 req-326b90dc-76dd-4712-bbf3-155a428ab97f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:19.256970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4fd70236-8798-44d3-9b77-1cc34dfe5959 req-326b90dc-76dd-4712-bbf3-155a428ab97f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:19.257477 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4fd70236-8798-44d3-9b77-1cc34dfe5959 req-326b90dc-76dd-4712-bbf3-155a428ab97f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:19.271879 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4fd70236-8798-44d3-9b77-1cc34dfe5959 req-326b90dc-76dd-4712-bbf3-155a428ab97f service nova] Creating event network-changed:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:34:19.277344 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4fd70236-8798-44d3-9b77-1cc34dfe5959 req-326b90dc-76dd-4712-bbf3-155a428ab97f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044742 Oct 31 16:34:19.278343 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3701/7276] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:20.229223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-865947102"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:20.229880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:20.236583 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:20.237670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:20.238124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:20.238859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:20.239304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:20.239918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:20.373035 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.network.security_group_api [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Adding security group 810618ab-8d59-4b85-aa65-5c11674c831d to port 1bc43f09-a856-42fb-be21-b16aca174f9c Oct 31 16:34:20.691361 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-15cfefe6-5637-4646-96e1-c9d565f5e6bc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.465972 Oct 31 16:34:20.692195 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3576/7277] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:34:20 2022] POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:34:20.701629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:20.702427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:20.711184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:20.711815 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:20.712433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:20.713497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:20.714077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:20.714572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:20.866829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:20.875166 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66a31c51-c9fd-4592-b749-cdd8b1f8d046 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1756 microversion: 2.1 time: 0.178422 Oct 31 16:34:20.875762 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3702/7278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:20 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:21.293971 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-8906213c-e975-44e6-9398-31bae7aec18f req-8e11cff0-ca4f-4830-8d53-82596b2b231d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:21.304112 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8906213c-e975-44e6-9398-31bae7aec18f req-8e11cff0-ca4f-4830-8d53-82596b2b231d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:21.304597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8906213c-e975-44e6-9398-31bae7aec18f req-8e11cff0-ca4f-4830-8d53-82596b2b231d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:21.305071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-8906213c-e975-44e6-9398-31bae7aec18f req-8e11cff0-ca4f-4830-8d53-82596b2b231d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:21.316148 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-8906213c-e975-44e6-9398-31bae7aec18f req-8e11cff0-ca4f-4830-8d53-82596b2b231d service nova] Creating event network-changed:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:34:21.321669 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-8906213c-e975-44e6-9398-31bae7aec18f req-8e11cff0-ca4f-4830-8d53-82596b2b231d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032464 Oct 31 16:34:21.322328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3577/7279] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:37.659980 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:37.662291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:37.665313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:37.665977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:37.671701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:37.672195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:37.672641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:37.673365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:37.673830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:37.674268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:37.745264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a3ccf34-995a-45da-94d7-7b7f2bb27a75 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.089716 Oct 31 16:34:37.746446 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3703/7280] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:34:37 2022] POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:34:37.756503 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:37.757264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:37.761407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:37.762183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:37.770432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:37.770942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:37.772090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:37.773192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:37.773676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:37.774128 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:38.012113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:38.021106 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fb7a8581-d12d-4824-9420-89f3971db3d6 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1748 microversion: 2.1 time: 0.269297 Oct 31 16:34:38.021702 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3578/7281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:37 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1748 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:39.045501 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:39.046109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:39.054038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:39.054570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:39.055015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:39.055717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:39.056176 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:39.056631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:39.203691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:39.211970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0abb3d3-4675-4c11-954f-56cdd954f1a4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.170876 Oct 31 16:34:39.212574 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3704/7282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:39 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:40.235612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:40.236246 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:40.243199 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:40.243700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:40.244155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:40.244896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:40.245376 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:40.245820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:40.393242 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:40.401551 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7e9ae2a3-f74b-4398-84cb-9226dcef0532 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.170006 Oct 31 16:34:40.402148 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3579/7283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:40 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:41.426155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:41.426696 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:41.433818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:41.434299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:41.434733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:41.435423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:41.435878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:41.436304 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:41.578997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:41.587264 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4931ba79-6b2b-42f1-96d6-255f06598610 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.165692 Oct 31 16:34:41.587833 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3705/7284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:41 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:42.612082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:42.612747 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:42.619617 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:42.620117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:42.620570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:42.621301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:42.621778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:42.622224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:42.768335 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:42.776527 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0d73a719-d749-4e37-8c99-70fec4cae05b tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.169122 Oct 31 16:34:42.777136 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3580/7285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:42 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:43.800383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:43.801006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:43.807782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:43.808290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:43.808745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:43.809435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:43.809892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:43.810335 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:43.955524 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:43.963738 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d94af9d-60df-4125-a59c-5d25cc04f1ea tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.167993 Oct 31 16:34:43.964336 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3706/7286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:43 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:44.987765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:44.988387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:44.995389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:44.995891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:44.996345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:44.997081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:44.997555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:44.997998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:45.143850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:45.152616 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-778da189-2eaf-47cd-8f08-717e85d80d28 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.168996 Oct 31 16:34:45.153343 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3581/7287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:44 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:46.177542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:46.178226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:46.184488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:46.185107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:46.185460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:46.186155 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:46.186608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:46.187032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:46.333661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:46.341869 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-df439574-5eba-4394-b0cc-7a6c2cbd68b9 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.168886 Oct 31 16:34:46.342440 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3707/7288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:46 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:47.366300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:47.366948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:47.373071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:47.373570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:47.374020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:47.374722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:47.375190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:47.375626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:47.519233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:47.527447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-16452f9e-74c4-4c47-8064-597f0ab9d0cc tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.165318 Oct 31 16:34:47.528019 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3582/7289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:47 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:48.551466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:48.552022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:48.558952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:48.559436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:48.559876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:48.560567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:48.561054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:48.561484 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:48.703722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:48.712725 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6b17805b-6be3-4660-9c8e-c1d3f3440288 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1753 microversion: 2.1 time: 0.165483 Oct 31 16:34:48.713317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3708/7290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:48 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:49.736644 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:49.737318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:49.744307 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:49.744857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:49.745300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:49.746006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:49.746477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:49.746922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:49.889700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:49.899130 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aa39a1c2-bc59-4198-9fcb-568f3b376528 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1756 microversion: 2.1 time: 0.166475 Oct 31 16:34:49.899715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3583/7291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:49 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:22.100302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-865947102"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:22.100938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:22.103011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:22.103662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:22.104862 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:35:22.104983 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:35:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action (ip 10.222.0.48) !!! Oct 31 16:35:22.112802 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:22.113301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:22.114375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:22.115096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:22.115553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:22.115981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:22.250091 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.network.security_group_api [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Removing security group 810618ab-8d59-4b85-aa65-5c11674c831d from port 1bc43f09-a856-42fb-be21-b16aca174f9c Oct 31 16:35:22.549844 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0096318e-90c5-432c-9e56-d9fa0d3fc597 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.453471 Oct 31 16:35:22.553960 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3709/7292] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:35:22 2022] POST /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:35:22.587588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-719528de-4172-4ade-9939-606a581c5ad6 req-f81c2985-31a6-4381-bd2a-ad1d9cb1d737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:22.602109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:22.603317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=36 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:22.608332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-719528de-4172-4ade-9939-606a581c5ad6 req-f81c2985-31a6-4381-bd2a-ad1d9cb1d737 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:22.610020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-719528de-4172-4ade-9939-606a581c5ad6 req-f81c2985-31a6-4381-bd2a-ad1d9cb1d737 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:22.610815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-719528de-4172-4ade-9939-606a581c5ad6 req-f81c2985-31a6-4381-bd2a-ad1d9cb1d737 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:22.646447 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-719528de-4172-4ade-9939-606a581c5ad6 req-f81c2985-31a6-4381-bd2a-ad1d9cb1d737 service nova] Creating event network-changed:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:35:22.651941 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-719528de-4172-4ade-9939-606a581c5ad6 req-f81c2985-31a6-4381-bd2a-ad1d9cb1d737 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071191 Oct 31 16:35:22.652545 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3584/7293] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:23.933550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:23.934135 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:23.940263 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:23.940780 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:23.941222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:23.941925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:23.942384 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:23.942810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:24.029909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lazy-loading 'services' on Instance uuid f51bd2ca-4434-4526-86ef-aeb6ba07fe30 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:35:24.108770 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9428590a-8c63-4791-ba0e-4583eb5aa6bd tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments/beca48b2-485d-4f02-a1bb-41ae80cd68f1" status: 202 len: 0 microversion: 2.1 time: 0.179908 Oct 31 16:35:24.110273 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3710/7294] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:35:23 2022] DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments/beca48b2-485d-4f02-a1bb-41ae80cd68f1 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:35:24.121560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:24.124042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:24.133141 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:24.133965 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:24.134417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:24.135147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:24.135877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:24.136386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:24.171499 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ba38ac1e-690e-47cf-b42b-9223a39f814e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056472 Oct 31 16:35:24.172732 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3585/7295] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:35:24 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:24.669141 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-770bc71c-d38e-43b9-88e0-d16085eb649f req-6a085ff4-14ad-4c3d-b5f7-9f56a870df81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:24.681422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-770bc71c-d38e-43b9-88e0-d16085eb649f req-6a085ff4-14ad-4c3d-b5f7-9f56a870df81 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:24.682006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-770bc71c-d38e-43b9-88e0-d16085eb649f req-6a085ff4-14ad-4c3d-b5f7-9f56a870df81 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:24.682535 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-770bc71c-d38e-43b9-88e0-d16085eb649f req-6a085ff4-14ad-4c3d-b5f7-9f56a870df81 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:24.694735 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-770bc71c-d38e-43b9-88e0-d16085eb649f req-6a085ff4-14ad-4c3d-b5f7-9f56a870df81 service nova] Creating event network-changed:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:35:24.699678 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-770bc71c-d38e-43b9-88e0-d16085eb649f req-6a085ff4-14ad-4c3d-b5f7-9f56a870df81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Oct 31 16:35:24.700428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3711/7296] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:25.184036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:25.187015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:25.194542 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:25.195139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:25.195697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:25.196495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:25.197240 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:25.197763 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:25.234362 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e61d0817-59ce-4990-bd92-5dfacb11ac9f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054564 Oct 31 16:35:25.235012 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3586/7297] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:35:25 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:26.250557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:26.252892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:26.259979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:26.260751 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:26.261192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:26.261893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:26.262348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:26.262777 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:26.293090 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12976658-0754-4b11-9461-692f0081f328 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Oct 31 16:35:26.293685 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3712/7298] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:35:26 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:27.306413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:27.308792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:27.315630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:27.316135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:27.316758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:27.317570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:27.318062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:27.318480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:27.348626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27800194-11cd-47c3-8a2a-3f5bf8004a81 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Oct 31 16:35:27.349217 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3587/7299] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:35:27 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:28.360432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:28.362652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:28.370047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:28.370532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:28.370970 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:28.371664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:28.372122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:28.372554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:28.404990 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39c0ada1-dedc-4fd0-a974-e3d0f09f2f4f tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048608 Oct 31 16:35:28.405554 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3713/7300] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:35:28 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:29.417499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:29.419748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:29.426834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:29.427279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:29.427732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:29.428450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:29.428949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:29.429396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:29.458919 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bf9526f-2388-4b4f-a4a5-b6ec9afc3920 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045462 Oct 31 16:35:29.459484 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3588/7301] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Oct 31 16:35:29 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:35:29.469998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:29.470491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:29.477228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:29.477708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:29.478142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:29.478829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:29.479291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:29.479716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:29.553462 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] HTTP exception thrown: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 is not attached to volume beca48b2-485d-4f02-a1bb-41ae80cd68f1 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Request method failure captured: Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments/beca48b2-485d-4f02-a1bb-41ae80cd68f1 HTTP/1.1 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_eyYK-dnr7e8zON6iI2hEw-PFM2DhEuj5SIGiIA7DfOUN7hdJAQg2YhNO8p03n33imyNM4xq5sYvqvFpo3-aaHAyt015T4f0OHGH5CRBeGPOhm2Z7ipiQO5hl7Nkl4C1SYVP5-vqNgJcBZtoDp95cE-jA9hxFLfYRqn7EG5ukdUNvc Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29972189b0004124a5824449a6bb96c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29972189b0004124a5824449a6bb96c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: ad19f3c6ede24eb5ad16410d4558847e Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 is not attached to volume beca48b2-485d-4f02-a1bb-41ae80cd68f1 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'server_id': 'f51bd2ca-4434-4526-86ef-aeb6ba07fe30', 'id': 'beca48b2-485d-4f02-a1bb-41ae80cd68f1'} Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id beca48b2-485d-4f02-a1bb-41ae80cd68f1. Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 is not attached to volume beca48b2-485d-4f02-a1bb-41ae80cd68f1 Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:35:29.555063 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 is not attached to volume beca48b2-485d-4f02-a1bb-41ae80cd68f1 Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Returning 404 to user: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 is not attached to volume beca48b2-485d-4f02-a1bb-41ae80cd68f1 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0d9248c-13ab-4d69-be63-29d76c6009d4 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments/beca48b2-485d-4f02-a1bb-41ae80cd68f1" status: 404 len: 154 microversion: 2.1 time: 0.090540 Oct 31 16:35:29.559539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3714/7302] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Oct 31 16:35:29 2022] DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30/os-volume_attachments/beca48b2-485d-4f02-a1bb-41ae80cd68f1 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:35:32.810160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:32.810670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:32.818367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:32.818870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:32.819333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:32.820035 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:32.820506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:32.820985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:32.845917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:35:32.927617 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-691cf608-8852-4944-a8d1-a38f40733010 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 204 len: 0 microversion: 2.1 time: 0.120255 Oct 31 16:35:32.928234 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3589/7303] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:35:32 2022] DELETE /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:35:32.936653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:32.937293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:32.945166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:32.945657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:32.946087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:32.946791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:32.947349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:32.947663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:33.082575 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:33.090549 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f8c735d-738b-430a-ace8-399fbcd7771a tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1551 microversion: 2.1 time: 0.157793 Oct 31 16:35:33.091134 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3715/7304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:32 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:35:34.115524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:34.116268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:34.124151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:34.124651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:34.125124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:34.125826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:34.126291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:34.126728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:34.256824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:34.264848 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e30bab3-ad6c-4380-b110-e0c650f49402 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1551 microversion: 2.1 time: 0.154270 Oct 31 16:35:34.265422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3590/7305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:34 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:35.289917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:35.290603 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:35.296775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:35.297266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:35.297709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:35.298445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:35.298906 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:35.299340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:35.322562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9e57cf51-c62f-491e-9c6a-a63665ee5290 req-7c844a1f-db23-482b-aa29-78a9d333bad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51bd2ca-4434-4526-86ef-aeb6ba07fe30", "name": "network-vif-deleted", "tag": "1bc43f09-a856-42fb-be21-b16aca174f9c"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:35.337589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9e57cf51-c62f-491e-9c6a-a63665ee5290 req-7c844a1f-db23-482b-aa29-78a9d333bad6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:35.338125 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9e57cf51-c62f-491e-9c6a-a63665ee5290 req-7c844a1f-db23-482b-aa29-78a9d333bad6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:35.338566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9e57cf51-c62f-491e-9c6a-a63665ee5290 req-7c844a1f-db23-482b-aa29-78a9d333bad6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:35.351580 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9e57cf51-c62f-491e-9c6a-a63665ee5290 req-7c844a1f-db23-482b-aa29-78a9d333bad6 service nova] Creating event network-vif-deleted:1bc43f09-a856-42fb-be21-b16aca174f9c for instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 on n-h2-858383-17 Oct 31 16:35:35.356399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9e57cf51-c62f-491e-9c6a-a63665ee5290 req-7c844a1f-db23-482b-aa29-78a9d333bad6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037967 Oct 31 16:35:35.357199 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3591/7306] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:35.369514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad19f3c6ede24eb5ad16410d4558847e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29972189b0004124a5824449a6bb96c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:35.379236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e207325-1b45-4393-9391-362832ca7d45 tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 200 len: 1509 microversion: 2.1 time: 0.093712 Oct 31 16:35:35.380320 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3716/7307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:35 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 1509 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:36.405223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:36.405942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] [instance: f51bd2ca-4434-4526-86ef-aeb6ba07fe30] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:36.412140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:36.412641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:36.413132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:36.413824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:36.414300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:36.414744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:36.428103 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] HTTP exception thrown: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 could not be found. Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Request method failure captured: Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 HTTP/1.1 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_eyYK-dnr7e8zON6iI2hEw-PFM2DhEuj5SIGiIA7DfOUN7hdJAQg2YhNO8p03n33imyNM4xq5sYvqvFpo3-aaHAyt015T4f0OHGH5CRBeGPOhm2Z7ipiQO5hl7Nkl4C1SYVP5-vqNgJcBZtoDp95cE-jA9hxFLfYRqn7EG5ukdUNvc Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29972189b0004124a5824449a6bb96c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29972189b0004124a5824449a6bb96c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29972189b0004124a5824449a6bb96c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 29972189b0004124a5824449a6bb96c0 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestMinimumBasicScenario-976639280 Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: ad19f3c6ede24eb5ad16410d4558847e Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestMinimumBasicScenario-976639280-project Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 could not be found. Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'f51bd2ca-4434-4526-86ef-aeb6ba07fe30'} Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 could not be found. Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 could not be found. Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:35:36.429731 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 could not be found. Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Returning 404 to user: Instance f51bd2ca-4434-4526-86ef-aeb6ba07fe30 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0049735c-87eb-4a3c-8923-39f41498e6be tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30" status: 404 len: 111 microversion: 2.1 time: 0.031371 Oct 31 16:35:36.434626 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3592/7308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:36 2022] GET /compute/v2.1/servers/f51bd2ca-4434-4526-86ef-aeb6ba07fe30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:35:36.440048 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-312acc99-3302-4f13-8783-48fba9fa912e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] Calling method '.version_select at 0x7f5ca13be4c0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:36.461493 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-312acc99-3302-4f13-8783-48fba9fa912e tempest-TestMinimumBasicScenario-976639280 tempest-TestMinimumBasicScenario-976639280-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1772563385" status: 202 len: 0 microversion: 2.1 time: 0.025303 Oct 31 16:35:36.462069 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3717/7309] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Oct 31 16:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1772563385 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:35:45.472711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6d464d08-bf2b-4f6e-a47c-9e2cdb97479f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: .version_select at 0x7f5ca155d4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-883771702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMPTJ/LKied3TBepZHaMvJVOMwHm/KUo1id+PBFySaYzbOfewV1c7M/w7uaY5dtFonmSwhGNdUO3bA+rKEPgt7jJXLGJB3KzPwKCadV/MbtqHEnkQ3lk1/Ujfsu1hpB4Q=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:45.489574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6d464d08-bf2b-4f6e-a47c-9e2cdb97479f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:35:45.494709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-6d464d08-bf2b-4f6e-a47c-9e2cdb97479f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:35:45.508152 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d464d08-bf2b-4f6e-a47c-9e2cdb97479f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [e6149452-7858-4595-94fa-9010c8426312] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:35:46.421148 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:46.515508 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d464d08-bf2b-4f6e-a47c-9e2cdb97479f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [e6149452-7858-4595-94fa-9010c8426312] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 51438. Oct 31 16:35:46.534752 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6d464d08-bf2b-4f6e-a47c-9e2cdb97479f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.233008 Oct 31 16:35:46.535372 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3593/7310] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:35:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:52.273786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:52.274545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:52.279192 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1473373780", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "ffa8b8ba-27a0-42ae-b60e-44c2f9c3dcfb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-883771702", "security_groups": [{"name": "tempest-secgroup-smoke-1240670446"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:52.408071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] validate_networks() for [('ffa8b8ba-27a0-42ae-b60e-44c2f9c3dcfb', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:35:52.863310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:35:52.863863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:35:52.864345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:35:52.864781 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:35:52.865197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:35:52.874206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:52.874690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:52.875130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:52.875855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:52.876312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:52.876769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:52.895158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:35:52.900475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:35:52.914131 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:35:52.916446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:35:52.965395 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-225fdc7a-6a00-4868-bcc5-bdd88ce29322 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693692 Oct 31 16:35:52.966213 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3718/7311] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:35:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:35:52.979432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4e4dd746-6b54-42fd-a788-c65e84a52e07 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:52.979977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4e4dd746-6b54-42fd-a788-c65e84a52e07 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:52.982235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:53.050666 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4e4dd746-6b54-42fd-a788-c65e84a52e07 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:53.059689 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4e4dd746-6b54-42fd-a788-c65e84a52e07 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1266 microversion: 2.1 time: 0.085961 Oct 31 16:35:53.060270 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3594/7312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:52 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:54.083830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:54.084466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:54.091381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:54.091870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:54.092308 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:54.093045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:54.093502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:54.093933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:54.163002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:54.172435 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-647dee9c-941c-4a16-b267-17745bb4fa6a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1318 microversion: 2.1 time: 0.093483 Oct 31 16:35:54.174463 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3719/7313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:54 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:55.201765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:55.202984 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:55.210877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:55.211706 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:55.212351 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:55.213299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:55.214178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:55.226022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:55.824823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:55.833164 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e10a15fa-7a9a-403d-b45a-935d1a5d15e6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.638764 Oct 31 16:35:55.833758 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3595/7314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:55 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:56.207246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b215d9c6-9605-4477-a39e-c0d9ab20f319 req-1f4d70b3-ffb9-4c16-96f6-c95e558ce4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b", "tag": "e54591f3-77f8-461a-8c37-ae7d1e43229e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:56.218348 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b215d9c6-9605-4477-a39e-c0d9ab20f319 req-1f4d70b3-ffb9-4c16-96f6-c95e558ce4cb service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:56.219021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b215d9c6-9605-4477-a39e-c0d9ab20f319 req-1f4d70b3-ffb9-4c16-96f6-c95e558ce4cb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:56.219458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b215d9c6-9605-4477-a39e-c0d9ab20f319 req-1f4d70b3-ffb9-4c16-96f6-c95e558ce4cb service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:56.231561 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b215d9c6-9605-4477-a39e-c0d9ab20f319 req-1f4d70b3-ffb9-4c16-96f6-c95e558ce4cb service nova] Creating event network-changed:e54591f3-77f8-461a-8c37-ae7d1e43229e for instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b on n-h1-858383-17 Oct 31 16:35:56.236606 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b215d9c6-9605-4477-a39e-c0d9ab20f319 req-1f4d70b3-ffb9-4c16-96f6-c95e558ce4cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033961 Oct 31 16:35:56.237722 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3720/7315] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:56.856954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:56.857622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:56.865184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:56.865685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:56.866136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:56.866855 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:56.867328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:56.867772 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:57.001255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:57.009575 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-40256ea0-a0de-40fa-bfde-2789511495bf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.156617 Oct 31 16:35:57.010156 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3596/7316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:56 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:58.034033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:58.035470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:58.041681 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.042162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.042598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.043284 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.043743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.044170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.183453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:58.191416 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93f4acb7-8e2b-4af6-88c4-2f89f7bed775 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.162475 Oct 31 16:35:58.192016 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3721/7317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:58 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:59.214263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:59.214891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:59.222017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:59.222515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:59.222964 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:59.223673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:59.224146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:59.224592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:59.396597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:59.404613 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4c7a058-fbf7-4b38-9fab-01e2afa519ec tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.194210 Oct 31 16:35:59.405246 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3597/7318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:59 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:00.427676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:00.428223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:00.435062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:00.435548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:00.436011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:00.436726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:00.437195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:00.437653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:00.569645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:00.577324 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-023c1bdd-4c57-4b12-a3d3-01bdd1840428 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.153772 Oct 31 16:36:00.577933 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3722/7319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:00 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:01.600784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:01.601425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:01.608259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:01.608792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:01.609251 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:01.609962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:01.610441 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:01.610888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:01.745452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:01.753705 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d2d501aa-ef45-46ce-9aff-0ee5f9ef8414 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.156809 Oct 31 16:36:01.754255 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3598/7320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:01 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:02.717761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b0c209cc-cc1a-4bc8-ae4c-94c20eba2df1 req-2a44096c-ef20-4afa-864b-6469bcb6939b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b", "name": "network-vif-plugged", "status": "completed", "tag": "e54591f3-77f8-461a-8c37-ae7d1e43229e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:02.728917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0c209cc-cc1a-4bc8-ae4c-94c20eba2df1 req-2a44096c-ef20-4afa-864b-6469bcb6939b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:02.729470 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0c209cc-cc1a-4bc8-ae4c-94c20eba2df1 req-2a44096c-ef20-4afa-864b-6469bcb6939b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:02.729902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0c209cc-cc1a-4bc8-ae4c-94c20eba2df1 req-2a44096c-ef20-4afa-864b-6469bcb6939b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:02.741812 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b0c209cc-cc1a-4bc8-ae4c-94c20eba2df1 req-2a44096c-ef20-4afa-864b-6469bcb6939b service nova] Creating event network-vif-plugged:e54591f3-77f8-461a-8c37-ae7d1e43229e for instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b on n-h1-858383-17 Oct 31 16:36:02.746688 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b0c209cc-cc1a-4bc8-ae4c-94c20eba2df1 req-2a44096c-ef20-4afa-864b-6469bcb6939b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032720 Oct 31 16:36:02.747287 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3723/7321] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:02.777774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:02.778504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:02.786465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:02.787061 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:02.787579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:02.788368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:02.788945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:02.789393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:02.987786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:02.995894 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c0643581-99d1-45c3-b69f-6e7cd38f83d2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.222291 Oct 31 16:36:02.996473 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3599/7322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:02 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:04.016062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:04.016913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:04.022247 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:04.022948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:04.030103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:04.030588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:04.031027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:04.031708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:04.032164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:04.032588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:04.164265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:04.172258 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-979c5b85-057b-4575-9bec-3cd3dcb0003d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1392 microversion: 2.1 time: 0.157130 Oct 31 16:36:04.172859 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3724/7323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:04 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:05.195552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:05.196187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:05.198129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:05.204363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:05.204903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:05.205361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:05.206068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:05.206547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:05.207008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:05.338206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:05.345916 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6b8974d4-9ed9-427b-9417-b5cdebcf2039 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1563 microversion: 2.1 time: 0.154431 Oct 31 16:36:05.346490 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3600/7324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:05 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:05.368436 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:05.369080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:05.375937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:05.376357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:05.376850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:05.377542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:05.378001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:05.378423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:05.513210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:05.521542 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34cd56a0-b891-4df5-9750-0042821731bb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1563 microversion: 2.1 time: 0.157001 Oct 31 16:36:05.522110 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3725/7325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:05 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:07.063685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:07.064324 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:07.068050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1e16c5f6-6408-4fce-a29b-1bc536b0f1c6 req-d6295c8d-319b-49a9-9f9a-2fe9ab27aa82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b", "tag": "e54591f3-77f8-461a-8c37-ae7d1e43229e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:07.072176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:07.072741 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:07.073189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:07.073919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:07.074410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:07.074847 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:07.083497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e16c5f6-6408-4fce-a29b-1bc536b0f1c6 req-d6295c8d-319b-49a9-9f9a-2fe9ab27aa82 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:07.084290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e16c5f6-6408-4fce-a29b-1bc536b0f1c6 req-d6295c8d-319b-49a9-9f9a-2fe9ab27aa82 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:07.084819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e16c5f6-6408-4fce-a29b-1bc536b0f1c6 req-d6295c8d-319b-49a9-9f9a-2fe9ab27aa82 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:07.098848 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1e16c5f6-6408-4fce-a29b-1bc536b0f1c6 req-d6295c8d-319b-49a9-9f9a-2fe9ab27aa82 service nova] Creating event network-changed:e54591f3-77f8-461a-8c37-ae7d1e43229e for instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b on n-h1-858383-17 Oct 31 16:36:07.104200 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1e16c5f6-6408-4fce-a29b-1bc536b0f1c6 req-d6295c8d-319b-49a9-9f9a-2fe9ab27aa82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042012 Oct 31 16:36:07.105428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3726/7326] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:07.277294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:07.286955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5376bb20-9eca-423c-a6c7-37c03fc5fdc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1563 microversion: 2.1 time: 0.228146 Oct 31 16:36:07.287756 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3601/7327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:07 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:40.578058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:40.578723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=38 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:40.583774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:40.586084 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:40.593820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:40.594385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:40.594818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:40.595506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:40.595961 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:40.596385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:40.664422 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-05d39d1d-4a97-445e-a7dd-6d05f31891af tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action" status: 200 len: 24570 microversion: 2.1 time: 0.088628 Oct 31 16:36:40.665130 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3727/7328] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:36:40 2022] POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action => generated 24570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:37:11.128152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=17 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:11.129018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=42 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:11.130085 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:37:11.130222 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action (ip 10.222.0.48) !!! Oct 31 16:37:11.135132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:11.135675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:11.144526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:11.145045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:11.145495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:11.146192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:11.146662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:11.147736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:11.214840 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-16603143-c7f0-4e85-9718-d885eb7b4493 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action" status: 202 len: 0 microversion: 2.1 time: 0.088300 Oct 31 16:37:11.215541 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3602/7329] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:11 2022] POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:37:11.226646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:11.227354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:11.230393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:11.231045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:11.240852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:11.241376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:11.241870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:11.242626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:11.243070 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:11.243494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:11.453621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:11.462349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10ea0063-bfdd-4c1f-b3f0-4382ab92202f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1686 microversion: 2.1 time: 0.240768 Oct 31 16:37:11.462934 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3728/7330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:11 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1686 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:12.487886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:12.488554 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:12.495304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:12.495804 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:12.496258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:12.496990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:12.497467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:12.497945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:12.680966 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:12.688713 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8eb21ab9-e6ea-4b88-8af7-6203c506a226 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1666 microversion: 2.1 time: 0.206213 Oct 31 16:37:12.689383 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3603/7331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:12 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1666 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:13.780544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:13.782797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:13.790627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:13.791120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:13.791565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:13.792269 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:13.792763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:13.793197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:13.860980 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7370b49-2f39-4e2e-960b-1f7d13a78cbb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action" status: 200 len: 32645 microversion: 2.1 time: 0.084193 Oct 31 16:37:13.861874 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3729/7332] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:13 2022] POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action => generated 32645 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:37:13.873820 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:13.874380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:13.881193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:13.881802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:13.882293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:13.882998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:13.883467 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:13.883907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:13.949935 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b1e886be-cacf-4645-9aa6-0ee3381f497a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action" status: 202 len: 0 microversion: 2.1 time: 0.079812 Oct 31 16:37:13.952147 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3604/7333] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:13 2022] POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:37:13.959811 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:13.960648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:13.967826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:13.968310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:13.968784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:13.969511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:13.969973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:13.970404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:14.106415 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:14.114150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d3464b9-2dc7-484c-ac38-a717fde7e505 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1673 microversion: 2.1 time: 0.158964 Oct 31 16:37:14.114727 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3730/7334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:13 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:15.140357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:15.141057 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:15.148025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:15.148531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:15.149012 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:15.149736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:15.150213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:15.150656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:15.285160 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:15.293297 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9eef5e5e-6065-487c-afbc-dbedfc33e48e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1681 microversion: 2.1 time: 0.158073 Oct 31 16:37:15.293898 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3605/7335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:15 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:15.397798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:15.399873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:15.407475 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:15.407957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:15.408394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:15.409113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:15.409569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:15.409991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:15.470138 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c240d5a-1840-4c4c-b140-4bc0ddc768a4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action" status: 200 len: 36266 microversion: 2.1 time: 0.076844 Oct 31 16:37:15.471060 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3731/7336] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:15 2022] POST /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b/action => generated 36266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:37:16.483298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:16.483806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:16.486235 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-16b92ffa-774b-43e0-a6c5-351f123a9e73 req-9e2ffe65-458f-40bd-b214-b92d0c826351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b", "tag": "e54591f3-77f8-461a-8c37-ae7d1e43229e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:16.491878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:16.492729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:16.492872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:16.493575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:16.494249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:16.494692 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:16.498038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-16b92ffa-774b-43e0-a6c5-351f123a9e73 req-9e2ffe65-458f-40bd-b214-b92d0c826351 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:16.498592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-16b92ffa-774b-43e0-a6c5-351f123a9e73 req-9e2ffe65-458f-40bd-b214-b92d0c826351 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:16.499198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-16b92ffa-774b-43e0-a6c5-351f123a9e73 req-9e2ffe65-458f-40bd-b214-b92d0c826351 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:16.511793 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-16b92ffa-774b-43e0-a6c5-351f123a9e73 req-9e2ffe65-458f-40bd-b214-b92d0c826351 service nova] Creating event network-changed:e54591f3-77f8-461a-8c37-ae7d1e43229e for instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b on n-h1-858383-17 Oct 31 16:37:16.517056 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-16b92ffa-774b-43e0-a6c5-351f123a9e73 req-9e2ffe65-458f-40bd-b214-b92d0c826351 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035079 Oct 31 16:37:16.517750 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3732/7337] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:37:16.524109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:37:16.612588 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9304cdcf-4ad8-41fc-bb82-c7e4769a85dc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 204 len: 0 microversion: 2.1 time: 0.133224 Oct 31 16:37:16.613375 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3606/7338] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:37:16 2022] DELETE /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:37:16.622870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:16.623578 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:16.630100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:16.630589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:16.631587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:16.632404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:16.632895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:16.633324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:17.137480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:17.145425 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b155c4a-e3b8-466e-9661-3ab925726ee1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1687 microversion: 2.1 time: 0.527387 Oct 31 16:37:17.146010 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3733/7339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:16 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1687 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:18.170634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:18.171291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:18.177523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:18.178619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:18.179118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:18.179904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:18.180390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:18.180872 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:18.377042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:18.385120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d4616672-cb75-4b62-bd29-9f2ed68c088a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 200 len: 1687 microversion: 2.1 time: 0.218971 Oct 31 16:37:18.385804 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3607/7340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:18 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:18.864953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f7b495b5-6435-47b3-87fa-0af7bbdab653 req-270c468c-71e5-4660-90a7-cb5c1d40daee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b", "name": "network-vif-deleted", "tag": "e54591f3-77f8-461a-8c37-ae7d1e43229e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:18.881219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f7b495b5-6435-47b3-87fa-0af7bbdab653 req-270c468c-71e5-4660-90a7-cb5c1d40daee service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:18.881710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f7b495b5-6435-47b3-87fa-0af7bbdab653 req-270c468c-71e5-4660-90a7-cb5c1d40daee service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:18.882147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f7b495b5-6435-47b3-87fa-0af7bbdab653 req-270c468c-71e5-4660-90a7-cb5c1d40daee service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:18.894176 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f7b495b5-6435-47b3-87fa-0af7bbdab653 req-270c468c-71e5-4660-90a7-cb5c1d40daee service nova] Creating event network-vif-deleted:e54591f3-77f8-461a-8c37-ae7d1e43229e for instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b on n-h1-858383-17 Oct 31 16:37:18.900621 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f7b495b5-6435-47b3-87fa-0af7bbdab653 req-270c468c-71e5-4660-90a7-cb5c1d40daee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039431 Oct 31 16:37:18.901274 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3734/7341] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:37:19.411169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:19.411762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:19.420517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:19.421136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:19.421669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:19.422489 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:19.423084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:19.423633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:19.438417 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] HTTP exception thrown: Instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b could not be found. Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Request method failure captured: Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b HTTP/1.1 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_lg8gZMCixr5nz_l8lhxLEC3_HrXN4pkhguQDzo3XeKSjKClzeFuvyeE7qodqCgtU_OX96_rTCAiyNH1i8RQbLnXvuFf1zczO7LYA0WFLsXHxRBPyizMT_oNP_Z4r1yl3VePn_odNWDIV1W1IjF_j1GA77HtU-cDyff1D9g74ZKQ4E Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/027b52829fc44415b62fd71640190fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_027b52829fc44415b62fd71640190fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 119e5eab6b8f4080b4cd95f807b9ef23 Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b could not be found. Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b'} Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b could not be found. Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b could not be found. Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:37:19.440169 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b could not be found. Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Returning 404 to user: Instance 454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c19d168f-5722-4b53-b5fe-8e7e223d3fa2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b" status: 404 len: 111 microversion: 2.1 time: 0.035162 Oct 31 16:37:19.445321 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3608/7342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:19 2022] GET /compute/v2.1/servers/454ac38f-16c9-4c4d-8440-2bb9d6c6ef9b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:37:22.485653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3bbbeece-98ff-4ba9-8a00-f8eadc39242a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '.version_select at 0x7f5ca139bca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:22.506827 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3bbbeece-98ff-4ba9-8a00-f8eadc39242a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-883771702" status: 202 len: 0 microversion: 2.1 time: 0.025340 Oct 31 16:37:22.507582 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3735/7343] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Oct 31 16:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-883771702 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:37:22.534081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-33da2349-f31a-4346-ae59-0e7f132f88f8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: .version_select at 0x7f5ca3db9670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1801461206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2krdob8n3WJudB1CrRxjTeDqIv15KGCAHT0Q2SivpQR9LLzHkNQCADwAZj7DKZjeez8D97oBulvhrsPTjUDJc4gfykxuApW/5JmF1fJE5l6odf7MzfinIV9ryFCGDRoQ=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:22.551229 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-33da2349-f31a-4346-ae59-0e7f132f88f8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:37:22.557136 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-33da2349-f31a-4346-ae59-0e7f132f88f8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:37:22.579975 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-33da2349-f31a-4346-ae59-0e7f132f88f8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049827 Oct 31 16:37:22.580567 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3609/7344] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:37:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:37:28.564667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1443359513", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "f655da6e-7c38-46d6-9929-81dcd8dcb8aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1801461206", "security_groups": [{"name": "tempest-secgroup-smoke-1175853016"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:28.710728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] validate_networks() for [('f655da6e-7c38-46d6-9929-81dcd8dcb8aa', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:37:28.889407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=30 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:29.133663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:37:29.134116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:37:29.134592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:37:29.135030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:37:29.135440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:37:29.144598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:29.145112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:29.145551 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:29.146818 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:29.147277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:29.147705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:29.166626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:37:29.172301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:37:29.188627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:37:29.191143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:37:29.241159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-331cda56-e34f-411e-a959-9d8a9ce74045 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685057 Oct 31 16:37:29.242086 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3736/7345] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:37:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:37:29.254393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c3e5b54f-cc70-4741-8af7-0cc842ef6ad8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:29.255017 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c3e5b54f-cc70-4741-8af7-0cc842ef6ad8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:29.334362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c3e5b54f-cc70-4741-8af7-0cc842ef6ad8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:29.355484 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c3e5b54f-cc70-4741-8af7-0cc842ef6ad8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1267 microversion: 2.1 time: 0.105933 Oct 31 16:37:29.356458 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3610/7346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:29 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:30.378860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:30.379794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:30.390624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:30.391463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:30.392934 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:30.393693 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:30.394158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:30.394584 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:30.481736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:30.492078 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c1b4c20-8177-41f5-8286-6695955d264d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1337 microversion: 2.1 time: 0.117358 Oct 31 16:37:30.492773 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3737/7347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:30 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1337 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:31.515955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:31.516877 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:31.519098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:31.526629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:31.527395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:31.528025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:31.528962 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:31.529437 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:31.530049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:31.754949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:31.763534 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5eb5c5bc-29be-4648-b0d2-bed79eaf4eb2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1393 microversion: 2.1 time: 0.251696 Oct 31 16:37:31.764617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3611/7348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:31 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1393 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:31.899624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ba8fbe24-b5ab-423b-a6dd-6f1f27eb1fda req-4a98b9ce-e1d2-4eae-9383-1dfa439e7cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7aae38-b715-4fe7-bb7b-88067053c1ee", "tag": "61087203-20b7-44d5-bf69-587e71493404"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:31.913560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ba8fbe24-b5ab-423b-a6dd-6f1f27eb1fda req-4a98b9ce-e1d2-4eae-9383-1dfa439e7cd0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:31.914189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ba8fbe24-b5ab-423b-a6dd-6f1f27eb1fda req-4a98b9ce-e1d2-4eae-9383-1dfa439e7cd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:31.914724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ba8fbe24-b5ab-423b-a6dd-6f1f27eb1fda req-4a98b9ce-e1d2-4eae-9383-1dfa439e7cd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:31.926915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ba8fbe24-b5ab-423b-a6dd-6f1f27eb1fda req-4a98b9ce-e1d2-4eae-9383-1dfa439e7cd0 service nova] Creating event network-changed:61087203-20b7-44d5-bf69-587e71493404 for instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee on n-h2-858383-17 Oct 31 16:37:31.932749 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ba8fbe24-b5ab-423b-a6dd-6f1f27eb1fda req-4a98b9ce-e1d2-4eae-9383-1dfa439e7cd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036943 Oct 31 16:37:31.933598 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3738/7349] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:37:32.788264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:32.788926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:32.795890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:32.796395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:32.796887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:32.797602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:32.798082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:32.798533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:32.931836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:32.939496 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9aecc362-ab90-4b00-8dd4-c6c865350cce tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1393 microversion: 2.1 time: 0.156007 Oct 31 16:37:32.940069 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3612/7350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:32 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:33.964181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:33.964859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:33.971039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:33.971525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:33.971968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:33.972659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:33.973147 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:33.973574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:34.109813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:34.117683 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-984db8b1-c999-43ce-852b-a158c2548303 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1393 microversion: 2.1 time: 0.159438 Oct 31 16:37:34.118272 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3739/7351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:33 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:35.141796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:35.142431 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:35.150068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:35.150578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:35.151036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:35.151758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:35.152236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:35.152681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:35.285330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:35.293599 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a9e45b26-f90d-4b58-804c-e5a905b04211 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1393 microversion: 2.1 time: 0.155728 Oct 31 16:37:35.294174 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3613/7352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:35 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:35.765318 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5394f8b9-cbfd-421f-bed5-4e8fa1456792 req-4da40068-a7d4-419e-8952-e8de89605d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7aae38-b715-4fe7-bb7b-88067053c1ee", "name": "network-vif-plugged", "status": "completed", "tag": "61087203-20b7-44d5-bf69-587e71493404"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:35.775882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5394f8b9-cbfd-421f-bed5-4e8fa1456792 req-4da40068-a7d4-419e-8952-e8de89605d9a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:35.776373 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5394f8b9-cbfd-421f-bed5-4e8fa1456792 req-4da40068-a7d4-419e-8952-e8de89605d9a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:35.777008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5394f8b9-cbfd-421f-bed5-4e8fa1456792 req-4da40068-a7d4-419e-8952-e8de89605d9a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:35.788220 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5394f8b9-cbfd-421f-bed5-4e8fa1456792 req-4da40068-a7d4-419e-8952-e8de89605d9a service nova] Creating event network-vif-plugged:61087203-20b7-44d5-bf69-587e71493404 for instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee on n-h2-858383-17 Oct 31 16:37:35.793196 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5394f8b9-cbfd-421f-bed5-4e8fa1456792 req-4da40068-a7d4-419e-8952-e8de89605d9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Oct 31 16:37:35.793798 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3740/7353] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:37:36.316559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:36.317311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:36.324154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:36.324653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:36.325143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:36.325850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:36.326322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:36.326761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:36.457045 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:36.465505 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c91547a1-f649-4df3-ba6f-aef0adb28c13 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1393 microversion: 2.1 time: 0.152866 Oct 31 16:37:36.466068 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3614/7354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:36 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:37.489921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:37.490522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:37.497395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:37.497876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:37.498311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:37.498999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:37.499452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:37.499876 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:37.631727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:37.640349 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f60f071-3994-4e23-acc0-476584721bc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1564 microversion: 2.1 time: 0.155641 Oct 31 16:37:37.640957 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3741/7355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:37 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:37.664398 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:37.665068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:37.671987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:37.672495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:37.673013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:37.673731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:37.674216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:37.674669 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:37.810272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:37.818010 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-8c931b28-3814-46e9-bf72-fdbc2e350625 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1564 microversion: 2.1 time: 0.158025 Oct 31 16:37:37.818599 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3615/7356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:37 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:39.720283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:39.721753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2e9f0623-9402-4b67-bfed-744dfbc978a7 req-7c2c13f7-4717-4d36-b16e-b84429627147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7aae38-b715-4fe7-bb7b-88067053c1ee", "tag": "61087203-20b7-44d5-bf69-587e71493404"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:39.722349 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:39.725683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:39.727266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:39.730737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:39.733231 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2e9f0623-9402-4b67-bfed-744dfbc978a7 req-7c2c13f7-4717-4d36-b16e-b84429627147 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:39.733951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2e9f0623-9402-4b67-bfed-744dfbc978a7 req-7c2c13f7-4717-4d36-b16e-b84429627147 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:39.734087 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:39.734397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2e9f0623-9402-4b67-bfed-744dfbc978a7 req-7c2c13f7-4717-4d36-b16e-b84429627147 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:39.734847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:39.735725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:39.736759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:39.737803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:39.738519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:39.746847 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2e9f0623-9402-4b67-bfed-744dfbc978a7 req-7c2c13f7-4717-4d36-b16e-b84429627147 service nova] Creating event network-changed:61087203-20b7-44d5-bf69-587e71493404 for instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee on n-h2-858383-17 Oct 31 16:37:39.751970 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2e9f0623-9402-4b67-bfed-744dfbc978a7 req-7c2c13f7-4717-4d36-b16e-b84429627147 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033927 Oct 31 16:37:39.752583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3616/7357] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:37:39.966018 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:39.978345 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f41316e-ec80-4130-bbbb-b432d1c3b942 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1564 microversion: 2.1 time: 0.262557 Oct 31 16:37:39.979037 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3742/7358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:39 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:01.263350 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:01.264111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=32 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:01.268362 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:01.270658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:01.279070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:01.279070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:01.279341 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:01.280050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:01.280520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:01.281006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:01.339970 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9edde398-8a60-4cb6-a6e8-b5fdc841c9fb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee/action" status: 200 len: 24575 microversion: 2.1 time: 0.078739 Oct 31 16:38:01.340612 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3617/7359] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:38:01 2022] POST /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee/action => generated 24575 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:38:12.408987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:12.411261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:12.414110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:12.414867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=30 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:12.420666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:12.421168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:12.421601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:12.422338 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:12.422741 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:12.423163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:12.500057 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8baa0a24-40f8-41b5-b96a-8424efc6b8ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee/action" status: 202 len: 0 microversion: 2.1 time: 0.094849 Oct 31 16:38:12.501109 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3743/7360] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:38:12 2022] POST /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:38:12.510111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:12.510836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:12.513988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:12.514655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:12.520768 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:12.521268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:12.521726 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:12.522432 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:12.523126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:12.523576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:12.750970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:12.759449 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e742a6ad-0c6f-4309-a918-3b43cc0e2da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1674 microversion: 2.1 time: 0.253657 Oct 31 16:38:12.760034 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3618/7361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:12 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:13.784779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:13.785490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:13.792881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:13.793372 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:13.793817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:13.794517 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:13.794982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:13.795414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:13.930398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:13.938186 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-46141231-502e-47fe-800f-e5bc7cc5205b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.157742 Oct 31 16:38:13.938757 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3744/7362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:13 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:14.962712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:14.963359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:14.972188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:14.972738 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:14.973187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:14.973913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:14.974395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:14.974845 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:15.105378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:15.113112 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-36858057-0e18-4238-b126-f37dd69775a7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.155226 Oct 31 16:38:15.113697 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3619/7363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:14 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:16.138276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:16.138894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:16.145127 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:16.145613 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:16.146054 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:16.146774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:16.147233 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:16.147660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:16.280272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:16.288026 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ed8205ee-ea02-47ed-b15f-a8ba353dbef1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.154207 Oct 31 16:38:16.289249 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3745/7364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:16 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:38:17.313303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:17.313933 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:17.321190 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:17.321691 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:17.322145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:17.322850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:17.323319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:17.323758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:17.454825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:17.462553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e09e0c03-24f4-4256-bc72-60945cf67a79 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.153540 Oct 31 16:38:17.463119 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3620/7365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:17 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:38:18.486088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:18.486632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:18.494537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:18.495025 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:18.495466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:18.496194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:18.496654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:18.497107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:18.627617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:18.635562 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c410c2d-e828-4fd2-b1e1-f5b266d2b6db tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.153490 Oct 31 16:38:18.636136 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3746/7366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:18 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:19.659593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:19.660223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:19.667778 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:19.668274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:19.668744 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:19.669452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:19.669918 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:19.670356 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:19.803465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:19.811192 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9dd5267-5c93-480e-a6eb-f41376e1904c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.155594 Oct 31 16:38:19.811762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3621/7367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:19 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:20.835786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:20.836432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:20.843273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:20.843755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:20.844186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:20.844913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:20.845370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:20.845793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:20.975080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:20.982971 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8353c4b-2d12-474a-bc01-f6418575506e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.151767 Oct 31 16:38:20.983542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3747/7368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:20 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:22.006364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:22.007696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:22.014993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:22.015497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:22.015955 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:22.016672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:22.017176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:22.017625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:22.153367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:22.161128 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1d4eb49b-de96-4e64-9c69-d73d260f07df tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.158702 Oct 31 16:38:22.162070 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3622/7369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:22 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:23.185223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:23.185844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:23.192847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:23.193329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:23.193771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:23.194976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:23.195464 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:23.195898 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:23.326387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:23.334150 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1fb6d092-b0b3-4150-bc9a-47d226eaba96 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.152857 Oct 31 16:38:23.334847 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3748/7370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:23 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:24.358001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:24.358630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:24.365645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:24.366198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:24.366737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:24.367450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:24.367927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:24.368371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:24.502329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:24.510665 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-991a8a23-8c1b-44ca-82fb-002fed3e1b03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.156721 Oct 31 16:38:24.511220 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3623/7371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:24 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:25.533885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:25.534505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:25.542101 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:25.542589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:25.543036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:25.543731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:25.544196 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:25.544627 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:25.677179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:25.685907 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3789da6c-a85d-4b29-a4d5-522a676bebc6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.155980 Oct 31 16:38:25.686480 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3749/7372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:25 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:26.710439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:26.710995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:26.717826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:26.718333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:26.718775 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:26.719480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:26.719951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:26.720392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:26.854811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:26.862451 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-388246d2-9a71-4d5e-ba0f-1554751f8eac tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.156657 Oct 31 16:38:26.863017 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3624/7373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:26 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:27.885998 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:27.886618 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:27.893766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:27.894256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:27.894695 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:27.895387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:27.895848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:27.896276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:28.029500 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:28.037251 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d8f09946-b4a1-4e52-ba91-3989fe850800 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1679 microversion: 2.1 time: 0.155242 Oct 31 16:38:28.037839 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3750/7374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:27 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:29.061352 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:29.062021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:29.069027 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:29.069537 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:29.070550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:29.071455 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:29.071935 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:29.072391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:29.205212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:29.214377 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2a96e3b7-b150-4239-9ed9-5f6591982172 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1682 microversion: 2.1 time: 0.156914 Oct 31 16:38:29.214969 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3625/7375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:29 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:53.404645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:53.406867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:53.409185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:53.409839 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:53.416532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:53.417043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:53.417478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:53.418165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:53.418620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:53.419071 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:53.476253 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ebe65f1-eac7-49cf-865f-153cc1d23db2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee/action" status: 200 len: 67639 microversion: 2.1 time: 0.075483 Oct 31 16:38:53.476844 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3751/7376] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:38:53 2022] POST /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee/action => generated 67639 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:39:00.534549 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:00.535073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:00.539031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=16 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:00.539810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=48 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:00.547385 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:00.548098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:00.548369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:00.549131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:00.549610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:00.550058 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:00.578535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:39:00.598319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-3a7d41a1-0478-445f-b5d3-a49b10b300f5 req-8c6585ea-ed0c-406a-8d57-c6c649e9cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7aae38-b715-4fe7-bb7b-88067053c1ee", "tag": "61087203-20b7-44d5-bf69-587e71493404"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:00.610703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3a7d41a1-0478-445f-b5d3-a49b10b300f5 req-8c6585ea-ed0c-406a-8d57-c6c649e9cff9 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:00.611194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3a7d41a1-0478-445f-b5d3-a49b10b300f5 req-8c6585ea-ed0c-406a-8d57-c6c649e9cff9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:00.611783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-3a7d41a1-0478-445f-b5d3-a49b10b300f5 req-8c6585ea-ed0c-406a-8d57-c6c649e9cff9 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:00.623006 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-3a7d41a1-0478-445f-b5d3-a49b10b300f5 req-8c6585ea-ed0c-406a-8d57-c6c649e9cff9 service nova] Creating event network-changed:61087203-20b7-44d5-bf69-587e71493404 for instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee on n-h2-858383-17 Oct 31 16:39:00.628198 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-3a7d41a1-0478-445f-b5d3-a49b10b300f5 req-8c6585ea-ed0c-406a-8d57-c6c649e9cff9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094586 Oct 31 16:39:00.629431 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3752/7377] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:00.664399 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c054788a-aad4-4ca2-9395-5e159fa4c89a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 204 len: 0 microversion: 2.1 time: 0.133581 Oct 31 16:39:00.665226 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3626/7378] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:39:00 2022] DELETE /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:39:00.675151 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:00.675868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:00.683053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:00.683709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:00.684162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:00.685104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:00.685796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:00.686400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:00.857658 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:00.866379 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c53ad8fd-2e97-435a-9b07-42ecc6f987fc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1688 microversion: 2.1 time: 0.195766 Oct 31 16:39:00.880785 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3753/7379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:00 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:01.891838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:01.892559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:01.900042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:01.900539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:01.901023 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:01.901733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:01.902206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:01.902646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:02.062508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:02.070340 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e9750aed-ac0f-4ba7-bb17-f9e58749d337 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1688 microversion: 2.1 time: 0.183120 Oct 31 16:39:02.071125 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3627/7380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:01 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:02.643478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-68b8c435-4f63-4d30-b6cc-667d9d3bf680 req-53f27226-ca2f-4c1d-b449-6c599c414b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7aae38-b715-4fe7-bb7b-88067053c1ee", "name": "network-vif-deleted", "tag": "61087203-20b7-44d5-bf69-587e71493404"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:02.658410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-68b8c435-4f63-4d30-b6cc-667d9d3bf680 req-53f27226-ca2f-4c1d-b449-6c599c414b7f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:02.658896 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-68b8c435-4f63-4d30-b6cc-667d9d3bf680 req-53f27226-ca2f-4c1d-b449-6c599c414b7f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:02.659325 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-68b8c435-4f63-4d30-b6cc-667d9d3bf680 req-53f27226-ca2f-4c1d-b449-6c599c414b7f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:02.673329 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-68b8c435-4f63-4d30-b6cc-667d9d3bf680 req-53f27226-ca2f-4c1d-b449-6c599c414b7f service nova] Creating event network-vif-deleted:61087203-20b7-44d5-bf69-587e71493404 for instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee on n-h2-858383-17 Oct 31 16:39:02.680361 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-68b8c435-4f63-4d30-b6cc-667d9d3bf680 req-53f27226-ca2f-4c1d-b449-6c599c414b7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041035 Oct 31 16:39:02.680988 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3754/7381] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:03.093714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:03.094360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:03.102221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:03.102736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:03.103198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:03.103926 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:03.104410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:03.104889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:03.144646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:03.145187 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:03.145660 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:03.146121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lazy-loading 'fault' on Instance uuid 7d7aae38-b715-4fe7-bb7b-88067053c1ee {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:39:03.189096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:03.196328 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-39439dec-1f56-471f-9753-1fc6506c9262 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 200 len: 1357 microversion: 2.1 time: 0.106674 Oct 31 16:39:03.196945 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3628/7382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:03 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:04.219771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:04.220479 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: 7d7aae38-b715-4fe7-bb7b-88067053c1ee] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:04.227819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:04.228305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:04.228774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:04.229468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:04.229932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:04.230361 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:04.243644 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] HTTP exception thrown: Instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee could not be found. Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Request method failure captured: Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee HTTP/1.1 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_lg8gZMCixr5nz_l8lhxLEC3_HrXN4pkhguQDzo3XeKSjKClzeFuvyeE7qodqCgtU_OX96_rTCAiyNH1i8RQbLnXvuFf1zczO7LYA0WFLsXHxRBPyizMT_oNP_Z4r1yl3VePn_odNWDIV1W1IjF_j1GA77HtU-cDyff1D9g74ZKQ4E Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/027b52829fc44415b62fd71640190fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_027b52829fc44415b62fd71640190fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 119e5eab6b8f4080b4cd95f807b9ef23 Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee could not be found. Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': '7d7aae38-b715-4fe7-bb7b-88067053c1ee'} Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee could not be found. Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee could not be found. Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:39:04.245305 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee could not be found. Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Returning 404 to user: Instance 7d7aae38-b715-4fe7-bb7b-88067053c1ee could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7ec7229-e36f-4bd1-94b4-d4f351663ab1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee" status: 404 len: 111 microversion: 2.1 time: 0.031193 Oct 31 16:39:04.250482 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3755/7383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:04 2022] GET /compute/v2.1/servers/7d7aae38-b715-4fe7-bb7b-88067053c1ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:39:07.562588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-19c07434-81c9-4565-ac2e-7836204b46e1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '.version_select at 0x7f5ca1dbe550>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:07.582580 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-19c07434-81c9-4565-ac2e-7836204b46e1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1801461206" status: 202 len: 0 microversion: 2.1 time: 0.023769 Oct 31 16:39:07.583127 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3629/7384] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Oct 31 16:39:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1801461206 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:39:07.609515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6da33f64-7675-4907-bc99-5088aae8d665 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: .version_select at 0x7f5ca2435790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1328120752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK9YFFWoTPoq5tO1yg99GkZmCkWutrJYagd9YFMeSRJUP0EJnGCLq8CagY/qVfDHRWa1LYUsqbElqvEGz5ecIEW1X+6+I7I+8XtI52BfagPYfXB6tPH6i9onKDJ+wzcnA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:07.627095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-6da33f64-7675-4907-bc99-5088aae8d665 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:39:07.632466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-6da33f64-7675-4907-bc99-5088aae8d665 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:39:07.656406 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6da33f64-7675-4907-bc99-5088aae8d665 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050777 Oct 31 16:39:07.657068 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3756/7385] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:39:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:13.194654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-428440218", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "96f0d44b-ac27-4c8c-8f07-cdcc9d2c38ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1328120752", "security_groups": [{"name": "tempest-secgroup-smoke-212774934"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:13.207469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:13.321677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] validate_networks() for [('96f0d44b-ac27-4c8c-8f07-cdcc9d2c38ce', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:39:13.824399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:39:13.824884 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:39:13.825380 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:39:13.825810 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:39:13.826464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:39:13.835364 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:13.835805 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:13.836262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:13.837042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:13.837524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:13.837973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:13.856782 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:39:13.862396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:39:13.875781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:39:13.878158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:39:13.929054 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-17148d8e-a07e-423f-a23d-768c566abc18 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739283 Oct 31 16:39:13.929994 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3630/7386] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:39:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:39:13.941142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32ebb990-6aec-4484-ad94-e339916cb4c4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:13.942665 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32ebb990-6aec-4484-ad94-e339916cb4c4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:14.008440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-32ebb990-6aec-4484-ad94-e339916cb4c4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:14.017394 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32ebb990-6aec-4484-ad94-e339916cb4c4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1266 microversion: 2.1 time: 0.080230 Oct 31 16:39:14.018241 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3757/7387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:13 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:15.043430 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:15.044375 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:15.059290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:15.062968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:15.063646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:15.064609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:15.065952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:15.068255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:15.183846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:15.193706 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a8f71b6a-6452-4016-ab0c-719e5a93b0f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1326 microversion: 2.1 time: 0.156396 Oct 31 16:39:15.205282 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3631/7388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:15 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:39:16.219359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:16.219979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:16.222254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:16.248687 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:16.249218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:16.249872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:16.250855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:16.251560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:16.252229 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:16.501002 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:16.509863 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b1d35489-5f14-4db1-9b6a-c278b90a1966 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1391 microversion: 2.1 time: 0.294669 Oct 31 16:39:16.510460 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3758/7389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:16 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:16.895060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-32bdc1bc-74cb-450c-813d-97fb379e19d8 req-923a5aa3-73eb-44c0-8c36-0f1af1ebaf3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:16.904736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-32bdc1bc-74cb-450c-813d-97fb379e19d8 req-923a5aa3-73eb-44c0-8c36-0f1af1ebaf3b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:16.905244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-32bdc1bc-74cb-450c-813d-97fb379e19d8 req-923a5aa3-73eb-44c0-8c36-0f1af1ebaf3b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:16.905694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-32bdc1bc-74cb-450c-813d-97fb379e19d8 req-923a5aa3-73eb-44c0-8c36-0f1af1ebaf3b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:16.917351 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-32bdc1bc-74cb-450c-813d-97fb379e19d8 req-923a5aa3-73eb-44c0-8c36-0f1af1ebaf3b service nova] Creating event network-changed:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h1-858383-17 Oct 31 16:39:16.922728 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-32bdc1bc-74cb-450c-813d-97fb379e19d8 req-923a5aa3-73eb-44c0-8c36-0f1af1ebaf3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097717 Oct 31 16:39:16.923346 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3632/7390] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:39:17.534702 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:17.535559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:17.543646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:17.544300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:17.544790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:17.545686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:17.546161 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:17.546690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:17.687901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:17.696507 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe3f230b-e15f-4f0d-8c8c-66f056af3d88 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1391 microversion: 2.1 time: 0.165915 Oct 31 16:39:17.697120 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3759/7391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:17 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:18.721020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:18.721746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:18.728102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:18.728605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:18.729090 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.729800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:18.730277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:18.730724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.861560 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:18.870316 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-283a8100-ec52-4dea-9247-e3eb44650a03 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1391 microversion: 2.1 time: 0.153965 Oct 31 16:39:18.870894 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3633/7392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:18 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:19.893910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:19.894519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:19.901956 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:19.902437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:19.902873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:19.903588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:19.904046 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:19.904472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:20.040383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:20.048400 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b7eb5a4-876a-47af-b7c8-cfd006a60d7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1391 microversion: 2.1 time: 0.158361 Oct 31 16:39:20.049017 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3760/7393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:19 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:21.071977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:21.072604 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:21.079652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.080178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.080635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.081359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.081830 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.082268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.214891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:21.222581 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4fca1336-784a-4b98-94a7-a344dda66927 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1391 microversion: 2.1 time: 0.155232 Oct 31 16:39:21.223158 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3634/7394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:21 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:21.721140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-29a631c2-b475-4571-92f5-415a099f4cf3 req-042bff61-1a51-4630-a1b6-fbd2a2c56dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "name": "network-vif-plugged", "status": "completed", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:21.731156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-29a631c2-b475-4571-92f5-415a099f4cf3 req-042bff61-1a51-4630-a1b6-fbd2a2c56dd0 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.731635 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-29a631c2-b475-4571-92f5-415a099f4cf3 req-042bff61-1a51-4630-a1b6-fbd2a2c56dd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.732059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-29a631c2-b475-4571-92f5-415a099f4cf3 req-042bff61-1a51-4630-a1b6-fbd2a2c56dd0 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.744215 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-29a631c2-b475-4571-92f5-415a099f4cf3 req-042bff61-1a51-4630-a1b6-fbd2a2c56dd0 service nova] Creating event network-vif-plugged:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h1-858383-17 Oct 31 16:39:21.749159 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-29a631c2-b475-4571-92f5-415a099f4cf3 req-042bff61-1a51-4630-a1b6-fbd2a2c56dd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089636 Oct 31 16:39:21.749750 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3761/7395] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:22.245487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:22.246153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:22.253064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:22.253570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:22.254026 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:22.254740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:22.255216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:22.255662 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:22.388856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:22.396926 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-98a99d54-c0a7-4a6f-a421-0c6c48e43e35 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1391 microversion: 2.1 time: 0.155282 Oct 31 16:39:22.397567 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3635/7396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:22 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:23.422337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:23.423038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:23.424987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:23.430922 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:23.431413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:23.431858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:23.432646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:23.433134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:23.433565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:23.569509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:23.577480 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f010a427-1617-475b-a431-0e85d632ae70 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1564 microversion: 2.1 time: 0.160538 Oct 31 16:39:23.578060 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3762/7397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:23 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:23.601585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:23.602218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:23.609121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:23.609621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:23.610078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:23.610788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:23.611266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:23.611715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:23.744446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:23.752122 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9956c1cc-632d-497f-bcab-dfccab14d7ee tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1564 microversion: 2.1 time: 0.155211 Oct 31 16:39:23.752715 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3636/7398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:23 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:25.644273 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:25.645074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:25.646961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-9b01faa0-7129-406b-b82e-c9971edec535 req-e484c9ef-c23c-4994-b03f-6853f02a6514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:25.648617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:25.653383 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:25.654154 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:25.655779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:25.656654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:25.657830 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:25.658654 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:25.659114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:25.659710 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:25.661889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9b01faa0-7129-406b-b82e-c9971edec535 req-e484c9ef-c23c-4994-b03f-6853f02a6514 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:25.662387 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9b01faa0-7129-406b-b82e-c9971edec535 req-e484c9ef-c23c-4994-b03f-6853f02a6514 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:25.663007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-9b01faa0-7129-406b-b82e-c9971edec535 req-e484c9ef-c23c-4994-b03f-6853f02a6514 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:25.675352 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-9b01faa0-7129-406b-b82e-c9971edec535 req-e484c9ef-c23c-4994-b03f-6853f02a6514 service nova] Creating event network-changed:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h1-858383-17 Oct 31 16:39:25.680583 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-9b01faa0-7129-406b-b82e-c9971edec535 req-e484c9ef-c23c-4994-b03f-6853f02a6514 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038026 Oct 31 16:39:25.681218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3637/7399] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:39:25.858472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:25.868907 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20b0723c-a6b1-43d9-b12d-f1767817e607 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1564 microversion: 2.1 time: 0.228915 Oct 31 16:39:25.869777 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3763/7400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:25 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:59.152870 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:59.153889 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=36 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:59.158416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:59.160753 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:59.169098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:59.169609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:59.170068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:59.170788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:59.171259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:59.171712 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:59.241438 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-720b7e58-3b06-4af2-94f2-7618d97c6c64 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action" status: 200 len: 24570 microversion: 2.1 time: 0.089426 Oct 31 16:39:59.242111 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3638/7401] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:39:59 2022] POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:40:29.640817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:40:29.641590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:40:29.647252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:40:29.649652 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:29.656758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:29.657250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:29.657744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:29.658519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:29.659723 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:29.660159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:29.700947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:29.706838 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Old instance type m1.heat2, new instance type m1.heat {{(pid=120625) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:40:29.713568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:40:29.713992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:40:29.714468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:40:29.714879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:40:29.715291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:40:29.776334 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [3194ab6b-a60d-40a1-8821-4d4858079bc2] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:40:30.786983 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [3194ab6b-a60d-40a1-8821-4d4858079bc2] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 51936. Oct 31 16:40:30.790803 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5db061cc-241a-497e-9f5a-0cf67408d26b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action" status: 202 len: 0 microversion: 2.1 time: 1.151824 Oct 31 16:40:30.791431 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3764/7402] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:40:29 2022] POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action => generated 0 bytes in 1153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:40:30.800284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:30.801028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:30.804374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:40:30.805252 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:40:30.811327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:30.811835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:30.812296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:30.813201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:30.813822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:30.814458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:30.955992 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:30.964472 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-390f2b92-4dbc-4fa1-80b4-19c0b1662c98 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1692 microversion: 2.1 time: 0.168430 Oct 31 16:40:30.965081 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3639/7403] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:30 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:31.989427 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:31.990109 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:31.996399 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:31.996921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:31.997356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:31.998056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:31.998514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:31.998942 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:32.138189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:32.145925 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8559291-5799-473d-bdd1-d9c69187e9cc tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1692 microversion: 2.1 time: 0.161363 Oct 31 16:40:32.146536 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3765/7404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:31 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:33.171404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:33.172151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:33.180263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:33.180900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:33.181394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:33.182142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:33.182626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:33.183077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:33.314377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:33.323247 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4339628b-6422-4f2a-bfcc-0dd35b0daad6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.155735 Oct 31 16:40:33.323819 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3640/7405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:33 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:34.347061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:34.347672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:34.355759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:34.356540 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:34.357012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:34.357703 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:34.358158 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:34.358583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:34.496760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:34.504546 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cd2a754-b2ba-44ea-a0c5-fb4cccc64862 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.161444 Oct 31 16:40:34.505156 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3766/7406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:34 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:35.528527 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:35.529133 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:35.535916 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:35.536404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:35.537547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:35.538274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:35.538739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:35.539183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:35.672262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:35.680504 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cffb6cfd-18e1-4feb-a9db-a801b0002ece tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.156018 Oct 31 16:40:35.681097 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3641/7407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:35 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:36.703472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:36.704091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:36.712031 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:36.712527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:36.713005 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:36.713709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:36.714173 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:36.714630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:36.851136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:36.858866 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71c94b9d-91f6-49f4-aea6-593ea831b902 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.159363 Oct 31 16:40:36.859435 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3767/7408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:36 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:37.883826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:37.884459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:37.891687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:37.892191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:37.892648 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:37.893413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:37.893900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:37.894347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:38.028241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:38.036061 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-79c26688-b363-4081-8b9f-e0d62de8034e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.156940 Oct 31 16:40:38.036894 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3642/7409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:37 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:39.059842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:39.060438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:39.067387 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:39.067854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:39.068438 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:39.069163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:39.069622 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:39.070052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:39.199677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:39.207376 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1236297-6c92-4193-973e-fd56bf57d114 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.151453 Oct 31 16:40:39.207949 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3768/7410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:39 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:40.231196 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:40.231815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:40.238674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:40.239170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:40.239620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:40.240323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:40.240824 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:40.241267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:40.375819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:40.384033 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1aeb7475-014c-495f-aee8-b74d816b26d3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.156779 Oct 31 16:40:40.384610 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3643/7411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:40 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:41.409203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:41.409822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:41.417498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:41.418205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:41.418558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:41.419118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:41.419582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:41.420015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:41.550074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:41.558959 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-184c8a36-1f50-4719-b132-06deacd1f289 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.153600 Oct 31 16:40:41.559539 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3769/7412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:41 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:42.584869 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:42.585516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:42.593113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:42.593614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:42.594077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:42.594813 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:42.595291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:42.595737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:42.730758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:42.738469 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1e91583c-5e62-4f13-acd5-4cb3b47cffb6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.157662 Oct 31 16:40:42.739048 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3644/7413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:42 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:43.762481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:43.763356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:43.770194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:43.770683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:43.771294 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:43.772082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:43.772545 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:43.772999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:43.906589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:43.915030 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77ca5fcf-7d3a-43ed-b3dd-f9c1a598f9b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1697 microversion: 2.1 time: 0.156464 Oct 31 16:40:43.915623 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3770/7414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:43 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:44.939193 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:44.939997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:44.948083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:44.948733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:44.949194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:44.949912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:44.950384 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:44.950825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:45.090532 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:45.098549 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f8684c48-32ad-4e2c-b7fa-f5b43e2f7c31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1696 microversion: 2.1 time: 0.163548 Oct 31 16:40:45.099848 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3645/7415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:44 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:45.349319 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "name": "network-vif-unplugged", "status": "completed", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:40:45.361462 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:45.362090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:45.362369 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:45.375057 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] Creating event network-vif-unplugged:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h2-858383-17 Oct 31 16:40:45.380515 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120625) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:40:45.392083 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-38b56564-9d3a-4c29-be98-33ab3e2d6cb3 req-0d3e253f-22cb-487a-ab63-d449f00fd943 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047491 Oct 31 16:40:45.393123 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3771/7416] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:40:46.171570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:46.172880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:46.179673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:46.180189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:46.180656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:46.181414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:46.181893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:46.182339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:46.317277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:46.326254 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f6ecc471-2e6a-4b8e-b2fd-434f0786343b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1696 microversion: 2.1 time: 0.207294 Oct 31 16:40:46.326885 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3646/7417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:46 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:47.351661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:47.352428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:47.358951 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:47.359431 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:47.360317 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:47.360546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:47.361038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:47.361460 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:47.429435 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:40:47.438941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:47.439585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:47.439873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:47.451757 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] Creating event network-changed:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h2-858383-17 Oct 31 16:40:47.457280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-17', 'n-h1-858383-17'} {{(pid=120626) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:40:47.468998 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f2a71eeb-22de-4718-a7c1-bfcd813b2795 req-597bdd5f-5a3e-48f5-80d5-e8f3d3e30161 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043821 Oct 31 16:40:47.469614 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3647/7418] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:40:47.497239 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:47.505399 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8e0be834-85d7-418e-b208-6d7650d5bd85 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1694 microversion: 2.1 time: 0.158696 Oct 31 16:40:47.506233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3772/7419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:47 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:48.532890 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:48.533512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:48.540051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:48.540551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:48.541110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:48.541828 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:48.542301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:48.542746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:48.683123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:48.691263 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-123270b9-9542-4e47-9b37-5718b8931239 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1691 microversion: 2.1 time: 0.163667 Oct 31 16:40:48.691939 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3648/7420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:48 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:48.714473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:40:48.715014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:48.721878 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:48.722366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:48.722808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:48.723502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:48.724057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:48.724579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:48.782791 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cdc02eeb-61ef-4259-862b-e1a0086999de tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action" status: 204 len: 0 microversion: 2.1 time: 0.072065 Oct 31 16:40:48.783577 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3773/7421] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:40:48 2022] POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:40:48.792091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:48.793105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:48.799693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:48.800521 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:48.801131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:48.802705 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:48.803302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:48.803758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:49.024838 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:49.032797 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08b498a5-9d04-4d7e-a662-b4380a7d69a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1691 microversion: 2.1 time: 0.244567 Oct 31 16:40:49.033417 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3649/7422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:48 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:49.056778 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:49.057440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:49.063734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:49.064221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:49.064767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:49.065428 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:49.067425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:49.067425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:49.290543 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:49.298236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3625b7e-d459-4f55-bb16-214c6041c133 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1691 microversion: 2.1 time: 0.246388 Oct 31 16:40:49.299066 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3774/7423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:49 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:50.322693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:40:50.323494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:40:50.330400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:50.330904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:50.331359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:50.332070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:50.332543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:50.333601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:50.477425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:40:50.485499 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-80cf7159-aa44-4238-80e5-053f46d1f734 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1683 microversion: 2.1 time: 0.166691 Oct 31 16:40:50.486078 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3650/7424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:40:50 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:40:50.613861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b64e2d7d-43a0-47f7-8f0f-573de5c19dbe req-7e269d38-853e-451a-be16-b4628051871b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "name": "network-vif-plugged", "status": "completed", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:40:50.625123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b64e2d7d-43a0-47f7-8f0f-573de5c19dbe req-7e269d38-853e-451a-be16-b4628051871b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:40:50.625662 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b64e2d7d-43a0-47f7-8f0f-573de5c19dbe req-7e269d38-853e-451a-be16-b4628051871b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:40:50.626091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b64e2d7d-43a0-47f7-8f0f-573de5c19dbe req-7e269d38-853e-451a-be16-b4628051871b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:40:50.638488 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b64e2d7d-43a0-47f7-8f0f-573de5c19dbe req-7e269d38-853e-451a-be16-b4628051871b service nova] Creating event network-vif-plugged:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h2-858383-17 Oct 31 16:40:50.643320 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b64e2d7d-43a0-47f7-8f0f-573de5c19dbe req-7e269d38-853e-451a-be16-b4628051871b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033268 Oct 31 16:40:50.644074 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3775/7425] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:12.679468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:12.681818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:12.685056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=24 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:12.685725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=70 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:12.691709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:12.692223 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:12.692675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:12.693707 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:12.694182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:12.694622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:12.747822 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6dec2eed-cebf-410a-9fc1-7e27b60caa55 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action" status: 200 len: 24574 microversion: 2.1 time: 0.072932 Oct 31 16:41:12.748484 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3651/7426] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:41:12 2022] POST /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449/action => generated 24574 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:41:19.718909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:19.720222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:19.724835 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-6291cf70-bd2a-4281-b48a-716c7b4275de req-77c2aecb-2e24-4a0a-98bc-ee6cbb74c1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:19.725893 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:19.726567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:19.735185 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:19.735399 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6291cf70-bd2a-4281-b48a-716c7b4275de req-77c2aecb-2e24-4a0a-98bc-ee6cbb74c1a8 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:19.735731 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6291cf70-bd2a-4281-b48a-716c7b4275de req-77c2aecb-2e24-4a0a-98bc-ee6cbb74c1a8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:19.735865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:19.736213 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-6291cf70-bd2a-4281-b48a-716c7b4275de req-77c2aecb-2e24-4a0a-98bc-ee6cbb74c1a8 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:19.736382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:19.737228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:19.737752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:19.738240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:19.749036 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-6291cf70-bd2a-4281-b48a-716c7b4275de req-77c2aecb-2e24-4a0a-98bc-ee6cbb74c1a8 service nova] Creating event network-changed:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h2-858383-17 Oct 31 16:41:19.754830 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-6291cf70-bd2a-4281-b48a-716c7b4275de req-77c2aecb-2e24-4a0a-98bc-ee6cbb74c1a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035209 Oct 31 16:41:19.755940 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3652/7427] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:19.767930 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:41:19.858936 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-87b21291-9c18-41a5-b60d-0c45db6337a3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 204 len: 0 microversion: 2.1 time: 0.141638 Oct 31 16:41:19.860901 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3776/7428] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:41:19 2022] DELETE /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:41:19.871482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:19.872218 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:19.880127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:19.881400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:19.881858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:19.882592 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:19.883095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:19.884410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:20.029258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:20.038043 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-845804f0-2dd4-4cf1-b4e8-9a85f40688c1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1689 microversion: 2.1 time: 0.172656 Oct 31 16:41:20.038723 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3653/7429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:19 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:21.063359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:21.064066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:21.071510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:21.071999 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:21.072443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:21.073165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:21.073626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:21.074056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:21.287359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:21.297428 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42473e21-f021-4fc9-a8f3-cada4752cc0d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 200 len: 1689 microversion: 2.1 time: 0.238165 Oct 31 16:41:21.297950 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3777/7430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:21 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:21.628557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4122d3f9-bdeb-42db-bb40-91225db1f3a0 req-fd014ad0-d17b-4b33-9b0f-f68c250d5e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55008c5-ce9a-42e4-867c-d4a5c1f2b449", "name": "network-vif-deleted", "tag": "01113b7a-8f67-40d8-90a0-b82f5a7e16cc"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:21.640894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4122d3f9-bdeb-42db-bb40-91225db1f3a0 req-fd014ad0-d17b-4b33-9b0f-f68c250d5e3f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:21.641392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4122d3f9-bdeb-42db-bb40-91225db1f3a0 req-fd014ad0-d17b-4b33-9b0f-f68c250d5e3f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:21.641859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4122d3f9-bdeb-42db-bb40-91225db1f3a0 req-fd014ad0-d17b-4b33-9b0f-f68c250d5e3f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:21.653440 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4122d3f9-bdeb-42db-bb40-91225db1f3a0 req-fd014ad0-d17b-4b33-9b0f-f68c250d5e3f service nova] Creating event network-vif-deleted:01113b7a-8f67-40d8-90a0-b82f5a7e16cc for instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 on n-h2-858383-17 Oct 31 16:41:21.658148 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4122d3f9-bdeb-42db-bb40-91225db1f3a0 req-fd014ad0-d17b-4b33-9b0f-f68c250d5e3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033353 Oct 31 16:41:21.658739 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3654/7431] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:22.321416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:22.322056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: e55008c5-ce9a-42e4-867c-d4a5c1f2b449] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:22.328857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:22.329337 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:22.329769 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:22.330453 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:22.330913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:22.331333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:22.345318 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] HTTP exception thrown: Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 could not be found. Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Request method failure captured: Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 HTTP/1.1 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_lg8gZMCixr5nz_l8lhxLEC3_HrXN4pkhguQDzo3XeKSjKClzeFuvyeE7qodqCgtU_OX96_rTCAiyNH1i8RQbLnXvuFf1zczO7LYA0WFLsXHxRBPyizMT_oNP_Z4r1yl3VePn_odNWDIV1W1IjF_j1GA77HtU-cDyff1D9g74ZKQ4E Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/027b52829fc44415b62fd71640190fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_027b52829fc44415b62fd71640190fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 119e5eab6b8f4080b4cd95f807b9ef23 Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 could not be found. Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'e55008c5-ce9a-42e4-867c-d4a5c1f2b449'} Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 could not be found. Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 could not be found. Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:41:22.346947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 could not be found. Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Returning 404 to user: Instance e55008c5-ce9a-42e4-867c-d4a5c1f2b449 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b733d37d-ce6f-4e9e-b12e-3fc37ce86f37 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449" status: 404 len: 111 microversion: 2.1 time: 0.030984 Oct 31 16:41:22.352947 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3778/7432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:22 2022] GET /compute/v2.1/servers/e55008c5-ce9a-42e4-867c-d4a5c1f2b449 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:41:25.640680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7dfdd880-92e8-4032-82d8-0976d133946e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '.version_select at 0x7f5ca14d0a60>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:25.667697 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7dfdd880-92e8-4032-82d8-0976d133946e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1328120752" status: 202 len: 0 microversion: 2.1 time: 0.031581 Oct 31 16:41:25.668728 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3655/7433] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Oct 31 16:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1328120752 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:41:25.692012 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9318861d-ed40-49eb-bd7a-a96a974d7f3e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: .version_select at 0x7f5ca14c4af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1466684500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeC2aCqE38m2y0YVfhBVRwpIqPnLRA4vUvXPhQNFBQXY+wRk1F/2WcQp+GpfWnCIVQ9IOSCfNwDzkwBsLOMlrcZG0yUzjtBqPsStKWcykleAkgu4nScN9uQv57CYImLxQ=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:25.719017 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-9318861d-ed40-49eb-bd7a-a96a974d7f3e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:41:25.725792 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-9318861d-ed40-49eb-bd7a-a96a974d7f3e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:41:25.750495 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9318861d-ed40-49eb-bd7a-a96a974d7f3e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062496 Oct 31 16:41:25.751123 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3779/7434] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:41:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:31.696654 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1247549947", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "d3f312f7-71f3-4eff-90d6-1035576853ff"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1466684500", "security_groups": [{"name": "tempest-secgroup-smoke-654032127"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:31.709400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=14 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:31.832272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] validate_networks() for [('d3f312f7-71f3-4eff-90d6-1035576853ff', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:41:32.323523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:41:32.323999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:41:32.324806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:41:32.325448 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:41:32.326095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:41:32.337075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:32.337585 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:32.338066 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:32.338811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:32.339282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:32.339774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:32.365511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:41:32.373120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:41:32.387645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:41:32.391150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:41:32.445790 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-835078fd-923a-4e86-bb97-06ae34cb7e6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753991 Oct 31 16:41:32.446654 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3656/7435] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:41:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:41:32.455996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:32.460391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ebecdc7-d715-4830-b6b2-9f83c677d5e7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:32.461059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4ebecdc7-d715-4830-b6b2-9f83c677d5e7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:32.534554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4ebecdc7-d715-4830-b6b2-9f83c677d5e7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:32.544811 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ebecdc7-d715-4830-b6b2-9f83c677d5e7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1267 microversion: 2.1 time: 0.090750 Oct 31 16:41:32.547164 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3780/7436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:32 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:33.579597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:33.580361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:33.604760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:33.605572 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:33.606072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:33.606857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:33.607371 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:33.607857 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:33.700320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:33.711745 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad19a7de-cb13-4d64-b800-20ff24a9c97a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1319 microversion: 2.1 time: 0.140303 Oct 31 16:41:33.713201 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3657/7437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:33 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:34.738357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:34.738989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:34.751744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:34.752451 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:34.753119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:34.754026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:34.754497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:34.754979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:34.959638 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:34.969592 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d8b80b9-21f0-4f96-9754-e5dc2c6b31e2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.235127 Oct 31 16:41:34.970182 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3781/7438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:34 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:35.338064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-4096f81d-0ebb-4c8b-8f90-accb1f0993db req-fcf46a2e-18d8-45ec-8cff-2f8ca75a2a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61d1b1e-ebee-445c-8b8d-2c82efc56855", "tag": "2726eb3f-4272-48b0-a877-4a56482ddbf9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:35.348543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4096f81d-0ebb-4c8b-8f90-accb1f0993db req-fcf46a2e-18d8-45ec-8cff-2f8ca75a2a0d service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:35.349274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4096f81d-0ebb-4c8b-8f90-accb1f0993db req-fcf46a2e-18d8-45ec-8cff-2f8ca75a2a0d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:35.349729 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-4096f81d-0ebb-4c8b-8f90-accb1f0993db req-fcf46a2e-18d8-45ec-8cff-2f8ca75a2a0d service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:35.364980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-4096f81d-0ebb-4c8b-8f90-accb1f0993db req-fcf46a2e-18d8-45ec-8cff-2f8ca75a2a0d service nova] Creating event network-changed:2726eb3f-4272-48b0-a877-4a56482ddbf9 for instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 on n-h1-858383-17 Oct 31 16:41:35.370159 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-4096f81d-0ebb-4c8b-8f90-accb1f0993db req-fcf46a2e-18d8-45ec-8cff-2f8ca75a2a0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035992 Oct 31 16:41:35.370784 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3658/7439] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:35.993184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:35.993864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:36.000810 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:36.001295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:36.001731 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:36.002419 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:36.002875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:36.003299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:36.139472 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:36.147920 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d11e495-cc33-4803-a873-3feb9724d4e3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.158780 Oct 31 16:41:36.148494 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3782/7440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:35 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:37.172570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:37.173668 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:37.180206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:37.180739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:37.181265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:37.181981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:37.182465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:37.182921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:37.312975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:37.320735 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dcc7ebe2-c460-4fe9-97ae-96b819fc4dd5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.153436 Oct 31 16:41:37.321312 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3659/7441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:37 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:38.343433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:38.344056 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:38.351496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:38.351988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:38.352433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:38.353171 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:38.353639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:38.354075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:38.484107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:38.492484 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8dfaa1b8-f4ef-41cc-acc1-94879a0da129 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.152944 Oct 31 16:41:38.493091 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3783/7442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:38 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:39.515832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:39.516367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:39.523834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:39.524331 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:39.524821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:39.525529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:39.526003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:39.526446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:39.662922 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:39.670994 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c94f691-e61f-4c79-bd8b-63b606e9f7b7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.159356 Oct 31 16:41:39.671617 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3660/7443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:39 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:40.694163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:40.694785 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:40.701968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:40.702758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:40.703199 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:40.703984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:40.704446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:40.704913 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:40.837563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:40.845269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b2d207a-a340-43f9-9795-3dc39056ec06 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.155573 Oct 31 16:41:40.845844 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3784/7444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:40 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:41.868856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:41.869496 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:41.876404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:41.876940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:41.877402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:41.878181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:41.878597 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:41.879047 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:42.015545 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:42.024294 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c8f1abe-a202-4f41-b255-6c7908b544f7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.159467 Oct 31 16:41:42.025523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3661/7445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:41 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:42.048686 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-723d32b4-38a3-400a-be57-816d71dd148a req-03f31625-4328-4ecc-84f8-eff0e390d3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61d1b1e-ebee-445c-8b8d-2c82efc56855", "name": "network-vif-plugged", "status": "completed", "tag": "2726eb3f-4272-48b0-a877-4a56482ddbf9"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:42.060216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-723d32b4-38a3-400a-be57-816d71dd148a req-03f31625-4328-4ecc-84f8-eff0e390d3b6 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:42.060716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-723d32b4-38a3-400a-be57-816d71dd148a req-03f31625-4328-4ecc-84f8-eff0e390d3b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:42.061172 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-723d32b4-38a3-400a-be57-816d71dd148a req-03f31625-4328-4ecc-84f8-eff0e390d3b6 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:42.075969 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-723d32b4-38a3-400a-be57-816d71dd148a req-03f31625-4328-4ecc-84f8-eff0e390d3b6 service nova] Creating event network-vif-plugged:2726eb3f-4272-48b0-a877-4a56482ddbf9 for instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 on n-h1-858383-17 Oct 31 16:41:42.081027 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-723d32b4-38a3-400a-be57-816d71dd148a req-03f31625-4328-4ecc-84f8-eff0e390d3b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036436 Oct 31 16:41:42.081651 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3785/7446] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:43.049265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:43.049903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:43.052512 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:43.053216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:43.054689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:43.060851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:43.061354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:43.061807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:43.062523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:43.062998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:43.063444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:43.196686 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:43.204355 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0247508a-8d22-49cc-9e01-71aba163d8ed tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1392 microversion: 2.1 time: 0.159100 Oct 31 16:41:43.204951 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3662/7447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:43 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:44.225245 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:44.230206 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:44.230911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:44.237439 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:44.237920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:44.238353 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:44.239669 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:44.240227 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:44.240659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:44.374908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:44.382677 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-792b0723-57e1-4d1f-add7-8f64e8c26396 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1565 microversion: 2.1 time: 0.158534 Oct 31 16:41:44.383247 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3786/7448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:44 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:44.404898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:44.405528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:44.413068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:44.413789 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:44.414243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:44.414957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:44.415677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:44.416458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:44.549021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:44.557239 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c09e221c-514b-4d12-aa9c-e6c211e1b826 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1565 microversion: 2.1 time: 0.156299 Oct 31 16:41:44.557808 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3663/7449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:44 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:46.113510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:46.115103 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:46.119781 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-db62558a-71d1-405c-8e9a-64c96bb858c1 req-4a3e6a44-be1d-4d6a-bd0a-a2210675c5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61d1b1e-ebee-445c-8b8d-2c82efc56855", "tag": "2726eb3f-4272-48b0-a877-4a56482ddbf9"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:46.121968 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:46.122630 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:46.123164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:46.124761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:46.125408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:46.125854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:46.131230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-db62558a-71d1-405c-8e9a-64c96bb858c1 req-4a3e6a44-be1d-4d6a-bd0a-a2210675c5fe service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:46.131977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-db62558a-71d1-405c-8e9a-64c96bb858c1 req-4a3e6a44-be1d-4d6a-bd0a-a2210675c5fe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:46.132427 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-db62558a-71d1-405c-8e9a-64c96bb858c1 req-4a3e6a44-be1d-4d6a-bd0a-a2210675c5fe service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:46.143963 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-db62558a-71d1-405c-8e9a-64c96bb858c1 req-4a3e6a44-be1d-4d6a-bd0a-a2210675c5fe service nova] Creating event network-changed:2726eb3f-4272-48b0-a877-4a56482ddbf9 for instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 on n-h1-858383-17 Oct 31 16:41:46.150013 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-db62558a-71d1-405c-8e9a-64c96bb858c1 req-4a3e6a44-be1d-4d6a-bd0a-a2210675c5fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043039 Oct 31 16:41:46.150906 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3664/7450] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:46.314058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:46.324519 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c21ccdd6-9ef5-4b5c-baf6-b067c3c01caf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1565 microversion: 2.1 time: 0.220147 Oct 31 16:41:46.325418 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3787/7451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:46 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1565 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:19.606295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=5 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:19.606985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=42 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:19.611674 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:19.613982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:19.621039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:19.621550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:19.622002 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:19.622711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:19.623191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:19.623633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:19.694467 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-366f2ed9-8fa5-4265-863d-c1aa0f12470d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action" status: 200 len: 24563 microversion: 2.1 time: 0.089653 Oct 31 16:42:19.695144 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3665/7452] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:42:19 2022] POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action => generated 24563 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:42:50.171983 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:50.173216 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=38 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:50.174664 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 31 16:42:50.182057 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d182d3c8-d637-46a9-9512-b629098cb15f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:50.189541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d182d3c8-d637-46a9-9512-b629098cb15f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:50.190024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d182d3c8-d637-46a9-9512-b629098cb15f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:50.190458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d182d3c8-d637-46a9-9512-b629098cb15f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:50.213860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d182d3c8-d637-46a9-9512-b629098cb15f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 16:42:50.255470 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d182d3c8-d637-46a9-9512-b629098cb15f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action" status: 202 len: 0 microversion: 2.1 time: 0.084929 Oct 31 16:42:50.256006 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3788/7453] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:42:50 2022] POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:42:50.266005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:50.266728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:50.270270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:50.271082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:50.279037 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:50.279543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:50.280001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:50.280745 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:50.281227 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:50.281672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:50.475801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:50.484028 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a81e0f8e-4d49-42fd-a3b8-86741517cf9c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.222578 Oct 31 16:42:50.484603 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3666/7454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:50 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:51.512022 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:51.512755 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:51.519211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:51.519756 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:51.520226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:51.521051 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:51.521522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:51.521967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:51.700093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:51.708022 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-56224371-2fef-419f-8a0c-d39a489a39c0 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.202001 Oct 31 16:42:51.708643 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3789/7455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:51 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:52.730946 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:52.731564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:52.739373 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:52.739878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:52.740334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:52.741078 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:52.741553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:52.741997 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:52.903586 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:52.914929 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5a24f2fe-a572-4d01-898e-f947b012a253 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.187172 Oct 31 16:42:52.915903 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3667/7456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:52 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:53.939411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:53.940030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:53.947007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:53.947495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:53.947940 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:53.948641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:53.949213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:53.949690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:54.082059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:54.090717 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9eeddb9-f8e2-49cc-8061-a3c917d727ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.155201 Oct 31 16:42:54.091297 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3790/7457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:53 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:55.115389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:55.116015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:55.123502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:55.124029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:55.124479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:55.125225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:55.125694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:55.126131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:55.256245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:55.264564 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4a5b7f9d-5dbd-425c-9d18-96fc73275eb5 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.153079 Oct 31 16:42:55.265338 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3668/7458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:55 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:56.287443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:56.288063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:56.295490 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:56.295986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:56.296441 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:56.297154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:56.297621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:56.298055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:56.431309 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:56.439031 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5960524a-b518-49a3-b772-bcae0be1ae8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.155529 Oct 31 16:42:56.439605 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3791/7459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:56 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:57.463538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:57.464183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:57.471089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:57.471595 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:57.472056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:57.472809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:57.473295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:57.473746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:57.602640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:57.610358 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6493cd8c-6300-496d-851a-3be3af8338f1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.151427 Oct 31 16:42:57.610934 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3669/7460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:57 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:58.635285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:58.635905 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:58.643085 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:58.643598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:58.644037 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:58.644760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:58.645223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:58.645653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:58.781939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:58.790171 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ee213515-b2c0-4d10-8bdf-7e05a2257ec1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.159485 Oct 31 16:42:58.790748 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3792/7461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:58 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:59.813355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:59.813904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:59.821081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:59.821591 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:59.822049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:59.822796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:59.823272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:59.823718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:59.954996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:59.963020 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-88b51cba-4154-40a0-8fd2-a676be8e8522 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.153652 Oct 31 16:42:59.963583 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3670/7462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:59 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:00.986677 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:00.987323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:00.994457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:00.995188 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:00.995639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:00.996340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:00.996831 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:00.997265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:01.134764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:01.142803 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20797371-cf27-4a10-a021-97b25ffeeed4 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.160056 Oct 31 16:43:01.144198 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3793/7463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:00 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:02.168652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:02.169318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:02.176570 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:02.177115 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:02.177579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:02.178299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:02.178784 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:02.179238 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:02.316304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:02.324069 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-168c6e9b-00ec-40b0-a445-6eed71e8729d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.160222 Oct 31 16:43:02.324658 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3671/7464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:02 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:03.347897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:03.348546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:03.355425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:03.355909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:03.356341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:03.357059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:03.357516 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:03.357944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:03.487376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:03.495181 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bc431dca-75e5-4966-baa4-9491ae4a343a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.151178 Oct 31 16:43:03.495766 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3794/7465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:03 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:04.519268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:04.519819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:04.527025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:04.527526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:04.527979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:04.528685 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:04.529182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:04.529625 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:04.666577 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:04.674553 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f868a053-9769-4346-8f5a-0c2b249a4766 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1694 microversion: 2.1 time: 0.159310 Oct 31 16:43:04.675137 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3672/7466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:04 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:05.699377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:05.699937 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:05.706678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:05.707162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:05.707598 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:05.708289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:05.708775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:05.709205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:05.839822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:05.847635 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b627275-e814-463e-88ce-14eeab9a053f tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1671 microversion: 2.1 time: 0.152825 Oct 31 16:43:05.848223 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3795/7467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:05 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:06.944589 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:06.947421 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:06.954277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:06.954774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:06.955225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:06.955923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:06.956402 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:06.956883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:07.016546 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e83597f-f996-4559-8434-84900c00dc8b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action" status: 200 len: 35616 microversion: 2.1 time: 0.075679 Oct 31 16:43:07.017210 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3673/7468] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:43:06 2022] POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action => generated 35616 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 16:43:07.029378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b86c4e8-3365-41a4-aa08-186f2cea4354 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:07.037157 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b86c4e8-3365-41a4-aa08-186f2cea4354 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:07.037648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b86c4e8-3365-41a4-aa08-186f2cea4354 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:07.038088 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b86c4e8-3365-41a4-aa08-186f2cea4354 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:07.061404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b86c4e8-3365-41a4-aa08-186f2cea4354 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Going to try to start instance {{(pid=120625) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 16:43:07.102562 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b86c4e8-3365-41a4-aa08-186f2cea4354 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action" status: 202 len: 0 microversion: 2.1 time: 0.076037 Oct 31 16:43:07.103181 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3796/7469] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:43:07 2022] POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:43:07.112013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:07.112815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:07.120481 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:07.121000 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:07.121452 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:07.122155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:07.122629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:07.123067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:07.254152 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:07.262615 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a7e45b9c-8bd0-41a9-afb0-df65a76b98f2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1680 microversion: 2.1 time: 0.154848 Oct 31 16:43:07.263191 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3674/7470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:07 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:08.287122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:08.287833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:08.295835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:08.296260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:08.296718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:08.297422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:08.297890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:08.298323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:08.429564 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:08.437410 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31d01247-c338-4726-9dd8-32ea57ce3f89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1680 microversion: 2.1 time: 0.154558 Oct 31 16:43:08.437985 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3797/7471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:08 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:09.461786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:09.462414 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:09.469300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:09.469796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:09.470248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:09.470945 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:09.471415 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:09.471851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:09.604999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:09.612613 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dcb0380e-b1c3-4ef6-9e7b-018286518cdf tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1684 microversion: 2.1 time: 0.154831 Oct 31 16:43:09.613218 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3675/7472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:09 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:41.829617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:41.831721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:41.834212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=20 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:41.834872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:41.841272 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:41.841752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:41.842187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:41.842877 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:41.843333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:41.843760 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:41.918324 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9479e164-538e-45c8-9ec9-ef7b7aca9194 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action" status: 200 len: 60182 microversion: 2.1 time: 0.092513 Oct 31 16:43:41.919011 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3798/7473] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:43:41 2022] POST /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855/action => generated 60182 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 16:43:59.107463 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a9f0f1cf-82c2-4451-b71c-38034658f2a7 req-fb9a0ef1-df9a-46b1-8e89-77c18049ac84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61d1b1e-ebee-445c-8b8d-2c82efc56855", "tag": "2726eb3f-4272-48b0-a877-4a56482ddbf9"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:59.113304 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:59.113846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:59.116087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=20 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:59.116862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=58 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:59.119972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:59.120823 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:59.127355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9f0f1cf-82c2-4451-b71c-38034658f2a7 req-fb9a0ef1-df9a-46b1-8e89-77c18049ac84 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:59.127837 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9f0f1cf-82c2-4451-b71c-38034658f2a7 req-fb9a0ef1-df9a-46b1-8e89-77c18049ac84 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:59.128270 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a9f0f1cf-82c2-4451-b71c-38034658f2a7 req-fb9a0ef1-df9a-46b1-8e89-77c18049ac84 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:59.137675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:59.138188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:59.138906 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:59.139626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:59.140333 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:59.140807 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:59.143371 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a9f0f1cf-82c2-4451-b71c-38034658f2a7 req-fb9a0ef1-df9a-46b1-8e89-77c18049ac84 service nova] Creating event network-changed:2726eb3f-4272-48b0-a877-4a56482ddbf9 for instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 on n-h1-858383-17 Oct 31 16:43:59.148877 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a9f0f1cf-82c2-4451-b71c-38034658f2a7 req-fb9a0ef1-df9a-46b1-8e89-77c18049ac84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045274 Oct 31 16:43:59.149492 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3799/7474] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:43:59.168211 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:43:59.264003 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b7d4f88e-9bd2-4507-93da-28d01cdc9000 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 204 len: 0 microversion: 2.1 time: 0.165492 Oct 31 16:43:59.268523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3676/7475] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:43:59 2022] DELETE /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:43:59.273995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:59.274706 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:59.281642 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:59.282388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:59.282819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:59.283708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:59.284162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:59.284790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:59.441554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:59.449600 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-af5f7da1-0700-4b85-9166-98038fd9aef3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1690 microversion: 2.1 time: 0.180318 Oct 31 16:43:59.450322 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3800/7476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:59 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:44:00.474163 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:00.474831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:00.481903 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:00.482404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:00.482856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:00.483571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:00.484044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:00.484486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:00.684248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:00.692359 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9a9d19da-c523-4334-a226-a78a0ba8d67a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1690 microversion: 2.1 time: 0.222464 Oct 31 16:44:00.693222 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3677/7477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:00 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:01.581952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d30a1e01-f525-458c-af22-c33189dc36b6 req-5de47db6-2d1d-4cf5-9569-92d2a794aa65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61d1b1e-ebee-445c-8b8d-2c82efc56855", "name": "network-vif-deleted", "tag": "2726eb3f-4272-48b0-a877-4a56482ddbf9"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:01.591907 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d30a1e01-f525-458c-af22-c33189dc36b6 req-5de47db6-2d1d-4cf5-9569-92d2a794aa65 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:01.592385 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d30a1e01-f525-458c-af22-c33189dc36b6 req-5de47db6-2d1d-4cf5-9569-92d2a794aa65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:01.592850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d30a1e01-f525-458c-af22-c33189dc36b6 req-5de47db6-2d1d-4cf5-9569-92d2a794aa65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:01.607275 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d30a1e01-f525-458c-af22-c33189dc36b6 req-5de47db6-2d1d-4cf5-9569-92d2a794aa65 service nova] Creating event network-vif-deleted:2726eb3f-4272-48b0-a877-4a56482ddbf9 for instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 on n-h1-858383-17 Oct 31 16:44:01.612871 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d30a1e01-f525-458c-af22-c33189dc36b6 req-5de47db6-2d1d-4cf5-9569-92d2a794aa65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094669 Oct 31 16:44:01.613597 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3801/7478] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:01.716129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:01.716792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:01.723567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:01.724072 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:01.724531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:01.725282 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:01.725761 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:01.726205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:01.760188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:01.760639 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:01.761123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:01.761588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lazy-loading 'fault' on Instance uuid f61d1b1e-ebee-445c-8b8d-2c82efc56855 {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:44:01.803391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:01.811574 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d00d852a-c3b2-4ff0-9d78-ee6f35b884b9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 200 len: 1357 microversion: 2.1 time: 0.099314 Oct 31 16:44:01.812157 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3678/7479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:01 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:02.838122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:02.838833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: f61d1b1e-ebee-445c-8b8d-2c82efc56855] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:02.846008 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:02.846503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:02.846948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:02.847651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:02.848125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:02.848561 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:02.862840 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] HTTP exception thrown: Instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 could not be found. Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Request method failure captured: Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 HTTP/1.1 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_lg8gZMCixr5nz_l8lhxLEC3_HrXN4pkhguQDzo3XeKSjKClzeFuvyeE7qodqCgtU_OX96_rTCAiyNH1i8RQbLnXvuFf1zczO7LYA0WFLsXHxRBPyizMT_oNP_Z4r1yl3VePn_odNWDIV1W1IjF_j1GA77HtU-cDyff1D9g74ZKQ4E Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/027b52829fc44415b62fd71640190fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_027b52829fc44415b62fd71640190fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 119e5eab6b8f4080b4cd95f807b9ef23 Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 could not be found. Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'f61d1b1e-ebee-445c-8b8d-2c82efc56855'} Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 could not be found. Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 could not be found. Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:44:02.864440 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 could not be found. Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Returning 404 to user: Instance f61d1b1e-ebee-445c-8b8d-2c82efc56855 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28d52973-f71e-409c-bf48-4c5f0f88f795 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855" status: 404 len: 111 microversion: 2.1 time: 0.032784 Oct 31 16:44:02.869629 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3802/7480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:02 2022] GET /compute/v2.1/servers/f61d1b1e-ebee-445c-8b8d-2c82efc56855 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:44:05.910553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3ebea931-4138-4e43-9bf3-97afc7e1c5ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '.version_select at 0x7f5ca12af670>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:05.915126 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ebea931-4138-4e43-9bf3-97afc7e1c5ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [e6149452-7858-4595-94fa-9010c8426312] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:44:06.923561 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [None req-3ebea931-4138-4e43-9bf3-97afc7e1c5ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [e6149452-7858-4595-94fa-9010c8426312] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52290. Oct 31 16:44:06.944262 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3ebea931-4138-4e43-9bf3-97afc7e1c5ef tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1466684500" status: 202 len: 0 microversion: 2.1 time: 1.037724 Oct 31 16:44:06.944872 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3679/7481] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Oct 31 16:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1466684500 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:44:06.978639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-83138f58-4c42-4d21-a4aa-dea8ba1fd127 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: .version_select at 0x7f5ca14a04c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2080458993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOneh1GN7ADyQuP3RWb43/s8VAy99awy/lIe4WuiFAXpXvfE+4FF3WyD74ac1yM0R5ZKw0sT6WpVzCzAdBrKgymWWA19ldPjoq+QNZtAgqsgNIBHGW5THqkk4+BbEJjSHA=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:06.995491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-83138f58-4c42-4d21-a4aa-dea8ba1fd127 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:44:07.000717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-83138f58-4c42-4d21-a4aa-dea8ba1fd127 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:44:07.014617 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83138f58-4c42-4d21-a4aa-dea8ba1fd127 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [b1ad4042-2481-4b13-86d4-01577420aa37] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:44:08.020526 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [None req-83138f58-4c42-4d21-a4aa-dea8ba1fd127 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [b1ad4042-2481-4b13-86d4-01577420aa37] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52294. Oct 31 16:44:08.035530 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-83138f58-4c42-4d21-a4aa-dea8ba1fd127 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.061425 Oct 31 16:44:08.036131 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3803/7482] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:44:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:13.789760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:13.795949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-222831559", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "networks": [{"uuid": "dbd586a6-c566-4020-8485-d05529c5ef4b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2080458993", "security_groups": [{"name": "tempest-secgroup-smoke-540262619"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:13.929328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] validate_networks() for [('dbd586a6-c566-4020-8485-d05529c5ef4b', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:44:14.428534 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:44:14.428998 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:44:14.430274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:44:14.430942 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:44:14.431396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:44:14.441672 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:14.442173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:14.442907 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:14.443651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:14.444123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:14.444562 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:14.462811 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:44:14.468300 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Getting quotas for user 119e5eab6b8f4080b4cd95f807b9ef23 and project 027b52829fc44415b62fd71640190fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:44:14.482337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:44:14.485288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:44:14.535432 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [225ac707-913e-491c-8ecc-f0309407a598] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:44:15.545170 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [225ac707-913e-491c-8ecc-f0309407a598] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52342. Oct 31 16:44:15.549788 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b9fcf439-73a8-496b-9682-eed2ad66057c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.762578 Oct 31 16:44:15.550444 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3680/7483] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:44:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:44:15.560200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:15.566588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f752ceaa-eb65-4779-a32a-5dd43aa4adf1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:15.567667 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f752ceaa-eb65-4779-a32a-5dd43aa4adf1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:15.652528 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f752ceaa-eb65-4779-a32a-5dd43aa4adf1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:15.663449 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f752ceaa-eb65-4779-a32a-5dd43aa4adf1 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1266 microversion: 2.1 time: 0.104725 Oct 31 16:44:15.677868 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3804/7484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:15 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:16.691098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:16.691716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:16.707561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:16.708075 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:16.708552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:16.709318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:16.709996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:16.710722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:16.787007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:16.796977 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e352fa5c-e82d-46a6-bd5d-f83eb401e6eb tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1326 microversion: 2.1 time: 0.111322 Oct 31 16:44:16.798129 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3681/7485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:16 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:17.821083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:17.822362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:17.830214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:17.831134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:17.832234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:17.833186 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:17.833819 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:17.834558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:17.982211 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:17.990705 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f9c38cfa-574d-4138-b481-a0eb1db74da7 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.173555 Oct 31 16:44:17.991317 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3805/7486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:17 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:18.262139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-62213cbb-e576-4aef-bf30-75f8ce9c2bd8 req-689ec982-a601-4fdf-8d38-28049386ab65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81aeaf5-7278-498b-b292-47ba52600f7e", "tag": "8db5843e-843a-4fe9-a024-24378bdd342e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:18.274981 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-62213cbb-e576-4aef-bf30-75f8ce9c2bd8 req-689ec982-a601-4fdf-8d38-28049386ab65 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:18.275576 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-62213cbb-e576-4aef-bf30-75f8ce9c2bd8 req-689ec982-a601-4fdf-8d38-28049386ab65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:18.276108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-62213cbb-e576-4aef-bf30-75f8ce9c2bd8 req-689ec982-a601-4fdf-8d38-28049386ab65 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:18.287182 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-62213cbb-e576-4aef-bf30-75f8ce9c2bd8 req-689ec982-a601-4fdf-8d38-28049386ab65 service nova] Creating event network-changed:8db5843e-843a-4fe9-a024-24378bdd342e for instance a81aeaf5-7278-498b-b292-47ba52600f7e on n-h1-858383-17 Oct 31 16:44:18.293501 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-62213cbb-e576-4aef-bf30-75f8ce9c2bd8 req-689ec982-a601-4fdf-8d38-28049386ab65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036856 Oct 31 16:44:18.294328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3682/7487] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:19.015886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:19.016510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:19.024128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:19.024617 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:19.025086 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:19.025783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:19.026251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:19.026682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:19.159715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:19.167538 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c245c522-8250-44de-90b0-e9789204b890 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.155948 Oct 31 16:44:19.168119 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3806/7488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:19 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:20.191260 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:20.191974 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:20.199675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:20.200172 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:20.200656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:20.201386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:20.201856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:20.202298 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:20.332800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:20.340556 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-571079af-9008-4152-8dba-104dd65f1b1b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.153575 Oct 31 16:44:20.341151 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3683/7489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:20 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:21.363495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:21.364110 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:21.371145 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:21.371663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:21.372104 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:21.372936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:21.373402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:21.373832 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:21.509342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:21.518016 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-01d20d19-aef0-450e-90f4-a0c9d786e1ad tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.158457 Oct 31 16:44:21.518646 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3807/7490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:21 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:22.542062 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:22.542697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:22.549494 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:22.549986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:22.550515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:22.551221 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:22.551688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:22.552127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:22.692173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:22.700507 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d1f8e85a-094f-4c7b-ad91-868e501d2d1d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.162723 Oct 31 16:44:22.701116 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3684/7491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:22 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:23.724655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:23.725204 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:23.733378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:23.733904 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:23.734340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:23.735045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:23.735537 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:23.735967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:23.869637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:23.877387 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b7b8a376-2c8f-4c31-8a95-f3e89d843a6d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.156695 Oct 31 16:44:23.877960 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3808/7492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:23 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:24.747952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:24.748754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:24.802156 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-acda3040-f1e5-4517-bce6-56bcedfcfa5b req-f77d3ed3-84fb-458e-9eb9-28338a44bc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81aeaf5-7278-498b-b292-47ba52600f7e", "name": "network-vif-plugged", "status": "completed", "tag": "8db5843e-843a-4fe9-a024-24378bdd342e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:24.811908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-acda3040-f1e5-4517-bce6-56bcedfcfa5b req-f77d3ed3-84fb-458e-9eb9-28338a44bc23 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:24.812397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-acda3040-f1e5-4517-bce6-56bcedfcfa5b req-f77d3ed3-84fb-458e-9eb9-28338a44bc23 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:24.812868 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-acda3040-f1e5-4517-bce6-56bcedfcfa5b req-f77d3ed3-84fb-458e-9eb9-28338a44bc23 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:24.826914 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-acda3040-f1e5-4517-bce6-56bcedfcfa5b req-f77d3ed3-84fb-458e-9eb9-28338a44bc23 service nova] Creating event network-vif-plugged:8db5843e-843a-4fe9-a024-24378bdd342e for instance a81aeaf5-7278-498b-b292-47ba52600f7e on n-h1-858383-17 Oct 31 16:44:24.831861 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-acda3040-f1e5-4517-bce6-56bcedfcfa5b req-f77d3ed3-84fb-458e-9eb9-28338a44bc23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089282 Oct 31 16:44:24.832454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3685/7493] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:24.901721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:24.902333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:24.909502 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:24.909988 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:24.910437 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:24.911116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:24.911572 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:24.912011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:25.052582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:25.061333 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c3ea3ba-51af-4441-aefe-1efbdd7f6da9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.164038 Oct 31 16:44:25.061920 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3809/7494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:24 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:26.086791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:26.087509 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:26.093736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:26.094235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:26.094690 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:26.095389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:26.095864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:26.096311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:26.229021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:26.236649 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-df9377fb-5e27-44ba-ac8c-adcb3a2ed443 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1391 microversion: 2.1 time: 0.155545 Oct 31 16:44:26.239032 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3686/7495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:26 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:27.262660 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:27.263203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:27.265444 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:27.271434 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.271921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.272362 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.273833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.274305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.274734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.404198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:27.411970 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b4eb6c8-9b15-456d-bd1a-fd59d1983e89 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1563 microversion: 2.1 time: 0.153360 Oct 31 16:44:27.412542 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3810/7496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:27 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:27.435266 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:27.435898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:27.442754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.443259 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.443716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.444468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.445009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.445488 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.579177 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:27.587574 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-40e27d0f-4039-47f7-a1fc-aad72aabe2a9 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1563 microversion: 2.1 time: 0.156153 Oct 31 16:44:27.588150 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3687/7497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:27 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:29.144277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:29.152090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:29.156091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:29.161523 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:29.162100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:29.162637 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:29.163478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:29.164010 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:29.164504 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:29.213809 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-a0d4ad9c-b15e-4243-8b63-f7fab60e1ad8 req-b1c9254c-57a2-4506-9fa3-fa4e2f897331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81aeaf5-7278-498b-b292-47ba52600f7e", "tag": "8db5843e-843a-4fe9-a024-24378bdd342e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:29.219225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:29.225541 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a0d4ad9c-b15e-4243-8b63-f7fab60e1ad8 req-b1c9254c-57a2-4506-9fa3-fa4e2f897331 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:29.226272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a0d4ad9c-b15e-4243-8b63-f7fab60e1ad8 req-b1c9254c-57a2-4506-9fa3-fa4e2f897331 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:29.226792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-a0d4ad9c-b15e-4243-8b63-f7fab60e1ad8 req-b1c9254c-57a2-4506-9fa3-fa4e2f897331 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:29.239478 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-a0d4ad9c-b15e-4243-8b63-f7fab60e1ad8 req-b1c9254c-57a2-4506-9fa3-fa4e2f897331 service nova] Creating event network-changed:8db5843e-843a-4fe9-a024-24378bdd342e for instance a81aeaf5-7278-498b-b292-47ba52600f7e on n-h1-858383-17 Oct 31 16:44:29.245874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-a0d4ad9c-b15e-4243-8b63-f7fab60e1ad8 req-b1c9254c-57a2-4506-9fa3-fa4e2f897331 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099696 Oct 31 16:44:29.247409 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3688/7498] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:29.317865 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:29.327018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-04efc806-6f7f-4a3c-87f3-306cbc113090 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1563 microversion: 2.1 time: 0.186672 Oct 31 16:44:29.327609 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3811/7499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:29 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:02.610873 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:02.613247 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:02.616661 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=38 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:02.623846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:02.624418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:02.624911 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:02.625629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:02.626110 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:02.626561 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:02.697343 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-aef2d6ef-10ce-4d60-9fe4-002692b6bb0a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action" status: 200 len: 24573 microversion: 2.1 time: 0.091234 Oct 31 16:45:02.697997 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3689/7500] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:45:02 2022] POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action => generated 24573 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:45:33.157270 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:45:33.157755 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:45:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action (ip 10.222.0.48) !!! Oct 31 16:45:33.159221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:33.159960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=42 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:33.165520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:33.166096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:33.174526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:33.175015 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:33.175459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:33.176163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:33.176624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:33.177080 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:33.201602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lazy-loading 'flavor' on Instance uuid a81aeaf5-7278-498b-b292-47ba52600f7e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:45:33.265701 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66d85074-2959-40e9-8651-f9f09843680b tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action" status: 202 len: 0 microversion: 2.1 time: 0.110267 Oct 31 16:45:33.266320 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3812/7501] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:45:33 2022] POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:45:33.275334 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:33.276109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:33.278670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:33.279365 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:33.285539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:33.286040 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:33.286487 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:33.287228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:33.287694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:33.288851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:33.421815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:33.430561 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-844a84f1-837b-4f31-8fb0-be51e0997e4e tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1689 microversion: 2.1 time: 0.159631 Oct 31 16:45:33.431140 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3690/7502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:33 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:34.457102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:34.457804 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:34.464006 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:34.464487 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:34.464957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:34.465648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:34.466105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:34.466532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:34.602246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:34.609998 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86927fda-e531-4098-86a7-acac843f8588 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1689 microversion: 2.1 time: 0.158270 Oct 31 16:45:34.610566 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3813/7503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:34 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:35.634605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:35.635233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:35.643318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:35.643817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:35.644270 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:35.644996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:35.645471 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:35.645915 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:35.775236 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:35.783008 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-34230263-9f51-44ec-9245-5f42f53b4f7c tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1672 microversion: 2.1 time: 0.153072 Oct 31 16:45:35.783582 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3691/7504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:35 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:45:36.878952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:36.881301 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:36.888359 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:36.888890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:36.889599 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:36.890297 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:36.890759 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:36.891187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:36.953134 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a483ae89-b603-4b6a-95b2-e85249417d1a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action" status: 200 len: 36622 microversion: 2.1 time: 0.077923 Oct 31 16:45:36.954037 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3814/7505] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:45:36 2022] POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action => generated 36622 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:45:36.966306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:36.966854 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:36.973821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:36.974329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:36.974787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:36.976113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:36.976607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:36.977085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:37.046783 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-fd248c08-0d58-4712-85c8-7f25366c6533 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action" status: 202 len: 0 microversion: 2.1 time: 0.084193 Oct 31 16:45:37.047420 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3692/7506] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:45:36 2022] POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:45:37.056386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:37.057209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:37.064422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:37.065047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:37.065499 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:37.066212 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:37.066674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:37.067108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:37.212350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:37.220293 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e77cb214-f66e-454b-b721-4b5a4548911a tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1678 microversion: 2.1 time: 0.168292 Oct 31 16:45:37.221268 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3815/7507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:37 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:38.244822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:38.245535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:38.251656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:38.252150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:38.252603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:38.253327 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:38.253799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:38.254237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:38.383330 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:38.391217 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-03da97ac-70b2-41a2-a8dd-87748adc248d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1678 microversion: 2.1 time: 0.151536 Oct 31 16:45:38.391790 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3693/7508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:38 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:39.414402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:39.415053 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:39.421936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:39.422416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:39.422848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:39.423536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:39.423992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:39.424414 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:39.559602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:39.567400 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8cc542a-4e7c-406b-937f-092c8c4f0b4d tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1681 microversion: 2.1 time: 0.157100 Oct 31 16:45:39.567971 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3816/7509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:39 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:39.682257 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:39.684581 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:39.691600 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:39.692109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:39.692571 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:39.693316 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:39.693800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:39.694249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:39.756864 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ae9d71ef-a742-4329-8e02-3b1efc91e4a6 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action" status: 200 len: 36622 microversion: 2.1 time: 0.079546 Oct 31 16:45:39.757710 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3694/7510] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:45:39 2022] POST /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e/action => generated 36622 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:45:41.108485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:41.109133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:41.111559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-0c38a96e-9e54-4940-8066-707a9103b18e req-48b48576-acda-47ba-8322-6f928e3b167a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81aeaf5-7278-498b-b292-47ba52600f7e", "tag": "8db5843e-843a-4fe9-a024-24378bdd342e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:41.116447 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:41.116976 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:41.117411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:41.118394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:41.118855 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:41.119350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:41.123132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c38a96e-9e54-4940-8066-707a9103b18e req-48b48576-acda-47ba-8322-6f928e3b167a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:41.123633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c38a96e-9e54-4940-8066-707a9103b18e req-48b48576-acda-47ba-8322-6f928e3b167a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:41.124079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-0c38a96e-9e54-4940-8066-707a9103b18e req-48b48576-acda-47ba-8322-6f928e3b167a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:41.136259 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-0c38a96e-9e54-4940-8066-707a9103b18e req-48b48576-acda-47ba-8322-6f928e3b167a service nova] Creating event network-changed:8db5843e-843a-4fe9-a024-24378bdd342e for instance a81aeaf5-7278-498b-b292-47ba52600f7e on n-h1-858383-17 Oct 31 16:45:41.142200 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-0c38a96e-9e54-4940-8066-707a9103b18e req-48b48576-acda-47ba-8322-6f928e3b167a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034238 Oct 31 16:45:41.142656 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3695/7511] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:45:41.148805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:45:41.234065 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-781ba8a5-a713-41af-9edc-8b04fea68791 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 204 len: 0 microversion: 2.1 time: 0.129306 Oct 31 16:45:41.238551 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3817/7512] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:45:41 2022] DELETE /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:45:41.245006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:41.245733 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:41.252171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:41.252681 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:41.253216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:41.253938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:41.254416 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:41.254858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:41.397814 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:41.406277 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9dcafb74-655e-4e5e-83e8-66921532ba31 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1687 microversion: 2.1 time: 0.166340 Oct 31 16:45:41.406876 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3696/7513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:41 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:45:42.432194 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:42.432916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:42.439648 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:42.440123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:42.440553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:42.441260 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:42.441712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:42.442134 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:42.576473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:42.584457 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-12f46461-83c5-4e8d-a79a-c5cfb2a7fcc8 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1687 microversion: 2.1 time: 0.156713 Oct 31 16:45:42.585077 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3818/7514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:42 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:43.475719 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-389b9686-9e22-47d9-bcd2-8650d4bd1f5e req-705d99c5-524a-4e1d-a0bb-ad4234952779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81aeaf5-7278-498b-b292-47ba52600f7e", "name": "network-vif-deleted", "tag": "8db5843e-843a-4fe9-a024-24378bdd342e"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:43.487492 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-389b9686-9e22-47d9-bcd2-8650d4bd1f5e req-705d99c5-524a-4e1d-a0bb-ad4234952779 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:43.487990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-389b9686-9e22-47d9-bcd2-8650d4bd1f5e req-705d99c5-524a-4e1d-a0bb-ad4234952779 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:43.488444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-389b9686-9e22-47d9-bcd2-8650d4bd1f5e req-705d99c5-524a-4e1d-a0bb-ad4234952779 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:43.500061 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-389b9686-9e22-47d9-bcd2-8650d4bd1f5e req-705d99c5-524a-4e1d-a0bb-ad4234952779 service nova] Creating event network-vif-deleted:8db5843e-843a-4fe9-a024-24378bdd342e for instance a81aeaf5-7278-498b-b292-47ba52600f7e on n-h1-858383-17 Oct 31 16:45:43.505624 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-389b9686-9e22-47d9-bcd2-8650d4bd1f5e req-705d99c5-524a-4e1d-a0bb-ad4234952779 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Oct 31 16:45:43.506530 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3697/7515] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:45:43.609090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:43.610140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:43.619032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:43.619525 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:43.619959 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:43.620682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:43.621159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:43.621582 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:43.655725 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:43.656210 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:43.656653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:43.657132 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lazy-loading 'fault' on Instance uuid a81aeaf5-7278-498b-b292-47ba52600f7e {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:45:43.700231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119e5eab6b8f4080b4cd95f807b9ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027b52829fc44415b62fd71640190fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:45:43.708187 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a8e5e5c-5b09-4f4b-924f-87a8bc9b7ce3 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 200 len: 1356 microversion: 2.1 time: 0.102954 Oct 31 16:45:43.708777 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3819/7516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:43 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:45:44.734299 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:44.735021 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] [instance: a81aeaf5-7278-498b-b292-47ba52600f7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:45:44.741511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:44.742107 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:44.742575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:44.743294 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:45:44.743767 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:45:44.744210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:45:44.758384 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] HTTP exception thrown: Instance a81aeaf5-7278-498b-b292-47ba52600f7e could not be found. Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Request method failure captured: Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e HTTP/1.1 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_lg8gZMCixr5nz_l8lhxLEC3_HrXN4pkhguQDzo3XeKSjKClzeFuvyeE7qodqCgtU_OX96_rTCAiyNH1i8RQbLnXvuFf1zczO7LYA0WFLsXHxRBPyizMT_oNP_Z4r1yl3VePn_odNWDIV1W1IjF_j1GA77HtU-cDyff1D9g74ZKQ4E Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/027b52829fc44415b62fd71640190fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_027b52829fc44415b62fd71640190fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/027b52829fc44415b62fd71640190fb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 027b52829fc44415b62fd71640190fb6 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-989371638 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 119e5eab6b8f4080b4cd95f807b9ef23 Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestNetworkAdvancedServerOps-989371638-project Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance a81aeaf5-7278-498b-b292-47ba52600f7e could not be found. Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'a81aeaf5-7278-498b-b292-47ba52600f7e'} Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81aeaf5-7278-498b-b292-47ba52600f7e could not be found. Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81aeaf5-7278-498b-b292-47ba52600f7e could not be found. Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:45:44.760068 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81aeaf5-7278-498b-b292-47ba52600f7e could not be found. Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Returning 404 to user: Instance a81aeaf5-7278-498b-b292-47ba52600f7e could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-af6c0f39-9228-416c-a1f1-3ca07e8bcd66 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e" status: 404 len: 111 microversion: 2.1 time: 0.032451 Oct 31 16:45:44.765887 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3698/7517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:45:44 2022] GET /compute/v2.1/servers/a81aeaf5-7278-498b-b292-47ba52600f7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:45:47.932420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b021865a-a801-48c5-a294-e12a2df32ee2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] Calling method '.version_select at 0x7f5ca12af9d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:45:47.963400 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b021865a-a801-48c5-a294-e12a2df32ee2 tempest-TestNetworkAdvancedServerOps-989371638 tempest-TestNetworkAdvancedServerOps-989371638-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2080458993" status: 202 len: 0 microversion: 2.1 time: 0.035334 Oct 31 16:45:47.964138 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3820/7518] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Oct 31 16:45:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2080458993 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:45:59.079846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=18 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:59.080728 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:45:59.269991 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-813822b5-1999-4286-8770-e79189382052 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'create', calling method: .version_select at 0x7f5ca0f67670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1693771012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQ6eGstizBkQFiVv4jSHIEP8f9OQEr+lrf6RbDm6aDOdzmQ5kJQ1OY2gE0vBEdOnJ/YyknADBh0g6Oo0r3Nl+0mCN8KrbYM0kEpPn1QybbrjmMcTHLiMCGHK2lhWAbwVw=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:45:59.285714 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-813822b5-1999-4286-8770-e79189382052 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for project de1779df61814c8f91d00b5082e8f615. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:45:59.292961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-813822b5-1999-4286-8770-e79189382052 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for user 1c437228a13a48fb97d17c2a0c55a504 and project de1779df61814c8f91d00b5082e8f615. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:45:59.318427 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-813822b5-1999-4286-8770-e79189382052 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244043 Oct 31 16:45:59.319961 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3699/7519] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:45:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:46:00.447139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1367569172", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1693771012", "security_groups": [{"name": "tempest-secgroup-smoke-1000368461"}], "networks": [{"uuid": "be7bfea7-1e0d-43e8-8c88-2110057af049"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:00.458588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:00.459416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:00.567029 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] validate_networks() for [('be7bfea7-1e0d-43e8-8c88-2110057af049', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:46:01.046038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:46:01.046465 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:46:01.047162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:46:01.047580 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:46:01.047991 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:46:01.057020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:01.057506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:01.057939 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:01.058659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:01.059113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:01.059541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:01.076336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for project de1779df61814c8f91d00b5082e8f615. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:46:01.081546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for user 1c437228a13a48fb97d17c2a0c55a504 and project de1779df61814c8f91d00b5082e8f615. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:46:01.094655 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:46:01.096984 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:46:01.146033 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cad82793-3cc5-4a43-bd60-92fa5852d589 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703034 Oct 31 16:46:01.146712 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3821/7520] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:46:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:46:01.159688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eccc30d2-ba4b-491d-a7c0-15064d1e8328 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:01.163734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eccc30d2-ba4b-491d-a7c0-15064d1e8328 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:01.231025 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eccc30d2-ba4b-491d-a7c0-15064d1e8328 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:01.238955 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eccc30d2-ba4b-491d-a7c0-15064d1e8328 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1247 microversion: 2.1 time: 0.084023 Oct 31 16:46:01.239562 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3700/7521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:01 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:02.262799 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:02.264116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:02.271179 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:02.272214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:02.272748 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:02.273649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:02.275021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:02.275519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:02.352090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:02.363736 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d202c31-ffce-4dfb-ae39-da6bd99085e7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1307 microversion: 2.1 time: 0.104271 Oct 31 16:46:02.364592 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3822/7522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:02 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:46:03.388676 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:03.389602 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:03.398653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:03.399096 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:03.399643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:03.400281 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:03.400790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:03.401619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:03.562547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:03.571966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ba9ffd74-0da3-4b06-9314-681007b07b0e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.187498 Oct 31 16:46:03.572635 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3701/7523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:03 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:03.824529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d38a9184-3822-420b-8404-6fc34580b6a8 req-8286e064-6884-4dc7-bbc1-63159a92171e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:03.835611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d38a9184-3822-420b-8404-6fc34580b6a8 req-8286e064-6884-4dc7-bbc1-63159a92171e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:03.836416 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d38a9184-3822-420b-8404-6fc34580b6a8 req-8286e064-6884-4dc7-bbc1-63159a92171e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:03.837081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d38a9184-3822-420b-8404-6fc34580b6a8 req-8286e064-6884-4dc7-bbc1-63159a92171e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:03.857018 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d38a9184-3822-420b-8404-6fc34580b6a8 req-8286e064-6884-4dc7-bbc1-63159a92171e service nova] Creating event network-changed:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:46:03.863236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-d38a9184-3822-420b-8404-6fc34580b6a8 req-8286e064-6884-4dc7-bbc1-63159a92171e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043553 Oct 31 16:46:03.864070 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3823/7524] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:46:04.595440 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:04.596071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:04.604118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:04.604614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:04.605089 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:04.605800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:04.606265 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:04.606702 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:04.747228 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:04.754876 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5412bf33-7bba-43f5-a12a-09af593105d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.163333 Oct 31 16:46:04.755452 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3702/7525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:04 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:05.779861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:05.780505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:05.787620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:05.788114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:05.788556 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:05.789298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:05.789763 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:05.790197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:05.921357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:05.929143 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5df1af7a-9e86-4082-8665-cf1e15bbf796 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.153610 Oct 31 16:46:05.929722 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3824/7526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:05 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:06.952839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:06.953504 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:06.960987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:06.961490 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:06.961948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:06.962656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:06.963130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:06.963574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:07.095007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:07.103225 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf88e833-2d92-491d-8d30-74e73d66360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.154494 Oct 31 16:46:07.103807 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3703/7527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:06 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:08.125159 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:08.125825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:08.132803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:08.133291 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:08.133735 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:08.134433 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:08.134903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:08.135334 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:08.270311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:08.278074 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8c4b4a6-d9bc-4fe3-99e8-c8ed397edfb7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.156866 Oct 31 16:46:08.278654 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3825/7528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:08 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:09.302143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:09.302697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:09.311006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:09.311517 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:09.311970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:09.312720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:09.313203 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:09.313642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:09.453923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:09.461898 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2583ea79-0621-4620-8674-a1e72ed428c1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.164250 Oct 31 16:46:09.462482 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3704/7529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:09 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:10.484493 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:10.485252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:10.493163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:10.493680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:10.494114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:10.494813 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:10.495326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:10.495886 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:10.637137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:10.645071 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3828e56e-d849-48c4-99c8-41156be4738e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.164476 Oct 31 16:46:10.645647 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3826/7530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:10 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:11.253457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-870c8ba9-0041-495c-8608-8e765d61c7fb req-6a5a0de6-1727-4857-8234-19fd5b56d524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "name": "network-vif-plugged", "status": "completed", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:11.259633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:11.267826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-870c8ba9-0041-495c-8608-8e765d61c7fb req-6a5a0de6-1727-4857-8234-19fd5b56d524 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:11.268322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-870c8ba9-0041-495c-8608-8e765d61c7fb req-6a5a0de6-1727-4857-8234-19fd5b56d524 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:11.268787 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-870c8ba9-0041-495c-8608-8e765d61c7fb req-6a5a0de6-1727-4857-8234-19fd5b56d524 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:11.279904 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-870c8ba9-0041-495c-8608-8e765d61c7fb req-6a5a0de6-1727-4857-8234-19fd5b56d524 service nova] Creating event network-vif-plugged:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:46:11.285559 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-870c8ba9-0041-495c-8608-8e765d61c7fb req-6a5a0de6-1727-4857-8234-19fd5b56d524 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035470 Oct 31 16:46:11.286138 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3705/7531] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:46:11.669406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:11.669972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:11.671977 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:11.672861 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:11.679821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:11.680310 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:11.680782 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:11.681488 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:11.681953 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:11.682422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:11.813047 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:11.821385 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1980795a-8dc3-46f0-a0dd-3da2898a270b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1373 microversion: 2.1 time: 0.156054 Oct 31 16:46:11.821969 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3827/7532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:11 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:12.845182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:12.845894 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:12.853565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:12.854059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:12.854513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:12.855226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:12.855693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:12.856135 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:12.993693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:13.001342 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-18384e6e-b406-4e26-8a5c-f5a34b13ab23 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1557 microversion: 2.1 time: 0.160590 Oct 31 16:46:13.001925 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3706/7533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:12 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:13.024191 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:13.025509 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:13.032548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:13.033075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:13.033521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:13.034221 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:13.034683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:13.035116 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:13.170758 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:13.179540 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c146e0c0-e30e-4a64-aa27-4959aa30b20c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1557 microversion: 2.1 time: 0.159552 Oct 31 16:46:13.180461 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3828/7534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:13 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:15.145069 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-722aa8a6-6830-42f9-9a13-c18ddec0588b req-ca1de3e1-17f5-4f0f-b604-2c4720eb7a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:15.156348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-722aa8a6-6830-42f9-9a13-c18ddec0588b req-ca1de3e1-17f5-4f0f-b604-2c4720eb7a67 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:15.156959 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-722aa8a6-6830-42f9-9a13-c18ddec0588b req-ca1de3e1-17f5-4f0f-b604-2c4720eb7a67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:15.157530 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-722aa8a6-6830-42f9-9a13-c18ddec0588b req-ca1de3e1-17f5-4f0f-b604-2c4720eb7a67 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:15.169764 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-722aa8a6-6830-42f9-9a13-c18ddec0588b req-ca1de3e1-17f5-4f0f-b604-2c4720eb7a67 service nova] Creating event network-changed:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:46:15.175190 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-722aa8a6-6830-42f9-9a13-c18ddec0588b req-ca1de3e1-17f5-4f0f-b604-2c4720eb7a67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033844 Oct 31 16:46:15.175893 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3707/7535] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:48:41.578943 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:48:41.579991 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:48:41.580548 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:41.581303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=40 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:41.582658 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:48:41.582785 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action (ip 10.222.0.48) !!! Oct 31 16:48:41.585202 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:48:41.585335 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action (ip 10.222.0.48) !!! Oct 31 16:48:41.586439 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:48:41.586563 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action (ip 10.222.0.48) !!! Oct 31 16:48:41.592844 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:41.593390 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:41.603989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:41.604426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:41.605394 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:41.606107 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:41.606567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:41.607024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:41.632915 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lazy-loading 'flavor' on Instance uuid 8458c9b8-c37b-4272-b736-a8d0664e52b5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:48:42.004128 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d9b6cc5-3585-4be8-99e3-1cd2546f133b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action" status: 202 len: 0 microversion: 2.1 time: 0.426918 Oct 31 16:48:42.004754 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3829/7536] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:48:41 2022] POST /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:48:42.011097 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:48:42.012510 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:48:42.013144 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:42.014077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=34 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:42.015260 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:48:42.015407 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:48:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 (ip 10.222.0.48) !!! Oct 31 16:48:42.016509 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:48:42.016758 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:48:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 (ip 10.222.0.48) !!! Oct 31 16:48:42.017533 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:48:42.017686 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:48:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 (ip 10.222.0.48) !!! Oct 31 16:48:42.024842 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:42.025555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:42.035411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:42.035905 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:42.036355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:42.037098 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:42.037569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:42.038006 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:42.226253 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:42.234036 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-865f9f61-d576-4879-ba08-d378dc58fe4a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.224791 Oct 31 16:48:42.234634 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3708/7537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:42 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:43.260300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:43.261033 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:43.270027 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:43.270513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:43.270948 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:43.271644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:43.272105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:43.272532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:43.277414 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52726. Oct 31 16:48:43.290103 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52724. Oct 31 16:48:43.409007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:43.416804 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dd012f18-a78e-405e-9c8f-e8fb3d98263e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.162256 Oct 31 16:48:43.418002 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3830/7538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:43 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:44.440839 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:44.441699 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:44.454766 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52732. Oct 31 16:48:44.461630 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52730. Oct 31 16:48:44.465908 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:44.466412 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:44.466863 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:44.467579 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:44.468052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:44.468502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:44.601740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:44.609946 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-5416911c-6ed5-4fda-9474-f39a67103848 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.173675 Oct 31 16:48:44.610521 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3709/7539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:44 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:45.633972 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:45.634585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:45.641892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:45.642378 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:45.642817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:45.643532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:45.643966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:45.644393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:45.775926 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:45.784113 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-067d28a8-5b2b-4f72-b9c0-ef51af61c39b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.154075 Oct 31 16:48:45.784687 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3831/7540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:45 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:46.808092 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:46.808762 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:46.815501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:46.815995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:46.816443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:46.817171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:46.817643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:46.818108 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:46.953119 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:46.960885 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4f07b96b-da8f-41f2-a048-90a565728210 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.156818 Oct 31 16:48:46.961466 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3710/7541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:46 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:47.984153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:47.984775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:47.991670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:47.992156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:47.992586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:47.993313 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:47.993775 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:47.994205 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:48.127283 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:48.135051 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa9e065d-4ce4-48b6-ad3e-d5ac04d7ff0d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.154829 Oct 31 16:48:48.135624 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3832/7542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:47 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:49.159179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:49.159808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:49.166806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:49.167821 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:49.168272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:49.169010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:49.169480 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:49.169921 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:49.302700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:49.311112 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9dfa9417-d93a-4b0b-9bff-f3803d39896f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.155841 Oct 31 16:48:49.311685 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3711/7543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:49 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:50.334546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:50.335130 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:50.343252 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:50.343746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:50.344237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:50.345032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:50.345494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:50.345924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:50.474989 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:50.482884 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e47813b8-dbe7-42d2-b0a7-c5831bf96b20 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.152344 Oct 31 16:48:50.483463 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3833/7544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:50 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:51.506555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:51.507122 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:51.514713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:51.515468 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:51.515912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:51.516614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:51.517109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:51.517546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:51.650413 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:51.658966 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bfc9961d-d091-4f7e-b2f7-25c0ca9c6208 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.156475 Oct 31 16:48:51.659568 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3712/7545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:51 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:52.682459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:52.683663 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:52.690717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:52.691197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:52.691629 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:52.692314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:52.692793 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:52.693219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:52.827266 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:52.835055 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4e979eba-0a3b-4cf9-8cfe-aeeba3668d5b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.156540 Oct 31 16:48:52.835629 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3834/7546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:52 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:53.859241 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:53.859881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:53.866996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:53.867497 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:53.867952 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:53.868663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:53.869165 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:53.869612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:54.003143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:54.011244 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce4335e5-588c-40a1-9716-7a668f672a8c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1702 microversion: 2.1 time: 0.156440 Oct 31 16:48:54.011841 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3713/7547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:53 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:55.035512 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:55.036137 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:55.043592 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:55.044081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:55.044526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:55.045254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:55.045718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:55.046152 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:55.181577 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:55.190278 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9ee304c-4c31-4986-ba67-e27fe6d41c77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1702 microversion: 2.1 time: 0.158744 Oct 31 16:48:55.190875 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3835/7548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:55 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:56.041696 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-3155c3a4-65b6-4393-8eda-00ebfe458bf9 req-97862f2a-2245-45b0-a08b-23e3621a8f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "name": "network-vif-plugged", "status": "completed", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:56.052201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3155c3a4-65b6-4393-8eda-00ebfe458bf9 req-97862f2a-2245-45b0-a08b-23e3621a8f62 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:56.052713 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3155c3a4-65b6-4393-8eda-00ebfe458bf9 req-97862f2a-2245-45b0-a08b-23e3621a8f62 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:56.053169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-3155c3a4-65b6-4393-8eda-00ebfe458bf9 req-97862f2a-2245-45b0-a08b-23e3621a8f62 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:56.064570 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-3155c3a4-65b6-4393-8eda-00ebfe458bf9 req-97862f2a-2245-45b0-a08b-23e3621a8f62 service nova] Creating event network-vif-plugged:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:48:56.070793 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-3155c3a4-65b6-4393-8eda-00ebfe458bf9 req-97862f2a-2245-45b0-a08b-23e3621a8f62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 Oct 31 16:48:56.071657 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3714/7549] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:48:56.213605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:56.214280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:56.221203 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:56.221690 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:56.222129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:56.222825 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:56.223286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:56.223716 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:56.353505 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:56.361266 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4846f52b-ce8c-49be-b5a6-6b33202a475d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1702 microversion: 2.1 time: 0.151603 Oct 31 16:48:56.361850 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3836/7550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:56 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1702 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:57.386568 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:57.387297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:57.393802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:57.394310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:57.394765 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:57.395473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:57.395949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:57.396394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:57.528339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:57.536197 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e114650f-7f66-4c7c-a079-295233f931a2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1702 microversion: 2.1 time: 0.154819 Oct 31 16:48:57.536799 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3715/7551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:57 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:58.560995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:58.561570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:58.568456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:58.568973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:58.569411 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:58.570108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:58.570576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:58.571003 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:58.710743 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:58.718694 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a53cae35-17f2-4301-8098-5c648f548b22 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1702 microversion: 2.1 time: 0.162235 Oct 31 16:48:58.719267 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3837/7552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:58 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1702 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:59.741881 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:59.745052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:59.756091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:59.757097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:59.757756 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:59.758498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:59.759189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:59.759930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:59.935917 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:59.944658 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9e150919-0089-4194-95f5-114b4a32b2d9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.206730 Oct 31 16:48:59.945392 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3716/7553] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:59 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:00.970796 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:00.971396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:00.981579 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:00.982446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:00.983108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:00.984042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:00.984507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:00.984957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:01.154168 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:01.162702 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-55b150bb-88a0-432d-b3f0-f6c27ed8e4a9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.195773 Oct 31 16:49:01.163493 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3838/7554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:00 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:02.193505 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:02.194438 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:02.202303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:02.202895 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:02.203439 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:02.205653 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:02.206425 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:02.207442 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:02.365050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:02.374074 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-dbf9464e-b636-462f-8d69-8e7f70b2a906 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.184862 Oct 31 16:49:02.374846 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3717/7555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:02 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:03.399238 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:03.399887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:03.407181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:03.407783 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:03.408296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:03.409128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:03.409914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:03.410061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:03.584842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:03.593742 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6542191-fe78-4aa7-8f88-05821538e8db tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.199354 Oct 31 16:49:03.605582 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3839/7556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:03 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:04.622736 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:04.623459 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:04.630619 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:04.631198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:04.631743 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:04.632533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:04.633263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:04.634295 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:04.782051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:04.790322 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0cb0f62d-3a9a-4894-b3e2-0f917ef13275 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.172531 Oct 31 16:49:04.805233 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3718/7557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:04 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:05.815320 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:05.815938 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:05.823446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:05.824344 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:05.825067 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:05.826043 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:05.826589 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:05.827139 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:05.986165 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:05.994249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b6cf2a1-94cf-4b26-9a51-9e4703a8a6e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.182794 Oct 31 16:49:06.008941 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3840/7558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:05 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:07.019262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:07.020162 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:07.033029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:07.033667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:07.034215 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:07.035081 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:07.035657 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:07.036404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:07.196357 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:07.204980 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2fcf0c99-0a6a-4ab1-a416-91970dd8cc76 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.190294 Oct 31 16:49:07.205555 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3719/7559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:07 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:08.229166 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:08.229927 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:08.236895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:08.237381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:08.237817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:08.238508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:08.238966 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:08.239391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:08.368964 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:08.377396 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5310ceac-fa81-48aa-8062-6f7335e3f2df tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1697 microversion: 2.1 time: 0.152138 Oct 31 16:49:08.377976 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3841/7560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:08 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:09.401836 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:09.402473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:09.409395 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:09.409900 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:09.410354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:09.411073 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:09.411574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:09.412014 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:09.547658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:09.555386 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0131cb1f-c6ab-49cc-a238-0e8856c4aab6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1679 microversion: 2.1 time: 0.157718 Oct 31 16:49:09.555956 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3720/7561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:09 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:10.579440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:10.580058 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:10.586990 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:10.587474 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:10.587914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:10.588602 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:10.589786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:10.590218 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:10.719707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:10.727375 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0cef4bde-dd1a-4362-9636-88ebbe4e00c2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1679 microversion: 2.1 time: 0.151862 Oct 31 16:49:10.727939 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3842/7562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:10 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:11.751290 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:11.751928 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:11.759121 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:11.759621 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:11.760070 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:11.760885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:11.761391 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:11.761849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:11.894694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:11.903199 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9d7944b3-4499-4046-aa73-001eb0cbb2ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1622 microversion: 2.1 time: 0.155894 Oct 31 16:49:11.903781 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3721/7563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:11 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:49:11.926845 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:49:11.927497 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:11.930200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=29 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:49:11.935395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:11.935888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:11.936328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:11.937077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:11.937541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:11.937987 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:11.940558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:49:11.981536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 16:49:12.051799 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ebedc19f-935f-4300-a86b-595e930fb9d4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action" status: 202 len: 0 microversion: 2.1 time: 0.128960 Oct 31 16:49:12.052728 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3843/7564] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:49:11 2022] POST /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:49:12.067450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:12.067620 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:12.070139 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=29 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:49:12.075837 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:12.076569 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:12.077291 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:12.078080 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:12.078748 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:12.079244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:12.084396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=81 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:49:12.111480 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5dc19312-eadd-4673-945c-ce17d43da8b3 req-e88b9819-eb9b-45b3-8c5f-37cd5c4c46f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "name": "network-vif-unplugged", "status": "completed", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:49:12.121698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5dc19312-eadd-4673-945c-ce17d43da8b3 req-e88b9819-eb9b-45b3-8c5f-37cd5c4c46f7 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:12.122720 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5dc19312-eadd-4673-945c-ce17d43da8b3 req-e88b9819-eb9b-45b3-8c5f-37cd5c4c46f7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:12.123506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5dc19312-eadd-4673-945c-ce17d43da8b3 req-e88b9819-eb9b-45b3-8c5f-37cd5c4c46f7 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:12.139624 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-5dc19312-eadd-4673-945c-ce17d43da8b3 req-e88b9819-eb9b-45b3-8c5f-37cd5c4c46f7 service nova] Unable to find a host for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5. Dropping event network-vif-unplugged {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 16:49:12.141249 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5dc19312-eadd-4673-945c-ce17d43da8b3 req-e88b9819-eb9b-45b3-8c5f-37cd5c4c46f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034091 Oct 31 16:49:12.142312 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3844/7565] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 31 16:49:12.234009 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:12.242342 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4bcd6620-4d29-45bd-841d-0a0e76a32938 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1630 microversion: 2.1 time: 0.179270 Oct 31 16:49:12.242918 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3722/7566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:12 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1630 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:13.266459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:13.267082 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:13.274050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:13.274542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:13.274982 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:13.275694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:13.276143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:13.276672 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:13.411170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:13.419595 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bcf0b3ce-30b1-4e80-9d7e-d68d2afeb869 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.157302 Oct 31 16:49:13.420164 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3845/7567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:13 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:14.445059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:14.445722 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:14.454102 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:14.455321 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:14.456189 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:14.457370 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:14.458173 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:14.459164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:14.630320 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:14.641392 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e7633a22-4e8c-4d73-b179-b47b754c8dd5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.201339 Oct 31 16:49:14.644901 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3723/7568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:14 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:49:15.669495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:15.670112 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:15.678232 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:15.679004 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:15.679626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:15.680342 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:15.680826 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:15.681257 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:15.834807 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:15.844218 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b2f4c0ec-240d-4ada-8e75-c9d30dcf7da6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.179228 Oct 31 16:49:15.845145 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3846/7569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:15 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:16.871306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:16.872220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:16.879501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:16.880010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:16.880461 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:16.881214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:16.881688 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:16.882130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:17.031948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:17.041270 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ad1b2f0e-93a1-4a86-9e6b-c499da7eef96 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.174948 Oct 31 16:49:17.051259 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3724/7570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:16 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:18.065164 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:18.065798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:18.072866 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:18.073909 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:18.074341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:18.075039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:18.075495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:18.075920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:18.219612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:18.228670 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99ebeb75-78c7-4bc0-abd8-c92bf85a8615 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.167291 Oct 31 16:49:18.229423 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3847/7571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:18 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:19.253616 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:19.254264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:19.262083 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:19.262593 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:19.263056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:19.263783 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:19.264263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:19.264724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:19.407114 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:19.416467 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b8aedfc-fb47-4f67-9c6d-2e0976e91334 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.166680 Oct 31 16:49:19.417932 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3725/7572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:19 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:20.440850 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:20.441478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:20.449038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:20.449536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:20.449981 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:20.450732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:20.451197 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:20.451626 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:20.594280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:20.602685 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6715ac52-3d63-4a8c-aebb-f8fcf49a33af tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.165806 Oct 31 16:49:20.603555 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3848/7573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:20 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:21.628723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:21.630100 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:21.638284 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:21.638929 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:21.639533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:21.640559 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:21.641091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:21.641557 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:21.788279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:21.796349 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0484f05b-5293-401c-bb3a-9135cb207726 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.172316 Oct 31 16:49:21.797158 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3726/7574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:21 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:22.821745 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:22.822393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:22.830382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:22.830873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:22.831312 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:22.832011 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:22.832468 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:22.832931 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:22.966887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:22.975271 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8a26305-80ff-4999-95fe-2c078b13f747 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.157742 Oct 31 16:49:22.975846 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3849/7575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:22 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:23.998982 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:23.999603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:24.006506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:24.006999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:24.007446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:24.008146 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:24.008614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:24.009077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:24.142677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:24.150481 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4f33a921-36b0-40cf-99c4-083a49239e9b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.155562 Oct 31 16:49:24.152627 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3727/7576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:23 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:25.175251 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:25.175963 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:25.182852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:25.183459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:25.183895 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:25.184583 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:25.185076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:25.185506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:25.321142 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:25.329804 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0d2b3a22-5b8e-4d74-aa2f-36175be94386 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.158414 Oct 31 16:49:25.330401 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3850/7577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:25 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:26.353697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:26.354317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:26.361948 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:26.362450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:26.362904 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:26.363607 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:26.364082 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:26.364528 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:26.497999 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:26.505754 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c820a0ae-1c1e-45b0-92c3-b263730bc437 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.156012 Oct 31 16:49:26.506334 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3728/7578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:26 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:27.530513 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:27.531234 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:27.537975 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:27.538457 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:27.538890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:27.539576 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:27.540026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:27.540452 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:27.671119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:27.678828 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8c2e47e-5edd-4b0c-a3e7-e550eca2e40a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.152848 Oct 31 16:49:27.679403 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3851/7579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:27 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:28.703296 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:28.703957 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:28.710786 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:28.711285 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:28.711739 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:28.712444 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:28.712949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:28.713394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:28.847515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:28.855709 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a4563cbe-2f0f-4da2-ae7f-559ac0f0d927 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.156508 Oct 31 16:49:28.856294 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3729/7580] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:28 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:29.879485 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:29.880035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:29.887631 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:29.888114 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:29.888550 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:29.889271 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:29.889728 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:29.890407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:30.019302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:30.027462 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5df7f89-f5c5-4c01-a218-9a6a669e9c53 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.151937 Oct 31 16:49:30.028052 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3852/7581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:29 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:31.051552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:31.052111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:31.059015 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:31.059513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:31.059970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:31.060720 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:31.061205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:31.061649 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:31.195400 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:31.203750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6e55aeeb-2d68-4cf5-b0b4-05fb784ab5bb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.156243 Oct 31 16:49:31.204328 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3730/7582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:31 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:32.229850 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:32.230477 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:32.239249 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:32.239758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:32.240214 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:32.241004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:32.241476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:32.241601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e9c172e4-249b-4307-b518-baec13e249a4 req-64930e97-43c0-4eca-8922-23fdc0d298e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "name": "network-vif-plugged", "status": "completed", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:49:32.242056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:32.252066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e9c172e4-249b-4307-b518-baec13e249a4 req-64930e97-43c0-4eca-8922-23fdc0d298e1 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:32.252552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e9c172e4-249b-4307-b518-baec13e249a4 req-64930e97-43c0-4eca-8922-23fdc0d298e1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:32.253105 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e9c172e4-249b-4307-b518-baec13e249a4 req-64930e97-43c0-4eca-8922-23fdc0d298e1 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:32.264721 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e9c172e4-249b-4307-b518-baec13e249a4 req-64930e97-43c0-4eca-8922-23fdc0d298e1 service nova] Creating event network-vif-plugged:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:49:32.270285 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e9c172e4-249b-4307-b518-baec13e249a4 req-64930e97-43c0-4eca-8922-23fdc0d298e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094617 Oct 31 16:49:32.270891 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3853/7583] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:49:32.375819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:32.384398 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-71885cf5-7331-4313-a589-e95ef74b6c00 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.160533 Oct 31 16:49:32.385019 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3731/7584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:32 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:33.409944 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:33.410651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:33.416894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:33.418000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:33.418553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:33.419249 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:33.419709 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:33.420136 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:33.549859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:33.557553 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e22753cb-4ac1-4fec-8c88-a8212bb1b31d tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1688 microversion: 2.1 time: 0.152719 Oct 31 16:49:33.558724 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3854/7585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:33 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:49:34.581749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:49:34.582359 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:49:34.589317 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:34.589896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:34.590347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:34.591049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:49:34.591518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:49:34.591961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:49:34.725996 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:49:34.734230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-417bcad4-f818-4e06-b34c-cc536729acc1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1675 microversion: 2.1 time: 0.156454 Oct 31 16:49:34.734810 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3732/7586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:49:34 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:11.382345 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:11.383643 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:11.388967 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:11.389396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=21 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:11.389840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:11.390161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=65 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:11.399156 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.399853 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.400567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.401565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.402093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.402770 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.431330 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:51:11.451008 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-28753961-4360-425a-baee-3d4a3e6e8821 req-5f57ee61-0b93-4f81-85ea-19b7a779443e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:11.462219 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-28753961-4360-425a-baee-3d4a3e6e8821 req-5f57ee61-0b93-4f81-85ea-19b7a779443e service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.462717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-28753961-4360-425a-baee-3d4a3e6e8821 req-5f57ee61-0b93-4f81-85ea-19b7a779443e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.463157 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-28753961-4360-425a-baee-3d4a3e6e8821 req-5f57ee61-0b93-4f81-85ea-19b7a779443e service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.475367 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-28753961-4360-425a-baee-3d4a3e6e8821 req-5f57ee61-0b93-4f81-85ea-19b7a779443e service nova] Creating event network-changed:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:51:11.480959 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-28753961-4360-425a-baee-3d4a3e6e8821 req-5f57ee61-0b93-4f81-85ea-19b7a779443e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097559 Oct 31 16:51:11.481771 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3733/7587] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:51:11.521686 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce26e2c7-e169-4e09-85d5-c4219bd8ed28 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 204 len: 0 microversion: 2.1 time: 0.141230 Oct 31 16:51:11.522622 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3855/7588] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:51:11 2022] DELETE /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:51:11.532515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:11.533278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:11.541725 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.542239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.542697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.543424 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.543910 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.544354 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.689071 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:11.697144 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c61c2024-001f-4bfd-91c6-c2e9d8d75b50 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.169787 Oct 31 16:51:11.697825 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3734/7589] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:11 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:12.723816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:12.724526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:12.731887 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:12.732386 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:12.732847 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:12.733560 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:12.734013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:12.734435 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:12.877752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:12.886336 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dc925bdf-1f6d-4d6e-9508-e9e90c69e849 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1681 microversion: 2.1 time: 0.167346 Oct 31 16:51:12.886928 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3856/7590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:12 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:13.673643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-c54a10d2-310c-462c-9f19-0542d9fdd152 req-0f06a638-d9f8-479f-a5ee-6af166a4266f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8458c9b8-c37b-4272-b736-a8d0664e52b5", "name": "network-vif-deleted", "tag": "5a1a05aa-a5b8-46f7-848d-0931255acee5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:13.686010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c54a10d2-310c-462c-9f19-0542d9fdd152 req-0f06a638-d9f8-479f-a5ee-6af166a4266f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:13.686514 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c54a10d2-310c-462c-9f19-0542d9fdd152 req-0f06a638-d9f8-479f-a5ee-6af166a4266f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:13.686954 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-c54a10d2-310c-462c-9f19-0542d9fdd152 req-0f06a638-d9f8-479f-a5ee-6af166a4266f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:13.699835 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-c54a10d2-310c-462c-9f19-0542d9fdd152 req-0f06a638-d9f8-479f-a5ee-6af166a4266f service nova] Creating event network-vif-deleted:5a1a05aa-a5b8-46f7-848d-0931255acee5 for instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 on n-h1-858383-17 Oct 31 16:51:13.705411 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-c54a10d2-310c-462c-9f19-0542d9fdd152 req-0f06a638-d9f8-479f-a5ee-6af166a4266f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035540 Oct 31 16:51:13.706413 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3735/7591] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:51:13.911646 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:13.912256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:13.918219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:13.918701 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:13.919138 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:13.919820 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:13.920302 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:13.920749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:13.955305 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:13.955795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:13.956226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:13.956671 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lazy-loading 'fault' on Instance uuid 8458c9b8-c37b-4272-b736-a8d0664e52b5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:51:14.001657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:14.010634 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-037a3c24-a40e-4c40-bd3e-33fcccb51ca2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 200 len: 1337 microversion: 2.1 time: 0.103047 Oct 31 16:51:14.011235 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3857/7592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:13 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 1337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:15.037278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:15.038723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: 8458c9b8-c37b-4272-b736-a8d0664e52b5] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:15.045543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:15.046153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:15.046675 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:15.047386 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:15.047885 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:15.048614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:15.063576 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] HTTP exception thrown: Instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 could not be found. Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Request method failure captured: Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 HTTP/1.1 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_vC7hzFl1nSPCrct10hl7wXa6V2kqN4_elF9AY4bt4-fCFDwguthvqi0D-NKpwPOTVSZCF-zjWgq8O6jYEXct5DNlLKLBkZKokJJQaP_o6yWqhrCNqOlY70ckezyfu3GMJGKIhCib7fvV4YJSBl4Yu9oJjRWqy_AJpWTsP4NKcb7Y0 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: de1779df61814c8f91d00b5082e8f615 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestShelveInstance-2106055507 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/de1779df61814c8f91d00b5082e8f615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/de1779df61814c8f91d00b5082e8f615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_de1779df61814c8f91d00b5082e8f615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/de1779df61814c8f91d00b5082e8f615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestShelveInstance-2106055507 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: de1779df61814c8f91d00b5082e8f615 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestShelveInstance-2106055507 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestShelveInstance-2106055507-project Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 1c437228a13a48fb97d17c2a0c55a504 Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestShelveInstance-2106055507-project Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 could not be found. Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '8458c9b8-c37b-4272-b736-a8d0664e52b5'} Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 could not be found. Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 could not be found. Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:51:15.065308 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 could not be found. Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Returning 404 to user: Instance 8458c9b8-c37b-4272-b736-a8d0664e52b5 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c1e65f9d-04d4-441c-940d-c90b0d695014 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5" status: 404 len: 111 microversion: 2.1 time: 0.035211 Oct 31 16:51:15.072485 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3736/7593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:15 2022] GET /compute/v2.1/servers/8458c9b8-c37b-4272-b736-a8d0664e52b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:51:15.231113 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8d8b753-89a5-4148-991a-a309e48f94a0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '.version_select at 0x7f5ca12af040>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:15.277286 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8d8b753-89a5-4148-991a-a309e48f94a0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1693771012" status: 202 len: 0 microversion: 2.1 time: 0.050195 Oct 31 16:51:15.277883 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3858/7594] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Oct 31 16:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1693771012 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:51:15.304308 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-549350d6-a99a-4a2c-ac43-cc81d0907018 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'create', calling method: .version_select at 0x7f5ca3da6940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1341927536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeUTVrPoqsGYArorBDS5PgM2vV5SEJzigCIQ3dtCR4brcgoEysFXsZWfMaZGbbOedtbsA1PdBgDsYhX24vVKsmXrPEg4QSuwxvjQTFV40+8C3JokFap7CgCs35begrbzQ=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:15.321059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-549350d6-a99a-4a2c-ac43-cc81d0907018 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for project de1779df61814c8f91d00b5082e8f615. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:51:15.326268 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-549350d6-a99a-4a2c-ac43-cc81d0907018 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for user 1c437228a13a48fb97d17c2a0c55a504 and project de1779df61814c8f91d00b5082e8f615. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:51:15.362138 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-549350d6-a99a-4a2c-ac43-cc81d0907018 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.062034 Oct 31 16:51:15.362762 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3737/7595] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:51:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:51:31.574274 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:31.575028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:31.579559 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-623254159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1341927536", "security_groups": [{"name": "tempest-secgroup-smoke-860791562"}], "networks": [{"uuid": "be7bfea7-1e0d-43e8-8c88-2110057af049"}], "block_device_mapping_v2": [{"uuid": "4a5faac8-7003-42c0-8add-795162880048", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:31.694323 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] validate_networks() for [('be7bfea7-1e0d-43e8-8c88-2110057af049', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:51:32.420209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:51:32.420639 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:51:32.421295 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:51:32.421712 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:51:32.422129 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:51:32.432077 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:32.432364 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:32.432903 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:32.433645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:32.434118 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:32.434590 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:32.452494 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for project de1779df61814c8f91d00b5082e8f615. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:51:32.457766 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Getting quotas for user 1c437228a13a48fb97d17c2a0c55a504 and project de1779df61814c8f91d00b5082e8f615. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:51:32.517021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:51:32.519170 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a5faac8-7003-42c0-8add-795162880048',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:51:32.647728 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e191f022-12c3-410d-8ef6-e0f1bb413b84 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.075138 Oct 31 16:51:32.648655 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3859/7596] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:51:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:51:32.657506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=12 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:32.658288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=4 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:32.659109 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:32.663614 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bf9121d7-893f-447b-b996-1bd695dac97c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:32.664245 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bf9121d7-893f-447b-b996-1bd695dac97c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:32.723018 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bf9121d7-893f-447b-b996-1bd695dac97c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:32.731237 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bf9121d7-893f-447b-b996-1bd695dac97c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1088 microversion: 2.1 time: 0.075552 Oct 31 16:51:32.731812 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3738/7597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:32 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:51:33.754678 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:33.755558 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:33.763649 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:33.764458 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:33.765016 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:33.766050 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:33.766571 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:33.767064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:33.846393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:33.855106 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c6afa20-fcf6-45ce-8046-17063f3ac07b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1204 microversion: 2.1 time: 0.104556 Oct 31 16:51:33.855881 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3860/7598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:33 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:34.879513 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:34.880404 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:34.887567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:34.888155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:34.888658 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:34.889825 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:34.890378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:34.891279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:35.107629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:35.118367 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f6f4731-e193-4c27-87cd-296289d2ee13 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1271 microversion: 2.1 time: 0.242747 Oct 31 16:51:35.118948 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3739/7599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:34 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:35.252892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5e489efd-d825-42a8-a5f1-85273d7b7f79 req-39796b24-4dad-44b6-b349-2c3fb03bd0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:35.268653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5e489efd-d825-42a8-a5f1-85273d7b7f79 req-39796b24-4dad-44b6-b349-2c3fb03bd0bf service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:35.269231 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5e489efd-d825-42a8-a5f1-85273d7b7f79 req-39796b24-4dad-44b6-b349-2c3fb03bd0bf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:35.269868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5e489efd-d825-42a8-a5f1-85273d7b7f79 req-39796b24-4dad-44b6-b349-2c3fb03bd0bf service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:35.282207 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5e489efd-d825-42a8-a5f1-85273d7b7f79 req-39796b24-4dad-44b6-b349-2c3fb03bd0bf service nova] Creating event network-changed:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h2-858383-17 Oct 31 16:51:35.288347 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5e489efd-d825-42a8-a5f1-85273d7b7f79 req-39796b24-4dad-44b6-b349-2c3fb03bd0bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039210 Oct 31 16:51:35.289315 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3861/7600] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:51:36.142446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:36.143791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:36.151302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:36.151808 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:36.152262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:36.153059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:36.153677 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:36.154120 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:36.313574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:36.322172 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-328e0e32-abb7-4924-9ba2-495ca7c648e2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1271 microversion: 2.1 time: 0.183915 Oct 31 16:51:36.322754 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3740/7601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:36 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:37.348026 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:37.348787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:37.355039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:37.355521 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:37.355954 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:37.356636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:37.357122 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:37.357546 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:37.491593 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:37.499454 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-910b1e51-1b7e-46ed-9e71-12b3d60ea194 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1271 microversion: 2.1 time: 0.157225 Oct 31 16:51:37.500038 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3862/7602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:37 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:38.523105 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:38.523806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:38.530732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:38.531230 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:38.531737 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:38.532388 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:38.532901 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:38.533322 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:38.677770 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:38.685681 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b67f5dbd-b872-474b-bc29-85d0a4768710 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1271 microversion: 2.1 time: 0.167501 Oct 31 16:51:38.686432 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3741/7603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:38 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:39.709935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:39.710573 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:39.717395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:39.717882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:39.718336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:39.719024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:39.719476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:39.719897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:39.848817 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:39.856449 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7f3d714f-fcdc-4be9-8a66-5bace4c78381 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.150589 Oct 31 16:51:39.857055 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3863/7604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:39 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:40.880886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:40.881525 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:40.888458 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:40.888988 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:40.889449 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:40.890159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:40.890896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:40.891343 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:41.024194 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:41.031987 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1f457a80-3351-4c80-892d-88359f3a73fc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.155729 Oct 31 16:51:41.032564 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3742/7605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:40 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:42.054432 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:42.054995 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:42.061840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:42.062326 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:42.062787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:42.063478 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:42.063929 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:42.064354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:42.197508 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:42.205115 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f434db25-c8ad-43ce-9684-9696f7fbbbee tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.154697 Oct 31 16:51:42.205690 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3864/7606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:42 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:43.227340 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:43.227973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:43.230771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:43.236520 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:43.237049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:43.237500 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:43.238742 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:43.239205 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:43.239651 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:43.373457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:43.381857 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-2df0d147-f2a6-47c8-8f36-cca2853219f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.158433 Oct 31 16:51:43.382453 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3743/7607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:43 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:44.405314 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:44.405952 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:44.407902 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:44.408555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:44.414495 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:44.414979 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:44.415413 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:44.416375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:44.416873 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:44.417300 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:44.555568 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:44.563286 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e7ef833-ee3f-4f5e-af9e-569f08dcb14e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.162233 Oct 31 16:51:44.563863 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3865/7608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:44 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:45.587007 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:45.587566 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:45.593633 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:45.594142 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:45.594599 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:45.595306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:45.595785 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:45.596235 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:45.726622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:45.734363 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-08783143-6d86-455e-b933-d8883d4b8bf4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.151714 Oct 31 16:51:45.735030 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3744/7609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:45 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:46.758541 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:46.759154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:46.766198 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:46.766676 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:46.767108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:46.767821 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:46.768276 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:46.768714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:46.903200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:46.911233 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e31d235-d4ce-4a90-903e-d96eb2cb08a4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.156588 Oct 31 16:51:46.911811 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3866/7610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:46 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:47.934369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:47.934995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:47.942878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:47.943372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:47.943818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:47.944519 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:47.945013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:47.945474 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:48.078940 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:48.086838 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-187e1dba-dd40-455a-92c3-fa39ace89fbc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.156383 Oct 31 16:51:48.087422 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3745/7611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:47 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:49.110673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:49.111293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:49.118767 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:49.119259 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:49.119704 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:49.120412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:49.120910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:49.121343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:49.256555 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:49.264517 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3d2bebf-20bd-4b6d-9432-5c1b03611e8f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.157829 Oct 31 16:51:49.265135 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3867/7612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:49 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:49.795088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-2b2bc3bb-f476-4c6d-b6aa-25bde42cbfe5 req-b75e038a-bb13-44c8-903f-9785aeaf763a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "name": "network-vif-plugged", "status": "completed", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:49.806645 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2b2bc3bb-f476-4c6d-b6aa-25bde42cbfe5 req-b75e038a-bb13-44c8-903f-9785aeaf763a service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:49.807145 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2b2bc3bb-f476-4c6d-b6aa-25bde42cbfe5 req-b75e038a-bb13-44c8-903f-9785aeaf763a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:49.807606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-2b2bc3bb-f476-4c6d-b6aa-25bde42cbfe5 req-b75e038a-bb13-44c8-903f-9785aeaf763a service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:49.818914 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-2b2bc3bb-f476-4c6d-b6aa-25bde42cbfe5 req-b75e038a-bb13-44c8-903f-9785aeaf763a service nova] Creating event network-vif-plugged:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h2-858383-17 Oct 31 16:51:49.823953 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-2b2bc3bb-f476-4c6d-b6aa-25bde42cbfe5 req-b75e038a-bb13-44c8-903f-9785aeaf763a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032663 Oct 31 16:51:49.824580 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3746/7613] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:51:50.288307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:50.288859 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:50.296096 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:50.296588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:50.297120 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:50.297829 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:50.298290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:50.298722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:50.430014 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:50.437792 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c12528f4-dfdf-42c8-9e1c-3b3b909348a1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1259 microversion: 2.1 time: 0.153861 Oct 31 16:51:50.438371 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3868/7614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:50 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:51.462864 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:51.463482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:51.469623 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:51.470204 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:51.470650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:51.471345 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:51.471812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:51.472323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:51.606843 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:51.615156 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-56db00f6-8873-45b2-8ef5-a7ce1b582cbb tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1443 microversion: 2.1 time: 0.157620 Oct 31 16:51:51.615761 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3747/7615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:51 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:51.637871 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:51.638538 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:51.645791 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:51.646278 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:51.646714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:51.647408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:51.647867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:51.648298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:51.780391 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:51.788915 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fff575d6-5e8e-4f26-8124-52eb5cc27e3a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1443 microversion: 2.1 time: 0.154847 Oct 31 16:51:51.789491 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3869/7616] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:51 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:53.397550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f8045025-9186-4bd8-acc5-f3809e4b571a req-7b0436b2-ced3-46d4-9fd9-8b1c9d09f970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:53.407844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f8045025-9186-4bd8-acc5-f3809e4b571a req-7b0436b2-ced3-46d4-9fd9-8b1c9d09f970 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:53.408342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f8045025-9186-4bd8-acc5-f3809e4b571a req-7b0436b2-ced3-46d4-9fd9-8b1c9d09f970 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:53.408806 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f8045025-9186-4bd8-acc5-f3809e4b571a req-7b0436b2-ced3-46d4-9fd9-8b1c9d09f970 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:53.420063 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f8045025-9186-4bd8-acc5-f3809e4b571a req-7b0436b2-ced3-46d4-9fd9-8b1c9d09f970 service nova] Creating event network-changed:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h2-858383-17 Oct 31 16:51:53.425414 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f8045025-9186-4bd8-acc5-f3809e4b571a req-7b0436b2-ced3-46d4-9fd9-8b1c9d09f970 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032187 Oct 31 16:51:53.426113 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3748/7617] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:53:45.403987 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:53:45.405082 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:53:45.405653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:53:45.406424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=58 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:53:45.407337 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:53:45.407482 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action (ip 10.222.0.48) !!! Oct 31 16:53:45.409897 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:53:45.410029 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action (ip 10.222.0.48) !!! Oct 31 16:53:45.412027 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:53:45.412177 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 16:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action (ip 10.222.0.48) !!! Oct 31 16:53:45.419410 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:53:45.419955 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:45.432404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:45.432852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:45.433289 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:45.433985 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:45.434443 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:45.434868 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:45.457336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lazy-loading 'flavor' on Instance uuid e0e45023-d482-4feb-8996-b8c21aa7b7e8 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:53:45.528630 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-550f9f64-23ec-48fc-92c4-7770390a9c10 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action" status: 202 len: 0 microversion: 2.1 time: 0.126413 Oct 31 16:53:45.529252 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3870/7618] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:53:45 2022] POST /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:53:45.536897 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:53:45.537818 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:53:45.538635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=24 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:53:45.539377 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=52 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:53:45.541623 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:53:45.541798 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 (ip 10.222.0.48) !!! Oct 31 16:53:45.543993 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:53:45.544172 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 (ip 10.222.0.48) !!! Oct 31 16:53:45.561464 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:45.562546 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:45.571123 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:45.571618 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:45.572064 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:45.572798 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:45.573279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:45.573709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:45.760716 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:45.768756 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-6c4532bd-b92f-40bb-80c6-914c2bdb2c71 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.234940 Oct 31 16:53:45.769324 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3749/7619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:45 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:53:46.796322 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:46.797068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:46.807377 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:46.807867 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:46.808336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:46.809079 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:46.809542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:46.809973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:46.817799 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53288. Oct 31 16:53:46.830780 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53290. Oct 31 16:53:47.030721 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:47.038486 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3c458e0-3f45-4d68-a505-582cb58803b1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.248700 Oct 31 16:53:47.039064 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3871/7620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:46 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:48.061655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:48.062237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:48.071543 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:48.072039 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:48.072495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:48.073226 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:48.073695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:48.074129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:48.077934 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53296. Oct 31 16:53:48.082158 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53298. Oct 31 16:53:48.211055 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:48.218750 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-eb873a7c-a32d-4beb-a83b-555ed0c7e082 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.161111 Oct 31 16:53:48.219316 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3750/7621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:48 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:49.242450 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:49.243059 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:49.249882 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:49.250357 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:49.250794 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:49.251481 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:49.251933 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:49.252356 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:49.386698 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:49.394664 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c22302e-eb98-4139-809b-a661873decd6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.156125 Oct 31 16:53:49.395233 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3872/7622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:49 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:50.419641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:50.420305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:50.427168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:50.427665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:50.428117 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:50.428851 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:50.429329 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:50.429793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:50.562710 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:50.570521 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bcac29f2-005d-4355-a825-1a0c91ebf063 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.154848 Oct 31 16:53:50.571096 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3751/7623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:50 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:51.594254 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:51.594872 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:51.602407 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:51.602894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:51.603336 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:51.604035 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:51.604498 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:51.604950 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:51.736265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:51.744831 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2890b09-c22b-4e68-b954-269d5104cdb5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.154504 Oct 31 16:53:51.745412 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3873/7624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:51 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:52.767919 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:52.768547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:52.776005 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:52.776502 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:52.776995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:52.777697 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:52.778169 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:52.778612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:52.913717 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:52.921534 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ebfb17e6-7335-4b38-aabf-7de572baaea5 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.157946 Oct 31 16:53:52.922111 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3752/7625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:52 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:53.945061 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:53.945683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:53.952544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:53.953062 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:53.953510 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:53.954202 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:53.954664 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:53.955090 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:54.084719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:54.092488 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7dd168c6-0a75-4c03-8c17-35651a57b513 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.151513 Oct 31 16:53:54.093097 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3874/7626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:53 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:55.116852 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:55.117555 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:55.124655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:55.125188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:55.125646 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:55.126355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:55.126833 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:55.127280 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:55.261498 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:55.269557 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-83d31d5b-17d5-42f1-b20f-446c546ba042 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.157385 Oct 31 16:53:55.270132 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3753/7627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:55 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:56.293195 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:56.293816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:56.300786 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:56.301280 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:56.301724 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:56.302456 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:56.302923 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:56.303375 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:56.434552 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:56.442412 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc8e128d-1e76-4fe4-94e6-88073e74d28a tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.153179 Oct 31 16:53:56.442992 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3875/7628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:56 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:57.466670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:57.467239 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:57.474303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:57.474799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:57.475871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:57.476584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:57.477428 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:57.477879 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:57.610206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:57.618095 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ce6016ad-239e-42fa-9e57-db97751e46d1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.155412 Oct 31 16:53:57.624747 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3754/7629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:57 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:58.642246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:58.643034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:58.650683 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:58.651169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:58.651606 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:58.652311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:58.652795 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:58.653226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:58.791957 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:58.799788 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d3c293c9-67d2-4706-9fa7-efc749fad331 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.161667 Oct 31 16:53:58.800367 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3876/7630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:58 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:59.824288 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:59.825042 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:59.832004 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:59.832506 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:59.832986 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:59.833689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:59.834159 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:59.835397 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:59.966183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:59.974060 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-bebdd306-a79f-4d4b-bc99-fdb65c1f5f9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1509 microversion: 2.1 time: 0.153674 Oct 31 16:53:59.974643 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3755/7631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:59 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:59.996718 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:53:59.997329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:00.004169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:00.004657 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:00.005133 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:00.005827 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:00.006864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:00.007298 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:00.039265 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 16:54:00.110194 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-200a5433-05dd-494d-b8c8-db704117a2b4 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "POST /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action" status: 202 len: 0 microversion: 2.1 time: 0.117516 Oct 31 16:54:00.113919 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3877/7632] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:53:59 2022] POST /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:54:00.119866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:00.120552 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:00.126793 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:00.127303 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:00.127754 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:00.128486 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:00.128978 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:00.129420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:00.272826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:00.280720 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-58d00edd-bfd3-4fb0-93e6-13154a9de0ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1517 microversion: 2.1 time: 0.165353 Oct 31 16:54:00.285179 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3756/7633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:00 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:01.305518 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:01.306123 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:01.312091 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:01.312574 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:01.313039 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:01.313729 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:01.314183 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:01.314605 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:01.452064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:01.460537 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34aefda3-3d9f-4d66-b382-76f60917ff51 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1519 microversion: 2.1 time: 0.160414 Oct 31 16:54:01.461147 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3878/7634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:01 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:02.484418 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:02.485010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:02.492050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:02.492665 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:02.493220 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:02.494016 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:02.494564 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:02.495079 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:02.510341 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8039f227-01a1-4c84-b4db-36a3039b7183 req-bc47e1da-5cbb-4037-a34b-89de93008948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "name": "network-vif-unplugged", "status": "completed", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:54:02.525045 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8039f227-01a1-4c84-b4db-36a3039b7183 req-bc47e1da-5cbb-4037-a34b-89de93008948 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:02.525532 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8039f227-01a1-4c84-b4db-36a3039b7183 req-bc47e1da-5cbb-4037-a34b-89de93008948 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:02.525965 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8039f227-01a1-4c84-b4db-36a3039b7183 req-bc47e1da-5cbb-4037-a34b-89de93008948 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:02.538779 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-8039f227-01a1-4c84-b4db-36a3039b7183 req-bc47e1da-5cbb-4037-a34b-89de93008948 service nova] Unable to find a host for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8. Dropping event network-vif-unplugged {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 16:54:02.539686 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8039f227-01a1-4c84-b4db-36a3039b7183 req-bc47e1da-5cbb-4037-a34b-89de93008948 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035954 Oct 31 16:54:02.540690 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3879/7635] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 16:54:02.638898 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:02.647999 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-d0da4912-a213-4862-b4d5-cf8838c1a7bc tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1519 microversion: 2.1 time: 0.167175 Oct 31 16:54:02.648595 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3757/7636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:02 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:03.671682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:03.672569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:03.680032 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:03.680526 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:03.680997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:03.681715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:03.682175 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:03.682774 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:03.824744 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:03.832562 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ac5494d-6223-40b8-801a-4b701a5f9b77 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1519 microversion: 2.1 time: 0.164934 Oct 31 16:54:03.833169 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3880/7637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:03 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:04.857834 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:04.858643 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:04.866799 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:04.867650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:04.868390 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:04.869606 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:04.870410 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:04.871161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:05.007961 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:05.015879 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-b8d72386-99fd-4232-8fc6-e890e7bc24e0 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1519 microversion: 2.1 time: 0.162160 Oct 31 16:54:05.016737 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3758/7638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:04 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:06.039277 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:06.039897 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:06.046880 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:06.047370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:06.047809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:06.048514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:06.048997 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:06.049425 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:06.253733 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:06.264059 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42710f96-61ab-4192-94f1-0ec2333c9084 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.228598 Oct 31 16:54:06.264658 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3881/7639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:06 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:06.932896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-112d5256-f41a-4771-a7af-e5b5c1577728 req-2524c630-7988-4df2-865c-cd18a4e3e50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:54:06.943258 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-112d5256-f41a-4771-a7af-e5b5c1577728 req-2524c630-7988-4df2-865c-cd18a4e3e50b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:06.944389 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-112d5256-f41a-4771-a7af-e5b5c1577728 req-2524c630-7988-4df2-865c-cd18a4e3e50b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:06.944865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-112d5256-f41a-4771-a7af-e5b5c1577728 req-2524c630-7988-4df2-865c-cd18a4e3e50b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:06.957414 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-112d5256-f41a-4771-a7af-e5b5c1577728 req-2524c630-7988-4df2-865c-cd18a4e3e50b service nova] Creating event network-changed:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h1-858383-17 Oct 31 16:54:06.962899 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-112d5256-f41a-4771-a7af-e5b5c1577728 req-2524c630-7988-4df2-865c-cd18a4e3e50b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034416 Oct 31 16:54:06.963504 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3759/7640] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:54:07.287476 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:07.288213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:07.295153 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:07.295636 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:07.296075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:07.296787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:07.297250 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:07.297674 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:07.513125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:07.521444 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d64f0247-3d0a-4be3-a422-25504b83d67b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.237814 Oct 31 16:54:07.522308 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3882/7641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:07 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:08.546137 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:08.546794 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:08.553511 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:08.554085 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:08.554539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:08.555237 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:08.555708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:08.556147 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:08.782224 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:08.790873 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-85841644-4e72-48d0-b72c-507470e12e9f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.249950 Oct 31 16:54:08.791454 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3760/7642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:08 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:09.814765 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:09.815393 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:09.822219 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:09.822705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:09.823140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:09.823835 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:09.824293 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:09.824739 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:09.955536 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:09.963992 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b10aa09-3994-4221-ae0b-0e2231fa7975 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.153021 Oct 31 16:54:09.964520 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3883/7643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:09 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:10.987882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:10.988508 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:10.996210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:10.996724 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:10.997178 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:10.997886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:10.998355 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:10.998792 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:11.131158 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:11.138908 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ac373745-7f60-4dbf-a3e8-bef3d27d9f1b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.154955 Oct 31 16:54:11.139554 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3761/7644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:10 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:12.163146 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:12.163881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:12.171214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:12.171711 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:12.172150 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:12.173041 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:12.173489 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:12.173918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:12.178064 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:54:12.304914 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:12.312615 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-960c680e-580d-4637-be3f-df8e70a3a4f9 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.153954 Oct 31 16:54:12.313217 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3884/7645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:12 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:13.336930 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:13.337565 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:13.344348 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:13.344882 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:13.345346 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:13.346053 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:13.346533 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:13.346977 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:13.480302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:13.488106 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e57c6fb2-7b2b-416b-b4fe-e07037f8d6f1 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.155864 Oct 31 16:54:13.488684 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3762/7646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:13 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:14.512182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:14.512761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:14.519694 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:14.520177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:14.520632 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:14.521381 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:14.521840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:14.522261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:14.653081 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:14.660852 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2dda29b7-8823-4b6b-b1e5-0b4711848f41 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.152952 Oct 31 16:54:14.661428 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3885/7647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:14 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:15.684311 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:15.685130 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:15.687995 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=29 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:54:15.694179 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:15.694687 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:15.695170 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:15.695891 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:15.696360 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:15.696826 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:15.699823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=81 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:54:15.839347 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:15.847326 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a2f68cde-a4b5-4e8c-98fa-67d1ba291a1e tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.166977 Oct 31 16:54:15.847917 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3763/7648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:15 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:54:16.870960 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:16.871673 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:16.873734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:54:16.878918 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:16.879400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:16.879833 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:16.880520 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:16.880996 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:16.881418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:17.011329 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:17.019389 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a3afb43-7a63-4a49-94b8-5932c36cc4d6 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.153075 Oct 31 16:54:17.019968 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3886/7649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:16 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:18.042969 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:18.043529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:18.050293 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:18.050788 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:18.051233 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:18.051927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:18.052394 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:18.052867 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:18.186305 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:18.194120 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-10f25cad-e2a7-4547-87a0-3a18df147d4b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.155208 Oct 31 16:54:18.195533 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3764/7650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:18 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:19.217917 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:19.218563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:19.225554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:19.226860 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:19.227466 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:19.228162 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:19.228621 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:19.229083 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:19.361365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:19.369762 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-79071989-eeee-4f1b-a6de-5722dccf732b tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.155767 Oct 31 16:54:19.370347 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3887/7651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:19 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:19.662050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-ce60565c-3088-4fcd-b0f8-8661f22fdd1d req-7b68ae4d-7802-483c-a164-474e6e30e484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "name": "network-vif-plugged", "status": "completed", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:54:19.673131 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ce60565c-3088-4fcd-b0f8-8661f22fdd1d req-7b68ae4d-7802-483c-a164-474e6e30e484 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:19.673629 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ce60565c-3088-4fcd-b0f8-8661f22fdd1d req-7b68ae4d-7802-483c-a164-474e6e30e484 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:19.674161 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-ce60565c-3088-4fcd-b0f8-8661f22fdd1d req-7b68ae4d-7802-483c-a164-474e6e30e484 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:19.685871 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-ce60565c-3088-4fcd-b0f8-8661f22fdd1d req-7b68ae4d-7802-483c-a164-474e6e30e484 service nova] Creating event network-vif-plugged:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h1-858383-17 Oct 31 16:54:19.690900 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-ce60565c-3088-4fcd-b0f8-8661f22fdd1d req-7b68ae4d-7802-483c-a164-474e6e30e484 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Oct 31 16:54:19.691861 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3765/7652] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:54:20.392857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:20.393459 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:20.400354 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:20.400900 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:20.401343 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:20.402042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:20.402506 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:20.402935 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:20.535529 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:20.543377 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ee15418-ae6b-4be2-9b6c-69988b8af863 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1575 microversion: 2.1 time: 0.154720 Oct 31 16:54:20.543959 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3888/7653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:20 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:54:21.568405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:54:21.569077 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:54:21.577289 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:21.577790 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:21.578244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:21.578951 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:54:21.579420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:54:21.579859 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:54:21.709652 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:54:21.717532 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-27cbc305-7b82-4a98-aa13-3ccb0ec48c45 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1562 microversion: 2.1 time: 0.154380 Oct 31 16:54:21.718104 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3766/7654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:54:21 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:55:38.390094 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:55:38.390916 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:55:38.393020 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=7 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:55:38.393832 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=19 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:55:38.397809 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:38.398569 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:38.407420 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:38.417666 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:38.418446 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:38.419306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:38.419812 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:38.425409 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:38.452422 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:55:38.489947 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-351c9215-be46-45f8-896e-f7443cbf5501 req-ba05bb0b-297f-40c3-867e-0a596707ea72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:55:38.500248 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-351c9215-be46-45f8-896e-f7443cbf5501 req-ba05bb0b-297f-40c3-867e-0a596707ea72 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:38.500771 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-351c9215-be46-45f8-896e-f7443cbf5501 req-ba05bb0b-297f-40c3-867e-0a596707ea72 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:38.501217 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-351c9215-be46-45f8-896e-f7443cbf5501 req-ba05bb0b-297f-40c3-867e-0a596707ea72 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:38.513162 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-351c9215-be46-45f8-896e-f7443cbf5501 req-ba05bb0b-297f-40c3-867e-0a596707ea72 service nova] Creating event network-changed:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h1-858383-17 Oct 31 16:55:38.519290 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-351c9215-be46-45f8-896e-f7443cbf5501 req-ba05bb0b-297f-40c3-867e-0a596707ea72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129080 Oct 31 16:55:38.520149 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3767/7655] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:55:38.539731 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8a8dfd5-d4b9-49e2-9e38-1e3a9bb8d51c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 204 len: 0 microversion: 2.1 time: 0.151373 Oct 31 16:55:38.543682 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3889/7656] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 16:55:38 2022] DELETE /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:55:38.550244 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:38.550973 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:38.557523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:38.558028 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:38.558476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:38.559212 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:38.559746 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:38.560200 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:38.699693 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:38.707858 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-04ba1921-bdb0-4829-9d51-c5545049396c tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.162564 Oct 31 16:55:38.708451 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3768/7657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:38 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:55:39.731727 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:39.732365 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:39.739689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:39.740177 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:39.740607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:39.741340 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:39.741797 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:39.742224 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:39.914563 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:39.922732 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76f2b8d4-f33c-4c60-aa7c-4071f1d5c3ac tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1568 microversion: 2.1 time: 0.196179 Oct 31 16:55:39.923313 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3890/7658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:39 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:55:40.851319 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-5c1b77f3-88b3-4142-9c5b-75b5dc5c05f8 req-99b3d14c-3470-4723-9597-bba938d37043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e45023-d482-4feb-8996-b8c21aa7b7e8", "name": "network-vif-deleted", "tag": "a098e5a5-fac7-441b-bd99-4a310a81b202"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:55:40.862049 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5c1b77f3-88b3-4142-9c5b-75b5dc5c05f8 req-99b3d14c-3470-4723-9597-bba938d37043 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:40.862538 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5c1b77f3-88b3-4142-9c5b-75b5dc5c05f8 req-99b3d14c-3470-4723-9597-bba938d37043 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:40.862979 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-5c1b77f3-88b3-4142-9c5b-75b5dc5c05f8 req-99b3d14c-3470-4723-9597-bba938d37043 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:40.874032 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-5c1b77f3-88b3-4142-9c5b-75b5dc5c05f8 req-99b3d14c-3470-4723-9597-bba938d37043 service nova] Creating event network-vif-deleted:a098e5a5-fac7-441b-bd99-4a310a81b202 for instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 on n-h1-858383-17 Oct 31 16:55:40.879194 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-5c1b77f3-88b3-4142-9c5b-75b5dc5c05f8 req-99b3d14c-3470-4723-9597-bba938d37043 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Oct 31 16:55:40.879855 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3769/7659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:55:40.946708 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:40.947307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:40.955068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:40.955808 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:40.956240 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:40.957169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:40.957633 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:40.958063 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:41.022611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:41.030818 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b57f19b-64c7-4096-830f-2e9b13ea81ba tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1219 microversion: 2.1 time: 0.088211 Oct 31 16:55:41.031396 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3891/7660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:40 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:55:42.055803 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:42.056419 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:42.063336 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:42.063865 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:42.064323 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:42.065060 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:42.065535 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:42.065975 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:42.136516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:42.145774 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-21613fff-2e8c-431b-9426-d5f625e32fc7 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1219 microversion: 2.1 time: 0.095236 Oct 31 16:55:42.146527 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3770/7661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:42 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:55:43.170065 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:43.172396 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:43.179717 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:43.180208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:43.180645 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:43.181423 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:43.181911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:43.182370 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:43.245097 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:43.254006 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99eb29cf-9303-4cdc-9243-1747d0419f24 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1219 microversion: 2.1 time: 0.088376 Oct 31 16:55:43.254610 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3892/7662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:43 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:55:44.277310 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:44.277993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:44.285626 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:44.286124 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:44.286567 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:44.287264 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:44.287730 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:44.288168 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:44.355846 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:44.364683 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-930f4be2-39c0-4a6b-bd3d-3cb618b9b7ef tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1219 microversion: 2.1 time: 0.091218 Oct 31 16:55:44.365285 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3771/7663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:44 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:55:45.387570 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:45.388424 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:45.396412 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:45.396945 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:45.397392 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:45.398100 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:45.398587 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:45.399030 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:45.430947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:45.431440 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:45.431875 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:45.432511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lazy-loading 'fault' on Instance uuid e0e45023-d482-4feb-8996-b8c21aa7b7e8 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:55:45.486181 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c437228a13a48fb97d17c2a0c55a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1779df61814c8f91d00b5082e8f615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:55:45.493508 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c36e7be5-6a91-4d00-b8f1-f439807a21f2 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 200 len: 1224 microversion: 2.1 time: 0.109860 Oct 31 16:55:45.494115 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3893/7664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:45 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:55:46.518101 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:46.518740 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] [instance: e0e45023-d482-4feb-8996-b8c21aa7b7e8] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:55:46.525656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:46.526166 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:46.526627 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:46.527337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:55:46.527817 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:55:46.528262 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:55:46.541815 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] HTTP exception thrown: Instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 could not be found. Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Request method failure captured: Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 HTTP/1.1 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_vC7hzFl1nSPCrct10hl7wXa6V2kqN4_elF9AY4bt4-fCFDwguthvqi0D-NKpwPOTVSZCF-zjWgq8O6jYEXct5DNlLKLBkZKokJJQaP_o6yWqhrCNqOlY70ckezyfu3GMJGKIhCib7fvV4YJSBl4Yu9oJjRWqy_AJpWTsP4NKcb7Y0 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: de1779df61814c8f91d00b5082e8f615 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestShelveInstance-2106055507 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/de1779df61814c8f91d00b5082e8f615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/de1779df61814c8f91d00b5082e8f615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_de1779df61814c8f91d00b5082e8f615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/de1779df61814c8f91d00b5082e8f615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestShelveInstance-2106055507 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: de1779df61814c8f91d00b5082e8f615 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestShelveInstance-2106055507 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestShelveInstance-2106055507-project Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 1c437228a13a48fb97d17c2a0c55a504 Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestShelveInstance-2106055507-project Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 could not be found. Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': 'e0e45023-d482-4feb-8996-b8c21aa7b7e8'} Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 could not be found. Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 could not be found. Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:55:46.543476 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 could not be found. Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Returning 404 to user: Instance e0e45023-d482-4feb-8996-b8c21aa7b7e8 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-536d4d77-acbc-4265-9d06-3388bf5a360f tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8" status: 404 len: 111 microversion: 2.1 time: 0.031897 Oct 31 16:55:46.550088 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3772/7665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:55:46 2022] GET /compute/v2.1/servers/e0e45023-d482-4feb-8996-b8c21aa7b7e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:55:46.718901 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e8f02c9-c295-44ef-a68f-69b3165e7b46 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] Calling method '.version_select at 0x7f5ca23928b0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:55:46.754699 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e8f02c9-c295-44ef-a68f-69b3165e7b46 tempest-TestShelveInstance-2106055507 tempest-TestShelveInstance-2106055507-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1341927536" status: 202 len: 0 microversion: 2.1 time: 0.040018 Oct 31 16:55:46.755659 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3894/7666] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Oct 31 16:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1341927536 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:56:04.101655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=14 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:04.102943 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=24 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:04.319941 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f6a90562-18e3-4c28-a211-6d195304121f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Action: 'create', calling method: .version_select at 0x7f5ca0f3c3a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2026315273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0KHV+1Mzd7l/fEnTADwl98tXGEM/aj+/6dbp+x+rYSv9tWE1xnVngkSeyBIKkJdiQtsJM8DGL2quaouRhk23VOqbYM2BEO7aE03Tv9eU1pfwWq/G+eprKfzGfgEL40Rg=="}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:56:04.341531 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f6a90562-18e3-4c28-a211-6d195304121f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Getting quotas for project 676b6596c5be4ecd8bbadd10fbf65590. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:56:04.348800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-f6a90562-18e3-4c28-a211-6d195304121f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Getting quotas for user 8e84f97641cb4390980befebf16d47ae and project 676b6596c5be4ecd8bbadd10fbf65590. Resources: {'key_pairs'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:56:04.386140 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f6a90562-18e3-4c28-a211-6d195304121f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.289228 Oct 31 16:56:04.387011 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3773/7667] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Oct 31 16:56:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:56:05.528068 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:05.528993 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:05.533661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-744875873", "imageRef": "967f19e9-45bc-4d95-8300-59f1ed239b9a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2026315273", "security_groups": [{"name": "tempest-secgroup-smoke-1717327909"}], "networks": [{"uuid": "be455916-edc5-417e-aa78-fea12f5e3a13"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:56:05.646912 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] validate_networks() for [('be455916-edc5-417e-aa78-fea12f5e3a13', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:56:06.044095 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:56:06.044653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:56:06.045389 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:56:06.045840 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:56:06.046282 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:56:06.055214 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:06.055705 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:06.056144 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:06.056911 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:06.057376 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:06.057805 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:06.077060 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Getting quotas for project 676b6596c5be4ecd8bbadd10fbf65590. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:56:06.082862 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.quota [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Getting quotas for user 8e84f97641cb4390980befebf16d47ae and project 676b6596c5be4ecd8bbadd10fbf65590. Resources: {'instances', 'ram', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:56:06.095879 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:56:06.098246 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='967f19e9-45bc-4d95-8300-59f1ed239b9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:56:06.146823 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2f86bca-dcbd-4ad0-b500-8f981a2c519b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.620656 Oct 31 16:56:06.153405 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3895/7668] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:56:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:56:06.159588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-701a025d-17cd-426b-8022-b0516ccb86a3 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:06.165087 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-701a025d-17cd-426b-8022-b0516ccb86a3 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:06.224129 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-701a025d-17cd-426b-8022-b0516ccb86a3 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:06.233086 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-701a025d-17cd-426b-8022-b0516ccb86a3 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1248 microversion: 2.1 time: 0.077516 Oct 31 16:56:06.234003 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3774/7669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:06 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:07.256854 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:07.258222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:07.266038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:07.267307 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:07.268021 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:07.269024 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:07.269732 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:07.270395 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:07.657715 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:07.666005 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b091b893-ad01-4a54-a7a5-415be3370da1 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1308 microversion: 2.1 time: 0.413949 Oct 31 16:56:07.666786 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3896/7670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:07 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:08.697182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:08.698456 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:08.709499 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:08.710277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:08.710949 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:08.712732 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:08.713501 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:08.714036 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:08.946760 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:08.954626 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e2e602a5-6a53-49fc-a9e6-0ee0176d56a0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.267309 Oct 31 16:56:08.955600 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3775/7671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:08 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:09.210522 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-92a3c843-8f8f-4bb5-ab81-9cda7efb5497 req-06fd0469-ba10-4928-a555-85f17906a41b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:56:09.230445 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92a3c843-8f8f-4bb5-ab81-9cda7efb5497 req-06fd0469-ba10-4928-a555-85f17906a41b service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:09.233261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92a3c843-8f8f-4bb5-ab81-9cda7efb5497 req-06fd0469-ba10-4928-a555-85f17906a41b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:09.233787 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-92a3c843-8f8f-4bb5-ab81-9cda7efb5497 req-06fd0469-ba10-4928-a555-85f17906a41b service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:09.251523 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-92a3c843-8f8f-4bb5-ab81-9cda7efb5497 req-06fd0469-ba10-4928-a555-85f17906a41b service nova] Creating event network-changed:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 16:56:09.256585 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-92a3c843-8f8f-4bb5-ab81-9cda7efb5497 req-06fd0469-ba10-4928-a555-85f17906a41b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050424 Oct 31 16:56:09.257436 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3897/7672] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:56:09.980636 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:09.981556 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:09.988363 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:09.988987 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:09.989516 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:09.990382 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:09.990993 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:09.991609 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:10.129315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:10.137119 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-116e941e-abee-4e80-9855-caad81c83abf tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.162378 Oct 31 16:56:10.137693 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3776/7673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:09 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:11.161736 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:11.162360 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:11.168726 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:11.169209 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:11.169679 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:11.170379 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:11.170858 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:11.171285 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:11.307691 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:11.316287 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9113898f-5849-49cd-83fd-d5ebc731894e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.159535 Oct 31 16:56:11.316718 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3898/7674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:11 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:12.339420 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:12.340153 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:12.347374 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:12.347866 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:12.348342 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:12.349084 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:12.349551 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:12.349985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:12.483880 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:12.491518 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-e5c54c50-005f-40cd-90b7-6c0b8bd07907 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.156078 Oct 31 16:56:12.492093 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3777/7675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:12 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:13.515511 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:13.516143 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:13.523388 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:13.523885 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:13.524368 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:13.525119 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:13.525586 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:13.526028 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:13.668503 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:13.676544 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a355432-5654-414b-8b82-4f69046391e6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.165597 Oct 31 16:56:13.677162 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3899/7676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:13 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:14.700143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:14.700802 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:14.707709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:14.708207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:14.708734 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:14.709446 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:14.709938 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:14.710368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:14.846968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:14.854647 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-22b79ea5-902e-4987-8797-f32cda1d78c2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.158473 Oct 31 16:56:14.855238 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3778/7677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:14 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:15.331366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c2a09ec8-7e9f-40e1-a3fc-fdee4d2da3b4 req-103b1516-5f3f-49ab-9887-4a5309370165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "name": "network-vif-plugged", "status": "completed", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:56:15.342331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c2a09ec8-7e9f-40e1-a3fc-fdee4d2da3b4 req-103b1516-5f3f-49ab-9887-4a5309370165 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:15.342331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c2a09ec8-7e9f-40e1-a3fc-fdee4d2da3b4 req-103b1516-5f3f-49ab-9887-4a5309370165 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:15.342644 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c2a09ec8-7e9f-40e1-a3fc-fdee4d2da3b4 req-103b1516-5f3f-49ab-9887-4a5309370165 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:15.354534 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c2a09ec8-7e9f-40e1-a3fc-fdee4d2da3b4 req-103b1516-5f3f-49ab-9887-4a5309370165 service nova] Creating event network-vif-plugged:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 16:56:15.359605 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c2a09ec8-7e9f-40e1-a3fc-fdee4d2da3b4 req-103b1516-5f3f-49ab-9887-4a5309370165 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092630 Oct 31 16:56:15.360213 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3900/7678] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:56:15.878550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:15.879201 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:15.886176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:15.886709 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:15.887164 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:15.888001 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:15.889031 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:15.889482 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:16.023680 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:16.031782 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-c22c9846-1bd7-4c07-95c1-a58adbfae472 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1374 microversion: 2.1 time: 0.157085 Oct 31 16:56:16.032366 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3779/7679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:15 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:17.052007 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:17.052822 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:17.058383 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:17.059102 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:17.066108 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:17.066588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:17.067020 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:17.067707 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:17.068163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:17.068585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:17.200299 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:17.208628 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58ac7685-c61e-4e1b-8403-80fcd45509b2 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1559 microversion: 2.1 time: 0.157624 Oct 31 16:56:17.209225 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3901/7680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:17 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:17.234010 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:56:17.234634 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:56:17.236524 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:56:17.242476 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:17.242968 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:17.243417 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:17.244113 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:17.244578 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:17.245050 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:17.379689 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:56:17.387608 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-37b70452-c963-4632-97cc-52374bd30c6b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1559 microversion: 2.1 time: 0.157713 Oct 31 16:56:17.389063 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3780/7681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:56:17 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:56:19.118093 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b4b63345-cfc6-4cd5-9810-e286e3b71c48 req-f8f7a6ea-2507-4a71-b574-ac0ebb7c5264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:56:19.127653 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b4b63345-cfc6-4cd5-9810-e286e3b71c48 req-f8f7a6ea-2507-4a71-b574-ac0ebb7c5264 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:56:19.128128 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b4b63345-cfc6-4cd5-9810-e286e3b71c48 req-f8f7a6ea-2507-4a71-b574-ac0ebb7c5264 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:56:19.128553 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b4b63345-cfc6-4cd5-9810-e286e3b71c48 req-f8f7a6ea-2507-4a71-b574-ac0ebb7c5264 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:56:19.140358 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b4b63345-cfc6-4cd5-9810-e286e3b71c48 req-f8f7a6ea-2507-4a71-b574-ac0ebb7c5264 service nova] Creating event network-changed:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 16:56:19.145715 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b4b63345-cfc6-4cd5-9810-e286e3b71c48 req-f8f7a6ea-2507-4a71-b574-ac0ebb7c5264 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086573 Oct 31 16:56:19.146675 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3902/7682] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:58:14.193446 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:58:14.194411 n-d-858383-17 devstack@n-api.service[120626]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:58:14.195208 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:14.196206 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=36 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:14.197291 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:58:14.197443 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:58:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2/action (ip 10.222.0.48) !!! Oct 31 16:58:14.200174 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:58:14.200323 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 16:58:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2/action (ip 10.222.0.48) !!! Oct 31 16:58:14.207450 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1023996525"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:14.210003 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:14.221216 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:14.221723 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:14.222181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:14.222896 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:14.223369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:14.223815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:14.425529 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-3a477d43-52bd-4f26-8955-a3e98233a63e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "POST /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2/action" status: 202 len: 0 microversion: 2.1 time: 0.233603 Oct 31 16:58:14.426134 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3781/7683] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 16:58:14 2022] POST /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 16:58:20.018468 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:58:20.019277 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:58:20.020125 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:20.020925 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:20.027469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-f8ea484c-01dc-41fe-b79e-eeb1aab00dbf req-dd6af569-e757-46e9-9ada-cd4faf1972bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "name": "network-vif-plugged", "status": "completed", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:20.047816 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8ea484c-01dc-41fe-b79e-eeb1aab00dbf req-dd6af569-e757-46e9-9ada-cd4faf1972bc service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:20.048303 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8ea484c-01dc-41fe-b79e-eeb1aab00dbf req-dd6af569-e757-46e9-9ada-cd4faf1972bc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:20.048992 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-f8ea484c-01dc-41fe-b79e-eeb1aab00dbf req-dd6af569-e757-46e9-9ada-cd4faf1972bc service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:20.062432 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-f8ea484c-01dc-41fe-b79e-eeb1aab00dbf req-dd6af569-e757-46e9-9ada-cd4faf1972bc service nova] Creating event network-vif-plugged:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 16:58:20.070371 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-f8ea484c-01dc-41fe-b79e-eeb1aab00dbf req-dd6af569-e757-46e9-9ada-cd4faf1972bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054153 Oct 31 16:58:20.071549 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3903/7684] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:58:27.974301 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:27.975091 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:27.979207 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1117388180", "imageRef": "2ed5e0c4-1880-46d5-b1cd-313cb34933da", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2026315273", "security_groups": [{"name": "tempest-secgroup-smoke-1717327909"}], "networks": [{"uuid": "be455916-edc5-417e-aa78-fea12f5e3a13"}]}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:28.005641 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [58e6fbee-c01f-4e8f-8e8a-21f0c3991432] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53800. Oct 31 16:58:28.006390 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] [bb3735fa-2c55-4916-a0fa-468a19557d11] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53802. Oct 31 16:58:28.093526 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.network.neutron [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] validate_networks() for [('be455916-edc5-417e-aa78-fea12f5e3a13', None, None, None, None, None)] {{(pid=120626) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:58:28.515749 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Flavor limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:58:28.516183 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Image limits 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:58:28.516670 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Flavor pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:58:28.517368 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Image pref 0:0:0 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:58:28.517819 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.virt.hardware [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120626) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:58:28.526635 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:28.527127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:28.527574 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:28.528302 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:28.528796 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:28.529274 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:28.545603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Getting quotas for project 676b6596c5be4ecd8bbadd10fbf65590. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:58:28.550715 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.quota [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Getting quotas for user 8e84f97641cb4390980befebf16d47ae and project 676b6596c5be4ecd8bbadd10fbf65590. Resources: {'instances', 'ram', 'cores'} {{(pid=120626) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:58:28.563283 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Going to run 1 instances... {{(pid=120626) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:58:28.565774 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2ed5e0c4-1880-46d5-b1cd-313cb34933da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120626) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:58:28.613230 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cf3cd3d2-e04c-477a-ba71-31f23913ef1e tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641066 Oct 31 16:58:28.613874 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3782/7685] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Oct 31 16:58:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:58:28.626184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b0d0913f-bfce-4f37-9f8d-8bb8df7ee964 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:28.626894 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b0d0913f-bfce-4f37-9f8d-8bb8df7ee964 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:28.662454 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53818. Oct 31 16:58:28.663289 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53816. Oct 31 16:58:28.698491 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-b0d0913f-bfce-4f37-9f8d-8bb8df7ee964 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:28.706239 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b0d0913f-bfce-4f37-9f8d-8bb8df7ee964 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1249 microversion: 2.1 time: 0.084827 Oct 31 16:58:28.706780 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3904/7686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:28 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:29.731970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:29.732711 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:29.740111 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:29.740622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:29.741104 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:29.741886 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:29.743457 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:29.744011 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:29.834540 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:29.843717 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-f7da33e5-20f5-4114-aebf-309ba204503b tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1309 microversion: 2.1 time: 0.118636 Oct 31 16:58:29.844299 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3783/7687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:29 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:30.003296 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-03cf95b4-6e5a-4195-95a8-6e08e2b82739 req-0db90b75-7ae1-40e5-a50d-e6263c9b3521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "name": "network-vif-unplugged", "status": "completed", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:30.019182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-03cf95b4-6e5a-4195-95a8-6e08e2b82739 req-0db90b75-7ae1-40e5-a50d-e6263c9b3521 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:30.019973 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-03cf95b4-6e5a-4195-95a8-6e08e2b82739 req-0db90b75-7ae1-40e5-a50d-e6263c9b3521 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:30.020870 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-03cf95b4-6e5a-4195-95a8-6e08e2b82739 req-0db90b75-7ae1-40e5-a50d-e6263c9b3521 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:30.033236 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-03cf95b4-6e5a-4195-95a8-6e08e2b82739 req-0db90b75-7ae1-40e5-a50d-e6263c9b3521 service nova] Creating event network-vif-unplugged:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 16:58:30.040038 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-03cf95b4-6e5a-4195-95a8-6e08e2b82739 req-0db90b75-7ae1-40e5-a50d-e6263c9b3521 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045435 Oct 31 16:58:30.041653 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3905/7688] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:58:30.871656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:30.873192 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:30.885022 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:30.885791 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:30.886429 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:30.887337 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:30.887970 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:30.889143 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:31.054641 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:31.063004 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-56a5d649-36ae-469d-888a-95010c23e4d4 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.195750 Oct 31 16:58:31.068766 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3784/7689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:30 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:32.088752 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:32.089527 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:32.096852 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:32.097350 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:32.097790 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:32.098496 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:32.098969 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:32.099402 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:32.247223 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:32.256986 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-17191f14-042a-48fb-8f25-6bb21a350ea7 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.173131 Oct 31 16:58:32.258024 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3906/7690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:32 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:33.281188 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:33.282473 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:33.289751 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:33.290254 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:33.290700 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:33.291411 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:33.291878 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:33.292314 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:33.446953 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:33.455751 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ef327c40-190e-488d-bea6-a14d6d225d86 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.179900 Oct 31 16:58:33.456608 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3785/7691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:33 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:34.480404 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:34.481333 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:34.502936 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:34.504036 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:34.505881 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:34.506611 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:34.507075 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:34.508403 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:34.662565 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:34.671466 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-863ff720-d7ea-4c64-9180-d01f440db76f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.195310 Oct 31 16:58:34.672667 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3907/7692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:34 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:35.696927 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:35.697601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:35.704844 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:35.705393 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:35.705856 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:35.706588 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:35.707067 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:35.707518 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:35.862849 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:35.871102 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7a5a61cb-fa92-4c98-92da-f889cb437a0d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.178997 Oct 31 16:58:35.871680 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3786/7693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:35 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:36.898910 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:36.899680 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:36.909461 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:36.910160 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:36.910594 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:36.911311 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:36.911784 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:36.912244 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:37.095418 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:37.103403 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-81b4d765-a275-48eb-b072-ccfea03be607 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.208403 Oct 31 16:58:37.103990 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3908/7694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:36 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:38.127013 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:38.127640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:38.134667 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:38.135180 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:38.135642 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:38.136396 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:38.136912 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:38.137361 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:38.272883 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:38.280794 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4b12bc2b-ad1f-4861-9bb9-2a047288bfdc tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.158299 Oct 31 16:58:38.281370 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3787/7695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:38 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:39.304253 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:39.304920 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:39.307722 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:39.313688 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:39.314184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:39.314612 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:39.315306 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:39.315764 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:39.316189 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:39.520213 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:39.527900 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c5d4f03-b909-4e5a-b3b9-91edfb8b7e1f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.227566 Oct 31 16:58:39.529001 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3909/7696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:39 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:40.074306 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [req-f1ad38f1-62cf-4fda-b314-cbd9db16243f req-3352b53c-d61d-47bb-9471-e5b2d934ae47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7af509a-4127-4a13-a642-beec8b2cbc7e", "tag": "5907b3f7-77b5-4e0a-a04c-7797be1a9be5"}]} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:40.080118 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:40.081134 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell0:SELECT=6 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:40.090893 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f1ad38f1-62cf-4fda-b314-cbd9db16243f req-3352b53c-d61d-47bb-9471-e5b2d934ae47 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:40.091515 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f1ad38f1-62cf-4fda-b314-cbd9db16243f req-3352b53c-d61d-47bb-9471-e5b2d934ae47 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:40.091985 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [req-f1ad38f1-62cf-4fda-b314-cbd9db16243f req-3352b53c-d61d-47bb-9471-e5b2d934ae47 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:40.103282 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.compute.server_external_events [req-f1ad38f1-62cf-4fda-b314-cbd9db16243f req-3352b53c-d61d-47bb-9471-e5b2d934ae47 service nova] Creating event network-changed:5907b3f7-77b5-4e0a-a04c-7797be1a9be5 for instance c7af509a-4127-4a13-a642-beec8b2cbc7e on n-h1-858383-17 Oct 31 16:58:40.109243 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [req-f1ad38f1-62cf-4fda-b314-cbd9db16243f req-3352b53c-d61d-47bb-9471-e5b2d934ae47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039875 Oct 31 16:58:40.109989 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3788/7697] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:58:40.551557 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:40.552924 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:40.560042 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:40.560682 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:40.561154 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:40.561857 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:40.562324 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:40.562757 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:40.694290 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:40.702964 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a2e9888-c617-4c15-a78f-46175ae5bab6 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.155568 Oct 31 16:58:40.703533 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3910/7698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:40 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:41.729523 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:41.736328 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:41.738182 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:41.738708 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:41.739181 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:41.739923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:41.740407 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:41.740888 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:41.878892 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:41.886547 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-7f21e0d6-dd80-408e-8717-3abd86238989 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.163239 Oct 31 16:58:41.887164 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3789/7699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:41 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:42.910588 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:42.911208 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:42.918055 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:42.918544 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:42.919074 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:42.919803 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:42.920275 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:42.920719 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:43.063595 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:43.071460 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85f6c7f2-2b4f-4f2b-98c8-496b996190b5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.164764 Oct 31 16:58:43.072034 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3911/7700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:42 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:44.095831 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:44.096465 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:44.103405 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:44.103913 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:44.104372 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:44.105126 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:44.105601 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:44.106052 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:44.248103 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:44.255925 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-4f47c58b-eee7-4621-9eaf-2dd086ebc1ad tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.164186 Oct 31 16:58:44.256523 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3790/7701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:44 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:45.279614 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:45.280237 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:45.287400 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:45.287888 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:45.288328 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:45.289052 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:45.289514 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:45.289947 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:45.423856 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:45.434458 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb25d039-5518-4462-92fb-22543031234a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.159565 Oct 31 16:58:45.435239 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3912/7702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:45 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:46.457829 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:46.458378 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:46.465263 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:46.465815 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:46.466436 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:46.467140 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:46.467612 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:46.468056 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:46.663539 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:46.671741 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-1fc0f4cc-c34b-465c-9b70-70f027af7ad0 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.218004 Oct 31 16:58:46.672311 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3791/7703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:46 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:46.949585 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c1f8b1e9-3573-4e1c-89fc-7839e5e67df0 req-087395bd-ff71-48f6-a507-d2e990f17809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7af509a-4127-4a13-a642-beec8b2cbc7e", "name": "network-vif-plugged", "status": "completed", "tag": "5907b3f7-77b5-4e0a-a04c-7797be1a9be5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:46.960798 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c1f8b1e9-3573-4e1c-89fc-7839e5e67df0 req-087395bd-ff71-48f6-a507-d2e990f17809 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:46.961261 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c1f8b1e9-3573-4e1c-89fc-7839e5e67df0 req-087395bd-ff71-48f6-a507-d2e990f17809 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:46.961689 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c1f8b1e9-3573-4e1c-89fc-7839e5e67df0 req-087395bd-ff71-48f6-a507-d2e990f17809 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:46.973760 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c1f8b1e9-3573-4e1c-89fc-7839e5e67df0 req-087395bd-ff71-48f6-a507-d2e990f17809 service nova] Creating event network-vif-plugged:5907b3f7-77b5-4e0a-a04c-7797be1a9be5 for instance c7af509a-4127-4a13-a642-beec8b2cbc7e on n-h1-858383-17 Oct 31 16:58:46.979086 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c1f8b1e9-3573-4e1c-89fc-7839e5e67df0 req-087395bd-ff71-48f6-a507-d2e990f17809 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033101 Oct 31 16:58:46.979704 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3913/7704] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:58:47.694610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:47.695243 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:47.702171 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:47.702673 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:47.703132 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:47.703841 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:47.704318 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:47.704800 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:47.835650 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:47.843351 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-820a7a84-0f5e-4084-afdb-3751d785e1cb tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1375 microversion: 2.1 time: 0.152743 Oct 31 16:58:47.843935 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3792/7705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:47 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:48.867771 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:48.868519 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:48.874921 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:48.875408 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:48.875848 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:48.876542 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:48.877034 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:48.877469 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:49.060013 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:49.067767 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65b1fe36-a519-4c00-ab04-98e35183454a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1560 microversion: 2.1 time: 0.205102 Oct 31 16:58:49.068338 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3914/7706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:48 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:49.092297 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:58:49.092976 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:58:49.099862 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:49.100366 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:49.100858 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:49.101573 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:49.102051 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:49.102495 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:49.235547 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:58:49.243313 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-de73b813-25df-415b-886b-22313dca58fe tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1560 microversion: 2.1 time: 0.156902 Oct 31 16:58:49.243882 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3793/7707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 16:58:49 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:58:51.415842 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2c1da317-6521-409f-8002-2dd6cbf91f2d req-215a9130-a69d-407a-89ea-27fcbb62e221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7af509a-4127-4a13-a642-beec8b2cbc7e", "tag": "5907b3f7-77b5-4e0a-a04c-7797be1a9be5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:58:51.428554 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2c1da317-6521-409f-8002-2dd6cbf91f2d req-215a9130-a69d-407a-89ea-27fcbb62e221 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:58:51.429182 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2c1da317-6521-409f-8002-2dd6cbf91f2d req-215a9130-a69d-407a-89ea-27fcbb62e221 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:58:51.429670 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2c1da317-6521-409f-8002-2dd6cbf91f2d req-215a9130-a69d-407a-89ea-27fcbb62e221 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:58:51.441222 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=55 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:58:51.444474 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2c1da317-6521-409f-8002-2dd6cbf91f2d req-215a9130-a69d-407a-89ea-27fcbb62e221 service nova] Creating event network-changed:5907b3f7-77b5-4e0a-a04c-7797be1a9be5 for instance c7af509a-4127-4a13-a642-beec8b2cbc7e on n-h1-858383-17 Oct 31 16:58:51.450878 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2c1da317-6521-409f-8002-2dd6cbf91f2d req-215a9130-a69d-407a-89ea-27fcbb62e221 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039277 Oct 31 16:58:51.451687 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3915/7708] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 16:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 17:00:50.228225 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:00:50.228937 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=64 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:00:50.229934 n-d-858383-17 devstack@n-api.service[120626]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 17:00:50.230083 n-d-858383-17 devstack@n-api.service[120626]: Mon Oct 31 17:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e/action (ip 10.222.0.48) !!! Oct 31 17:00:50.236663 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1219267139"}} {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 17:00:50.238990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:00:50.248603 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:00:50.249127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:00:50.249575 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:00:50.250272 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:00:50.251255 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:00:50.251679 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:00:50.451874 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0ddb8437-3888-48c2-a444-78bc7ebac83f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "POST /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e/action" status: 202 len: 0 microversion: 2.1 time: 0.225619 Oct 31 17:00:50.452515 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3794/7709] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Oct 31 17:00:50 2022] POST /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 17:00:57.566594 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 17:00:57.568434 n-d-858383-17 devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 17:00:57.569193 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:00:57.570177 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 17:00:57.570177 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 17:00:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 31 17:00:57.572876 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 17:00:57.573008 n-d-858383-17 devstack@n-api.service[120625]: Mon Oct 31 17:00:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 31 17:00:57.584761 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-70b3d823-102e-4e6f-b284-b8b844f83afe req-1e3745a0-2c60-4f7d-8619-f5fbedc86ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7af509a-4127-4a13-a642-beec8b2cbc7e", "name": "network-vif-plugged", "status": "completed", "tag": "5907b3f7-77b5-4e0a-a04c-7797be1a9be5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 17:00:57.602398 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-70b3d823-102e-4e6f-b284-b8b844f83afe req-1e3745a0-2c60-4f7d-8619-f5fbedc86ff2 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:00:57.602890 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-70b3d823-102e-4e6f-b284-b8b844f83afe req-1e3745a0-2c60-4f7d-8619-f5fbedc86ff2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:00:57.603331 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-70b3d823-102e-4e6f-b284-b8b844f83afe req-1e3745a0-2c60-4f7d-8619-f5fbedc86ff2 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:00:57.614659 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-70b3d823-102e-4e6f-b284-b8b844f83afe req-1e3745a0-2c60-4f7d-8619-f5fbedc86ff2 service nova] Creating event network-vif-plugged:5907b3f7-77b5-4e0a-a04c-7797be1a9be5 for instance c7af509a-4127-4a13-a642-beec8b2cbc7e on n-h1-858383-17 Oct 31 17:00:57.619723 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-70b3d823-102e-4e6f-b284-b8b844f83afe req-1e3745a0-2c60-4f7d-8619-f5fbedc86ff2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056544 Oct 31 17:00:57.620637 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3916/7710] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 17:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 17:01:09.317191 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_api:SELECT=2 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:01:09.318469 n-d-858383-17 devstack@n-api.service[120626]: DEBUG dbcounter [-] [120626] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:01:09.322200 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-e909e540-b62c-4981-a449-80438703fd8b req-310557ad-3de9-40b6-a154-8a49e6297e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7af509a-4127-4a13-a642-beec8b2cbc7e", "tag": "5907b3f7-77b5-4e0a-a04c-7797be1a9be5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 17:01:09.323544 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:09.324443 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:09.330567 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:01:09.331978 n-d-858383-17 devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 17:01:09.333656 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:09.334694 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:09.335358 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:09.336367 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:09.337150 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:09.337818 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:09.352522 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [6358a2a6-8006-4184-bbc6-8dda6e3c03c9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54138. Oct 31 17:01:09.357986 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e909e540-b62c-4981-a449-80438703fd8b req-310557ad-3de9-40b6-a154-8a49e6297e8f service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:09.358473 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e909e540-b62c-4981-a449-80438703fd8b req-310557ad-3de9-40b6-a154-8a49e6297e8f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:09.358908 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-e909e540-b62c-4981-a449-80438703fd8b req-310557ad-3de9-40b6-a154-8a49e6297e8f service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:09.362747 n-d-858383-17 devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ef695d0-b00d-42d0-983f-30f0152b97ff] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54136. Oct 31 17:01:09.368758 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 17:01:09.372038 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-e909e540-b62c-4981-a449-80438703fd8b req-310557ad-3de9-40b6-a154-8a49e6297e8f service nova] Creating event network-changed:5907b3f7-77b5-4e0a-a04c-7797be1a9be5 for instance c7af509a-4127-4a13-a642-beec8b2cbc7e on n-h1-858383-17 Oct 31 17:01:09.378269 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-e909e540-b62c-4981-a449-80438703fd8b req-310557ad-3de9-40b6-a154-8a49e6297e8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060809 Oct 31 17:01:09.378879 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3917/7711] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 17:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 17:01:09.460111 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-0b159529-9def-4b3e-8a3c-52bea024a24d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 204 len: 0 microversion: 2.1 time: 0.144917 Oct 31 17:01:09.464135 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3795/7712] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 17:01:09 2022] DELETE /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 17:01:09.470651 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:09.471507 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:09.478366 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:09.479426 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:09.480066 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:09.481140 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:09.481607 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:09.482038 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:09.623228 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 17:01:09.631256 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-390bac41-6b79-4a87-a08b-d34cf4d2ff41 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1684 microversion: 2.1 time: 0.165327 Oct 31 17:01:09.631876 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3918/7713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:09 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 17:01:10.655630 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:10.656278 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:10.663097 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:10.663584 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:10.664063 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:10.664801 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:10.665277 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:10.665718 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:10.870044 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 17:01:10.878566 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-ec378c74-6994-46c0-a0f0-b96a1275430a tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1684 microversion: 2.1 time: 0.227443 Oct 31 17:01:10.879154 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3796/7714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:10 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1684 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 17:01:11.763187 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5f709f0e-1de1-4461-bd46-f90e57f1ce50 req-d3694187-357a-4a08-aa21-b7df73637b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7af509a-4127-4a13-a642-beec8b2cbc7e", "name": "network-vif-deleted", "tag": "5907b3f7-77b5-4e0a-a04c-7797be1a9be5"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 17:01:11.773714 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f709f0e-1de1-4461-bd46-f90e57f1ce50 req-d3694187-357a-4a08-aa21-b7df73637b54 service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:11.774184 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f709f0e-1de1-4461-bd46-f90e57f1ce50 req-d3694187-357a-4a08-aa21-b7df73637b54 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:11.774608 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f709f0e-1de1-4461-bd46-f90e57f1ce50 req-d3694187-357a-4a08-aa21-b7df73637b54 service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:11.786109 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5f709f0e-1de1-4461-bd46-f90e57f1ce50 req-d3694187-357a-4a08-aa21-b7df73637b54 service nova] Creating event network-vif-deleted:5907b3f7-77b5-4e0a-a04c-7797be1a9be5 for instance c7af509a-4127-4a13-a642-beec8b2cbc7e on n-h1-858383-17 Oct 31 17:01:11.791134 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5f709f0e-1de1-4461-bd46-f90e57f1ce50 req-d3694187-357a-4a08-aa21-b7df73637b54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088367 Oct 31 17:01:11.791940 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3919/7715] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 17:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 17:01:11.902550 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:11.903210 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:11.910640 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:11.911151 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:11.911605 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:11.912315 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:11.912812 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:11.913256 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:11.944871 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:11.945369 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:11.945823 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:11.946279 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.objects.instance [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lazy-loading 'fault' on Instance uuid c7af509a-4127-4a13-a642-beec8b2cbc7e {{(pid=120626) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 17:01:11.989610 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 17:01:11.999175 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-a60952cd-ba52-43ec-99b7-a4bd26485e16 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 200 len: 1339 microversion: 2.1 time: 0.100379 Oct 31 17:01:12.000571 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3797/7716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:11 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 17:01:13.025076 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:13.025772 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: c7af509a-4127-4a13-a642-beec8b2cbc7e] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:13.032659 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:13.033163 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:13.033601 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:13.034286 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:13.034746 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:13.035169 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:13.048238 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] HTTP exception thrown: Instance c7af509a-4127-4a13-a642-beec8b2cbc7e could not be found. Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Request method failure captured: Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e HTTP/1.1 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Accept: application/json Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Accept-Encoding: identity Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Connection: close Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Content-Length: 0 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Content-Type: application/json Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Host: 10.222.0.48 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: Openstack-System-Scope: None Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjX_4fmZz8iN2wC3NimQxM0gLboWd9QN_hupN-uyeBpd8Z-BCmAFuKzraCSfK9xEFbIBF2widB02vp_SX1dZwgK92_J7X_C0mzihhhbbXeLLo1o__ESmnsBazmzO7d5dLCd07jQhIvHtOno246yyCHpggub1YLg2eO1JpjfwEzPx4R56A Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Id: None Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Domain-Name: None Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Identity-Status: Confirmed Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Is-Admin-Project: True Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Id: default Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Domain-Name: Default Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Id: 676b6596c5be4ecd8bbadd10fbf65590 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Project-Name: tempest-TestSnapshotPattern-500073618 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Role: member,reader Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Roles: member,reader Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant: tempest-TestSnapshotPattern-500073618 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Id: 676b6596c5be4ecd8bbadd10fbf65590 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestSnapshotPattern-500073618 Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-User: tempest-TestSnapshotPattern-500073618-project Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Id: default Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-User-Domain-Name: Default Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-User-Id: 8e84f97641cb4390980befebf16d47ae Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: X-User-Name: tempest-TestSnapshotPattern-500073618-project Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: method: > Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: exception: Instance c7af509a-4127-4a13-a642-beec8b2cbc7e could not be found. Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: action_args: {'id': 'c7af509a-4127-4a13-a642-beec8b2cbc7e'} Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7af509a-4127-4a13-a642-beec8b2cbc7e could not be found. Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7af509a-4127-4a13-a642-beec8b2cbc7e could not be found. Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 17:01:13.049863 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7af509a-4127-4a13-a642-beec8b2cbc7e could not be found. Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Returning 404 to user: Instance c7af509a-4127-4a13-a642-beec8b2cbc7e could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8265bcf6-5195-4180-9244-4e3358feda2c tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e" status: 404 len: 111 microversion: 2.1 time: 0.031286 Oct 31 17:01:13.055892 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3920/7717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:13 2022] GET /compute/v2.1/servers/c7af509a-4127-4a13-a642-beec8b2cbc7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 17:01:14.704155 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:14.705065 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:14.705620 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-73ad8723-9ed4-42a4-b691-cbb282158ab9 req-ccc66758-2561-4bbe-a8f2-b2c620dab76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 17:01:14.712332 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:14.712989 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:14.713553 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:14.714392 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:14.715127 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:14.715671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:14.716430 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-73ad8723-9ed4-42a4-b691-cbb282158ab9 req-ccc66758-2561-4bbe-a8f2-b2c620dab76c service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:14.716932 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-73ad8723-9ed4-42a4-b691-cbb282158ab9 req-ccc66758-2561-4bbe-a8f2-b2c620dab76c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:14.717355 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-73ad8723-9ed4-42a4-b691-cbb282158ab9 req-ccc66758-2561-4bbe-a8f2-b2c620dab76c service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:14.734975 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-73ad8723-9ed4-42a4-b691-cbb282158ab9 req-ccc66758-2561-4bbe-a8f2-b2c620dab76c service nova] Creating event network-changed:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 17:01:14.740632 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-73ad8723-9ed4-42a4-b691-cbb282158ab9 req-ccc66758-2561-4bbe-a8f2-b2c620dab76c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038605 Oct 31 17:01:14.741991 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3921/7718] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 17:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 17:01:14.744176 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Going to try to terminate instance {{(pid=120626) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 17:01:14.831191 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-588e1886-28cf-4b3c-9514-ec2cb5f1344d tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 204 len: 0 microversion: 2.1 time: 0.130918 Oct 31 17:01:14.832060 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3798/7719] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Oct 31 17:01:14 2022] DELETE /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 17:01:14.841406 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:14.842641 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:14.853241 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:14.854256 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:14.854734 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:14.855661 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:14.856382 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:14.857000 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:15.043001 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.policy [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 17:01:15.054102 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-43a633b4-bdfc-4b16-8e50-49e84f6f0247 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1684 microversion: 2.1 time: 0.217347 Oct 31 17:01:15.054760 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3922/7720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:14 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1684 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 17:01:16.078198 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:16.078923 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:16.085671 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:16.086174 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:16.086632 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:16.087339 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:16.087822 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:16.088267 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:16.251956 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.policy [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e84f97641cb4390980befebf16d47ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676b6596c5be4ecd8bbadd10fbf65590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120626) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 17:01:16.261811 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-cc6ba14f-c1db-4d81-9ec4-0a4b19b744c5 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 200 len: 1565 microversion: 2.1 time: 0.187791 Oct 31 17:01:16.262402 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3799/7721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:16 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 17:01:16.273268 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1390f844-ce56-48fc-9e06-487e445d533a req-930a8c0a-d9cc-4bac-a983-d1700e6ff5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4409933a-7ceb-4000-9256-fe5423bf88b2", "name": "network-vif-deleted", "tag": "bfe6d96e-0fb3-4af2-831f-1b71cf9a140e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 17:01:16.285749 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1390f844-ce56-48fc-9e06-487e445d533a req-930a8c0a-d9cc-4bac-a983-d1700e6ff5ef service nova] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:16.286226 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1390f844-ce56-48fc-9e06-487e445d533a req-930a8c0a-d9cc-4bac-a983-d1700e6ff5ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:16.286864 n-d-858383-17 devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1390f844-ce56-48fc-9e06-487e445d533a req-930a8c0a-d9cc-4bac-a983-d1700e6ff5ef service nova] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:16.299720 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1390f844-ce56-48fc-9e06-487e445d533a req-930a8c0a-d9cc-4bac-a983-d1700e6ff5ef service nova] Creating event network-vif-deleted:bfe6d96e-0fb3-4af2-831f-1b71cf9a140e for instance 4409933a-7ceb-4000-9256-fe5423bf88b2 on n-h2-858383-17 Oct 31 17:01:16.304504 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1390f844-ce56-48fc-9e06-487e445d533a req-930a8c0a-d9cc-4bac-a983-d1700e6ff5ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 Oct 31 17:01:16.305314 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3923/7722] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Oct 31 17:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 17:01:17.286059 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '>' {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:17.286695 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.compute.api [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] [instance: 4409933a-7ceb-4000-9256-fe5423bf88b2] Fetching instance by UUID {{(pid=120626) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 17:01:17.293529 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:17.294029 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:17.294479 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:17.295184 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Acquiring lock "5f57b238-df31-4e1d-8756-1681193983c3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 17:01:17.295655 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 17:01:17.296095 n-d-858383-17 devstack@n-api.service[120626]: DEBUG oslo_concurrency.lockutils [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Lock "5f57b238-df31-4e1d-8756-1681193983c3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 17:01:17.309358 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.wsgi [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] HTTP exception thrown: Instance 4409933a-7ceb-4000-9256-fe5423bf88b2 could not be found. Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Request method failure captured: Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: request: GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 HTTP/1.1 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Accept: application/json Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Accept-Encoding: identity Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Connection: close Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Content-Length: 0 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Content-Type: application/json Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Host: 10.222.0.48 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: Openstack-System-Scope: None Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: User-Agent: python-urllib3/1.26.12 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Auth-Token: gAAAAABjX_4fmZz8iN2wC3NimQxM0gLboWd9QN_hupN-uyeBpd8Z-BCmAFuKzraCSfK9xEFbIBF2widB02vp_SX1dZwgK92_J7X_C0mzihhhbbXeLLo1o__ESmnsBazmzO7d5dLCd07jQhIvHtOno246yyCHpggub1YLg2eO1JpjfwEzPx4R56A Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Id: None Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Domain-Name: None Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Identity-Status: Confirmed Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Is-Admin-Project: True Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Id: default Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Domain-Name: Default Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Id: 676b6596c5be4ecd8bbadd10fbf65590 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Project-Name: tempest-TestSnapshotPattern-500073618 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Role: member,reader Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Roles: member,reader Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/676b6596c5be4ecd8bbadd10fbf65590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant: tempest-TestSnapshotPattern-500073618 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Id: 676b6596c5be4ecd8bbadd10fbf65590 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-Tenant-Name: tempest-TestSnapshotPattern-500073618 Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-User: tempest-TestSnapshotPattern-500073618-project Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Id: default Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-User-Domain-Name: Default Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-User-Id: 8e84f97641cb4390980befebf16d47ae Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: X-User-Name: tempest-TestSnapshotPattern-500073618-project Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: method: > Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: exception: Instance 4409933a-7ceb-4000-9256-fe5423bf88b2 could not be found. Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: action_args: {'id': '4409933a-7ceb-4000-9256-fe5423bf88b2'} Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: {{(pid=120626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4409933a-7ceb-4000-9256-fe5423bf88b2 could not be found. Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4409933a-7ceb-4000-9256-fe5423bf88b2 could not be found. Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 17:01:17.310990 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4409933a-7ceb-4000-9256-fe5423bf88b2 could not be found. Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: ERROR nova.api.openstack.wsgi Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: DEBUG nova.api.openstack.wsgi [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Returning 404 to user: Instance 4409933a-7ceb-4000-9256-fe5423bf88b2 could not be found. {{(pid=120626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: INFO nova.api.openstack.requestlog [None req-9245bd1b-86cd-436b-a839-4217ae18e02f tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2" status: 404 len: 111 microversion: 2.1 time: 0.030856 Oct 31 17:01:17.317622 n-d-858383-17 devstack@n-api.service[120626]: [pid: 120626|app: 0|req: 3800/7723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Oct 31 17:01:17 2022] GET /compute/v2.1/servers/4409933a-7ceb-4000-9256-fe5423bf88b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 17:01:17.478597 n-d-858383-17 devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0ffc0e7-d11b-4a3d-9579-2429867fe397 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] Calling method '.version_select at 0x7f5ca1119ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 17:01:17.503919 n-d-858383-17 devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0ffc0e7-d11b-4a3d-9579-2429867fe397 tempest-TestSnapshotPattern-500073618 tempest-TestSnapshotPattern-500073618-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2026315273" status: 202 len: 0 microversion: 2.1 time: 0.030180 Oct 31 17:01:17.504395 n-d-858383-17 devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3924/7724] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Oct 31 17:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2026315273 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)